<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="nlm-ta">reapress</journal-id>
      <journal-id journal-id-type="publisher-id">null</journal-id>
      <journal-title>reapress</journal-title><issn pub-type="ppub">3042-2248</issn><issn pub-type="epub">3042-2248</issn><publisher>
      	<publisher-name>reapress</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">https://doi.org/10.48313/maa.v1i4.109</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Research Article</subject>
        </subj-group>
        <subj-group><subject>Hyper-heuristic, Cloud resource management, Reinforcement learning, Virtual machine placement, Task scheduling, Exploration–exploitation.</subject></subj-group>
      </article-categories>
      <title-group>
        <article-title>World Hyper-Heuristic: A Reinforcement Learning Approach for Dynamic Exploration–Exploitation in Cloud Resource Management</article-title><subtitle>World Hyper-Heuristic: A Reinforcement Learning Approach for Dynamic Exploration–Exploitation in Cloud Resource Management</subtitle></title-group>
      <contrib-group><contrib contrib-type="author">
	<name name-style="western">
	<surname>Cheshmeh</surname>
		<given-names>Adel </given-names>
	</name>
	<aff>Department of Computer Engineering, Faculty of Computer Engineering, Sharif University of Technology, Tehran, Iran.</aff>
	</contrib></contrib-group>		
      <pub-date pub-type="ppub">
        <month>12</month>
        <year>2024</year>
      </pub-date>
      <pub-date pub-type="epub">
        <day>24</day>
        <month>12</month>
        <year>2024</year>
      </pub-date>
      <volume>1</volume>
      <issue>4</issue>
      <permissions>
        <copyright-statement>© 2024 reapress</copyright-statement>
        <copyright-year>2024</copyright-year>
        <license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/2.5/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</p></license>
      </permissions>
      <related-article related-article-type="companion" vol="2" page="e235" id="RA1" ext-link-type="pmc">
			<article-title>World Hyper-Heuristic: A Reinforcement Learning Approach for Dynamic Exploration–Exploitation in Cloud Resource Management</article-title>
      </related-article>
	  <abstract abstract-type="toc">
		<p>
			Cloud computing resource management presents a formidable optimization challenge characterized by dynamic and unpredictable workloads, heterogeneous resource pools, competing multi-objective trade-offs among energy consumption, Service Level Agreement (SLA) compliance, resource utilization, makespan, and operational cost, as well as the NP-hard combinatorial nature of core sub-problems including Virtual Machine (VM) placement, task scheduling, and dynamic resource scaling. Existing approaches suffer from well-documented limitations: static heuristics such as First Fit Decreasing (FFD) and Round-Robin (RR) lack adaptability to workload fluctuations; single metaheuristics including Particle Swarm Optimization (PSO) and Genetic Algorithms (GA) exhibit premature convergence and maintain a fixed exploration–exploitation balance; and pure Reinforcement Learning (RL) methods, while adaptive, are sample-inefficient and transfer poorly across workload types. In this paper, we propose World Hyper-Heuristic (WHH) for Cloud Resource Management (World-CRM), an extended adaptation of the WHH originally introduced by Daliri et al. [1] in expert systems with applications. World-CRM adapts the World's novel RL-based dynamic exploration–exploitation switching mechanism to cloud environments through five key innovations: 1) a cloud-aware 12-dimensional RL state representation encoding CPU utilization variance, memory fragmentation, SLA violation rate, and energy metrics, 2) a composite multi-objective fitness function with adaptive weight adjustment, 3) a cloud-specific Low-Level Heuristic (LLH) pool comprising 12 operators spanning VM placement, task scheduling, and dynamic scaling, 4) an online sliding-window adaptation mechanism employing Kullback–Leibler divergence for workload shift detection and real-time policy updates, and 5) a multi-tier coordination architecture operating across infrastructure, platform, and application layers. World-CRM is evaluated on CloudSim Plus simulations with three real-world workload traces Google Cluster Trace (CCT) 2019, Azure VM Traces 2019, and bitbrains distributed data center across small (50 hosts), medium (200 hosts), and large (800 hosts) data center configurations. Results across 30 independent runs per configuration demonstrate that World-CRM achieves 23–31% energy reduction, 42–58% fewer SLA violations, 15–22% better resource utilization, and 18–27% lower makespan compared to the best-performing baselines including NSGA-II-VM, PSO-Cloud, DQN-VMPlace, Modified Best Fit Decreasing (MBFD), and the original World algorithm. The online adaptation module maintains performance under workload shifts with decision latency below 300 milliseconds and enables 3–4× faster recovery compared to RL and evolutionary baselines. All improvements are statistically significant under the Wilcoxon rank-sum test with Bonferroni correction at p < 0.05.
		</p>
		</abstract>
    </article-meta>
  </front>
  <body></body>
  <back>
    <ack>
      <p>null</p>
    </ack>
  </back>
</article>