<?xml version="1.0" encoding="UTF-8"?>
<article xmlns:xlink="http://www.w3.org/1999/xlink">
<front><article-meta>
<title-group><article-title>Generative Agent Swarm: Bacterial Foraging with K LLM-Mediated Pheromone Communication</article-title></title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Ferreira</surname><given-names>Daniel A.</given-names></name><xref ref-type="aff" rid="aff1"/></contrib>
<aff id="aff1">School of Electrical and Computer Engineering, University of Campinas, Campinas, Brazil.</aff>
</contrib-group>
<abstract><p>Expensive black-box optimization spends its budget fast. Simulation-driven engineering design and hyperparameter tuning admit only a few hundred true function evaluations, so every observation collected during the search becomes a priced asset. This paper deploys GAS-Bacterial Foraging Optimization (BFO), a surrogate-assisted optimizer in which a swarm of thirty large-language-model-mediated bacterial agents runs chemotaxis over a shared collective memory. Agents post structured textual observations of their local landscape throughout the run, and every ten iterations a language model condenses this memory into a natural-language pheromone, a small set of weighted region summaries that defines an explicit chemoattractant field biasing every agent&apos;s movement; a hallucination guard cross-checks each directional cue against the surrogate gradient and falls back to a classical tumble on disagreement. The evaluation rebuilds the budget ledger from the ground up: Twelve problems, ten mathematical benchmarks and two simulated engineering cases, three budget tiers of 150, 400, and 900 true evaluations, thirty runs per cell, and fourteen methods, nine established references plus four language-model optimizers newly admitted to the race, OPRO, FunSearch, EoH, and ReEvo, raced under token-matched accounting. Survival analysis on tier-relative time-to-target carries the inference: GAS-BFO holds the best mean gap on 22 of 36 problem-tier cells, reaches the target gap with the highest probability at every tier, and is significantly faster than all thirteen rivals at the 400- and 900-evaluation tiers under Holm-corrected log-rank tests, with hazard ratios pricing the separation, while conceding specific cells, the mixed-space tuning task to Tree-structured Parzen Estimation (TPE) among them, that the ledger records openly. Ablations attribute the gain to generative condensation and collective memory; the token tables state the price, one to three dollars per run at deployment tiers; and under bursty message dropout and controlled distributional shift, the swarm amortizes knowledge where single-model and single-history rivals concentrate it, retaining 79.4% of lossless quality at a 60% loss rate against 41.2% for Bayesian Optimization with Expected Improvement (BO-EI).</p></abstract>
<kwd-group kwd-group-type="author"><kwd>Generative agents</kwd><kwd>Bacterial foraging optimization</kwd><kwd>Large language models</kwd><kwd>Surrogate-assisted</kwd></kwd-group>
</article-meta></front>
<body>
<sec id="sec-1">
<p>optimization, Stigmergy, Expensive black-box optimization.</p>
</sec>
<sec id="sec-2"><label>1</label><title>Introduction</title>
<p>Many engineering and scientific objectives behave as expensive black boxes. One evaluation can bill minutes to hours of computation: A fluid-dynamics solve, a crash or structural simulation, or the full training of a machine-learning model <xref ref-type="bibr" rid="ref-1">[1]</xref>, <xref ref-type="bibr" rid="ref-2">[2]</xref>. The design and analysis of computer experiments formalized this regime early <xref ref-type="bibr" rid="ref-1">[1]</xref>. Modern hyperparameter optimization inherits it at scale <xref ref-type="bibr" rid="ref-3">[3]</xref>. With the total number of evaluations B capped at a few hundred, observation, not reasoning, is the line item that binds. Every number the run collects acquires strategic value. The optimizer&apos;s central task becomes disciplined accumulation, compression, and redistribution of scarce evidence.</p>
<p>Two methodological lineages divide the market. Bayesian Optimization (BO) and its model-based relatives maintain a probabilistic surrogate of the objective and spend evaluations through an acquisition policy <xref ref-type="bibr" rid="ref-4">[4]</xref>, <xref ref-type="bibr" rid="ref-5">[5]</xref>. The family is sample-efficient in low dimensions. But it books all knowledge in a single statistical model, which strains under multimodality, moderate dimension, or drift. Population-based metaheuristics explore in parallel and absorb rugged landscapes <xref ref-type="bibr" rid="ref-6">[6–9]</xref>. Their classical variants spend evaluations freely, though. The operators assume fitness probes are cheap, so tight budgets force a surrogate wrapper to keep them competitive. Neither lineage communicates intermediate findings in any rich sense. Population methods exchange selection pressure and occasional numeric neighborhood statistics, never an interpretable summary of what the swarm has learned.</p>
<p>Biological swarms settled the communication problem long ago. Their settlement is stigmergy: Agents coordinate by modifying a shared environment rather than by addressing each other directly <xref ref-type="bibr" rid="ref-10">[10]</xref>. Ant colonies deposit pheromone that amortizes thousands of foraging trips into a gradient-like field <xref ref-type="bibr" rid="ref-11">[11]</xref>, <xref ref-type="bibr" rid="ref-12">[12]</xref>. The channel works precisely because it is lossy and graded. The field summarizes history, expires when unsupported, and biases movement without dictating it. Artificial stigmergy stayed numerically rigid instead. A pheromone table over discrete graph edges, as in Ant Colony Optimization (ACO), cannot express what a human analyst would report after inspecting the same evidence. That report might note a promising valley elongating toward smaller aspect ratios, or newest samples contradicting the previously hypothesized optimum.</p>
<p>Large Language Models (LLMs) re-priced what scattered, heterogeneous evidence can support <xref ref-type="bibr" rid="ref-13">[13–16]</xref>. They read hundreds of numeric observations and emit compact, structured hypotheses about landscape geometry. Agent architectures built around them have demonstrated persistent memory and reflective summarization in simulated social settings <xref ref-type="bibr" rid="ref-17">[17]</xref>. So far, optimization deployments cast the LLM as a proposal generator or an evolutionary operator <xref ref-type="bibr" rid="ref-18">[18]</xref>: the model itself suggests the next candidate. The complementary role remains unexplored. There, the LLM is not a proposer but a communication medium. It is a stigmergic channel that condenses a swarm&apos;s accumulated observations into a natural-language pheromone field. The channel sits inside a budget-aware surrogate framework, with explicit guards against hallucinated guidance and honest accounting of token cost.</p>
<p>The gap above prices the work. Three research questions convert it into spendable form, and three hypotheses wager falsifiable answers. Every claim is denominated in the currency this regime trades: final-solution quality per evaluation budget. The evaluation of Section 6 settles the ledger with fixed budgets, seeded replication, and rank-based inference. The ablations of Section 6.5 audit which components earn their keep, and the stress tests of Sections 6.7 and 7 complete the account.</p>
<p>RQ1. Does stigmergic LLM-mediated pheromone communication raise final-solution quality and time-to-target per evaluation budget over the Bayesian-optimization, evolutionary, and language-model lineages represented by thirteen reference methods across three budget tiers?</p>
<p>RQ2. Which protocol components carry the gain, message schemata, collective memory, self-consistency, the hallucination guard, or the acquisition-gated budget accounting, and how do the condensation cadence and swarm size trade quality against tokens at each tier?</p>
<p>RQ3. Does the gain survive communication stress in the form of bursty message dropout and latency, and distributional shift of the objective itself, against both single-model and single-history rivals?</p>
<p>H1: At every budget tier, GAS-BFO outperforms the reference field in tier-relative time-to-target, with Holm-corrected log-rank significance against all thirteen rivals at the 400- and 900-evaluation tiers, and holds the best mean gap on 22 of the 36 problem-tier cells, with the mixed-space tuning case conceded to Tree-structured Parzen Estimation (TPE) among others.</p>
<p>H2: Component ablations attribute the gain to the communication layer, collective memory, self-consistency, and the hallucination guard, not to the surrounding surrogate machinery, and the cadence and swarm-size sweeps price the remaining dials against token cost.</p>
<p>H3: The gain persists under stress: retention under bursty dropout and latency stays above every reference method, and degradation under controlled shift stays below both the Bayesian references and the language-model single-history rivals.</p>
<p>This paper converts the complementary role into GAS-BFO, a generative agent swarm built on Bacterial Foraging Optimization (BFO) <xref ref-type="bibr" rid="ref-8">[8]</xref>. Thirty bacterial agents run chemotaxis over the search box. Each agent posts structured textual observations into a shared collective memory. Every ten iterations, an LLM condenses that memory into a small set of weighted region summaries. The summaries compile into an explicit chemoattractant field that biases every agent&apos;s run direction, in mixture with the gradient of a Gaussian-process surrogate. The budget manager admits a true evaluation only when Expected Improvement (EI) or condensation confidence covers the spend. A hallucination guard cross-checks every directional cue against the surrogate before it can move an agent. The target problem is stated formally as</p>
<p>min f(x) s.t. neval (f) ≤ B, (1)</p>
<p>where X is a box in d dimensions, f is observable only through costly evaluations, and the budget B books both the initial design and every evaluation the search triggers. The contributions of this work are as follows.</p>
<p>I. A stigmergic communication protocol whose pheromone is a natural-language artifact: LLM condensations of a capped collective memory compile into an explicit chemoattractant field that biases swarm movement. II. A cost-aware agent architecture coupling the pheromone field with a Gaussian-process surrogate:</p>
<p>Acquisition-gated true evaluations, health-based reproduction, and pheromone-biased elimination and dispersal, all charged to one budget.</p>
<p>III. A hallucination guard that scores agreement between LLM directional cues and surrogate gradients and falls back to classical tumble behavior on disagreement, backed by hard token-budget caps and schema-level failure handling.</p>
<p>IV. A token economics analysis with a per-run cost model: Measured prompt and completion token counts, dollar cost, and wall-clock overhead against BO at equal budget.</p>
<p>V. A rigorous empirical study on twelve problems under three budget tiers, 150, 400, and 900 true evaluations:</p>
<p>30 runs per cell, fourteen methods including four token-matched language-model optimizers, survival-analysis inference with Kaplan-Meier curves, Holm-corrected log-rank tests, and Cox hazard ratios, Cliff&apos;s delta <xref ref-type="bibr" rid="ref-19">[19]</xref> effect sizes, component-wise ablations with cadence and swarm-size sweeps, per-run token accounting, bursty-dropout and latency stress, and a controlled distributional-shift study.</p>
<p>The itinerary follows. Section 2 reviews BFO, LLM-based optimization, and surrogate-assisted search, then states the gap this work fills. Section 3 details the system architecture of GAS-BFO. Section 4 specifies the communication protocol: Its message schemata, prompting strategy, information-theoretic reading, and failure modes. Section 5 presents the algorithm and its cost model. Section 6 reports the empirical ledger: quality per budget, ablations, token economics, and communication stress. Section 7 studies robustness under distributional shift. Section 8 discusses scope, limitations, and validity threats; Section 9 concludes and charts future directions.</p>
</sec>
<sec id="sec-3"><label>2</label><title>Background</title>
<p>This section places GAS-BFO at the junction of three literatures. It first traces BFO and pinpoints the limitations that matter in expensive settings. It then reviews how LLMs serve as search operators and optimizers. Finally, it summarizes surrogate-assisted optimization under tight budgets. The closing argument: no existing system combines stigmergic communication with generative agents in a budget-aware manner.</p>
<sec id="sec-4"><label>2.1</label><title>Bacterial Foraging Optimization: Lineage and Limitations</title>
<p>Passino <xref ref-type="bibr" rid="ref-8">[8]</xref> introduced BFO as a biomimicry of Escherichia coli foraging: Bacteria sense local chemoattractant gradients through temporal comparisons, run while conditions improve, tumble otherwise, and periodically reproduce and disperse. The algorithm mirrors these operators directly. Chemotaxis implements biased random walks. Reproduction duplicates the healthiest half of the population. Elimination–dispersal relocates agents probabilistically to model environmental cataclysms. Liu and Passino <xref ref-type="bibr" rid="ref-20">[20]</xref> later supplied stability analyses for the resulting distributed optimization dynamics. The survey by Das et al. <xref ref-type="bibr" rid="ref-22">[21]</xref> consolidated an application ledger spanning controller tuning, power systems, and image processing. The enduring appeal of BFO is architectural: A population of simple agents, local rules, and no central model.</p>
<p>Three limitations settle BFO&apos;s fate on expensive problems: 1) classical chemotaxis estimates gradients by probing pairwise position differences, and each probe bills multiple evaluations per agent per step; at B = 200, probing alone can exhaust the budget, 2) the original swarming term communicates only coarse numeric attraction and repulsion between agents, and the algorithm is otherwise memoryless. Evidence gathered by one bacterium reaches the swarm only through selection, never as an interpretable summary, 3) the operator schedule, such as chemotactic step counts, reproduction frequency, and dispersal probability, is hand-set, and no component prices the economic value of an evaluation. The no-free-lunch theorems rule out any fixed operator schedule that dominates across problem classes <xref ref-type="bibr" rid="ref-23">[22]</xref>. The fix must let the search adapt to what the accumulated evidence actually says.</p>
</sec>
<sec id="sec-5"><label>2.2</label><title>Large Language Models as Search Operators and Optimizers</title>
<p>The optimization community has recently hired LLMs in three roles. As an optimizer, the model reads a trajectory of candidate-value pairs and proposes the next candidate. OPRO demonstrated that instruction-tuned models optimize small continuous and combinatorial tasks purely in context, with the prompt serving as population memory <xref ref-type="bibr" rid="ref-18">[18]</xref>. As an operator, LLMs supply evolutionary variation: Liu et al. <xref ref-type="bibr" rid="ref-24">[23]</xref> showed that an LLM performing crossover and mutation over continuous vectors stays competitive with classical operators on low-dimensional benchmarks, and LLaMEA uses an LLM to generate and refine entire metaheuristic algorithms <xref ref-type="bibr" rid="ref-25">[24]</xref>. As a program searcher, FunSearch evolves code with an LLM mutator and has produced new mathematical constructions <xref ref-type="bibr" rid="ref-26">[25]</xref>, while Evolution of Heuristics automates heuristic design for combinatorial problems <xref ref-type="bibr" rid="ref-28">[26]</xref>.</p>
<p>These deployments inherit a specific toolkit from the prompting literature. Chain-of-thought prompting elicits intermediate reasoning steps <xref ref-type="bibr" rid="ref-29">[27]</xref>. Self-consistency aggregates several sampled reasoning paths into a majority answer and improves reliability <xref ref-type="bibr" rid="ref-30">[28]</xref>. Agentic scaffolds interleave reasoning with tool calls, and surrogate queries are a natural instance <xref ref-type="bibr" rid="ref-31">[29]</xref>. Two assets make LLMs attractive for expensive optimization: They interpolate patterns across heterogeneous evidence, and they emit hypotheses in a form humans and other agents can consume. Two liabilities argue for caution: outputs are stochastic, and the model can assert structure the input evidence does not support.</p>
<p>No existing system, however, runs the LLM as a communication channel inside a budget-limited search population. OPRO-style optimizers replace the population with a single context window. Operator-style systems insert the LLM where variation belongs, so its influence stays confined to proposing genotypes. In both, token spend scales with population activity in ways the literature rarely reports. Neither design audits the model&apos;s claims against an independent numerical model before acting on them. This work states the design question in deliberately inverse terms. Keep the classical population dynamics. Pay the LLM only for what it does uniquely well: Read a large, messy log of observations and write a compact, checkable summary of the landscape.</p>
</sec>
<sec id="sec-6"><label>2.3</label><title>Surrogate-Assisted Optimization under Tight Evaluation Budgets</title>
<p>BO is the reference methodology for budget-limited black-box search <xref ref-type="bibr" rid="ref-4">[4]</xref>, <xref ref-type="bibr" rid="ref-5">[5]</xref>. A Gaussian Process (GP) maintains a posterior over the objective given all evaluated points <xref ref-type="bibr" rid="ref-32">[30]</xref>, with a nugget term guarding against numerical micro-noise <xref ref-type="bibr" rid="ref-33">[31]</xref>. An acquisition function converts the posterior into the next evaluation decision, EI <xref ref-type="bibr" rid="ref-2">[2]</xref>, probability of improvement, or an upper-confidence-bound score <xref ref-type="bibr" rid="ref-34">[32]</xref>. Read at the level of information flow, the GP is a shared memory of all observations, and the acquisition rule arbitrates globally which observation is worth buying next. Implementations at scale include tree-structured Parzen estimators <xref ref-type="bibr" rid="ref-35">[33]</xref>, the random-forest smoothers of SMAC <xref ref-type="bibr" rid="ref-36">[34]</xref>, and the surrogate-modeling practice long standard in engineering design <xref ref-type="bibr" rid="ref-1">[1]</xref>, <xref ref-type="bibr" rid="ref-37">[35]</xref>.</p>
<p>The standard GP formalism supplies the machinery. Given the evaluated inputs booked so far and their responses, the posterior mean and standard deviation at a candidate x are</p>
<p>( ) ( ) ( ) −1 ( )</p>
<p>t t ⊤ t 2 t (2)</p>
<p>μ (x) = k (x) (K + σnI) y ,</p>
<p>(t) (t) ⊤ (t) 2 −1 (t) (3)</p>
<p>σ (x) = √k(x, x) − k (x) (K + σnI) k (x),</p>
<p>where the kernel matrix K has entries k(·,·), the nugget added to the diagonal absorbs micro-noise and numerics <xref ref-type="bibr" rid="ref-33">[31]</xref>, and the superscript indexes the refit after the t-th accepted evaluation. These two moments drive the acquisition policy and, in GAS-BFO, also the movement rule and the hallucination guard. The line&apos;s assets are well documented. So are its limits under multimodality and moderate dimension, where a single centralized posterior over-concentrates the search. The position taken here does not retire GP-based search. It holds that a population of agents adds value if, and only if, a summary richer than the raw posterior coordinates it.</p>
</sec>
<sec id="sec-7"><label>2.4</label><title>Gap: No Stigmergic Communication with Generative Agents</title>
<p>Grassé&apos;s study of termite construction supplies the classic account of stigmergy: The emerging structure itself coordinates the workers <xref ref-type="bibr" rid="ref-10">[10]</xref>. Wilson&apos;s <xref ref-type="bibr" rid="ref-38">[36]</xref> sociobiological work traced how chemical signals mediate comparable coordination across social insects. Artificial swarm intelligence adopted the pattern. Beni and Wang <xref ref-type="bibr" rid="ref-39">[37]</xref> coined the term for cellular robotics. Colorni et al. <xref ref-type="bibr" rid="ref-40">[38]</xref> encoded pheromone trails over discrete edges. The ensuing literature built a rich theory of indirect coordination <xref ref-type="bibr" rid="ref-11">[11]</xref>, including non-pheromone stigmergic mechanisms such as the advertising dances of artificial bee colonies <xref ref-type="bibr" rid="ref-41">[39]</xref>. In every one of these systems, the communication medium is numeric, and design time fixes its semantics.</p>
<p>LLM-based multi-agent infrastructures such as AutoGen issue software agents rich conversational channels <xref ref-type="bibr" rid="ref-42">[40]</xref>. Generative agent simulations demonstrated believable collective behavior built on memory and reflection <xref ref-type="bibr" rid="ref-17">[17]</xref>. But these frameworks are not optimizers. They ship no evaluation-budget semantics, acquisition discipline, or guards against fabricated guidance. <xref ref-type="table" rid="tab1">Table 1</xref> positions GAS-BFO against the adjacent lines of work. No published system combines stigmergic communication, a generative pheromone medium, explicit evaluation budgets, hallucination guards, and reported token economics in a single optimizer. That combination is the contribution of this paper.</p>
<table-wrap id="tab1"><label>Table 1</label><caption><p>Positioning of GAS-BFO relative to adjacent research lines.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:5:66,510.7,537.1,756.3"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>*The marker n/a denotes method classes with no generative component, for which hallucination guards are not applicable.</p>
</sec>
</sec>
<sec id="sec-8"><label>3</label><title>System Architecture of GAS-Bacterial Foraging Optimization</title>
<p>GAS-BFO ships as six cooperating subsystems rather than a monolithic loop: An agent layer, a collective memory, a pheromone condensation service, a movement rule, an evolutionary cycle, and a surrogate-and-budget layer. Four design principles govern the assembly: 1) communication must summarize, not broadcast: Agents never exchange raw vectors, only schema-conformant observations, 2) generative capacity is reserved for interpretation: Authoring observations is programmatic and deterministic, which keeps the token bill small and the logs reproducible, 3) numeric evidence must audit every LLM output before it can move an agent, and 4) the evaluation budget is a first-class citizen of the ledger: A single manager admits true evaluations, and no subsystem can bypass it.</p>
<sec id="sec-9"><label>3.1</label><title>Agent Design: Bacteria as Generative Agents</title>
<p>Each bacterium is a lightweight generative agent in the sense of multi-agent systems <xref ref-type="bibr" rid="ref-43">[41]</xref>: An autonomous entity with persistent state, a perception-action cycle, and the ability to contribute to shared knowledge <xref ref-type="bibr" rid="ref-17">[17]</xref>. Its state at iteration t holds three items: a position x_i^(t) in the search box, a scalar health h_i^(t), and a private memory slice. The slice keeps the agent&apos;s own last ten positions and their observed or predicted values. Position is the decision variable. Health accrues merit for the reproduction operator. The private slice lets the agent price its local trend without querying the collective memory.</p>
<p>The LLM&apos;s role is deliberately asymmetric. Agents never call the model themselves. A programmatic layer fills each observation post from agent state: Coordinates rounded to three decimals, an evaluated fitness or a flagged surrogate estimate, a trend label, and a confidence value. Authoring therefore costs zero tokens and is bit-reproducible. All generative work concentrates in a single condensation service the whole swarm shares (Section 3.3). The division of labor follows the economics. Thirty agents posting free-form text at every iteration would multiply the token bill by orders of magnitude. They would add nothing beyond what the schema carries. The bacterium stays generative in consequence, not in authorship: language artifacts issued on behalf of the whole swarm shape its trajectory.</p>
</sec>
<sec id="sec-10"><label>3.2</label><title>Collective Memory as A Shared Substrate</title>
<p>The collective memory M is an append-only ledger of structured observations, the substrate on which the pheromone field grows. Each entry carries a position summary (the rounded coordinate vector) and the evaluated fitness if the position was ever truly evaluated; otherwise, the surrogate mean flagged as an estimate. It also carries a local trend label from the set {improving, flat, worsening}, computed from the posting agent&apos;s private slice. A confidence value equals one minus the normalized surrogate standard deviation at that position. A short templated note completes the entry, such as &apos;moved west of previous post; worse than expected&apos;. Every entry is stamped with the iteration and tagged with the posting agent&apos;s identifier.</p>
<p>A 500-entry cap with first-in-first-out eviction bounds the log, and the cap earns its keep three ways. It bounds the prompt length of every condensation call, the dominant line item of the token budget. It implements evaporation: Stale evidence leaves the context exactly as physical pheromone decays. And it keeps the swarm&apos;s attention on recent landscape structure, which matters under drift (Section 7). The condensation prompt draws on two read views. A recency window holds the newest 60 entries. A salience view holds the 40 entries with the largest absolute fitness change relative to their posting agent&apos;s previous post.</p>
</sec>
<sec id="sec-11"><label>3.3</label><title>Large Language Models-Mediated Pheromone Field</title>
<p>Every L = 10 iterations, the condensation service reads the memory views and tasks the LLM with analyzing the colony&apos;s search. The output is not free prose but a schema-conformant set of at most five region summaries. Each region r carries a center c_r, a lengthscale ℓ_r, a weight w_r in the unit interval, and a one-sentence rationale. A global hypothesis string and a binary confidence flag complete the emission (Section 4.1). Self-consistency sampling with k = 5 draws (Section 4.2) produces five candidate condensations. Region centers are clustered across the five draws, weights are averaged, and a region survives only when a majority of the draws proposed it. The aggregated regions define the chemoattractant field:</p>
<p>(t) 2 R (t)</p>
<p>‖x − c ‖</p>
<p>( ) (t) l</p>
<p>t (4)</p>
<p>Φ (x) = ∑ wr exp (− ), 2lr</p>
<p>where R^(t), at most five, counts the majority-supported regions and the lengthscale ell_r sets each region&apos;s radius of influence. Eq.(4) has the functional form of a mixture-of-Gaussians surface, but linguistic consensus rather than maximum likelihood prices its parameters. The LLM chooses where the swarm&apos;s evidence says promise lies; the vote across self-consistency samples decides how strongly. The field is attractive by construction. Repulsion arises implicitly: Regions unsupported by recent memory are simply not re-proposed, and FIFO eviction erases their contribution. The field is not a posterior mean, not a fitted response surface, and not authoritative. It is a compact, contestable hypothesis about landscape structure whose every parameter traces back to ledger entries, exactly what the hallucination guard needs to audit it (Section 4.4).</p>
</sec>
<sec id="sec-12"><label>3.4</label><title>Chemotaxis Movement Rule</title>
<p>Between condensations, each agent runs a biased run-and-tumble cycle. The run direction blends the surrogate&apos;s descent direction with the ascent direction of the pheromone field:</p>
<p>(t) (t) (t) (t) (t)</p>
<p>d ∝ −∇fˆ (x ) + γ∇Φ (x ), (5)</p>
<p>i i i</p>
<p>where the surrogate predictor f̂^(t) is the GP posterior mean of Eq. (2) and γ = 0.5 balances evidence-driven descent against colony-level attraction. Both gradients are evaluated analytically and bill a negligible fraction of a true evaluation. Step length decays geometrically from 8% to 1% of the box diagonal over the run, and the boundary reflects moves that would leave the box.</p>
<p>Tumbling modulates the mixture. The tumble probability climbs whenever the guidance an agent receives disagrees with its local surrogate evidence:</p>
<p>ptum (i) = p0 + (pmax − p0) (1 − a ), (6)</p>
<p>where a_i^(t) is the agreement statistic between the LLM&apos;s directional cue and the surrogate gradient at x_i, defined in Eq. (12), with p_0 = 0.1 and p_max = 0.7, guidance and surrogate in agreement purchase long, directed runs. Conflict reverts the agent to the exploration profile of classical BFO: frequent tumbling, trusting only local evidence. The movement rule is fail-safe by construction. The worse the coordination signal, the closer the behavior to the unguided baseline.</p>
</sec>
<sec id="sec-13"><label>3.5</label><title>Reproduction, Elimination–Dispersal</title>
<p>Every L iterations, immediately after condensation, the swarm executes the evolutionary half of BFO. Health pays agents whose observations beat the surrogate&apos;s expectation, the only form of surprise the system can meter without spending extra evaluations:</p>
<p>(t+1) (t) (t) (t) (t)</p>
<p>h = λh + max (0, μ (x ) − f (x )), (7)</p>
<p>i i i i</p>
<p>with decay λ = 0.9, so merit fades unless re-earned. Reproduction draws parents from a temperature-controlled softmax of health rather than duplicating a fixed top half:</p>
<p>exp⁡(βh )</p>
<p>rep i</p>
<p>p = , (8)</p>
<p>i N (t)</p>
<p>∑ exp⁡(βh )</p>
<p>i=1 i</p>
<p>with β = 1. Children inherit the parent position perturbed by small isotropic jitter and reset their health, keeping N = 30 constant. The softmax softens Passino&apos;s deterministic split and cuts the odds that one lucky early evaluation permanently captures the gene pool.</p>
<p>Elimination–dispersal then relocates each agent independently with probability p_ed = 0.25. Classical BFO redraws uniformly; GAS-BFO samples restarts from a density biased by the current pheromone field and mixed with a uniform component for insurance:</p>
<p>( ) Φ (x) + ε 1</p>
<p>p (x) = 0.5 + 0.5 , (9)</p>
<p>restart (t)</p>
<p>Z vol(x) where Z^(t) normalizes the shifted field and ε is a small floor. Dispersal thereby re-colonizes the regions the swarm&apos;s own language summaries currently favor, while the uniform half preserves global coverage (stigmergic memory deciding, explicitly, where the colony re-seeds after a cataclysm).</p>
</sec>
<sec id="sec-14"><label>3.6</label><title>Surrogate Layer and Evaluation Budget Manager</title>
<p>A single GP regression over all true observations is refit after every accepted evaluation, with a Matérn 5/2 kernel with automatic relevance determination, standardized inputs, and a nugget <xref ref-type="bibr" rid="ref-31">[29]</xref>, <xref ref-type="bibr" rid="ref-32">[30]</xref>. Three consumers bill the surrogate: The movement rule through the gradient of the posterior mean, the acquisition gate, and the hallucination guard. Evaluations are the only scarce resource, and one manager owns them all.</p>
<p>At each iteration, every agent proposes its next position, and the manager prices EI over the proposals together with the LLM&apos;s focus point when one is present. A proposal is admitted only under the acquisition-gated rule:</p>
<p>(t+1) (t) (t) (t) (t)</p>
<p>n = n + [maxE (x) ≥ τ or c = 1], (10)</p>
<p>eval eval (t) LLM</p>
<p>where C^(t) is the candidate set, EI is computed for the current incumbent following <xref ref-type="bibr" rid="ref-2">[2]</xref>, and the threshold τ^(t) decays linearly in standardized objective units with the iteration index, forcing late-run frugality. A stall guard admits the best-EI candidate whenever five consecutive iterations pass without an evaluation, so the loop always progresses toward budget exhaustion. The condensation&apos;s confidence flag c_LLM acts as an exploration override. When the LLM marks a high-potential region that no recent evaluation has tested, the region center is evaluated even if EI is momentarily low. In practice, the manager admits about one proposal per iteration, so a budget of B = 200 yields roughly 210 iterations and about 21 condensation events. The initial Latin hypercube design of 10 points is charged to the same ledger, and the manager refuses every request once the budget runs dry.</p>
</sec>
</sec>
<sec id="sec-15"><label>4</label><title>The Communication Protocol</title>
<p>The protocol is the centerpiece of the system, and this section specifies it in full. The message schemata flow through the channel. The prompting and aggregation strategy mints the pheromone. An information-theoretic reading prices what the pheromone yields. Failure modes and their guards close the account. The design goal holds throughout: A channel expressive enough to change swarm behavior, constrained enough to be auditable, and cheap enough to operate inside evaluation budgets of a few hundred true calls.</p>
<sec id="sec-16"><label>4.1</label><title>Message Schemata</title>
<p>Two artifact families flow through the channel. The agents&apos; deterministic authoring layer writes posts into the collective memory; the condensation service emits structured LLM output. Both are JSON-like records with fixed fields, listed in <xref ref-type="table" rid="tab2">Table 2</xref>. The post schema separates facts from interpretation: Position, fitness, and confidence are numeric facts drawn from state, while the trend label and the short note are weak interpretations produced by fixed rules. The emission schema separates geometry from narrative: Centers, lengthscales, and weights are executable and compile directly into the field of Eq. (4); the rationale and hypothesis strings are advisory and never actuated without clearing the guard.</p>
<p>The rationale field deserves comment. It spends tokens without ever entering a computation, yet the ablations show the system weakens without it (Section 6.5). Free-text rationales anchor the model&apos;s own region judgments across the k samples, functioning as an intra-ensemble consistency device. They also make every field human-auditable after the fact. The focus point and the confidence flag serve one purpose only: Let the language channel order an evaluation the numeric machinery would not order. In that sense, the protocol is bidirectional rather than merely broadcast.</p>
<table-wrap id="tab2"><label>Table 2</label><caption><p>Message schemata for the two directions of the communication channel.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:8:66,98.8,537.1,392.9"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>*Posts are authored programmatically and cost no tokens; emissions are produced by the condensation LLM under a strict JSON contract.</p>
</sec>
<sec id="sec-17"><label>4.2</label><title>Prompting Strategy and Robustness</title>
<p>Five ordered sections assemble the condensation prompt, described here in text rather than reproduced verbatim. First, a role header casts the model as an analyst serving a bacterial colony, with no knowledge of the objective&apos;s name or origin. Benchmark identity is never disclosed, which also blunts any memorization advantage (Section 8). Second, a task header states the dimension, the box bounds, and the evaluations spent and remaining. Third, the memory digest renders the recency and salience views as compact lines carrying identifier, position, value or flagged estimate, trend, and confidence. Fourth, a statistics block lists the incumbent best, the five best evaluated points, and the per-dimension ranges of the salience view. Fifth, an output contract fixes the JSON schema of <xref ref-type="table" rid="tab2">Table 2</xref>, caps regions at five, and instructs the model to mark low confidence explicitly rather than guess.</p>
<p>Robustness is layered, not hoped for. A schema violation triggers a single retry that embeds the validator&apos;s error message; a second failure reuses the previous field unchanged, so the swarm never acts on malformed output. Self-consistency draws k = 5 samples at temperature 0.7 to obtain genuinely different region hypotheses, then aggregates by majority vote on centers and mean weights <xref ref-type="bibr" rid="ref-30">[28]</xref>. All other decoding runs at temperature 0, and the model version is pinned per run. A hard token cap per condensation event aborts oversized generations and preserves the last valid field. These are deliberately conservative engineering choices. The interesting failures are semantic, and the next subsection interrogates them.</p>
</sec>
<sec id="sec-18"><label>4.3</label><title>Information-Theoretic View</title>
<p>The pheromone field admits a compression reading. At condensation time, the memory holds up to 500 entries of about 2d numbers each; on the benchmarks used here, that amounts to thousands of numeric observations. The emission amortizes this into at most five regions, roughly 5(2d + 2) numbers plus a few sentences, a compression of about two orders of magnitude. The field is a sufficient statistic for the swarm&apos;s movement only to the extent that the LLM captures real regularities; otherwise Eq. (4) is an expensive way of drawing random bumps. The movement-relevant information the channel carries is therefore estimated in the style of classical mutual-information estimators <xref ref-type="bibr" rid="ref-44">[42]</xref>:</p>
<p>p ˙(a, b) ˆ (t) (t)</p>
<p>I(Φ ;Δf ) = ∑ ∑ p ˆ(a, b) log ( ), (11)</p>
<p>p ⃗˙(a)p ˙(b)</p>
<p>a∈A b∈B</p>
<p>where a indexes whether an agent&apos;s realized step aligned with the pheromone gradient and Δf^(t) is the signed realized improvement of that step relative to the surrogate expectation, with both variables discretized into the bins A and B. On Hartmann-6D, the estimate averaged 0.42 bits for the full protocol against 0.09 bits when regions were randomly aggregated (Section 6.5). The language channel carries roughly four to five times the movement-relevant information of a random summary of the same memory. The estimate is a diagnostic of signal, not proof of sufficiency. A formal information-theoretic account of stigmergic compression remains open and is flagged in Section 9.</p>
</sec>
<sec id="sec-19"><label>4.4</label><title>Failure Modes and Guards</title>
<p>The protocol&apos;s characteristic failure is a hallucinated gradient: The condensation asserts, with fluent rationale, a region the evaluated evidence does not support. The guard operationalizes disagreement as an angle. Let g_LLM,i be the pull direction the field induces at x_i, the pheromone term of Eq. (5). The agreement statistic is the cosine similarity between this cue and the surrogate&apos;s direction of descent:</p>
<p>(t) (t) (t)</p>
<p>⟨g , −∇fˆ (x )⟩</p>
<p>(t) 屯,i i</p>
<p>a = , (12)</p>
<p>i (t) (t)</p>
<p>‖g ‖ ‖∇ (x )‖ + ε</p>
<p>也,i j</p>
<p>When a_i^(t) falls below a_min = 0.2, the pheromone term is dropped for that agent and iteration, and movement falls back to the plain BFO tumble. The same statistic feeds the tumble probability of Eq. (6), so mild disagreement already buys exploration. Removing the guard was measurably harmful: The Hartmann-6D gap rose from 0.061 to 0.118 (Section 6.5). That is the empirical sense in which unchecked hallucination is a first-class optimization hazard rather than a curiosity <xref ref-type="bibr" rid="ref-45">[43]</xref>. On Hartmann-6D, the guard fired on 3.1% of agent-iterations on average, an acceptable premium for the value the channel returns.</p>
<p>Four further guards complete the failure catalogue. Degenerate outputs, in which a single region absorbs all weight, are clipped at weight 0.6 and re-normalized. Winsorizing the fitness values that enter the digest prevents memory poisoning by outliers. Echo loops are structurally impossible: Prior emissions never feed back into the prompt, the condensation always reasons from raw observations only, and the FIFO cap bounds field staleness. The token budget itself is the final guard. Cumulative API cost that reaches the run-level cap suspends condensation, and the last valid field persists, degrading gracefully toward surrogate-assisted BFO. Every guard stays silent in the logs unless it fires, so post-hoc audits can tally hallucination events per run.</p>
</sec>
</sec>
<sec id="sec-20"><label>5</label><title>Algorithm and Cost Model</title>
<p>This section assembles the subsystems into a single algorithm, then prices it. The cost model separates three currencies the literature often conflates: True evaluations, tokens, and wall-clock time. Making all three explicit is what supports an honest statement of when the method earns its deployment.</p>
<sec id="sec-21"><label>5.1</label><title>Complete Pseudocode</title>
<p>Algorithm 1 presents the complete procedure. The outer loop alternates chemotaxis at every iteration with condensation, reproduction, and dispersal every L = 10 iterations; the budget manager is the only site that calls the true objective. All stochastic choices are seeded per run. The default configuration deploys N = 30 agents, memory capped at 500 entries, k = 5 self-consistency samples, and dispersal probability 0.25. Movement parameters run γ = 0.5, λ = 0.9, β = 1, a_min = 0.2, p_0 = 0.1, and p_max = 0.7. The run starts from an initial design of 10 Latin hypercube points and a budget of B = 200 true evaluations.</p>
<p>Algorithm 1. GAS-BFO.</p>
<p>1: Input: f, box X, budget B, N = 30, L = 10, k = 5, p_ed = 0.25, caps 2: D = 10-point Latin hypercube in X; evaluate f; n_eval = 10 3: fit GP surrogate (mu, sigma) on D 4: initialize agents x_1..x_N in X; health h_i = 0; memory M = {} 5: Phi = empty field; c_LLM = 0 6: for t = 1, 2, ... while n_eval &lt; B:</p>
<p>7: for each agent i: post structured observation to M (FIFO cap 500) 8: if t mod L = 0: // pheromone condensation 9: for s = 1..k: r_s = LLM_condense(digest(M), stats(D)) 10: Phi = majority_vote(r_1..r_k); extract focus point, c_LLM 11: for each agent i:</p>
<p>12: g_LLM_i = pheromone pull of Phi at x_i 13: a_i = cosine(g_LLM_i, -grad_mu(x_i)) // Eq. (12) 14: if a_i &lt; 0.2: d_i = random unit vector // guard 15: else: d_i = -grad_mu(x_i) + 0.5 * grad_Phi(x_i) // Eq. (5) 16: with probability p_tum(i): d_i = random unit vector // Eq. (6) 17: x_i = reflect(x_i + eta_t * d_i, X) 18: C = {x_1..x_N} plus focus point; x* = member with max EI 19: if EI(x*) &gt;= tau_t or c_LLM = 1: // Eq. (10) 20: y* = f(x*); n_eval = n_eval + 1; D = D + (x*, y*) 21: h_i* = 0.9 * h_i* + max(0, mu(x*) - y*) // Eq. (7) 22: refit GP on D; update mu, sigma 23: if t mod L = 0:</p>
<p>24: reproduction: parents ~ softmax(h); replace losers // Eq. (8) 25: for each agent i with probability 0.25: redraw x_i from Eq. (9) density 26: return best evaluated (x, f(x)) in D</p>
<p>Three remarks clarify the pseudocode. The LLM is called exactly at line 9 and nowhere else; given the seeds, every other subsystem is numeric and deterministic. In the ASCII listing, Phi denotes the chemoattractant field of Eq. (4), mu and sigma the surrogate moments of Eqs. (2) and (3), and tau_t the acquisition threshold of Eq. (10). The loop admits at most one evaluation per iteration, which is what makes token cost and evaluation cost commensurable. Replace the condensation service with the identity, Phi always empty, and Algorithm 1 reduces to a surrogate-assisted BFO, precisely the stripped floor priced by the ablations of Section 6.5.</p>
</sec>
<sec id="sec-22"><label>5.2</label><title>Complexity and Token Economics</title>
<p>GP refits dominate numerical complexity and scale cubically in the number of true observations. With n at most 200, a refit costs well under a second, and the gradients of the posterior mean and of the field are analytic. The distinctive overhead is linguistic. With about 21 condensation events per run and k = 5 samples each, a run performs roughly 100 API calls. The run-level cost model is:</p>
<p>(t) (t)</p>
<p>C = ∑ (c n + c n ), (13)</p>
<p>run p p c c</p>
<p>where n_p^(t) and n_c^(t) are the prompt and completion tokens of call t and c_p, c_c are the provider&apos;s unit prices. Hartmann-6D billed a run, on average, 387k prompt tokens and 61k completion tokens, a prompt-to-completion ratio of about 6:1, since the digest dwarfs the emission. At prevailing commodity API prices, this maps to an estimated US$2.1–3.4 per run. Mean optimizer wall-clock overhead, excluding true evaluations, ran 21.4 minutes (2.3 times the 9.3 minutes of BO-EI at the same budget), with API latency, not local computation, dominating the difference.</p>
<p>Scale decides whether these overheads matter. In cheap-evaluation settings they are pure loss; in expensive ones they are minor. At the assumed floor of 30 seconds per true evaluation, the 400-evaluation reference tier alone costs at least 200 minutes of wall-clock, so the LLM adds at most about 14% to end-to-end time, and the starved 150-evaluation tier about 25%. A few dollars of guidance sit beside the compute the evaluations themselves burn. Quality per dollar prices the tradeoff explicitly, the relative gap reduction purchased per unit of API spend:</p>
<p>1 gbase − gous</p>
<p>Qpd = ⋅ , (14)</p>
<p>Crun gbase where g denotes the final mean gap to the known optimum and the baseline is BO-EI, whose API cost is zero. On Hartmann-6D, Q_pd came to approximately 0.27 per dollar: A 72.9% gap reduction purchased for two to three dollars. One caveat belongs in the ledger. The k = 5 samples of a single condensation are independent and could be issued concurrently, cutting the latency overhead by roughly half; the reported figures are sequential, by conservative choice.</p>
</sec>
</sec>
<sec id="sec-23"><label>6</label><title>Evaluation under Budget Constraints</title>
<p>The evaluation prices the pheromone channel under the one constraint that matters in expensive optimization: The evaluation budget itself. Three budget tiers, 150, 400, and 900 true evaluations, span the regimes a real campaign actually buys, from a starved pilot study to a mid-sized tuning run. Twelve problems, ten mathematical benchmarks and two simulated engineering cases, meet fourteen methods, nine established references and four language-model optimizers newly admitted to the race. The ledger reports final quality per tier, time-to-target survival, ablations, token economics, communication stress, and distributional shift, in that order.</p>
<sec id="sec-24"><label>6.1</label><title>Benchmark Functions and Budgets</title>
<p>Ten mathematical benchmarks span the regimes that stress budget-limited search <xref ref-type="bibr" rid="ref-46">[44]</xref>. Hartmann-3D and Hartmann-6D are low-dimensional multimodal landscapes with known optima. Michalewicz in ten dimensions adds banana-shaped valleys that punish gradient bias. Rastrigin in ten dimensions, rotated by a fixed orthogonal map, carries dense periodic local optima; Ackley in ten and twenty dimensions grades landscape breadth; Rosenbrock in ten dimensions couples a curved valley with a smooth floor; Levy in ten dimensions carries mild multimodality around a global valley; Zakharov in twenty dimensions, shifted off the origin, and Dixon-Price in twenty dimensions complete the high-dimensional wing. All functions are minimized on their standard domains and rescaled to the unit box for the agents, with the known optimum used to report gaps.</p>
<p>Two simulated engineering cases complete the suite, both rebuilt for this study. The first tunes six hyperparameters of a gradient-boosted classifier <xref ref-type="bibr" rid="ref-47">[45]</xref>: Learning rate on a log scale, maximum depth, minimum child weight, subsample ratio, column subsample ratio, and L2 regularization, a genuinely mixed search space of continuous, integer, and logarithmic dimensions. The objective is five-fold cross-validated log-loss, and each configuration is billed a thirty-second evaluation cost with training parallelism disabled. The second is an aerodynamic shape problem in the surrogate spirit of <xref ref-type="bibr" rid="ref-37">[35]</xref>: Eight Hicks-Henne bump amplitudes deform the RAE 2822 profile at transonic conditions <xref ref-type="bibr" rid="ref-48">[46]</xref>, and the ground truth is a deterministic drag-like response reproducing the shock-induced drag rise and curvature typical of such flows, a simulated CFD-like surrogate rather than an actual solve, a limitation noted in Section 8.</p>
<p>Every problem runs at all three budget tiers, B = 150, 400, and 900 true evaluations, of which the first ten fund a shared Latin hypercube design. The tier structure is the study&apos;s spine: what a method buys with tripling budgets separates the families that amortize structural knowledge, the language-model lineage, from those that convert budget linearly, the Bayesian lineage. <xref ref-type="table" rid="tab3">Table 3</xref> records the suite, the tiers, and the reporting conventions.</p>
<table-wrap id="tab3"><label>Table 3</label><caption><p>Benchmark suite, budget tiers, and reporting conventions.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:12:66,294.7,537.1,453.6"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>the drag-count difference to its reference optimum.</p>
</sec>
<sec id="sec-25"><label>6.2</label><title>Reference Methods under Budget</title>
<p>Dim. Tiers (evals) Metric 3 150 / 400 / 900 Gap to optimum 6 150 / 400 / 900 Gap to optimum 10 150 / 400 / 900 Gap to optimum 10 150 / 400 / 900 Gap to optimum 10 150 / 400 / 900 Gap to optimum 20 150 / 400 / 900 Gap to optimum 10 150 / 400 / 900 Gap to optimum 10 150 / 400 / 900 Gap to optimum 20 150 / 400 / 900 Gap to optimum 20 150 / 400 / 900 Gap to optimum 6 (3 types) 150 / 400 / 900 Log-loss gap 8 150 / 400 / 900 Drag-count gap</p>
<p>Mathematical benchmarks report the gap to the known optimum; the tuning case reports the log-loss difference to the best configuration found by any method at the 900-evaluation tier; the airfoil case reports</p>
<p>Fourteen methods run the race. Nine established references span the two classical lineages: Bayesian Optimization with Expected Improvement (BO-EI) <xref ref-type="bibr" rid="ref-2">[2]</xref> as the reference standard, probability of improvement (BO-PI), and an upper-confidence-bound policy with β = 2 (BO-UCB) <xref ref-type="bibr" rid="ref-34">[32]</xref> complete the acquisition family; TPE <xref ref-type="bibr" rid="ref-35">[33]</xref> and SMAC3 with its random-forest surrogate <xref ref-type="bibr" rid="ref-49">[47]</xref> stand in for scalable model-based competitors; a budget-restricted CMA-ES, population 10 for the tier-dependent generation count, carries the derandomized evolution-strategy flag <xref ref-type="bibr" rid="ref-9">[9]</xref>; uniform random search <xref ref-type="bibr" rid="ref-50">[48]</xref> prices the floor; and vanilla BFO, Passino&apos;s parameterization scaled to the tier <xref ref-type="bibr" rid="ref-8">[8]</xref>, plus the BFO+GP hybrid that shares GAS-BFO&apos;s surrogate, gating, and population dynamics minus the language channel, bracket the swarm lineage. TPE and SMAC3 natively support the mixed search space of the tuning case; the remaining continuous methods run on a unit-box encoding with inverse transforms for integer and logarithmic dimensions.</p>
<p>Four language-model optimizers join as new admissions, each raced with token-matched accounting on the same pinned model and API as GAS-BFO. OPRO, optimization by prompting <xref ref-type="bibr" rid="ref-18">[18]</xref>, asks the model to propose candidate solutions from a textual history of evaluated triples; it is the cleanest published instance of the LLM-as-optimizer lineage, its strength is a compact prompt that scales to any dimension, and its limitation is a history that mixes promising and poor triples without a condensation step, so the inductive bias the swarm buys structurally must be bought by the model in-context. Its relevance to RQ1 is direct: OPRO prices what a single-thread language channel achieves, against which the swarm&apos;s thirty-agent stigmergy is the treatment. FunSearch <xref ref-type="bibr" rid="ref-26">[25]</xref> evolves programs with an LLM as a mutation operator, searching the space of heuristics rather than the space of solutions; its strength is compositional discovery on problems with exploitable symbolic structure, its limitation is a wide search space that a few hundred evaluations cannot fund on numeric landscapes, and its inclusion prices whether program-space search transfers to budget-constrained continuous optimization at all. EoH <xref ref-type="bibr" rid="ref-28">[26]</xref> evolves short heuristic descriptions in a language-model loop with both crossover and mutation prompts; its strength is cheap iteration over explicit heuristic code, its limitation is the same budget arithmetic, and it prices the middle ground between OPRO&apos;s direct proposal and FunSearch&apos;s full program search. ReEvo <xref ref-type="bibr" rid="ref-51">[49]</xref> closes the set with reflective evolution: A population of heuristics undergoes verbal reflection and differential mutation; its strength is the strongest published record on combinatorial and continuous suites among LLM hyper-heuristics, its limitation is token appetite, and it is admitted as the strongest available representative of the reflective lineage, the closest published cousin of GAS-BFO&apos;s own condensation loop.</p>
<p>All fourteen methods share the same initial design, redrawn per seed but identical across methods within a seed, and the same tier accounting; the LLM quartet shares GAS-BFO&apos;s model version, decoding parameters, and API billing so that token comparisons are like-for-like. No method receives problem-specific tuning beyond its source defaults, a conservative choice that favors simplicity over last-percent performance, and every prompt, configuration, and transcript is archived for release.</p>
</sec>
<sec id="sec-26"><label>6.3</label><title>Run Accounting and Reproducibility</title>
<p>Each algorithm-problem-tier cell runs thirty times with seeds shared across methods, so the design is fully factorial over algorithm, problem, tier, and run, 5,040 runs per method in total. The reported solution quality is the best observed objective value at tier end, the quantity an expensive campaign actually buys. The primary inference is survival analysis on time-to-target: Each problem and tier carries a target gap, set at 1.5 times the best mean gap any method attains at that tier, so targets stay reachable exactly where the tier allows, and each run either reaches the target at some evaluation count or is censored at the tier budget. Kaplan-Meier curves estimate the survival function, the probability that a run has not yet hit the target as a function of evaluations; log-rank tests compare GAS-BFO against each of the thirteen rivals within each tier, pooled over the twelve problems, with Holm correction <xref ref-type="bibr" rid="ref-52">[50]</xref> across the thirteen comparisons; and a Cox proportional-hazards fit per tier reports each rival&apos;s hazard ratio with a 95% confidence interval, hazard below one meaning the rival reaches the target more slowly than GAS-BFO. Because targets are tier-relative, survival compares methods within a tier, and cross-tier statements stay on final quality.</p>
<p>The plan was chosen for the data&apos;s shape. Terminal-quality comparisons of the kind standardized in the metaheuristic literature <xref ref-type="bibr" rid="ref-53">[51–53]</xref> discard two structures the tiered design creates. Censoring: The weaker methods miss the tier-relative target in most runs, so their terminal gaps are artifacts of the budget rather than of the search. Anytime behavior: A method that reaches the target at 250 evaluations buys more deployment value than one reaching it at 890, a distinction endpoint comparisons collapse. Time-to-target respects the censoring, prices budget directly on the horizontal axis, and reads naturally in deployment terms; a survival curve is the probability that the campaign still has not succeeded after spending e evaluations. The proportional-hazards assumption is checked per contrast with Schoenfeld residual trend tests, and where the check fails, the pre-registered fallback reports the restricted mean survival time difference instead of the hazard ratio. Secondary instruments: Cliff&apos;s delta <xref ref-type="bibr" rid="ref-19">[19]</xref> on final gaps at the 400-evaluation tier as a distribution-free effect size, and per-tier win counts over the thirty-six cells.</p>
<p>The LLM is an instruction-tuned model in the GPT-4 class accessed through a commodity API <xref ref-type="bibr" rid="ref-15">[15]</xref>, with the model version pinned and recorded per run. Decoding runs at temperature 0 everywhere except the self-consistency ensemble, which samples at temperature 0.7. Seeds control all stochastic components on the local side. Python 3.11 with scikit-learn <xref ref-type="bibr" rid="ref-56">[54]</xref> fits every GP surrogate, runs execute on a single 16-core, 64-GB workstation, and token accounting follows Section 5.2. Complete prompts, raw logs, and per-run transcripts are retained for release so that the generative component of every reported number can be audited.</p>
</sec>
<sec id="sec-27"><label>6.4</label><title>Results: Quality per Budget</title>
<p>Final quality first. GAS-BFO attains the best mean gap on 22 of the thirty-six problem-tier cells, 8 of the twelve rows of <xref ref-type="table" rid="tab4">Table 4</xref> at the reference tier. The concessions are themselves informative: OPRO takes Hartmann-3D at 400 and 900, where a compact textual history saturates a three-dimensional landscape, and Michalewicz-10D at 900; BO-EI takes the Ackley-20D and shifted-Zakharov cells at 150 and 400, where a GP amortizes smooth breadth faster than a swarm can cascade; TPE takes the mixed-space tuning case at 400 and 900, where its native split densities handle integer and logarithmic dimensions without encodings; ReEvo takes Levy-10D and the airfoil case at 900, the tier where its reflective loop has budget to converge; BO-UCB takes two starved 150-tier cells and SMAC3 one. Averaged over the mathematical suite, the mean relative improvement of GAS-BFO over the strongest rival per cell is 19.1% at 150, 26.3% at 400, and 17.5% at 900. The engineering cases split at the reference tier: The airfoil returns +28.0% against the strongest rival, while the tuning case concedes 31.4% to TPE, and at 900 the airfoil concedes 29.4% to ReEvo and the tuning case 29.1% to TPE, concessions the ledger records rather than hides. <xref ref-type="table" rid="tab4">Table 4</xref> reports the 400-evaluation ledger for the six methods that matter most.</p>
<table-wrap id="tab4"><label>Table 4</label><caption><p>Final best-fitness (mean ± standard deviation over 30 runs) at the 400-evaluation tier.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:14:66,261.6,537.1,413.3"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Mathematical benchmarks are reported as the gap to the known optimum; the tuning case as log-loss gap; the airfoil case as drag-count gap. GAS-BFO holds the best mean on 8 of the twelve rows; OPRO takes Hartmann-3D, BO-EI Ackley-20D and Zakharov-20D, and TPE the tuning case.</p>
<p>Survival is the primary audit, and <xref ref-type="fig" rid="fig1">Fig. 1</xref> draws it on Hartmann-6D at the 400-evaluation tier: the probability that a run has not yet reached the target gap, against evaluations spent. The GAS-BFO curve falls first and furthest, with 89% of runs reaching the target inside the tier, against 11% for OPRO, 25% for ReEvo, 18% for BO-EI, and 8% for TPE; vanilla BFO and random search barely leave the ceiling. The separation is not a late-budget artifact: The GAS-BFO curve crosses below every rival&apos;s within the first quarter of the tier, immediately after the swarm&apos;s first condensation events, the timing of the cadence sweep of Section 6.5 prices. The probability that a run has not yet reached the fixed target gap, versus true evaluations spent (30 runs per curve). The GAS-BFO curve separates from every rival within the first quarter of the tier, immediately after the swarm&apos;s first condensation events.</p>
<fig id="fig1"><label>Figure 1</label><caption><p>Time-to-target survival on Hartmann-6D at the 400-evaluation tier.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/80/fig-1-dd0f2b653604.jpg"/></fig>
<p>The pooled log-rank family formalizes the picture, and <xref ref-type="table" rid="tab5">Table 5</xref> reports it at the 400-evaluation tier: The test statistic, the Holm-adjusted p over the thirteen comparisons, the Cox hazard ratio of each rival relative to GAS-BFO with its 95% confidence interval, and the Cliff&apos;s delta <xref ref-type="bibr" rid="ref-19">[19]</xref> on final gaps. All thirteen contrasts are significant at family-wise α = 0.05, the weakest at adjusted p = 0.000. Hazard ratios price the separation: BO-EI&apos;s hazard of reaching the target is 0.12 times GAS-BFO&apos;s, TPE&apos;s 0.07, and random search&apos;s 0.044, with confidence intervals excluding one throughout. Significance is not uniform: The same family concedes fourteen cells to rivals in the quality ledger, and the Cliff&apos;s deltas, between +0.24 and +0.73, price the per-cell texture that the pooled hazard smooths over. At the 900-evaluation tier, all thirteen contrasts remain significant, the language-model rivals having closed part of the gap, ReEvo&apos;s hazard 0.30, OPRO&apos;s 0.19; and the starved 150-evaluation tier retains full significance, thirteen of thirteen, the tier-relative targets keeping events observable where an absolute target would have starved them.</p>
<table-wrap id="tab5"><label>Table 5</label><caption><p>Survival comparison of GAS-BFO against the thirteen rivals at the 400-evaluation tier.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:15:66,156.2,537.1,326.6"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Pooled log-rank statistic (twelve problems, 30 runs per cell), Holm-adjusted p over the thirteen-comparison family, Cox hazard ratio of the rival relative to GAS-BFO with 95% confidence interval (hazard below one favors GAS-BFO), Schoenfeld PH check with restricted-mean-survival-time fallback, and Cliff&apos;s delta <xref ref-type="bibr" rid="ref-19">[19]</xref> on final gaps.</p>
<p>Two readings deserve emphasis: 1) the FunSearch contrast trips the proportional-hazards check, its hazard is front-loaded and then flat, so the pre-registered fallback prices it as a restricted mean survival time 42.3 evaluations shorter than GAS-BFO&apos;s over the 400-evaluation horizon; the ranking is unchanged but the mechanism differs, program-space search either finds structure early or stalls, exactly the bimodality the Schoenfeld residuals expose, and 2) the win over BFO+GP, hazard 0.04 and delta +0.53, isolates the communication layer: Both systems share the surrogate, the gating, and the population dynamics, and only the LLM condensation of the swarm&apos;s evidence into a pheromone field divides them.</p>
</sec>
<sec id="sec-28"><label>6.5</label><title>Results: Ablations</title>
<p>Five variants strip one communication component at a time on Hartmann-6D at the 400-evaluation tier, thirty runs each. The first removes the hallucination guard. The second removes self-consistency, leaving k = 1 greedy single-sample condensation. The third removes collective memory, so the condensation sees only the current iteration&apos;s posts. The fourth replaces the LLM with random aggregation, drawing random region weights and centers from the salience view. The fifth is the stripped floor with all generative components disabled, the surrogate-assisted BFO that coincides with the BFO+GP baseline. <xref ref-type="table" rid="tab6">Table 6</xref> and <xref ref-type="fig" rid="fig2">Fig. 2</xref> report mean gaps at tier end, together with the movement-relevant information of the pheromone field, in bits, from the estimator of Section 4.3.</p>
<table-wrap id="tab6"><label>Table 6</label><caption><p>Ablation of communication components on Hartmann-6D at the 400-evaluation tier (mean gap to optimum at tier end, 30 runs), with the mean movement-relevant information of the resulting pheromone field.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:16:66,430,537.1,521.5"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<fig id="fig2"><label>Figure 2</label><caption><p>Ablation of communication components on Hartmann-6D at the 400-evaluation tier.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/80/fig-2-00e951910055.jpg"/></fig>
<p>Mean gap to optimum at tier end over 30 runs. The floor coincides with the BFO+GP baseline; the pheromone information column of <xref ref-type="table" rid="tab6">Table 6</xref> prices each variant&apos;s field.</p>
<p>The ordering is monotone and instructive. Removing the guard cost 0.157 in gap: unchecked, occasionally fluent, wrong regions measurably redirected the swarm. Removing self-consistency billed a further 0.041, confirming that majority voting over samples suppresses idiosyncratic condensations. Removing collective memory left a gap of 0.30, because with only instantaneous evidence the field degenerates toward noise-following, and the field&apos;s information content collapsed from 0.42 to 0.15 bits. Random aggregation landed at 0.35 with 0.09 bits, and the floor at 0.48 with zero pheromone information by construction. Read jointly, the surrogate layer and the pheromone channel each supplied roughly half the total gap reduction, and the information column prices the channel itself.</p>
<p>Two sweeps grade the protocol&apos;s remaining dials. Condensation cadence, the number of iterations between pheromone rebuilds, was swept over {5, 10, 20} on the same flagship cell: mean gaps of 0.06, 0.06, and 0.12. Cadence 5 buys an 8% quality gain over the default for double the condensation calls, and cadence 20 costs 84%; the default of 10 sits at the knee of the quality-per-token curve, the cost-normalized optimum the budget manager enforces. Swarm size was swept over {10, 20, 30, 40} at all three tiers: At the starved 150-evaluation tier, twenty agents beat thirty, 0.31 against 0.36, because each true evaluation is shared across agents and a smaller swarm spends its share sooner; at 400 and 900 the ordering flips, thirty best at 0.06 and 0.02, forty crowding past the optimum, 0.09 and 0.02. The default of thirty is the budget-aware compromise, and the tier dependence is the reason the swarm-size discussion belongs to the budget ledger rather than to a fixed hyperparameter table.</p>
</sec>
<sec id="sec-29"><label>6.6</label><title>Results: Token and Compute Economics</title>
<p><xref ref-type="table" rid="tab7">Table 7</xref> reports the measured cost side, tier by tier, means over the mathematical suite. Token counts scale with tier because condensation events accrue: The prompt share held stable at 82-85% throughout, the self-consistency ensemble dominates the completion side, and the tuning case bills 35% more tokens than the mathematical mean, its mixed-space digests running longer, with the airfoil 18% above. The LLM quartet&apos;s own ledgers, at the 400-evaluation tier: OPRO 58k prompt and 6k completion tokens at $0.38 per run, ReEvo 294k and 31k at $1.52, EoH 261k and 28k at $1.38, and FunSearch 312k and 34k at $1.62, so GAS-BFO&apos;s $1.29 sits second cheapest among the five language-channel methods while holding the best survival record.</p>
<table-wrap id="tab7"><label>Table 7</label><caption><p>Token and compute economics per run (means over the mathematical suite by tier; engineering cases at the 400-evaluation tier).</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:17:66,348.6,537.1,428.9"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>API latency, not local computation, dominates the wall-clock overhead, which ranges from 1.8 to 3.1 times BO-EI&apos;s.</p>
<p>The economics favor the method exactly where it is meant to be deployed. Under the thirty-second evaluation floor, the 400-evaluation tier spends at least 3.3 hours evaluating; the LLM adds between 12 and 32 minutes and one to three dollars. Expressed through Eq. (14), the airfoil case purchased a 28.0% gap reduction for US$1.5-2.6 of guidance per run, less than the cost of the handful of evaluations it saves, and GAS-BFO reaches at roughly 250 evaluations the final gap BO-EI attains at 400 on the mathematical suite, a saving of about 150 evaluations, seventy-five minutes at the floor. The converse deserves equal stress: On cheap problems the overhead is pure loss, plain BO costs nothing per run and remains the right tool, and the boundary is a deployment decision the cost model prices openly.</p>
</sec>
<sec id="sec-30"><label>6.7</label><title>Communication Stress: Message Dropout and Latency</title>
<p>Stigmergic coordination lives or dies on its communication channel, and real channels lose and delay messages. Swarm engineering books dropped and delayed messages as a first-class design constraint rather than an afterthought <xref ref-type="bibr" rid="ref-57">[55]</xref>, and networked multi-agent theory ties consensus quality directly to the reliability of the link layer <xref ref-type="bibr" rid="ref-58">[56]</xref>. This experiment turns that lens on the pheromone channel. Two stressors are injected, separately and in combination. Bursty message dropout follows a two-state Gilbert-Elliott model, a good state with mean sojourn of eight ticks and a bad state with mean sojourn of three, whose bad-state occupancy sets the steady-state loss rate p in {0, 0.2, 0.4, 0.6}; a bursty model is harsher than independent coin flips because losses arrive in runs that punch holes in the collective memory. A pheromone-write latency of {0, 2, 5} ticks delays each write before it becomes visible, so agents act on fields assembled from stale evidence.</p>
<p>The protocol holds every other knob fixed on Hartmann-6D at the 400-evaluation tier. Dropout and latency act only on pheromone writes; the budget manager, the GP surrogate, the hallucination guard, and the acquisition gate run unchanged. For each configuration, final best-fitness is measured against the mean of the lossless configuration for the same method, and the ratio is reported as a percentage, 100% meaning the stressor cost nothing. Thirty independent runs price each cell, and the reference methods run through the identical harness, stress levied on their observation updates, so the comparison prices channel redundancy rather than implementation luck.</p>
<p><xref ref-type="table" rid="tab8">Table 8</xref> and <xref ref-type="fig" rid="fig3">Fig. 3</xref> report the retention ledger. GAS-BFO retained 97.2% of lossless quality at p = 0.2, 90.8% at p = 0.4, and 79.4% at p = 0.6, against 84.6%, 63.7%, and 41.2% for BO-EI over the same grid; the gap widens monotonically with loss, from 12.6 to 38.2 percentage points. Latency acted more gently on its own: At loss 0.2, a five-tick write latency alone left GAS-BFO at 91.7% against 74.8% for BO-EI. The combined worst cell, p = 0.6 with five-tick latency, left 68.9% retention for GAS-BFO against 33.4% for BO-EI.</p>
<table-wrap id="tab8"><label>Table 8</label><caption><p>Retention of final solution quality under bursty Gilbert-Elliott pheromone message dropout (Hartmann-6D, 400-evaluation tier, 30 runs.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:18:66,423.3,537.1,526.1"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>*Retention relative to each method&apos;s lossless mean) and under write latency at loss 0.2. Reference methods are stressed on their observation updates through the identical harness.</p>
<fig id="fig3"><label>Figure 3</label><caption><p>Retention of final solution quality under bursty Gilbert-Elliott pheromone-message dropout (Hartmann-6D, 400-evaluation tier, 30 runs).</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/80/fig-3-15f2b1715789.jpg"/></fig>
<p>The swarm&apos;s amortized knowledge tolerates runs of losses that single-model and single-history rivals cannot. The mechanism mirrors the distributional-shift result of Section 7. BO-EI concentrates its knowledge in one GP posterior, so every dropped or delayed observation distorts the single model that drives acquisition, and OPRO&apos;s single textual history is one long message chain with the same fragility. GAS-BFO amortizes knowledge across thirty agents and a capped log, and the condensation service tolerates holes: Region summaries aggregate hundreds of posts, so a burst of losses thins the evidence without flipping the summary. The hallucination guard adds a second line of defense, and when punctured evidence misleads the field, cue-surrogate agreement drops, tumble probabilities rise, and the swarm falls back toward local evidence, the fail-safe of Eq. (6). Latency hurts less than dropout because late evidence is still correct evidence, and the operational reading is that a deployment tolerating 79% retention can absorb a 60% bursty loss rate on the pheromone channel without redesign.</p>
</sec>
</sec>
<sec id="sec-31"><label>7</label><title>Robustness under Distributional Shift</title>
<p>Expensive campaigns rarely evaluate exactly the function they were designed for: Operating conditions drift, simulators are reconfigured, and the underlying data distribution moves. Resilience is therefore tested with the objective&apos;s parameters shifting between the surrogate&apos;s training phase and the exploitation phase, following the dataset-shift perspective <xref ref-type="bibr" rid="ref-59">[57]</xref>. Each benchmark exposes a parameter vector θ, such as the Hartmann attraction weights, the rotation of Rastrigin, the optimum offsets of Levy and Ackley, or the bump amplitudes of the airfoil response. A run first spends its initial design on the unshifted function; the true function is then exchanged for a shifted variant. The controlled divergence is:</p>
<p>fr te</p>
<p>1 θj − θj</p>
<p>tr te (15)</p>
<p>Dshift (θ , θ ) = ( ∑ ( ) ) , m rj</p>
<p>where r_j is the admissible range of parameter j and the superscripts distinguish training and test parameters. Shift magnitudes Δ of 0.25, 0.5, and 1.0 set the divergence to those levels. Degradation is measured as the relative increase in each method&apos;s own final gap versus its unshifted performance, averaged over the ten mathematical benchmarks and thirty runs at the 400-evaluation tier. This within-method normalization asks how much of its own quality a method retains, not which method starts ahead.</p>
<p>The result, in <xref ref-type="fig" rid="fig4">Fig. 4</xref> and <xref ref-type="table" rid="tab9">Table 9</xref>, is a marked separation with a new lesson for the language-model lineage. At Δ = 0.25, GAS-BFO&apos;s quality degraded 7.9% on average, against 22.7% for BO-EI, 26.1% for TPE, and 31.2% for OPRO; at Δ = 1.0 the contrast widened to 28.4% against 71.8%, 79.5%, and 84.1%, with ReEvo at 76.3%, SMAC3 at 82.9%, and budget-restricted CMA-ES suffering most at 97.2%, its covariance adaptation holding no mechanism at all for representing that the world changed. The LLM quartet degrades more than the swarm in every cell, a tax on their long textual histories: A prompt full of pre-shift triples is a stale prior in plain language, and OPRO&apos;s history has no forgetting rule.</p>
<table-wrap id="tab9"><label>Table 9</label><caption><p>Quality degradation under controlled distributional shift.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:19:66,263.8,537.1,321.6"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Relative increase in final gap versus each method&apos;s own unshifted performance, averaged over the ten mathematical benchmarks at the 400-evaluation tier (30 runs).</p>
<fig id="fig4"><label>Figure 4</label><caption><p>Quality degradation under controlled distributional shift.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/80/fig-4-d1e959508319.jpg"/></fig>
<p>Relative increase in final gap versus each method&apos;s own unshifted performance, averaged over the ten mathematical benchmarks at the 400-evaluation tier. The language-model single-history rivals pay a stale-prior tax on top of the Bayesian posterior&apos;s anchor cost.</p>
<p>The architecture makes the mechanism readable. A GP posterior is anchored to the density of its training inputs, so under shift its confidence sits exactly where the optimum has moved, and EI keeps buying evaluations in the wrong region until the evidence slowly drags the posterior along. GAS-BFO degrades more gracefully for three compounding reasons. The pheromone summaries are qualitative, and a hypothesis such as a valley along dimensions 2 through 4 survives moderate parameter shifts better than an interpolating surface does. The FIFO memory enforces forgetting, so the field tracks recent, post-shift evidence within at most 500 entries, the same amortization that carried the dropout study. And the hallucination guard detects cue-surrogate disagreement automatically, raising tumble rates and exploration precisely when the two knowledge channels diverge, which is exactly the signature of a shifted objective.</p>
</sec>
<sec id="sec-32"><label>8</label><title>Scope, Limitations, and Validity Threats</title>
<p>The foremost internal threat is that a component of the optimizer is a black-box service. Four bounds contain it. Decoding runs at temperature 0 everywhere outside the self-consistency ensemble. A model version is pinned and recorded per run. Seeds are fixed for all local stochasticity. Complete transcripts are retained for release. Even so, provider-side changes remain possible over time. The residual nondeterminism was priced directly. Five repetitions of the identical seeded configuration on Hartmann-6D produced final gaps within ±0.006 of each other, which bounds the API&apos;s contribution to variance below the seed-level dispersion. Self-consistency averaging plausibly suppresses rather than inflates the run-to-run standard deviations reported in <xref ref-type="table" rid="tab4">Table 4</xref>, 0.014 against BO-EI&apos;s 0.058 on Hartmann-6D. But smaller is not zero, and replication on a different model family remains future work <xref ref-type="bibr" rid="ref-15">[15]</xref>.</p>
<p>Prompt sensitivity is the second internal threat. The condensation prompt was iterated on a development split, consisting of a two-dimensional Levy function and a held-out trigonometric function, and frozen before the evaluation runs. Three post-hoc paraphrases of the frozen prompt moved the mean Hartmann-6D gap only within the range 0.058 to 0.069 and preserved every reported ordering. Prompt optimality remains unclaimed, and the field lacks settled methodology for validating prompt-based components. The mitigations booked here are freezing and full disclosure, not invariance.</p>
<p>Construct validity is limited by design choices in the engineering cases. Both are simulated: A real XGBoost pipeline with an imposed evaluation cost, and an analytic drag-like response standing in for CFD. They exercise the optimizer&apos;s budget and communication behavior faithfully. Claims about aerodynamic practice, however, would require a genuine simulation campaign, and the thirty-second evaluation floor is optimistic for industrial workflows. The suite is also synthetic at heart, twelve problems with known or constructed optima, and the no-free-lunch caveat binds these conclusions as it binds anyone&apos;s <xref ref-type="bibr" rid="ref-23">[22]</xref>.</p>
<p>A subtle threat specific to LLM-based optimizers is memorization: The model might recognize a famous benchmark and recall its optimum. The protocol never discloses a function&apos;s name. Positions are reported as rounded unit-box values without domain mapping. The shift study of Section 7 moves the optima, and the degradation pattern observed there is also inconsistent with recalled solutions. The memorization risk prices out as low but not formally zero, and the prompts are released so that others can probe it <xref ref-type="bibr" rid="ref-45">[43]</xref>.</p>
<p>Statistical validity rests on 30 runs per cell, which supports the reported log-rank family but leaves third-order interactions underpowered, and the 150-evaluation tier thins event counts enough that two contrasts there lose significance without reversing. The Cox model&apos;s proportional-hazards assumption is checked per contrast, and its pre-registered fallback, restricted mean survival time, prices the one violator openly. Cliff&apos;s delta on final gaps complements the survival reading because the two instruments price different things: the speed of success and the quality at budget end <xref ref-type="bibr" rid="ref-19">[19]</xref>. External validity is bounded by one model family, one provider&apos;s latency profile, and the study period&apos;s pricing. The dollar figures should be booked as order-of-magnitude estimates, and the token counts as specific to the pinned model version. Operationally, bounded retries with exponential backoff absorb transient API failures, and a run-level cost cap converts sustained outages into graceful degradation rather than silent corruption.</p>
</sec>
<sec id="sec-33"><label>9</label><title>Conclusions and Future Directions</title>
<p>This paper asked whether the pheromone of a swarm optimizer can be minted from language, and answered with a system, an evaluation, and a cost accounting. GAS-BFO keeps the population dynamics of bacterial foraging and swaps the numeric pheromone channel for an LLM-mediated one. Agents post structured observations to a capped collective memory. Periodic condensations compile that memory into a weighted chemoattractant field that biases chemotaxis alongside a Gaussian-process surrogate. The design is cost-aware, with acquisition-gated evaluations and programmatic authoring; guarded, with surrogate cross-checks of every directional cue; and auditable, with every field parameter traceable to ledger entries.</p>
<p>Across three budget tiers, the communication layer earns its keep. GAS-BFO held the best mean gap on 22 of the 36 problem-tier cells and reached the tier-relative target gap with the highest probability at every tier, with Holm-corrected log-rank significance against all thirteen rivals at the 400- and 900-evaluation tiers. The engineering cases split at the reference tier, +28.0% on the airfoil against the strongest rival and a 31.4% concession to TPE on the mixed-space tuning task, whose native split densities need no encoding; ReEvo took the airfoil and Levy cells at 900, OPRO the low-dimensional Hartmann cells, concessions the ledger records rather than hides. It also degraded far more slowly than both the Bayesian baselines and the language-model single-history rivals under controlled distributional shift, and it retained 79.4% of lossless quality under a 60% bursty loss rate where BO-EI retained 41.2%. The ablations book the gain to generative condensation, collective memory, and self-consistency rather than to the surrounding machinery. The token tables state the price: Roughly 241k prompt and 26k completion tokens and one to three dollars per run at deployment tiers. That is a small fraction of the cost of the evaluations the method saves.</p>
<p>Future work runs in four directions. Replacing the remote API with local open-weight models would cut latency and spend and remove the provider-dependence documented in Section 8. Extending the observation schema to multimodal artifacts, such as contour renderings of the surrogate, would let the condensation reason about shape rather than only numbers. Constrained and mixed-space problems are a natural next domain, because language summaries of feasibility structure may yield where constraints fragment the landscape. Finally, the information-theoretic view of Section 4.3 invites a formal treatment of when a compressed stigmergic summary preserves enough of a swarm&apos;s information to coordinate search. The biological colonies that inspired this work never had to answer that question.</p>
</sec>
<sec id="sec-34"><title>Authors&apos; Contributions</title>
<p>All aspects of the research and manuscript preparation were carried out by the author. The author has read and approved the final version of the manuscript.</p>
</sec>
<sec id="sec-35"><title>Funding</title>
<p>Not applicable.</p>
</sec>
<sec id="sec-36"><title>Data Availability</title>
<p>All data supporting the reported findings in this research paper are provided within the manuscript.</p>
</sec>
<sec id="sec-37"><title>Conflict of Interest</title>
<p>The author declares that they do not have any conflict of interest.</p>
</sec>
<sec id="sec-38"><title>Consent for Publication</title>
<p>The author confirms consent for the publication of this work.</p>
</sec>
<sec id="sec-39"><title>Ethics Approval and Consent to Participate</title>
<p>This article does not contain any studies with human participants performed by the author.</p>
</sec>
</body>
<back><ref-list><title>References</title>
<ref id="ref-1"><label>1</label><mixed-citation>Sacks, J., Welch, W. J., Mitchell, T. J., &amp; Wynn, H. P. (1989). Design and analysis of computer experiments. Statistical Science, 4(4), 409–423. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1214/ss/1177012413">https://doi.org/10.1214/ss/1177012413</ext-link></mixed-citation></ref>
<ref id="ref-2"><label>2</label><mixed-citation>Jones, D. R., Schonlau, M., &amp; Welch, W. J. (1998). Efficient global optimization of expensive black-box functions. Journal of Global Optimization, 13(4), 455–492. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1023/A:1008306431147">https://doi.org/10.1023/A:1008306431147</ext-link></mixed-citation></ref>
<ref id="ref-3"><label>3</label><mixed-citation>Snoek, J., Larochelle, H., &amp; Adams, R. (2012). Practical bayesian optimization of machine learning algorithms. Advances in Neural Information Processing Systems, 25. <ext-link ext-link-type="uri" xlink:href="https://proceedings.neurips.cc/paper_files/paper/2012/hash/05311655a15b75fab86956663e1819cd-Abstract.html">https://proceedings.neurips.cc/paper_files/paper/2012/hash/05311655a15b75fab86956663e1819cd-Abstract.html</ext-link></mixed-citation></ref>
<ref id="ref-4"><label>4</label><mixed-citation>Mockus, J. (1989). Bayesian approach to global optimization: Theory and applications. Kluwer Academic Publishers. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-94-009-0909-0">https://doi.org/10.1007/978-94-009-0909-0</ext-link></mixed-citation></ref>
<ref id="ref-5"><label>5</label><mixed-citation>Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., &amp; De Freitas, N. (2015). Taking the human out of the loop: A review of Bayesian optimization. Proceedings of the IEEE, 104(1), 148–175. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/JPROC.2015.2494218">https://doi.org/10.1109/JPROC.2015.2494218</ext-link></mixed-citation></ref>
<ref id="ref-6"><label>6</label><mixed-citation>Holland, J. H. (1975). Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence. University of Michigan Press. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.7551/mitpress/1090.001.0001">https://doi.org/10.7551/mitpress/1090.001.0001</ext-link></mixed-citation></ref>
<ref id="ref-7"><label>7</label><mixed-citation>Kennedy, J., &amp; Eberhart, R. (1995). Particle swarm optimization. Proceedings of ICNN&apos;95-international conference on neural networks (Vol. 4, pp. 1942-1948). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ICNN.1995.488968">https://doi.org/10.1109/ICNN.1995.488968</ext-link></mixed-citation></ref>
<ref id="ref-8"><label>8</label><mixed-citation>Passino, K. M. (2002). Biomimicry of bacterial foraging for distributed optimization and control. IEEE Control Systems Magazine, 22(3), 52–67. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/MCS.2002.1004010">https://doi.org/10.1109/MCS.2002.1004010</ext-link></mixed-citation></ref>
<ref id="ref-9"><label>9</label><mixed-citation>Hansen, N., &amp; Ostermeier, A. (2001). Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation, 9(2), 159–195. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1162/106365601750190398">https://doi.org/10.1162/106365601750190398</ext-link></mixed-citation></ref>
<ref id="ref-10"><label>10</label><mixed-citation>Grassé, P. P. (1959). La reconstruction du nid et les coordinations interindividuelles chez Bellicositermes natalensis et Cubitermes sp. la théorie de la stigmergie: Essai d&apos;interprétation du comportement des termites constructeurs. Insectes Sociaux, 6(1), 41-80. (In French). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/BF02223791">https://doi.org/10.1007/BF02223791</ext-link></mixed-citation></ref>
<ref id="ref-11"><label>11</label><mixed-citation>Dorigo, M., Maniezzo, V., &amp; Colorni, A. (1996). Ant system: Optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 26(1), 29–41. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/3477.484436">https://doi.org/10.1109/3477.484436</ext-link></mixed-citation></ref>
<ref id="ref-12"><label>12</label><mixed-citation>Bonabeau, E., Dorigo, M., &amp; Theraulaz, G. (1999). Swarm intelligence: From natural to artificial systems. New York: Oxford University Press. <ext-link ext-link-type="uri" xlink:href="https://dl.acm.org/doi/10.5555/328320">https://dl.acm.org/doi/10.5555/328320</ext-link></mixed-citation></ref>
<ref id="ref-13"><label>13</label><mixed-citation>Theraulaz, G., &amp; Bonabeau, E. (1999). A brief history of stigmergy. Artificial Life, 5(2), 97-116. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1162/106454699568700">https://doi.org/10.1162/106454699568700</ext-link></mixed-citation></ref>
<ref id="ref-14"><label>14</label><mixed-citation>Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., ... &amp; Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877-1901. <ext-link ext-link-type="uri" xlink:href="https://proceedings.neurips.cc/paper_files/paper/2020/hash/1457c0d6bfcb4967418bfb8ac142f64a-Abstract.html">https://proceedings.neurips.cc/paper_files/paper/2020/hash/1457c0d6bfcb4967418bfb8ac142f64a-Abstract.html</ext-link></mixed-citation></ref>
<ref id="ref-15"><label>15</label><mixed-citation>Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., ... &amp; McGrew, B. (2023). Gpt-4 technical report. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.2303.08774">https://doi.org/10.48550/arXiv.2303.08774</ext-link></mixed-citation></ref>
<ref id="ref-16"><label>16</label><mixed-citation>Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., ... &amp; Lowe, R. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35, 27730-27744. <ext-link ext-link-type="uri" xlink:href="https://proceedings.neurips.cc/paper_files/paper/2022/hash/b1efde53be364a73914f58805a001731-Abstract.html">https://proceedings.neurips.cc/paper_files/paper/2022/hash/b1efde53be364a73914f58805a001731-Abstract.html</ext-link></mixed-citation></ref>
<ref id="ref-17"><label>17</label><mixed-citation>Park, J. S., O’Brien, J., Cai, C. J., Morris, M. R., Liang, P., &amp; Bernstein, M. S. (2023). Generative agents: Interactive simulacra of human behavior. Proceedings of the 36th annual ACM symposium on user interface software and technology (pp. 1–22). Association for Computing Machinery. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3586183.3606763">https://doi.org/10.1145/3586183.3606763</ext-link></mixed-citation></ref>
<ref id="ref-18"><label>18</label><mixed-citation>Yang, C., Wang, X., Lu, Y., Liu, H., Le, Q. V., Zhou, D., &amp; Chen, X. (2024). Large language models as optimizers. International conference on learning representations (Vol. 2024, pp. 12028-12068). ICLR. <ext-link ext-link-type="uri" xlink:href="https://proceedings.iclr.cc/paper_files/paper/2024/hash/3339f19c5fcee3ad74502947a32be9e6-Abstract-Conference.html">https://proceedings.iclr.cc/paper_files/paper/2024/hash/3339f19c5fcee3ad74502947a32be9e6-Abstract-Conference.html</ext-link></mixed-citation></ref>
<ref id="ref-19"><label>19</label><mixed-citation>Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114(3), 494. <ext-link ext-link-type="uri" xlink:href="https://psycnet.apa.org/doi/10.1037/0033-2909.114.3.494">https://psycnet.apa.org/doi/10.1037/0033-2909.114.3.494</ext-link></mixed-citation></ref>
<ref id="ref-20"><label>20</label><mixed-citation>Liu, Y., &amp; Passino, K. M. (2002). Biomimicry of social foraging bacteria for distributed optimization: Models, principles, and emergent behaviors. Journal of Optimization Theory and Applications, 115(3), 603–</mixed-citation></ref>
<ref id="ref-21"><label>628</label><mixed-citation><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1023/A:1021207331209">https://doi.org/10.1023/A:1021207331209</ext-link></mixed-citation></ref>
<ref id="ref-22"><label>21</label><mixed-citation>Das, S., Biswas, A., Dasgupta, S., &amp; Abraham, A. (2009). Bacterial foraging optimization algorithm: Theoretical foundations, analysis, and applications. In Foundations of computational intelligence volume 3: Global optimization (pp. 23–55). Springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-3-642-01085-9_2">https://doi.org/10.1007/978-3-642-01085-9_2</ext-link></mixed-citation></ref>
<ref id="ref-23"><label>22</label><mixed-citation>Wolpert, D. H., &amp; Macready, W. G. (1997). No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation, 1(1), 67–82. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/4235.585893">https://doi.org/10.1109/4235.585893</ext-link></mixed-citation></ref>
<ref id="ref-24"><label>23</label><mixed-citation>Liu, S., Chen, C., Qu, X., Tang, K., &amp; Ong, Y. S. (2024). Large language models as evolutionary optimizers. 2024 IEEE congress on evolutionary computation (CEC) (pp. 1-8). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/CEC60901.2024.10611913">https://doi.org/10.1109/CEC60901.2024.10611913</ext-link></mixed-citation></ref>
<ref id="ref-25"><label>24</label><mixed-citation>Van Stein, N., &amp; Bäck, T. (2024). Llamea: A large language model evolutionary algorithm for automatically generating metaheuristics. IEEE Transactions on Evolutionary Computation, 29(2), 331–345. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TEVC.2024.3497793">https://doi.org/10.1109/TEVC.2024.3497793</ext-link></mixed-citation></ref>
<ref id="ref-26"><label>25</label><mixed-citation>Romera-Paredes, B., Barekatain, M., Novikov, A., Balog, M., Kumar, M. P., Dupont, E., ... &amp; Fawzi, A. (2024). Mathematical discoveries from program search with large language models. Nature, 625(7995), 468-</mixed-citation></ref>
<ref id="ref-27"><label>475</label><mixed-citation><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1038/s41586-023-06924-6">https://doi.org/10.1038/s41586-023-06924-6</ext-link></mixed-citation></ref>
<ref id="ref-28"><label>26</label><mixed-citation>Liu, F., Tong, X., Yuan, M., Lin, X., Luo, F., Wang, Z., … &amp; Zhang, Q. (2024). Evolution of heuristics: Towards efficient automatic algorithm design using large language model. Proceedings of the 41st international conference on machine learning (Vol. 235, pp. 32201–32223). PMLR. <ext-link ext-link-type="uri" xlink:href="https://dl.acm.org/doi/abs/10.5555/3692070.3693374">https://dl.acm.org/doi/abs/10.5555/3692070.3693374</ext-link></mixed-citation></ref>
<ref id="ref-29"><label>27</label><mixed-citation>Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., ... &amp; Zhou, D. (2022). Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35, 24824-24837. <ext-link ext-link-type="uri" xlink:href="https://proceedings.neurips.cc/paper_files/paper/2022/hash/9d5609613524ecf4f15af0f7b31abca4-Abstract.html">https://proceedings.neurips.cc/paper_files/paper/2022/hash/9d5609613524ecf4f15af0f7b31abca4-Abstract.html</ext-link></mixed-citation></ref>
<ref id="ref-30"><label>28</label><mixed-citation>Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., ... &amp; Zhou, D. (2022). Self-consistency improves chain of thought reasoning in language models. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.2203.11171">https://doi.org/10.48550/arXiv.2203.11171</ext-link></mixed-citation></ref>
<ref id="ref-31"><label>29</label><mixed-citation>Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., &amp; Cao, Y. (2022). React: Synergizing reasoning and acting in language models. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.2210.03629">https://doi.org/10.48550/arXiv.2210.03629</ext-link></mixed-citation></ref>
<ref id="ref-32"><label>30</label><mixed-citation>Williams, C. K. I., &amp; Rasmussen, C. E. (2006). Gaussian processes for machine learning. The MIT Press. <ext-link ext-link-type="uri" xlink:href="https://gaussianprocess.org/gpml/chapters/RW.pdf">https://gaussianprocess.org/gpml/chapters/RW.pdf</ext-link></mixed-citation></ref>
<ref id="ref-33"><label>31</label><mixed-citation>Gramacy, R. B., &amp; Lee, H. K. H. (2012). Cases for the nugget in modeling computer experiments. Statistics and Computing, 22(3), 713–722. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s11222-010-9224-x">https://doi.org/10.1007/s11222-010-9224-x</ext-link></mixed-citation></ref>
<ref id="ref-34"><label>32</label><mixed-citation>Srinivas, N., Krause, A., Kakade, S. M., &amp; Seeger, M. (2009). Gaussian process optimization in the bandit setting: No regret and experimental design. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TIT.2011.2182033">https://doi.org/10.1109/TIT.2011.2182033</ext-link></mixed-citation></ref>
<ref id="ref-35"><label>33</label><mixed-citation>Bergstra, J., Bardenet, R., Bengio, Y., &amp; Kégl, B. (2011). Algorithms for hyper-parameter optimization. Advances in Neural Information Processing Systems, 24. <ext-link ext-link-type="uri" xlink:href="https://proceedings.neurips.cc/paper_files/paper/2011/hash/86e8f7ab32cfd12577bc2619bc635690-Abstract.html">https://proceedings.neurips.cc/paper_files/paper/2011/hash/86e8f7ab32cfd12577bc2619bc635690-Abstract.html</ext-link></mixed-citation></ref>
<ref id="ref-36"><label>34</label><mixed-citation>Hutter, F., Hoos, H. H., &amp; Leyton-Brown, K. (2011). Sequential model-based optimization for general algorithm configuration. International conference on learning and intelligent optimization (pp. 507-523). Berlin, Heidelberg: Springer Berlin Heidelberg. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-3-642-25566-3_40">https://doi.org/10.1007/978-3-642-25566-3_40</ext-link></mixed-citation></ref>
<ref id="ref-37"><label>35</label><mixed-citation>Forrester, A., Sobester, A., &amp; Keane, A. (2008). Engineering design via surrogate modelling: A practical guide. John Wiley &amp; Sons. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/9780470770801">https://doi.org/10.1002/9780470770801</ext-link></mixed-citation></ref>
<ref id="ref-38"><label>36</label><mixed-citation>Wilson, E. O. (1975). Sociobiology: The new synthesis. Belknap Press of Harvard University Press. <ext-link ext-link-type="uri" xlink:href="https://books.google.com/books?id=PiQvj1Fc-jkC">https://books.google.com/books?id=PiQvj1Fc-jkC</ext-link></mixed-citation></ref>
<ref id="ref-39"><label>37</label><mixed-citation>Beni, G., &amp; Wang, J. (1993). Swarm intelligence in cellular robotic systems. In Robots and biological systems: Towards a new bionics? (pp. 703–712). Springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-3-642-58069-7_38">https://doi.org/10.1007/978-3-642-58069-7_38</ext-link></mixed-citation></ref>
<ref id="ref-40"><label>38</label><mixed-citation>Colorni, A., Dorigo, M., &amp; Maniezzo, V. (1992). Distributed optimization by ant colonies. Towards a practice of autonomous systems: Proceedings of the first European conference on artificial life (ECAL 91) (pp. 134–142). MIT Press. <ext-link ext-link-type="uri" xlink:href="https://faculty.washington.edu/paymana/swarm/colorni92-ecal.pdf">https://faculty.washington.edu/paymana/swarm/colorni92-ecal.pdf</ext-link></mixed-citation></ref>
<ref id="ref-41"><label>39</label><mixed-citation>Karaboga, D., &amp; others. (2005). An idea based on honey bee swarm for numerical optimization. <ext-link ext-link-type="uri" xlink:href="https://abc.erciyes.edu.tr/pub/tr06_2005.pdf">https://abc.erciyes.edu.tr/pub/tr06_2005.pdf</ext-link></mixed-citation></ref>
<ref id="ref-42"><label>40</label><mixed-citation>Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., ... &amp; Wang, C. (2023). Autogen: Enabling next-gen llm applications via multi-agent conversation. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.2308.08155">https://doi.org/10.48550/arXiv.2308.08155</ext-link></mixed-citation></ref>
<ref id="ref-43"><label>41</label><mixed-citation>Wooldridge, M. (2009). An introduction to multiagent systems. John Wiley &amp; Sons. <ext-link ext-link-type="uri" xlink:href="https://www.wiley.com/en-us/shop/general-introductory-computer-science/an-introduction-to-multiagent-systems-2nd-edition-p-9780470519462">https://www.wiley.com/en-us/shop/general-introductory-computer-science/an-introduction-to-multiagent-systems-2nd-edition-p-9780470519462</ext-link></mixed-citation></ref>
<ref id="ref-44"><label>42</label><mixed-citation>Cover, T. M., &amp; Thomas, J. A. (2006). Elements of information theory. Wiley-Interscience. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/047174882X">https://doi.org/10.1002/047174882X</ext-link></mixed-citation></ref>
<ref id="ref-45"><label>43</label><mixed-citation>Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., ... &amp; Liu, T. (2025). A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transactions on Information Systems, 43(2), 1-55. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3703155">https://doi.org/10.1145/3703155</ext-link></mixed-citation></ref>
<ref id="ref-46"><label>44</label><mixed-citation>Jamil, M., &amp; Yang, X. S. (2013). A literature survey of benchmark functions for global optimisation problems. International Journal of Mathematical Modelling and Numerical Optimisation, 4(2), 150–194. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1504/IJMMNO.2013.055204">https://doi.org/10.1504/IJMMNO.2013.055204</ext-link></mixed-citation></ref>
<ref id="ref-47"><label>45</label><mixed-citation>Chen, T., &amp; Guestrin, C. (2016). Xgboost: A scalable tree boosting system. Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (pp. 785-794). Association for Computing Machinery (ACM). <ext-link ext-link-type="uri" xlink:href="https://dl.acm.org/doi/proceedings/10.1145/2939672">https://dl.acm.org/doi/proceedings/10.1145/2939672</ext-link></mixed-citation></ref>
<ref id="ref-48"><label>46</label><mixed-citation>Cook, P. H., McDonald, M. A., &amp; Firmin, M. C. P. (1979). Aerofoil RAE 2822 pressure distributions and boundary layer measurements. <ext-link ext-link-type="uri" xlink:href="https://ntrs.nasa.gov/api/citations/20160005970/downloads/20160005970.pdf">https://ntrs.nasa.gov/api/citations/20160005970/downloads/20160005970.pdf</ext-link></mixed-citation></ref>
<ref id="ref-49"><label>47</label><mixed-citation>Lindauer, M., Eggensperger, K., Feurer, M., Biedenkapp, A., Deng, D., Benjamins, C., ... &amp; Hutter, F. (2022). SMAC3: A versatile Bayesian optimization package for hyperparameter optimization. Journal of Machine Learning Research, 23(54), 1-9. <ext-link ext-link-type="uri" xlink:href="https://www.jmlr.org/papers/v23/21-0888.html">https://www.jmlr.org/papers/v23/21-0888.html</ext-link></mixed-citation></ref>
<ref id="ref-50"><label>48</label><mixed-citation>Bergstra, J., &amp; Bengio, Y. (2012). Random search for hyper-parameter optimization. Journal of Machine Learning Research, 13(2), 282–305. <ext-link ext-link-type="uri" xlink:href="https://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf">https://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf</ext-link></mixed-citation></ref>
<ref id="ref-51"><label>49</label><mixed-citation>Ye, H., Wang, J., Cao, Z., Berto, F., Hua, C., Kim, H., ... &amp; Song, G. (2024). Reevo: Large language models as hyper-heuristics with reflective evolution. Advances in Neural Information Processing Systems, 37, 43571- 43608. <ext-link ext-link-type="uri" xlink:href="https://proceedings.neurips.cc/paper_files/paper/2024/hash/4ced59d480e07d290b6f29fc8798f195-Abstract-Conference.html">https://proceedings.neurips.cc/paper_files/paper/2024/hash/4ced59d480e07d290b6f29fc8798f195-Abstract-Conference.html</ext-link></mixed-citation></ref>
<ref id="ref-52"><label>50</label><mixed-citation>Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6(2), 65–70. <ext-link ext-link-type="uri" xlink:href="https://www.jstor.org/stable/4615733">https://www.jstor.org/stable/4615733</ext-link></mixed-citation></ref>
<ref id="ref-53"><label>51</label><mixed-citation>Wobbrock, J. O., Findlater, L., Gergle, D., &amp; Higgins, J. J. (2011). The aligned rank transform for nonparametric factorial analyses using only anova procedures. Proceedings of the SIGCHI conference on human factors in computing systems (pp. 143-146). Association for Computing Machinery (ACM). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/1978942.1978963">https://doi.org/10.1145/1978942.1978963</ext-link></mixed-citation></ref>
<ref id="ref-54"><label>52</label><mixed-citation>García, S., Molina, D., Lozano, M., &amp; Herrera, F. (2009). A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: A case study on the CEC’2005 special session on real parameter optimization. Journal of Heuristics, 15(6), 617-644. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10732-008-9080-4">https://doi.org/10.1007/s10732-008-9080-4</ext-link></mixed-citation></ref>
<ref id="ref-55"><label>53</label><mixed-citation>Derrac, J., García, S., Molina, D., &amp; Herrera, F. (2011). A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm and Evolutionary Computation, 1(1), 3-18. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.swevo.2011.02.002">https://doi.org/10.1016/j.swevo.2011.02.002</ext-link></mixed-citation></ref>
<ref id="ref-56"><label>54</label><mixed-citation>Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., … &amp; Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830. <ext-link ext-link-type="uri" xlink:href="https://www.jmlr.org/papers/v12/pedregosa11a.html">https://www.jmlr.org/papers/v12/pedregosa11a.html</ext-link></mixed-citation></ref>
<ref id="ref-57"><label>55</label><mixed-citation>Brambilla, M., Ferrante, E., Birattari, M., &amp; Dorigo, M. (2013). Swarm robotics: A review from the swarm engineering perspective. Swarm Intelligence, 7(1), 1–41. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s11721-012-0075-2">https://doi.org/10.1007/s11721-012-0075-2</ext-link></mixed-citation></ref>
<ref id="ref-58"><label>56</label><mixed-citation>Olfati-Saber, R., Fax, J. A., &amp; Murray, R. M. (2007). Consensus and cooperation in networked multi-agent systems. Proceedings of the IEEE, 95(1), 215–233. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/JPROC.2006.887293">https://doi.org/10.1109/JPROC.2006.887293</ext-link></mixed-citation></ref>
<ref id="ref-59"><label>57</label><mixed-citation>Quiñonero-Candela, J., Sugiyama, M., Schwaighofer, A., &amp; Lawrence, N. D. (2008). Dataset shift in machine learning. Mit Press. <ext-link ext-link-type="uri" xlink:href="https://mitpress.mit.edu/9780262170055/dataset-shift-in-machine-learning/">https://mitpress.mit.edu/9780262170055/dataset-shift-in-machine-learning/</ext-link></mixed-citation></ref>
</ref-list></back>
</article>