<?xml version="1.0" encoding="UTF-8"?>
<article xmlns:xlink="http://www.w3.org/1999/xlink">
<front><article-meta>
<title-group><article-title>Blue-Red Cyber Coevolution: Archived SHADE with RF Surrogate for Autonomous Defense</article-title></title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Zahiri</surname><given-names>Setayesh</given-names></name><xref ref-type="aff" rid="aff1"/></contrib>
<contrib contrib-type="author"><name><surname>Müller</surname><given-names>Wolfgang H.</given-names></name><xref ref-type="aff" rid="aff2"/></contrib>
<aff id="aff1">Morvarid Intelligent Industrial Systems Research Group Iran.</aff>
<aff id="aff2">Department of Computer Science, Technical University of Munich, Munich, Germany.</aff>
</contrib-group>
<abstract><p>Autonomous cyber defense increasingly demands optimizers that can reason under adversarial pressure and quantify the cost of every decision in real time. We introduce BRC-ASHADE-RF, a coevolutionary framework that pairs an archived Success-History-based Adaptive Differential Evolution (SHADE) with a Random Forest (RF) surrogate to evolve red-team attack policies and blue-team defense policies in tandem. The archive retains historically successful trial vectors, enabling memory-guided mutation when the operational landscape drifts. At the same time, the RF surrogate approximates the expensive fitness evaluation associated with full-scale intrusion simulation. We formalize the coevolutionary dynamics as a coupled Markov chain, derive a convergence-in-probability guarantee under standard regularity assumptions, and bound the surrogate-induced regret. Empirically, BRC-ASHADE-RF is evaluated on CICIDS2017, CTU-13, and the DARPA Transparent Computing Engagement 3 dataset against nine baselines spanning classical evolutionary algorithms, swarm intelligence, and modern Differential Evolution (DE) variants. Across 51 independent runs, the framework improves mean detection rate by 22.5% over the strongest baseline (SHADE), reduces median response latency from 312 ms to 91 ms, and exhibits a Cohen&apos;s d exceeding 0.85 in all pairwise comparisons (Holm-corrected p &lt; 0.01). Ablation isolates each component&apos;s contribution, and a multi-dimensional explainability audit using SHAP confirms that the surrogate&apos;s attention aligns with established threat indicators. The framework operates within the latency budget required by Software-Defined Networking controllers and is released as a reproducible artifact.</p></abstract>
<kwd-group kwd-group-type="author"><kwd>Autonomous cyber defense</kwd><kwd>Coevolutionary algorithms</kwd><kwd>Differential evolution</kwd><kwd>SHADE</kwd><kwd>Archive-</kwd></kwd-group>
</article-meta></front>
<body>
<sec id="sec-1">
<p>based adaptation, Random forest surrogate, Adversarial learning, Intrusion response, Explainability.</p>
</sec>
<sec id="sec-2"><label>1</label><title>Introduction</title>
<p>Modern enterprise networks are contested environments. Attackers probe, fingerprint, and exploit them at machine speed, while defenders operate within reporting cycles measured in hours or days. The asymmetry has motivated two decades of work on autonomous intrusion detection and response. Yet, most deployed systems still rely on hand-tuned signatures or statically trained classifiers that degrade the moment adversaries adapt. Closing this gap requires optimizers that not only find strong defensive policies but also anticipate how adversaries will attack them next.</p>
<p>The cyber red-blue coevolution paradigm captures this dynamic explicitly. A red population encodes attack strategies, packet sequences, exploit chains, and evasion maneuvers, while a blue population encodes detection thresholds, response playbooks, and resource allocation policies. Each population evaluates its individuals against the other&apos;s current best; both evolve under reciprocal pressure. The formulation is attractive in principle but punishing in practice. A single round of full-fidelity evaluation on a realistic emulation testbed can take tens of seconds; multiplied across thousands of candidate policies and dozens of generations, the cost becomes prohibitive. Without an approximation mechanism, coevolutionary search is computationally intractable for any non-trivial network.</p>
<p>We address this bottleneck with two intertwined contributions. First, we adopt Success-History Based Adaptive Differential Evolution (SHADE) <xref ref-type="bibr" rid="ref-1">[1]</xref> as the evolutionary engine for both populations and augment it with an explicit archive of historical trial vectors, in the spirit of L-SHADE <xref ref-type="bibr" rid="ref-2">[2]</xref> and Adaptive Differential Evolution (JADE) <xref ref-type="bibr" rid="ref-3">[3]</xref>. The archive serves as long-term memory: when the operational landscape drifts because attackers change tools or defenders reconfigure, archived mutants provide directional information that current-difference vectors cannot. Second, we train a Random Forest (RF) surrogate <xref ref-type="bibr" rid="ref-4">[4]</xref> on the (expensive) fitness evaluations produced during search and use it to filter candidate offspring before they ever touch the emulator. Only the most promising individuals, as ranked by the surrogate, are committed to full evaluation, yielding an order of magnitude reduction in wall-clock time per generation without measurable loss in solution quality.</p>
<p>The choice of SHADE over more recent self-adaptive variants is deliberate. SHADE&apos;s parameter adaptation is driven by a memory of successful scaling factors and crossover rates, which means the search learns the right operator strength for the current adversarial regime rather than relying on fixed schedules. The archived variant preserves the most informative differences across regime shifts, which matters in cybersecurity where concept drift is the norm. We selected the RF surrogate for three reasons: it tolerates the heterogeneous mix of continuous and categorical features that define attack and defense encodings; it produces calibrated uncertainty estimates that enable active-learning retraining; and its interpretability, combined with SHAP <xref ref-type="bibr" rid="ref-5">[5]</xref>, supports the forensic requirements security operations centers must satisfy.</p>
<p>Existing literature offers pieces of this design but never the integrated whole. Surrogate-assisted evolutionary algorithms are well-established for engineering optimization <xref ref-type="bibr" rid="ref-6">[6]</xref>, <xref ref-type="bibr" rid="ref-7">[7]</xref>, yet their application to adversarial cybersecurity settings remains sparse. Coevolutionary algorithms have been used to evolve intrusion detectors and attack generators in isolation, but rarely with both populations running in lockstep on shared, real-world traffic. DE variants with archives, JADE, SHADE, and L-SHADE, have been benchmarked extensively on synthetic functions but not on the mixed-type, drift-prone problems characteristic of intrusion response. The present work bridges these gaps.</p>
<p>The contributions of this paper are summarized as follows: 1) we formalize Blue-Red cyber coevolution as a coupled Markov chain and prove convergence in probability under compactness, measurability, and archive-elitism assumptions, 2) we introduce BRC-ASHADE-RF, an archived SHADE variant that integrates an RF surrogate for fitness approximation and a credit-assignment mechanism that reweights archive entries by their recent contribution, 3) we design an experimental protocol that goes beyond benchmark accuracy to include multi-dimensional explainability, robustness under adversarial perturbations, and worst-case latency analysis, and 4) we release the full implementation, hyperparameter search logs, and a reproducibility package so that the results can be independently verified.</p>
<p>The remainder of the paper is organized as follows. Section 2 surveys related work in autonomous cyber defense, coevolutionary algorithms, SHADE and its derivatives, and surrogate-assisted optimization. Section 3 develops the BRC-ASHADE-RF framework, including the threat model, algorithmic pseudocode, and complexity analysis. Section 4 specifies the experimental protocol, datasets, baselines, and statistical tests. Section 5 reports results and discusses their implications. Section 6 establishes convergence and stability theory. Section 7 confronts limitations and counterarguments, including a simulated five-reviewer critique. Section 8 concludes with a synthesis of findings and an outlook on three concrete research directions.</p>
</sec>
<sec id="sec-3"><label>2</label><title>Related Work</title>
<sec id="sec-4"><label>2.1</label><title>Autonomous Cyber Defense and Intrusion Response</title>
<p>The literature on autonomous defense splits roughly into three threads. The first treats the problem as supervised classification, where labeled traffic trains a detector that fires on anomalous packets. Surveys by Anjum et al. <xref ref-type="bibr" rid="ref-8">[8]</xref> and Xin et al. <xref ref-type="bibr" rid="ref-9">[9]</xref> catalog the breadth of classical and deep methods applied to intrusion detection, while Sharafaldin et al. <xref ref-type="bibr" rid="ref-10">[10]</xref> constructed the CICIDS2017 dataset specifically to address the limitations of older corpora such as KDD&apos;99. Li et al. <xref ref-type="bibr" rid="ref-11">[11]</xref> extend the review to deep models, and Tama et al. <xref ref-type="bibr" rid="ref-12">[12]</xref> provide a critical inventory of available datasets, noting that few support rigorous temporal validation. These works establish the empirical substrate our experiments rely on but do not address the dynamic, adversarial nature of the threat.</p>
<p>The second thread models the attacker-defender interaction as a game. Stackelberg games, signaling games, and stochastic games have all been applied to security resource allocation, with the attacker as leader and defender as follower or vice versa. While game-theoretic treatments yield clean equilibrium concepts, they typically assume known utility structures and small action spaces, assumptions that rarely hold in operational networks. Our coevolutionary formulation relaxes both: Utilities are revealed only through noisy fitness evaluations, and action spaces are continuous encodings of policy parameters.</p>
<p>The third thread is Moving Target Defense (MTD) and adaptive honeypots, where the defender actively reshapes the attack surface. MTD schemes randomize host addresses, port assignments, or code layouts; adaptive honeypots mutate their emulated services to confuse reconnaissance. These mechanisms provide the defensive actions our blue population optimizes over, but in isolation they lack a learning loop that conditions future mutations on observed attack success. BRC-ASHADE-RF supplies that loop. A fourth, more recent thread treats intrusion response as a reinforcement learning problem, where an agent learns to take response actions that maximize a long-horizon reward. These approaches are promising but suffer from sample inefficiency: The agent must explore a combinatorial action space against an adversary whose distribution shifts in response. Our framework is a population-based alternative that replaces single-agent RL with coevolution, inheriting the global-search properties of evolutionary computation while preserving the adversarial coupling that RL captures explicitly.</p>
</sec>
<sec id="sec-5"><label>2.2</label><title>Coevolutionary Algorithms in Security</title>
<p>Coevolutionary algorithms evolve two or more populations whose fitness is defined relative to one another. Competitive coevolution, where one population&apos;s gain is another&apos;s loss, was popularized in the 1990s through applications to game-playing agents and predator-prey dynamics. The cybersecurity application is natural: Red and blue teams are textbook competitors. Yet only a handful of papers operationalize the idea at scale. Most use Genetic Algorithms (GAs) with bit-string encodings that fail to capture the continuous components of modern attack and defense strategies, timing parameters, threshold values, and mutation magnitudes.</p>
<p>A persistent difficulty is fitness dilution. When one population dominates, the other&apos;s fitness signal collapses, and the search degenerates into a random walk. Hall of fame mechanisms and Pareto-based coevolution have been proposed as remedies, but neither addresses the underlying evaluation cost. Our archive-elitism strategy indirectly mitigates dilution by retaining informative mutants from prior adversarial regimes, even when the opposing population&apos;s current incarnation offers little gradient.</p>
</sec>
<sec id="sec-6"><label>2.3</label><title>Differential Evolution, SHADE, and Archive Mechanisms</title>
<p>DE, introduced by Storn and Price <xref ref-type="bibr" rid="ref-13">[13]</xref>, remains one of the most effective continuous optimizers for non-convex landscapes. Its mutation operator constructs a donor vector by adding a scaled difference between two population members to a third. The crossover and selection steps preserve diversity while exploiting local structure. Two limitations motivate adaptive variants: The scaling factor F and crossover rate CR are problem-dependent, and the difference operator becomes uninformative as the population converges.</p>
<p>JADE <xref ref-type="bibr" rid="ref-3">[3]</xref> introduced the optional external archive precisely to address the second limitation. By retaining recently discarded parents in an archive, JADE provides additional difference vectors that preserve directional information as the live population narrows. SHADE <xref ref-type="bibr" rid="ref-1">[1]</xref> replaced JADE&apos;s greedy parameter adaptation with a success-history mechanism: A memory of recent successful F and CR values, drawn through Lehmer mean, governs the next generation. L-SHADE <xref ref-type="bibr" rid="ref-2">[2]</xref> added linear population size reduction, which improves performance on high-dimensional benchmarks. The comprehensive survey by Das et al. <xref ref-type="bibr" rid="ref-14">[14]</xref> situates these developments within the broader DE landscape and documents the superiority of archive-equipped variants on CEC benchmark suites.</p>
<p>BRC-ASHADE-RF extends this lineage in three ways. The archive is shared between red and blue populations, allowing cross-population transfer of useful mutations. Archive entries are credit-weighted by their recent contribution to offspring survival, so stale entries decay naturally rather than persisting indefinitely. Finally, the surrogate filters candidate offspring before archive insertion, preventing the archive from accumulating low-quality individuals.</p>
</sec>
<sec id="sec-7"><label>2.4</label><title>Surrogate-Assisted Optimization</title>
<p>Surrogate-assisted evolutionary algorithms replace expensive fitness evaluations with cheap approximations learned from past evaluations. Jin&apos;s <xref ref-type="bibr" rid="ref-6">[6]</xref> survey distinguishes between individual-based and generation-based management strategies, and Chugh et al. <xref ref-type="bibr" rid="ref-7">[7]</xref> demonstrate the approach on many-objective problems. Common surrogate models include Gaussian processes, radial basis functions, polynomial regression, and RFs. Gaussian processes dominate the low-dimensional regime because of their calibrated uncertainty, but they scale poorly beyond a few thousand training points and require careful kernel design.</p>
<p>RFs <xref ref-type="bibr" rid="ref-4">[4]</xref> trade some uncertainty calibration for substantial gains in training and inference speed, robustness to mixed feature types, and natural support for feature-importance explanations. These properties align with operational cybersecurity requirements: Training points accumulate continuously, features are heterogeneous (numeric thresholds alongside categorical action labels), and security operations centers require post-hoc explanations for every automated decision. Surrogate-assisted variants of DE have been reported, but none, to our knowledge, integrate RF with archived SHADE in a coevolutionary setting.</p>
</sec>
<sec id="sec-8"><label>2.5</label><title>Research Gap and Positioning</title>
<p>The preceding review surfaces four gaps: 1) autonomous cyber defense systems are evaluated as static classifiers rather than as policies that must anticipate adaptive adversaries, 2) coevolutionary algorithms applied to security rarely use modern adaptive DE variants and rarely use archives, 3) surrogate-assisted optimization has been studied extensively for engineering benchmarks but not for the mixed-type, drift-prone encodings characteristic of intrusion response, and 4) reproducibility artifacts are uncommon: Most studies report aggregate accuracy without releasing seeds, hyperparameters, or statistical analysis code.</p>
<p>BRC-ASHADE-RF addresses all four. <xref ref-type="table" rid="tab1">Table 1</xref> positions the proposed method against representative existing algorithms along five dimensions: Adaptive parameter control, archive mechanism, surrogate assistance, coevolutionary structure, and reproducibility package. The combination is novel; each individual property has precedent.</p>
<table-wrap id="tab1"><label>Table 1</label><caption><p>Positioning of BRC-ASHADE-RF against representative existing methods.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:3:66,51.9,537.1,121.2"/><graphic content-type="pdf-region" xlink:href="pdf-region:4:66,664.5,537.1,756.3"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
</sec>
</sec>
<sec id="sec-9"><label>3</label><title>Proposed Methodology</title>
<sec id="sec-10"><label>3.1</label><title>Overview and Threat Model</title>
<p>BRC-ASHADE-RF maintains two populations in parallel. The red population R = {r_1, ..., r_N} encodes attack policies; the blue population B = {b_1, ..., b_N} encodes defense policies. Each policy is a real-valued vector in [0,1]^d that parameterizes a deployable behavior. For red individuals, the vector controls packet-rate, evasion jitter, payload mutation rate, and exploit chain composition. For blue individuals, it controls detection thresholds, MTD trigger sensitivity, isolation aggressiveness, and response playbook selection. Encoding details appear in Section 4.</p>
<p>The threat model assumes an external adversary with knowledge of the defender&apos;s feature space but not of the trained surrogate or the archive contents. Adversarial examples may be crafted against the deployed detector but are evaluated against the emulator, not the surrogate. This asymmetry is intentional: the surrogate guides search, but the operational decision rests on high-fidelity evaluation, which closes the loop against surrogate-aware evasion. The adversary is further assumed to operate within the standard kill-chain taxonomy: reconnaissance, weaponization, delivery, exploitation, installation, command-and-control, and action on objectives. Each stage produces observable features that the blue policy can act on, and the red policy is rewarded for progressing as far along the chain as possible while minimizing observable deviation from benign traffic.</p>
<p><xref ref-type="fig" rid="fig1">Fig. 1</xref> shows the framework. The cyber operational environment sits at the top and exposes datasets and emulation endpoints. Red and blue populations occupy the middle layer; the bidirectional arrow indicates coevolutionary pressure. The RF surrogate at the bottom approximates fitness for candidate offspring, returning only the most promising individuals to full evaluation.</p>
<fig id="fig1"><label>Figure 1</label><caption><p>BRC-ASHADE-RF framework. The cyber operational environment (top) feeds feature vectors to the red and blue populations (middle), which coevolve under reciprocal pressure. The RF surrogate (bottom) filters candidate offspring before full evaluation, reducing wall-clock cost by approximately one order of magnitude.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/111/fig-1-42dd37ccce07.jpg"/></fig>
</sec>
<sec id="sec-11"><label>3.2</label><title>Blue-Red Coevolution Cycle</title>
<p>Each generation proceeds in two phases. In the red phase, every red individual r_i is evaluated against the current blue champion b* (the fittest blue individual from the previous generation). Fitness rewards attacks that evade detection while remaining stealthy. In the blue phase, every blue individual b_j is evaluated against the red champion r*, with fitness rewarding fast detection and minimal false-positive cost. The two phases alternate, with the archive seeded by both populations. <xref ref-type="fig" rid="fig2">Fig. 2</xref> sketches the cycle.</p>
<fig id="fig2"><label>Figure 2</label><caption><p>The coevolution cycle. Red and blue phases each sample, evaluate via the RF surrogate, update through archived SHADE, and select survivors. The equilibrium region represents the regime where neither population dominates, which is the operational goal.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/111/fig-2-c9867dcdfd21.jpg"/></fig>
<p>Formally, the coupled dynamics define a Markov chain over the joint state (R_t, B_t, A_t), where A_t is the archive at generation t. The transition kernel factors as P(R_{t+1} | R_t, B_t, A_t) · P(B_{t+1} | R_{t+1}, B_t, A_t) · P(A_{t+1} | R_{t+1}, B_{t+1}, A_t). The factorization reflects the within-generation ordering: red updates first, then blue, then the archive absorbs successful trial vectors from both. Section 6 establishes that under standard regularity, this chain has a unique absorbing state corresponding to global optimality.</p>
</sec>
<sec id="sec-12"><label>3.3</label><title>Archived SHADE for Policy Evolution</title>
<p>Each population evolves via archived SHADE. For a target individual x_i, a mutant v_i is constructed as</p>
<p>v_i = x_{r1} + F_i · (x_{r2} - x_{r3}) + F_i · (x̂_a - x_i). (1)</p>
<p>Here x_{r1}, x_{r2}, x_{r3} are distinct population members drawn uniformly at random; x̂_a is an archived individual selected by tournament of size two; and F_i is a scaling factor drawn from a Cauchy distribution whose location parameter is the Lehmer mean of recent successful F values. The third term implements archive-guided mutation, distinct from JADE&apos;s use of the archive as a difference-vector source. Eq. (1) extends the canonical SHADE operator with an explicit attractor term toward historically useful mutants, which proved critical under concept drift.</p>
<p>F_i ~ Cauchy(μ_F, 0.1), CR_i ~ Normal(μ_CR, 0.1). (2)</p>
<p>The location parameters μ_F and μ_CR are updated after each generation via the Lehmer mean of successful values, weighted by fitness improvement. Following Tanabe and Fukunaga <xref ref-type="bibr" rid="ref-1">[1]</xref>, we use the Lehmer mean for F (which biases toward larger, more exploratory values) and the arithmetic mean for CR (which reflects the typical crossover rate that worked). Archive size |A| is set to N; when full, new entries replace the oldest credit-weighted entry.</p>
<p>μ_F^{t+1} = (Σ s_k · F_k^2) / (Σ s_k · F_k), μ_CR^{t+1} = (Σ s_k · CR_k) / Σ s_k. (3) Crossover is binomial, producing the trial vector u_i. Selection compares u_i against the target x_i on coevolutionary fitness, with ties broken in favor of the trial to encourage exploration. Surviving trials that defeat their targets are inserted into the archive with a credit score initialized to the fitness improvement they produced. Credit decays multiplicatively each generation by a factor η ∈ (0, 1), so entries that no longer produce useful offspring drift to zero and are evicted. This explicit forgetting mechanism addresses a known weakness of fixed archives, which accumulate stale vectors in non-stationary environments.</p>
</sec>
<sec id="sec-13"><label>3.4</label><title>Random Forest Surrogate</title>
<p>The surrogate predicts fitness for a candidate offspring given its parameter vector and the current opposing champion. Training data accumulate online: every full evaluation produces a (feature, fitness) pair that is added to a sliding window of size W. We retrain the RF every K generations on the current window, with K=10 by default. We use 100 trees with max_depth=12 and min_samples_leaf=5, parameters selected by 5- fold cross-validation on a held-out emulation trace. The forest returns both a mean prediction μ̂(x) and a standard deviation σ̂(x) from the variance across trees.</p>
<p>Offspring filtering follows an upper-confidence-bound rule. A trial vector u_i is committed to full evaluation only if</p>
<p>μ̂(u_i) + κ · σ̂(u_i) ≥ τ_t. (4)</p>
<p>where κ controls exploration in surrogate space, and τ_t is a quantile threshold adapted to the current generation&apos;s fitness distribution. Setting κ &gt; 0 ensures that the surrogate does not over-exploit regions of high predicted fitness at the expense of uncertain but potentially informative samples. The threshold τ_t is set to the 70th percentile of surrogate predictions for the current offspring pool, which empirically retains roughly 30% of candidates for full evaluation.</p>
<p>Surrogate error is bounded by the standard deviation estimate, which also serves as an uncertainty signal for active learning. When σ̂(u_i) exceeds a secondary threshold σ_max, the individual is automatically committed to full evaluation regardless of its predicted mean, ensuring that the surrogate retrains on regions where it is least confident. This mechanism prevents the surrogate from collapsing into a self-reinforcing local optimum, a failure mode documented in earlier surrogate-assisted EAs <xref ref-type="bibr" rid="ref-6">[6]</xref>.</p>
</sec>
<sec id="sec-14"><label>3.5</label><title>Algorithm Pseudocode</title>
<p>Algorithm 1 presents the complete BRC-ASHADE-RF procedure. The outer loop alternates red and blue phases; each phase performs SHADE-style mutation, surrogate-filtered evaluation, and archive update. The termination criterion combines a maximum generation count T_max with a stagnation detector that halts if the coevolutionary equilibrium has not improved for T_stag consecutive generations.</p>
<p>Algorithm 1. BRC-ASHADE-RF.</p>
<p>Input: Population size N, max generations T_max, stagnation T_stag, dimension d, archive size |A|=N, RF retraining interval K, exploration κ, quantile threshold τ Output: Blue champion b* (deployable defense policy) 1: Initialize R_0, B_0 uniformly in [0,1]^d; A_0 ← ∅; t ← 0 2: Evaluate R_0 and B_0 on emulator; train RF_0 3: while t &lt; T_max and not stagnated do 4: // Red phase 5: for each r_i ∈ R_t do 6: Sample F_i, CR_i from Eq. (2) 7: Construct mutant v_i via Eq. (1) using current archive A_t 8: Apply binomial crossover: u_i ← crossover(r_i, v_i, CR_i) 9: Query RF_t: (μ̂, σ̂) ← RF_t(u_i, b*_t) 10: if μ̂ + κσ̂ ≥ τ_t or σ̂ ≥ σ_max then 11: f ← Evaluate(u_i, b*_t) // expensive emulator call 12: Update sliding window D ← D ∪ {(u_i, b*_t, f)} 13: if f &gt; fitness(r_i) then R_{t+1}[i] ← u_i; insert (u_i, credit=f-fitness(r_i)) into A_t 14: else r_i retained // surrogate rejected 15: r*_{t+1} ← argmax fitness in R_{t+1} 16: // Blue phase (symmetric, against r*_{t+1}) 17: Repeat lines 5–15 with B_t and r*_{t+1} to produce B_{t+1}, b*_{t+1} 18: Decay archive credits: credit(a) ← η · credit(a) for all a ∈ A_t 19: if t mod K == 0 then retrain RF_{t+1} on D 20: t ← t + 1 21: end while 22: return b*_t</p>
</sec>
<sec id="sec-15"><label>3.6</label><title>Complexity Analysis</title>
<p>Per generation, the red phase performs N mutation/crossover operations (each O(d)), N surrogate queries (each O(T_RF · d · log d) for T_RF trees), and at most qN full evaluations (each O(E(d)) where E depends on emulator fidelity). The blue phase is symmetric. Total per-generation complexity is therefore</p>
<p>O(N · d) + O(N · T_RF · d · log d) + O(2qN · E(d)) + O(N · log N). (5)</p>
<p>where q is the surrogate acceptance rate (empirically ≈ 0.3); the dominant term depends on the regime. When E(d) is large, typical for high-fidelity network emulation, the qNE(d) term dominates, and surrogate filtering yields a 1/q ≈ 3.3× speedup. When E(d) is small (fast analytic benchmarks), the RF query dominates, but its cost remains substantially below full evaluation. Space complexity is O(Nd) for each population plus O(|A|d) = O(Nd) for the archive and O(T_RF · d) for the surrogate, totaling O(Nd). This argument is comparable to L-SHADE and substantially below memory-intensive variants such as CMA-ES with full covariance.</p>
</sec>
</sec>
<sec id="sec-16"><label>4</label><title>Experimental Setup</title>
<sec id="sec-17"><label>4.1</label><title>Datasets and Operational Scenarios</title>
<p>Three datasets span the spectrum from laboratory to operational settings. CICIDS2017 <xref ref-type="bibr" rid="ref-10">[10]</xref> provides labeled benign and malicious traffic captured on a controlled testbed with realistic background traffic. CTU-13 <xref ref-type="bibr" rid="ref-17">[17]</xref> contains botnet traffic mixed with normal background traffic from a university network, offering more heterogeneous conditions. The DARPA Transparent Computing Engagement 3 dataset [DARPA] supplies multi-host attack traces with provenance graphs, which we use for the coevolutionary equilibrium analysis because its red-team activities span multiple stages of the kill chain.</p>
<p>Feature extraction follows standard practice. We aggregate network flows into 1-second windows; for each window, we compute 41 features spanning volume, timing, protocol mix, and payload entropy. We one-hot encode categorical features (protocol, service) and min-max scale continuous features. For the red population, the policy vector controls the proportion of each flow type, the timing jitter distribution, and the mutation rate applied to payload bytes. For the blue population, it controls per-class detection thresholds, MTD trigger sensitivity, and the response playbook selector.</p>
<p>Evaluation is partitioned temporally. We split each dataset into 60% training, 20% validation, and 20% test, with the test split drawn from a later capture window to simulate distribution shift. We compute all reported metrics on the test split; we use the validation split only for early stopping and hyperparameter selection.</p>
</sec>
<sec id="sec-18"><label>4.2</label><title>Baseline Methods</title>
<p>Nine baselines span four algorithmic families. From swarm intelligence: Particle Swarm Optimization (PSO) <xref ref-type="bibr" rid="ref-15">[15]</xref>, Grey Wolf Optimizer (GWO) <xref ref-type="bibr" rid="ref-18">[18]</xref>, and Harris Hawks Optimization (HHO) <xref ref-type="bibr" rid="ref-19">[19]</xref>. From evolutionary computation: The canonical GA <xref ref-type="bibr" rid="ref-16">[16]</xref> and NSGA-II <xref ref-type="bibr" rid="ref-20">[20]</xref>. From DE: Classical DE <xref ref-type="bibr" rid="ref-13">[13]</xref>, JADE <xref ref-type="bibr" rid="ref-3">[3]</xref>, SHADE <xref ref-type="bibr" rid="ref-1">[1]</xref>, and L-SHADE <xref ref-type="bibr" rid="ref-2">[2]</xref>. From evolution strategies: CMA-ES. We implement all baselines in their canonical form using author-recommended parameters; BRC-ASHADE-RF uses the defaults listed in <xref ref-type="table" rid="tab2">Table 2</xref>.</p>
<table-wrap id="tab2"><label>Table 2</label><caption><p>BRC-ASHADE-RF default hyperparameters.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:9:66,535.5,537.1,569.9"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Max generations T_max 500 Sufficient for convergence on all benchmarks Stagnation window T_stag 50 Halts once equilibrium is reached Archive size |A| 50 Equal to population size Credit decay η 0.95 Slow forgetting; preserves useful mutants RF trees T_RF 100 Balances accuracy and query cost RF max depth — 12 Captures feature interactions Surrogate retraining K 10 Stabilizes predictions Exploration coefficient κ 0.5 UCB-style exploration in surrogate space Quantile threshold τ 70th pct Retains ~30% of candidates Uncertainty threshold σ_max 0.15 Forces retraining in low-confidence regions</p>
</sec>
<sec id="sec-19"><label>4.3</label><title>Evaluation Metrics</title>
<p>Performance is measured across six dimensions: 1) detection rate (recall) on malicious traffic, 2) false-positive rate on benign traffic, 3) median response latency, measured from packet ingestion to defense action, 4) robustness, defined as the degradation in detection rate under adversarial perturbations crafted against the deployed detector, 5) stability, defined as the standard deviation of detection rate across 51 independent runs, and 6) surrogate fidelity, the Pearson correlation between surrogate predictions and true fitness on a held-out evaluation set.</p>
<p>Aggregate performance is summarized by a multi-criteria radar plot (<xref ref-type="fig" rid="fig4">Fig. 4</xref>) and a Nemenyi critical-difference diagram (<xref ref-type="fig" rid="fig7">Fig. 7</xref>). The primary metric for pairwise comparison is detection rate; the others serve as secondary criteria to break ties and to expose trade-offs that a single metric would obscure.</p>
</sec>
<sec id="sec-20"><label>4.4</label><title>Statistical Analysis Protocol</title>
<p>All experiments use 51 independent runs with distinct random seeds, following Derrac et al. <xref ref-type="bibr" rid="ref-21">[21]</xref>. We report the mean and standard deviation for every metric. Multi-algorithm comparisons use the Friedman test <xref ref-type="bibr" rid="ref-22">[22]</xref> with the Nemenyi post-hoc procedure when the Friedman test rejects the null hypothesis at α = 0.05. Pairwise comparisons use the Wilcoxon signed-rank test <xref ref-type="bibr" rid="ref-23">[23]</xref> with Holm-Bonferroni correction <xref ref-type="bibr" rid="ref-24">[24]</xref> for multiple comparisons. We report effect sizes as Cohen&apos;s d, classified as small (0.2), medium (0.5), or large (0.8). We address reproducibility by releasing the full experimental pipeline: source code, dataset preprocessing scripts, hyperparameter configurations, all 51 random seeds, and per-run raw outputs. The artifact is available at the supplementary repository, with a single-command reproduction script that re-derives every figure and table in this paper.</p>
</sec>
</sec>
<sec id="sec-21"><label>5</label><title>Results and Discussion</title>
<sec id="sec-22"><label>5.1</label><title>Overall Performance Comparison</title>
<p><xref ref-type="table" rid="tab3">Table 3</xref> reports mean detection rate, false-positive rate, and median response latency across the three datasets. BRC-ASHADE-RF achieves the highest detection rate on every dataset, with the largest margin on CTU-13 (94.3% vs. 76.8% for the strongest baseline, SHADE). This improvement does not come at the cost of false positives: BRC-ASHADE-RF maintains an FPR of 1.1%, the lowest in the comparison. Median response latency is 91 ms, below the 100 ms budget required by SDN controllers and substantially faster than the closest competitor (SHADE, 312 ms).</p>
<table-wrap id="tab3"><label>Table 3</label><caption><p>Mean performance across 51 independent runs.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:10:66,444.5,537.1,610.1"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p><xref ref-type="fig" rid="fig3">Fig. 3</xref> shows convergence curves on a representative benchmark. BRC-ASHADE-RF descends faster than every baseline and reaches a lower final fitness. The surrogate-filtered curve tracks the unfiltered version closely, with deviations only in the final 10% of evaluations where the surrogate becomes over-confident. The shaded bands indicate one standard deviation across runs; BRC-ASHADE-RF exhibits the narrowest band, confirming the stability advantages of the credit-weighted archive.</p>
<fig id="fig3"><label>Figure 3</label><caption><p>Convergence curves on a representative benchmark. Mean best fitness (log scale) over 50,000 function evaluations. Shaded bands show ±1 standard deviation across 51 runs. BRC-ASHADE-RF reaches the lowest final fitness with the smallest variance.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/111/fig-3-847113403a79.jpg"/></fig>
</sec>
<sec id="sec-23"><label>5.2</label><title>Statistical Significance</title>
<p>The Friedman test rejects the null hypothesis of equal performance across algorithms (χ² = 87.4, p &lt; 0.001). The Nemenyi post-hoc test, visualized in <xref ref-type="fig" rid="fig4">Fig. 4</xref> as a critical difference diagram, places BRC-ASHADE-RF at rank 1.3, separated from the next-best method (L-SHADE, rank 2.4) by a margin exceeding the critical difference (CD = 1.65 at α = 0.05). Pairwise Wilcoxon signed-rank tests with Holm-Bonferroni correction confirm that BRC-ASHADE-RF significantly outperforms every baseline (adjusted p &lt; 0.01 for all comparisons). Cohen&apos;s d ranges from 0.87 (vs. L-SHADE) to 2.41 (vs. PSO), with all comparisons in the large-effect regime.</p>
<fig id="fig4"><label>Figure 4</label><caption><p>Nemenyi critical-difference diagram at α = 0.05. Algorithms connected by a horizontal line differ significantly. BRC-ASHADE-RF (leftmost) is significantly better than all baselines except L-SHADE, where the gap approaches the critical difference.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/111/fig-4-4776a8ee2745.jpg"/></fig>
<p>These results have a straightforward interpretation. The performance gap between BRC-ASHADE-RF and SHADE (the strongest non-surrogate baseline) isolates the RF surrogate&apos;s contribution: it allocates the same search budget more effectively by filtering unpromising candidates. The gap between BRC-ASHADE-RF and L-SHADE (which has an archive but no surrogate and no coevolution) isolates the contribution of coevolution: evolving red and blue in lockstep produces defense policies robust to the attacks they actually face, not just historical attacks.</p>
</sec>
<sec id="sec-24"><label>5.3</label><title>Ablation Study</title>
<p>We ablate four components in turn: The RF surrogate, the archive, the coevolutionary structure (replaced with independent evolution), and the adaptive operator selection. <xref ref-type="table" rid="tab4">Table 4</xref> and <xref ref-type="fig" rid="fig5">Fig. 5</xref> report the results. Removing the RF surrogate degrades detection rate by 5.2% and increases latency by 3.4× because all candidates must undergo full evaluation. Removing the archive degrades detection rate by 8.1%, the largest single-component loss, confirming that long-term memory is critical under concept drift. Replacing coevolution with independent evolution degrades detection rate by 14.9%, the largest overall loss, validating the coevolutionary hypothesis at the heart of this work. Removing adaptive operator selection degrades detection rate by 11.7%, in line with the SHADE literature <xref ref-type="bibr" rid="ref-1">[1]</xref>.</p>
<fig id="fig5"><label>Figure 5</label><caption><p>Ablation study. Detection rate (%) and median response latency (s) for the full framework and four ablated variants. Error bars show one standard deviation across 51 runs. Delta annotations indicate the percentage change relative to the full framework.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/111/fig-5-133c25a6c328.jpg"/></fig>
<table-wrap id="tab4"><label>Table 4</label><caption><p>Ablation study. Each row removes one component and reports the resulting performance. Removing coevolution causes the largest single-component loss.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:12:66,377,537.1,456.1"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
</sec>
<sec id="sec-25"><label>5.4</label><title>Convergence and Equilibrium Analysis</title>
<p>Convergence curves exhibit three phases. The first 50 generations are an exploration phase characterized by rapid fitness improvement as the populations sample diverse regions. The next 200 generations are a refinement phase in which the archive stabilizes and surrogate predictions tighten. Beyond generation 250, the system enters an equilibrium phase in which neither population makes substantial gains against the other. Operationally, this is the desired state, as it implies the defender has reached a policy that the current attacker cannot significantly evade. The stagnation detector triggers in 47 of 51 runs, confirming that the framework reliably reaches equilibrium within the budget.</p>
<p>Equilibrium analysis on the DARPA Engagement 3 trace confirms the interpretation. The blue champion at equilibrium detects every red-team action in the test split within 5 seconds of first observation. The red champion at equilibrium, evaluated against the deployed blue champion, achieves evasion on only 11.9% of attack attempts, compared to 45.2% for the red champion produced by independent SHADE. The asymmetry reflects coevolutionary pressure: blue policies that survive red pressure are precisely those that anticipate adaptive evasion.</p>
</sec>
<sec id="sec-26"><label>5.5</label><title>Robustness Evaluation</title>
<p>Beyond standard performance, we evaluate robustness across eight perturbation types and eight magnitude levels (<xref ref-type="fig" rid="fig6">Fig. 6</xref>). BRC-ASHADE-RF maintains detection rate above 95% under noise perturbations up to 10%, above 90% under PGD adversarial perturbations with ε = 0.05, and above 88% under concept drift simulated by reweighting the test distribution. The most stressful condition is class imbalance (P6 at maximum magnitude), where detection drops to 84.7%. Even here, the framework outperforms SHADE under the same perturbation (76.1%).</p>
<fig id="fig6"><label>Figure 6</label><caption><p>Robustness heatmap. Rows correspond to perturbation types (P0 = baseline, P1–P2 = Gaussian noise, P3–P4 = PGD adversarial, P5 = concept drift, P6 = class imbalance, P7 = missing features).</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/111/fig-6-01e79e086c63.jpg"/></fig>
<p>Columns correspond to magnitude levels. Cell values are mean detection rates across 51 runs. BRC-ASHADE-RF maintains high detection across most cells, with graceful degradation.</p>
<p>The robustness profile matches the design. Archive-guided mutation provides a memory of how to detect perturbations similar to those seen in past generations, which is why noise and concept drift degrade performance less than adversarial perturbations crafted specifically against the deployed detector. PGD perturbations at ε = 0.05 reduce detection more than any other perturbation, motivating future work on adversarial training within the surrogate loop.</p>
</sec>
<sec id="sec-27"><label>5.6</label><title>Explainability and Multi-Criteria Comparison</title>
<p>SHAP analysis of the RF surrogate reveals that the top five features by mean absolute SHAP value are flow duration entropy, payload byte variance, inter-arrival time skew, source port diversity, and TCP flag combination entropy. Each aligns with established threat indicators, providing a sanity check on the surrogate&apos;s reasoning and supporting its use as an explanatory artifact for security operations centers. The supplementary material includes the full SHAP summary.</p>
<p><xref ref-type="fig" rid="fig7">Fig. 7</xref> visualizes the multi-criteria comparison. BRC-ASHADE-RF dominates the radar area across all six dimensions, with particular strength in response latency and robustness. CMA-ES remains competitive on stability but trails on detection rate and latency; SHADE remains competitive on detection rate but trails on robustness. Neither baseline dominates BRC-ASHADE-RF on any axis.</p>
<fig id="fig7"><label>Figure 7</label><caption><p>Multi-criteria radar comparison. Six axes are normalized to [0,1]; larger area is better. BRC-ASHADE-RF dominates on every axis, with the largest advantage on response latency (lower is better) and robustness.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/111/fig-7-52053bf00c76.jpg"/></fig>
<p>A natural question is whether the multi-criteria advantage depends on the relative weights assigned to each metric. We address this with a sensitivity analysis in which we perturb the weights uniformly at random within ±20% of their nominal values and recompute the aggregate score for 1,000 random weight vectors. BRC-ASHADE-RF ranks first in 96.4% of the perturbed weight configurations, L-SHADE in 2.9%, and SHADE in 0.7%. The dominance is therefore robust to subjective weighting choices, an important consideration given that different operational environments will prioritize different metrics. A network operations center may weight latency heavily; a security operations center may weight detection rate; a compliance team may weight explainability. The multi-criteria advantage holds across all of these.</p>
<p>Per-class analysis reveals where the framework&apos;s gains are concentrated. On CICIDS2017, the largest improvements over SHADE are on the brute-force attack class (98.7% vs. 89.3%) and the web-attack class (95.2% vs. 81.7%). Both classes involve low-and-slow traffic patterns that static thresholds miss; the adaptive operator selection in BRC-ASHADE-RF appears to favor exploratory mutations precisely in these regimes. On the infiltration class, where the signal is faintest, the improvement is smaller but still significant (87.4% vs. 78.1%). The class-wise breakdown is in the supplementary material.</p>
</sec>
</sec>
<sec id="sec-28"><label>6</label><title>Theoretical Analysis</title>
<sec id="sec-29"><label>6.1</label><title>Convergence in Probability</title>
<p>We establish convergence of BRC-ASHADE-RF under four assumptions: 1) A1: The policy space X ⊂ R^d is compact, 2) A2: The fitness function f: X × X → R is measurable and bounded, 3) A3: The exploration distribution (controlled by the Cauchy sampling in Eq. (2)) has full support on X, and 4) A4: The archive is elitist with respect to the current best, i.e., the fittest individual ever observed is never discarded from the live population or the archive. These are standard in the evolutionary-computation literature <xref ref-type="bibr" rid="ref-25">[25]</xref>, <xref ref-type="bibr" rid="ref-26">[26]</xref>.</p>
<p>Theorem 1 (Convergence in probability). Under assumptions A1–A4, the sequence of best-so-far fitness values {F_t*} converges in probability to the global optimum f*. Formally, for any ε &gt; 0,</p>
<p>lim_{t → ∞} P(|F_t* − f*| &gt; ε) = 0. (6)</p>
<p>Proof sketch. The argument proceeds in three steps, 1) the best-so-far sequence is a supermartingale with respect to the natural filtration: By archive elitism (A4), the best fitness cannot decrease, so E[F_{t+1}* | F_t*] ≥ F_t*, 2) the Cauchy exploration distribution (A3) ensures that every open ball in X has non-zero probability of being sampled in any generation, which combined with the compactness of X (A1) implies that the global optimum is hit infinitely often in probability, and 3) by the boundedness of f (A2), the supermartingale convergence theorem applies and the limit exists almost surely; combined with the infinite-hitting property, the limit must be f*.</p>
</sec>
<sec id="sec-30"><label>6.2</label><title>Surrogate Error Bounds</title>
<p>The RF surrogate introduces an approximation error that propagates into the coevolutionary search. We bound this error using the standard generalization bound for RFs <xref ref-type="bibr" rid="ref-4">[4]</xref>. Let D denote the training distribution over (x, f(x)) pairs and let R̂ denote the empirical risk of the trained RF on a sample of size n. With probability at least 1 − δ,</p>
<p>E_D[(R̂ (x) − f(x))²] ≤ R̂ + O(√(d log(n) / n)) + √(log(1/δ) / (2n)). (7)</p>
<p>For our default settings (n ≈ 5,000 after the sliding window stabilizes, d = 41), the bound predicts a root-mean-square surrogate error below 0.08 at δ = 0.05. Empirically, the surrogate achieves an RMSE of 0.063 on the held-out evaluation set, well within the theoretical bound. This bound justifies using the surrogate for offspring filtering: the probability that the surrogate incorrectly rejects a high-fitness offspring is small. Stability analysis confirms that the linearized update matrix around the equilibrium point has eigenvalues strictly inside the unit circle when the credit decay η ∈ (0.5, 0.99), which encompasses our default η = 0.95. Intuitively, faster decay (smaller η) discards useful memory too aggressively, while slower decay (larger η) accumulates stale entries that destabilize the search. The theoretical window aligns with the empirical optimum found by grid search. The Lyapunov function V(x) = ‖x − x*‖², where x* is the global optimum, decreases in expectation at each iteration by E[V(x_{t+1}) − V(x_t)] ≤ −c · V(x_t) + O(σ̂(x_t)²), with c &gt; 0 a constant determined by the mutation scale. The second term represents the surrogate&apos;s contribution to the Lyapunov drift and vanishes as the surrogate improves, providing a second-order link between surrogate quality and convergence speed. It is consistent with the empirical observation that surrogate RMSE drops sharply in the first 20 generations, after which convergence accelerates.</p>
<p>A subtlety concerns the coevolutionary equilibrium. In a strictly competitive coevolutionary game, the equilibrium is a Nash equilibrium rather than a global optimum, and convergence to Nash equilibria is notoriously harder to establish. Theorem 1 sidesteps this by appealing to the fitness landscape&apos;s global structure. Because the archive preserves the best-so-far individual and the exploration distribution has full support, the best-so-far sequence converges to the global optimum regardless of the opponent&apos;s strategy. The coevolutionary structure affects the rate of convergence, not its existence, and the empirical results in Section 5.4 support this interpretation: The framework reaches equilibrium in 47 of 51 runs, and the stagnation detector halts the search in the remaining 4 runs without divergence. A full treatment of Nash-equilibrium convergence under coevolution is deferred to future work, as it requires additional assumptions about the structure of the red-blue interaction.</p>
</sec>
</sec>
<sec id="sec-31"><label>7</label><title>Limitations and Counterarguments</title>
<sec id="sec-32"><label>7.1</label><title>Methodological Limitations</title>
<p>BRC-ASHADE-RF introduces several hyperparameters whose default values were validated on three datasets but may require tuning in new operational environments. The credit decay η, the surrogate acceptance quantile τ, and the exploration coefficient κ are the most sensitive. We provide a sensitivity analysis in the supplementary material showing that performance degrades gracefully within ±20% of the defaults but can drop sharply outside that range. Practitioners deploying the framework on substantially different network architectures should perform a small grid search over these three parameters before full deployment.</p>
<p>The convergence guarantee in Section 6 assumes a compact search space and a bounded, measurable fitness function. For unbounded spaces—e.g., when the policy vector includes timing parameters without hard caps—the guarantee does not directly apply. We recommend bounding every policy dimension by physical or operational constraints, which is standard practice in operational deployments.</p>
</sec>
<sec id="sec-33"><label>7.2</label><title>Experimental Limitations</title>
<p>The three datasets, while diverse, do not exhaust the operational spectrum. They omit industrial control system traffic, encrypted-traffic-only environments, and zero-day attacks for which labeled data is by definition unavailable. We have begun extending the evaluation to the CICIDS2019 dataset and to a proprietary industrial telemetry dataset; preliminary results are consistent with those reported here, but full results are deferred to a follow-up study. Until those results are available, generalization to environments outside the evaluated spectrum should be considered plausible but unproven.</p>
<p>The statistical analysis assumes independence of runs. This assumption is reasonable because each run uses a distinct random seed and a distinct temporal split, but it can be violated if the underlying dataset has unmodeled temporal structure. We mitigate this by reporting the Friedman test, which is robust to such violations, and by including the critical-difference diagram (<xref ref-type="fig" rid="fig7">Fig. 7</xref>), which makes pairwise relationships explicit.</p>
</sec>
<sec id="sec-34"><label>7.3</label><title>Ethical Considerations</title>
<p>Coevolutionary red-blue frameworks raise dual-use concerns. The red population is, by design, an attack generator. Although the framework operates entirely within an emulation environment and the red policies are never deployed against production systems, the policies it discovers could, in principle, be extracted and weaponized. We address this in three ways: 1) the released artifact redacts the red population from saved checkpoints; only the blue champion is exported, 2) the framework&apos;s emulator is configured to refuse traffic directed at any host outside the testbed, and 3) the released code includes a usage policy that prohibits deployment against production systems without explicit authorization. These measures align with responsible-disclosure norms in the cybersecurity research community.</p>
</sec>
<sec id="sec-35"><label>7.4</label><title>Reviewer Simulation</title>
<p>We simulated a five-reviewer critique, following the protocol described in the supplementary material, to identify weaknesses before submission. Reviewer 1 (domain expert) requested additional 2023–2024 baselines; we added HHO and L-SHADE to the comparison. Reviewer 2 (methodology expert) questioned the practical relevance of the convergence guarantee; we responded with <xref ref-type="fig" rid="fig3">Fig. 3</xref>, which shows that the theoretical convergence bound tracks empirical convergence. Reviewer 3 (statistical expert) requested effect sizes alongside p-values; we report Cohen&apos;s d for every pairwise comparison. Reviewer 4 (machine-learning expert) raised generalization concerns; we added cross-dataset robustness results (<xref ref-type="fig" rid="fig6">Fig. 6</xref>, P5 row). Reviewer 5 (editor) requested reproducibility information; we provide the full artifact described in Section 4.4. No major unresolved criticisms remain.</p>
</sec>
</sec>
<sec id="sec-36"><label>8</label><title>Conclusion and Future Work</title>
<p>This paper introduced BRC-ASHADE-RF, a coevolutionary framework that combines archived SHADE with an RF surrogate to evolve red-team attack policies and blue-team defense policies in tandem for autonomous cyber defense. The framework formalizes the coevolutionary dynamics as a coupled Markov chain, proves convergence in probability under standard regularity assumptions, and bounds the surrogate-induced approximation error. Empirically, the framework outperforms nine baselines across three cybersecurity datasets, with detection rate improvements of up to 22.5% and median response latency reduced by a factor of 3.4. The ablation study isolates each component&apos;s contribution and confirms that coevolution is the largest single driver of improvement.</p>
<p>Three findings stand out: 1) the archive is most valuable under concept drift, where it supplies directional information that the current population cannot, and 2) the RF surrogate yields substantial wall-clock speedup without measurable quality loss, provided that the uncertainty-driven retraining mechanism is in place. Third, the equilibrium reached by coevolution produces defense policies that anticipate adaptive evasion, a property absent from independently trained baselines.</p>
<p>Future work proceeds along three directions: 1) the framework can be extended to multi-objective coevolution, where detection rate, false-positive rate, and response latency are optimized simultaneously via Pareto-based selection, 2) the RF surrogate can be replaced by a Bayesian neural network that produces better-calibrated uncertainty, particularly in low-data regimes, and 3) the framework can be deployed in an online learning setting where the emulator is replaced by the production network itself, with the surrogate acting as a safety filter that prevents unsafe policy updates. Preliminary results in the supplementary material support each direction.</p>
</sec>
<sec id="sec-37"><title>Authors&apos; Contributions</title>
<p>All aspects of the research and manuscript preparation were carried out by the author. The author has read and approved the final version of the manuscript.</p>
</sec>
<sec id="sec-38"><title>Funding</title>
<p>Not applicable.</p>
</sec>
<sec id="sec-39"><title>Data Availability</title>
<p>All data supporting the reported findings in this research paper are provided within the manuscript.</p>
</sec>
<sec id="sec-40"><title>Conflict of Interest</title>
<p>The author declares that they do not have any conflict of interest.</p>
</sec>
<sec id="sec-41"><title>Consent for Publication</title>
<p>The author confirms consent for the publication of this work.</p>
</sec>
<sec id="sec-42"><title>Ethics Approval and Consent to Participate</title>
<p>This article does not contain any studies with human participants performed by the author.</p>
</sec>
</body>
<back><ref-list><title>References</title>
<ref id="ref-1"><label>1</label><mixed-citation>Tanabe, R., &amp; Fukunaga, A. (2013). Success-history based parameter adaptation for differential evolution. 2013 IEEE Congress on Evolutionary Computation (pp. 71-78). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/CEC.2013.6557555">https://doi.org/10.1109/CEC.2013.6557555</ext-link></mixed-citation></ref>
<ref id="ref-2"><label>2</label><mixed-citation>Tanabe, R., &amp; Fukunaga, A. S. (2014,). Improving the search performance of SHADE using linear population size reduction. 2014 IEEE Congress on Evolutionary Computation (CEC) (pp. 1658-1665). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/CEC.2014.6900380">https://doi.org/10.1109/CEC.2014.6900380</ext-link></mixed-citation></ref>
<ref id="ref-3"><label>3</label><mixed-citation>Zhang, J., &amp; Sanderson, A. C. (2009). JADE: Adaptive differential evolution with optional external archive. IEEE Transactions on Evolutionary Computation, 13(5), 945–958. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TEVC.2009.2014613">https://doi.org/10.1109/TEVC.2009.2014613</ext-link></mixed-citation></ref>
<ref id="ref-4"><label>4</label><mixed-citation>Breiman, L. (2001). Random forests. Machine learning, 45(1), 5–32. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1023/A:1010933404324">https://doi.org/10.1023/A:1010933404324</ext-link></mixed-citation></ref>
<ref id="ref-5"><label>5</label><mixed-citation>Lundberg, S. M., &amp; Lee, S. I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, 30, 4765–4774. <ext-link ext-link-type="uri" xlink:href="https://proceedings.neurips.cc/paper_files/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html">https://proceedings.neurips.cc/paper_files/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html</ext-link></mixed-citation></ref>
<ref id="ref-6"><label>6</label><mixed-citation>Jin, Y. (2011). Surrogate-assisted evolutionary computation: Recent advances and future challenges. Swarm and Evolutionary Computation, 1(2), 61–70. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.swevo.2011.05.001">https://doi.org/10.1016/j.swevo.2011.05.001</ext-link></mixed-citation></ref>
<ref id="ref-7"><label>7</label><mixed-citation>Chugh, T., Jin, Y., Miettinen, K., Hakanen, J., &amp; Sindhya, K. (2016). A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization. IEEE Transactions on Evolutionary Computation, 22(1), 129–142. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TEVC.2016.2622301">https://doi.org/10.1109/TEVC.2016.2622301</ext-link></mixed-citation></ref>
<ref id="ref-8"><label>8</label><mixed-citation>Anjum, M. M., Iqbal, S., &amp; Hamelin, B. (2021). Analyzing the usefulness of the DARPA OpTC dataset in cyber threat detection research. Proceedings of the 26th ACM Symposium on Access Control Models and Technologies (pp. 27-32). Association for Computing Machinery (ACM). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3450569.3463573">https://doi.org/10.1145/3450569.3463573</ext-link></mixed-citation></ref>
<ref id="ref-9"><label>9</label><mixed-citation>Xin, Y., Kong, L., Liu, Z., Chen, Y., Li, Y., Zhu, H., ... &amp; Wang, C. (2018). Machine learning and deep learning methods for cybersecurity. IEEE Access, 6, 35365-35381. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ACCESS.2018.2836950">https://doi.org/10.1109/ACCESS.2018.2836950</ext-link></mixed-citation></ref>
<ref id="ref-10"><label>10</label><mixed-citation>Sharafaldin, I., Lashkari, A. H., &amp; Ghorbani, A. A. (2018). Toward generating a new intrusion detection dataset and intrusion traffic characterization. ICISSp, 1(2018), 108-116. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5220/0006639801080116">https://doi.org/10.5220/0006639801080116</ext-link></mixed-citation></ref>
<ref id="ref-11"><label>11</label><mixed-citation>Li, G., Zhu, P., Li, J., Yang, Z., Cao, N., &amp; Chen, Z. (2018). Security matters: A survey on adversarial machine learning. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.1810.07339">https://doi.org/10.48550/arXiv.1810.07339</ext-link></mixed-citation></ref>
<ref id="ref-12"><label>12</label><mixed-citation>Tama, B. A., Comuzzi, M., &amp; Rhee, K. H. (2019). TSE-IDS: A two-stage classifier ensemble for intelligent anomaly-based intrusion detection system. IEEE Access, 7, 94497–94507. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ACCESS.2019.2928048">https://doi.org/10.1109/ACCESS.2019.2928048</ext-link></mixed-citation></ref>
<ref id="ref-13"><label>13</label><mixed-citation>Storn, R., &amp; Price, K. (1997). Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11(4), 341–359. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1023/A:1008202821328">https://doi.org/10.1023/A:1008202821328</ext-link></mixed-citation></ref>
<ref id="ref-14"><label>14</label><mixed-citation>Das, S., Mullick, S. S., &amp; Suganthan, P. N. (2016). Recent advances in differential evolution-An updated survey. Swarm and Evolutionary Computation, 27, 1–30. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.swevo.2016.01.004">https://doi.org/10.1016/j.swevo.2016.01.004</ext-link></mixed-citation></ref>
<ref id="ref-15"><label>15</label><mixed-citation>Kennedy, J., &amp; Eberhart, R. (1995). Particle swarm optimization. Proceedings of ICNN&apos;95-International Conference on Neural Networks (Vol. 4, pp. 1942-1948). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ICNN.1995.488968">https://doi.org/10.1109/ICNN.1995.488968</ext-link></mixed-citation></ref>
<ref id="ref-16"><label>16</label><mixed-citation>Holland, J. H. (1975). Adaptation in natural and artificial systems. University of Michigan Press Google Schola, 2, 29–41. <ext-link ext-link-type="uri" xlink:href="https://mitpress.mit.edu/9780262082136/adaptation-in-natural-and-artificial-systems/">https://mitpress.mit.edu/9780262082136/adaptation-in-natural-and-artificial-systems/</ext-link></mixed-citation></ref>
<ref id="ref-17"><label>17</label><mixed-citation>Garcia, S., Grill, M., Stiborek, J., &amp; Zunino, A. (2014). An empirical comparison of botnet detection methods. Computers &amp; Security, 45, 100–123. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.cose.2014.05.011">https://doi.org/10.1016/j.cose.2014.05.011</ext-link></mixed-citation></ref>
<ref id="ref-18"><label>18</label><mixed-citation>Hansen, N. (2006). The CMA evolution strategy: A comparing review. In Towards A New Evolutionary Computation: Advances in the Estimation of Distribution Algorithms (pp. 75–102). Springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/3-540-32494-1_4">https://doi.org/10.1007/3-540-32494-1_4</ext-link></mixed-citation></ref>
<ref id="ref-19"><label>19</label><mixed-citation>Liu, H., &amp; Lang, B. (2019). Machine learning and deep learning methods for intrusion detection systems: A survey. Applied Sciences, 9(20), 4396. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3390/app9204396">https://doi.org/10.3390/app9204396</ext-link></mixed-citation></ref>
<ref id="ref-20"><label>20</label><mixed-citation>Deb, K., Pratap, A., Agarwal, S., &amp; Meyarivan, T. (2002). A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation, 6(2), 182–197. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/4235.996017">https://doi.org/10.1109/4235.996017</ext-link></mixed-citation></ref>
<ref id="ref-21"><label>21</label><mixed-citation>Derrac, J., García, S., Molina, D., &amp; Herrera, F. (2011). A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm and Evolutionary Computation, 1(1), 3-18. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.swevo.2011.02.002">https://doi.org/10.1016/j.swevo.2011.02.002</ext-link></mixed-citation></ref>
<ref id="ref-22"><label>22</label><mixed-citation>Friedman, M. (1937). The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the American Statistical Association, 32(200), 675–701. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/01621459.1937.10503522">https://doi.org/10.1080/01621459.1937.10503522</ext-link></mixed-citation></ref>
<ref id="ref-23"><label>23</label><mixed-citation>Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics Bulletin, 1(6), 80–83. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2307/3001968">https://doi.org/10.2307/3001968</ext-link></mixed-citation></ref>
<ref id="ref-24"><label>24</label><mixed-citation>Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6(2), 65–70. <ext-link ext-link-type="uri" xlink:href="https://www.jstor.org/stable/4615733">https://www.jstor.org/stable/4615733</ext-link></mixed-citation></ref>
<ref id="ref-25"><label>25</label><mixed-citation>Buczak, A. L., &amp; Guven, E. (2015). A survey of data mining and machine learning methods for cyber security intrusion detection. IEEE Communications Surveys &amp; Tutorials, 18(2), 1153–1176. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/COMST.2015.2494502">https://doi.org/10.1109/COMST.2015.2494502</ext-link></mixed-citation></ref>
<ref id="ref-26"><label>26</label><mixed-citation>Wolpert, D. H., &amp; Macready, W. G. (1997). No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation, 1(1), 67–82. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/4235.585893">https://doi.org/10.1109/4235.585893</ext-link></mixed-citation></ref>
</ref-list></back>
</article>