<?xml version="1.0" encoding="UTF-8"?>
<article xmlns:xlink="http://www.w3.org/1999/xlink">
<front><article-meta>
<title-group><article-title>Interpretable Population Dynamics: Causal Inference for Engineering Optimization Decisions</article-title></title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Mahmoud</surname><given-names>Rania A.</given-names></name><xref ref-type="aff" rid="aff1"/></contrib>
<contrib contrib-type="author"><name><surname>Mensah</surname><given-names>Kwame A.</given-names></name><xref ref-type="aff" rid="aff2"/></contrib>
<aff id="aff1">Department of Computer Science, Alexandria University, Alexandria, Egypt.</aff>
<aff id="aff2">Department of Computer Science, University of Cape Coast, Cape Coast, Ghana.</aff>
</contrib-group>
<abstract><p>Engineering teams increasingly ask of an optimization algorithm more than a good design: They ask for a justification of it. This paper presents Interpretable Population Dynamics (IPD), a metaheuristic for optimization over Riemannian manifolds in which population evolution is governed by an explicitly modeled causal system, so that the algorithm can audit and explain its own search behavior. Within IPD, geodesic variation operators act as interventions on a causal graph of search dynamics, scheduling selects the action with maximal predicted counterfactual progress, and inverse-probability-weighted estimation on logged trajectories quantifies the Average Treatment Effect (ATE) of every algorithmic factor. The experimental program evaluates the method on ten problems spanning four manifold species, the sphere, the Stiefel manifold, the Symmetric Positive Definite (SPD) cone, and SO(3), against twelve racing competitors, including newly admitted Riemannian trust-region, adaptive stochastic, and quasi-Newton rivals, over 21 independent runs under a 12,000-evaluation budget. IPD attains the smallest median optimality gap on seven of the ten problems, with a median reduction of 26.2% against the strongest rival on those problems; exact paired permutation tests with Benjamini-Hochberg control confirm 94 of 100 contrasts, while Riemannian CMA-ES retains the two smooth SPD instances and a Riemannian trust-region method retains the best-conditioned Stiefel instance. In the audit leg, an honest Causal Forest reproduces the audit&apos;s effect ordering with Spearman correlation 0.90, whereas naive correlational attribution overstates the dominant operator&apos;s effect by 43.7%. Grouping by curvature regime locates the scheduling gain chiefly on positive-curvature multimodal instances, two one-sided equivalence tests certify wall-clock parity with the fastest baselines wherever objective evaluation dominates, and a regime surrogate with 85.9% cross-validated accuracy converts logged trajectories into decision-ready evidence.</p></abstract>
<kwd-group kwd-group-type="author"><kwd>Interpretable optimization</kwd><kwd>Causal inference</kwd><kwd>Population dynamics</kwd><kwd>Riemannian manifolds</kwd><kwd>Metaheuristics</kwd><kwd>Explainable artificial intelligence</kwd></kwd-group>
</article-meta></front>
<body>
<sec id="sec-1"><label>1</label><title>Introduction</title>
<p>When engineering teams entrust hard design choices to an optimization algorithm, responsibility travels with the design, because the people who sign off on the result answer for outcomes they did not directly compute. Whenever a metaheuristic proposes a sensor layout or a learned metric, the decision-maker reasonably asks why the search settled where it did, which mechanisms produced the observed progress, and whether more budget would change the answer. Provided that the objective admits few assumptions and the application demands graceful degradation on multimodal or noisy landscapes, population-based methods remain attractive in practice <xref ref-type="bibr" rid="ref-1">[1]</xref>, <xref ref-type="bibr" rid="ref-2">[2]</xref>. Their internal decision processes, however, resist inspection: Credit for improvement spreads implicitly across operators, parameters, and chance, and no standard metaheuristic documented to date produces evidence about its own search that would survive design review.</p>
<p>A growing share of engineering optimization problems is most naturally stated on Riemannian manifolds, because direction vectors live on spheres, orthogonal and low-rank factors on the Stiefel manifold, and covariance and diffusion structures in the cone of Symmetric Positive Definite (SPD) matrices <xref ref-type="bibr" rid="ref-3">[3]</xref>, <xref ref-type="bibr" rid="ref-4">[4]</xref>. Treating such a problem in ambient Euclidean space distorts geometry, forces repair or projection steps, and can alter the landscape being searched. For single-trajectory methods, the literature offers mature machinery, namely tangent spaces, retractions, and geodesic steps; population-based search on manifolds has received far less attention, and, so far as the record establishes, no method of either kind explains its own dynamics. The explainable-AI toolkit, from Shapley-value regressors <xref ref-type="bibr" rid="ref-5">[5]</xref> and local surrogates <xref ref-type="bibr" rid="ref-6">[6]</xref> to the broader attribution literature <xref ref-type="bibr" rid="ref-7">[7]</xref>, takes predictors rather than iterative search processes as its object. Pointed at optimizer logs, such tools return correlational statements: An operator co-occurred with progress, a parameter tracked the fitness curve. Within a feedback loop, such associations are treacherous, because the algorithm itself decides, as a function of the current state, when each operator is applied. It follows that the observed association between an operator and subsequent progress mixes the operator&apos;s true contribution with the circumstances that triggered its use.</p>
<p>The position defended here is that the search process itself should be the object of causal analysis <xref ref-type="bibr" rid="ref-8">[8]</xref>. Under this design, a small set of sufficient statistics summarizes the evolving population, every operator application acts as an intervention carrying an explicit dose on the resulting stochastic process, and a structural causal model, the causal graph of search dynamics, links doses to state transitions. Inverse-probability weighting on logged trajectories estimates the effects of algorithmic factors, after which the same model serves prospectively: The scheduler chooses each iteration&apos;s action by predicting counterfactual progress under candidate interventions. Explanation thereby ceases to be an afterthought and becomes the control signal of the optimizer.</p>
<p>The empirical portion of this work is organized around three questions, each matched to one falsifiable hypothesis. The questions separate the optimization claim, which concerns what Intervention-Aware Scheduling (IAS) buys over operator-blind search at equal budget, the identification claim, which concerns whether the population-dynamics effects are estimable under the stated assumptions, and the transfer claim, which concerns whether the estimates survive changes of manifold and dimension. The three claims are logically independent, so none can stand on the strength of another. Sections 6.4 through 6.8 supply the evidence for each hypothesis.</p>
<p>RQ1: Does intervention-aware causal operator scheduling improve manifold optimization relative to operator-blind competitors under a shared evaluation budget?</p>
<p>RQ2: Are the population-dynamics causal effects identifiable and consistently estimable under the stated assumptions, as the causal audit, now contested by an independent estimator, verifies?</p>
<p>RQ3: Do the estimated intervention effects transfer across curvature regimes and dimensions, as the grouping and ladder studies of Section 6.8 test?</p>
<p>H1. At equal budget, Interpretable Population Dynamics (IPD) attains a positive median gap reduction against the best-performing of the ten optimizer rivals on the majority of the ten problems and holds the smallest median gap on at least seven of them.</p>
<p>H2. The audit reports positive Average Treatment Effects (ATEs) whose Confidence Intervals (CIs) exclude zero, an independent causal estimator reproduces their ordering, and naive correlational attribution departs materially from both.</p>
<p>H3. Neither curvature regime nor dimension moderates the intervention-scheduling effect, so the grouped and scaled estimates agree with the pooled estimate within their confidence-interval widths.</p>
<p>The contributions of this work are as follows:</p>
<p>I. A causal formulation of population-based search on Riemannian manifolds, with operator doses entering as interventions on a structural model of population-dynamics state transitions (Section 3).</p>
<p>II. The IPD algorithm itself, which couples geodesic variation operators, namely covariance-adapted tangent mutation, Geodesic Crossover (GC), and retraction-based local search, with IAS driven by counterfactual simulation over a five-iteration horizon (Section 4).</p>
<p>III. An estimation methodology converting logged trajectories into ATEs with bootstrap CIs, together with a quantitative contrast against naive correlational attribution that indicates confounding-induced overestimation of 43.7% for the dominant operator, cross-checked by an independent causal estimator (Sections 4.5 and 6.5).</p>
<p>IV. A theoretical treatment covering convergence in probability to the global optimum on manifolds via a geodesic-distance potential function, consistency for the causal estimator under state-sufficient logging, and per-iteration complexity including estimation overhead (Section 5).</p>
<p>V. An empirical program on ten manifold problems spanning four manifold species, against twelve racing rivals, including Riemannian trust-region, adaptive stochastic, and quasi-Newton newcomers, and one rival causal estimator in the audit leg, over 21 runs per pairing under a 12,000-evaluation budget, with exact permutation inference, false-discovery-rate control, and equivalence testing of the overhead claim, and with estimator-agreement, curvature-sensitivity, and cross-dimension analyses (Section 6).</p>
<p>The remainder of the paper proceeds as follows. Section 2 reviews optimization on manifolds, causal inference, and explainability for search, and states the research gap; Section 3 formalizes manifold-constrained problems, the population state space, and the causal graph of search dynamics; and Section 4 presents the IPD algorithm together with its explainability pipeline, culminating in Algorithm 1. Section 5 develops the convergence, consistency, and complexity results, while Section 6 reports the experimental program: optimization results under exact permutation inference, the causal audit contested by an independent estimator, an intervention-attribution case study, ablations, and curvature and cross-dimension analyses. Section 7 discusses how decision-makers should interpret the outputs and when the estimates can fail; Section 8 lists limitations; and Section 9 concludes.</p>
</sec>
<sec id="sec-2"><label>2</label><title>Related Work</title>
<p>Three literatures bear on the present work: Riemannian optimization supplies the geometry, causal inference supplies the identification and estimation machinery, and interpretable machine learning supplies the interface between numbers and decisions. The discussion reviews each literature in turn and then states the gap that IPD addresses.</p>
<sec id="sec-3"><label>2.1</label><title>Optimization on Riemannian Manifolds</title>
<p>The recognition that orthogonality and rank constraints induce a nontrivial search geometry dates to early numerical linear algebra, and the view of constraint sets as manifolds equipped with tangent-space calculus was systematized by Edelman et al. <xref ref-type="bibr" rid="ref-9">[9]</xref>. Earlier still, Smith had introduced Riemannian optimization techniques for eigenvalue-type problems <xref ref-type="bibr" rid="ref-10">[10]</xref>, while Nishimori and Akaho <xref ref-type="bibr" rid="ref-11">[11]</xref> developed learning algorithms following quasi-geodesic flows on the Stiefel manifold. Around retractions, which act as first-order surrogates for the Riemannian exponential, Absil et al. <xref ref-type="bibr" rid="ref-4">[4]</xref> consolidated the field in a book-length treatment of line-search and trust-region methods on embedded manifolds. Three later contributions sharpened the picture: Bonnabel <xref ref-type="bibr" rid="ref-12">[12]</xref> analyzed stochastic gradient descent on manifolds, Absil et al. <xref ref-type="bibr" rid="ref-13">[13]</xref> introduced Riemannian trust-region methods, and Boumal et al. <xref ref-type="bibr" rid="ref-14">[14]</xref> established global convergence rates for nonconvex manifold optimization. On the SPD cone, an affine-invariant geometry whose distance is induced by matrix logarithms arises naturally <xref ref-type="bibr" rid="ref-15">[15]</xref>, <xref ref-type="bibr" rid="ref-16">[16]</xref>; Forstner and Moonen <xref ref-type="bibr" rid="ref-17">[17]</xref> studied a comparable metric structure for covariance matrices; and the cone underlies applications from information-theoretic metric learning <xref ref-type="bibr" rid="ref-18">[18]</xref> to covariance estimation. Sensor-network localization, a representative nonconvex least-squares problem over products of spheres whose semidefinite relaxations are well understood <xref ref-type="bibr" rid="ref-19">[19]</xref>, illustrates the engineering setting in which such products arise. By comparison, population-based search on manifolds remains underdeveloped: Geodesic variants of particle swarm optimization built on the classical dynamics of Kennedy and Eberhart <xref ref-type="bibr" rid="ref-20">[20]</xref> exist, as do manifold adaptations of evolution strategies, including the tangent-space realization of Covariance Matrix Adaptation (CMA) <xref ref-type="bibr" rid="ref-21">[21]</xref> that serves as the strongest baseline here, yet both inherit the black-box character of their Euclidean ancestors. None of these methods maintains a model of why its own population moves as it does, and that vacancy is precisely what this paper addresses.</p>
</sec>
<sec id="sec-4"><label>2.2</label><title>Causal Modeling and Inference in Computational Intelligence</title>
<p>Two interchangeable languages underpin modern causal inference. In the potential-outcomes tradition, effects are contrasts between hypothetical worlds in which the same unit receives different treatments <xref ref-type="bibr" rid="ref-22">[22]</xref>, <xref ref-type="bibr" rid="ref-23">[23]</xref>; in the structural tradition, data-generating processes are graphs manipulated with the do-operator <xref ref-type="bibr" rid="ref-8">[8]</xref>, <xref ref-type="bibr" rid="ref-24">[24]</xref>; and modern textbook treatments consolidate both languages while stating their assumptions explicitly <xref ref-type="bibr" rid="ref-25">[25]</xref>. Graphical model discovery addresses the harder problem of learning causal structure from observational data <xref ref-type="bibr" rid="ref-27">[26]</xref>. For time series, Granger&apos;s <xref ref-type="bibr" rid="ref-28">[27]</xref> notion of predictive causation is known to confuse influence with shared history, a caution reinforced in observational network settings <xref ref-type="bibr" rid="ref-29">[28]</xref> and one that motivates modern time-series causal discovery <xref ref-type="bibr" rid="ref-30">[29]</xref>, <xref ref-type="bibr" rid="ref-31">[30]</xref>.</p>
<p>Classically, estimation from observational data proceeds by balancing treatment assignment through propensity scores <xref ref-type="bibr" rid="ref-32">[31]</xref>, whose inverse-probability form descends from the Horvitz-Thompson <xref ref-type="bibr" rid="ref-33">[32]</xref> estimator of survey sampling; difference-in-differences instead exploits policy changes over time <xref ref-type="bibr" rid="ref-34">[33]</xref>, and the assumption audits these estimators demand are codified in dedicated treatises <xref ref-type="bibr" rid="ref-35">[34]</xref>. Within computational intelligence, causal vocabulary appears almost exclusively for external systems, for example feature selection, spatio-temporal forecasting, or neural architecture choice, whereas the algorithms doing the selecting are themselves analyzed, if at all, with purely descriptive statistics. No metaheuristic in this literature maintains a causal model of its own dynamics, estimates the effects of its own decisions, and schedules itself by interventions; filling that vacancy is the purpose of Sections 3 and 4.</p>
</sec>
<sec id="sec-5"><label>2.3</label><title>Explainability for Search and Optimization</title>
<p>Interpretable machine learning favors models whose structure can be read directly, a design philosophy surveyed by Rudin <xref ref-type="bibr" rid="ref-36">[35]</xref>, with classification and regression trees <xref ref-type="bibr" rid="ref-37">[36]</xref> and rule induction <xref ref-type="bibr" rid="ref-38">[37]</xref> as the workhorses. That intelligibility matters in high-stakes deployment was made concrete by the pneumonia-risk study of Caruana et al. <xref ref-type="bibr" rid="ref-39">[38]</xref>. Saliency methods such as Grad-CAM <xref ref-type="bibr" rid="ref-40">[39]</xref> explain visual classifiers but admit no natural analogue for a cloud of points on a manifold. Applied to optimization logs, post-hoc attribution tools such as Shapley regressors and local surrogates <xref ref-type="bibr" rid="ref-5">[5]</xref>, <xref ref-type="bibr" rid="ref-6">[6]</xref> inherit the correlational character of their estimands, yet are routinely presented as if they established contribution rather than co-occurrence.</p>
<p>An older tradition of credit assignment exists within evolutionary computation itself. Holland&apos;s <xref ref-type="bibr" rid="ref-41">[40]</xref> adaptive plans, CMA in evolution strategies <xref ref-type="bibr" rid="ref-21">[21]</xref>, and the self-adapting control parameters of differential evolution <xref ref-type="bibr" rid="ref-42">[41]</xref> all redistribute credit for observed improvement; adaptive operator selection formalizes the task as a multi-armed bandit over operators <xref ref-type="bibr" rid="ref-43">[42]</xref>, and parameter control is surveyed by Karafotias et al. <xref ref-type="bibr" rid="ref-44">[43]</xref>. These mechanisms learn from reward rather than from interventions: Because they condition on the very state that also caused the assignment, their credit estimates carry confounding by construction, and users rarely see them as auditable evidence. IPD retains the adaptivity while replacing observed-reward credit assignment with intervention-based effect estimation, and it elevates the resulting estimates to first-class outputs of the search.</p>
</sec>
<sec id="sec-6"><label>2.4</label><title>Research Gap and Positioning</title>
<p>Since the no-free-lunch theorems render algorithm performance instance-specific <xref ref-type="bibr" rid="ref-45">[44]</xref>, the case strengthens for methods that can report what happened in a particular run rather than what happens on average; sound statistical comparison practice likewise demands per-instance, distribution-aware evidence <xref ref-type="bibr" rid="ref-46">[45]</xref>. Read jointly, the three reviews above expose a vacancy: No existing method is simultaneously: 1) manifold-native, 2) equipped with a causal model of its own dynamics, 3) capable of built-in attribution with uncertainty quantification, 4) scheduled by interventions, and 5) covered by convergence analysis. <xref ref-type="table" rid="tab1">Table 1</xref> records this positioning against representative neighbors.</p>
<table-wrap id="tab1"><label>Table 1</label><caption><p>Positioning of IPD relative to representative prior approaches. Entries indicate that the property is native to the method rather than achievable only through external post-hoc analysis.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:4:66,406,537.1,577.1"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>*ATE, CI, n/a: Not applicable to a post-hoc analysis tool.</p>
<p>Each closest neighbor forgoes at least two of the five properties. R-CMA-ES is manifold-native and, as Section 6 confirms, the strongest baseline in practice; its Covariance Adaptation (CA), however, is correlational credit assignment learned from observed reward, and it offers no account of its own dynamics. Geodesic PSO and tangent-space differential evolution move correctly on the manifold while inheriting the opacity of their Euclidean ancestors. Post-hoc attribution applied to optimizer logs, the SHAP-on-EC row of <xref ref-type="table" rid="tab1">Table 1</xref>, yields correlational statements without identification, a distortion quantified in Section 6.5. Provided that this reading of the literature is correct, IPD is the first population-based optimizer to hold all five properties at once; whether the design costs or pays for itself in optimization quality is tested in Section 6.</p>
</sec>
</sec>
<sec id="sec-7"><label>3</label><title>Problem Formulation on Manifolds</title>
<p>This section sets up the formal objects: The manifold-constrained problem, the population state space with its sufficient statistics, and the causal graph that turns operator scheduling into intervention design. Notation is kept minimal, so that the estimation methodology of Section 4.5 and the consistency argument of Section 5.2 can be stated without auxiliary machinery.</p>
<sec id="sec-8"><label>3.1</label><title>Manifold-Constrained Optimization</title>
<p>Writing M for a smooth embedded submanifold of R^n, and T_X M for the tangent space at each point X in M, the problem takes the following form. Throughout, X_i^(t) denotes the i-th element of a population on M, and F is the objective to be minimized over the manifold:</p>
<p>min F(X). (1)</p>
<p>A retraction R_X: T_X M -&gt; M organizes moves on M; it sends a tangent vector G to a feasible point while agreeing with the Riemannian exponential to first order, so that R_X(0) = X and the differential of R_X at 0 is the identity <xref ref-type="bibr" rid="ref-4">[4]</xref>. Because retractions cost far less than exact exponentials while preserving descent structure, they serve as the workhorse of manifold optimization. Four retraction families cover the benchmark suite: On the sphere S^(d-1) and on products of spheres such as the oblique manifold, the normalization retraction R_X(G) = (X + G) / ||X + G||, applied factor by factor; on the Stiefel manifold St(p, n) of orthonormal p-frames, the Q factor of the QR decomposition of X + G; on the SPD cone, the matrix-exponential retraction given explicitly in Eq. (7) below; and on SO(3), the Rodrigues exponential map, which is exact and inexpensive in three dimensions. F is assumed continuously differentiable on M, with exact evaluations; Section 9 discusses noisy extensions.</p>
<p>Because single-trajectory manifold methods rely on Riemannian gradients, they can stall on multimodal or ill-conditioned landscapes. A population X_1, ..., X_N, by contrast, maintains samples across basins and senses landscape curvature only through those samples, which motivates population-based manifold search. The price is a set of additional degrees of freedom, such as how many offspring each operator generates and when to switch from exploration to exploitation, whose consequences entangle across iterations. Rendering those decisions explicit and estimable is the role of the causal model introduced next.</p>
</sec>
<sec id="sec-9"><label>3.2</label><title>Population State Space and Sufficient Statistics</title>
<p>At each iteration t, the population is summarized by a state vector of four sufficient statistics:</p>
<p>(t) (t) (t) (t) (t) ⊤</p>
<p>s = (D , g ˙ , ρ , Δ ) . (2)</p>
<p>Here D^(t), the mean pairwise geodesic distance among population elements, measures diversity; the second component is the mean norm of Riemannian gradients, estimated by central differences in tangent coordinates whenever analytic gradients are unavailable; rho^(t) is the clearance to the constraint boundary, instantiated as the log-scaled smallest eigenvalue of the worst individual on the SPD cone and as a constant on boundaryless compact manifolds such as the sphere and the Stiefel manifold; and Delta^(t), the interquartile spread of objective values normalized by 1 + |F_best^(t)|, measures fitness spread. Once adapted to the filtration generated by the population history, the state becomes a stochastic process, and every downstream causal statement is a statement about this process.</p>
<p>Four statistics constitute a deliberate compromise. A richer state, for instance the full empirical covariance of the population in tangent coordinates, would describe the dynamics more faithfully, but it would leave the propensity model of Section 4.5 ill-conditioned at the default window of W = 40 iterations. Throughout, s^(t) denotes the state vector of Eq. (2), a^(t) the action applied at iteration t, and Y^(t+1) the normalized progress outcome defined in Section 4.3. Assumption 1 (state sufficiency) states that, conditional on s^(t) and the action taken, the distribution of s^(t+1) does not depend on earlier history; Section 5.2 examines when this fails and what it costs the estimator.</p>
</sec>
<sec id="sec-10"><label>3.3</label><title>The Causal Graph of Search Dynamics</title>
<p>IPD distinguishes five algorithmic factors. Three of them are generative operators, Geodesic Mutation (GM), GX, and Geodesic Local Search (GLS), whose per-iteration doses form a point u^(t) on the 3-simplex, the dose u_k^(t) being the fraction of the N offspring generated by operator k. The remaining two factors are binary modes: CA, which switches mutation sampling between an adapted and an isotropic covariance, and IAS itself, whose indicator contrasts scheduler-chosen with randomized exploration actions. The joint action a^(t) = (u^(t), m^(t)) lives in the action space of dose-grid points crossed with binary modes. Nodes s^(t), a^(t), s^(t+1), and Y^(t+1) constitute the causal graph of search dynamics: The edge s^(t) -&gt; a^(t) exists because the scheduler observes the state, s^(t) -&gt; s^(t+1) because of population inertia, a^(t) -&gt; s^(t+1) because operators act on the population, and s^(t), s^(t+1) -&gt; Y^(t+1) because progress is a functional of the state pair. Exogenous noise closes the model.</p>
<p>A single structural equation encodes the dynamics:</p>
<p>(t+1) (t) (t) (t)</p>
<p>s = h(s , a , ε ), (3)</p>
<p>where h is unknown and is learned online from logged transitions. Whenever an intervention fixes factor k to a chosen value, a constant replaces the scheduler&apos;s equation for that component, which the do-calculus writes as the modified structural equation:</p>
<p>(t+1) (t) (t) (t) (t)</p>
<p>s ∣ do (a = a) = h (s , a , a, ε ). (4)</p>
<p>k −k</p>
<p>Confounding in naive analyses originates at the edge s^(t) -&gt; a^(t): States with low diversity and long stagnation both invite high mutation doses and carry large unrealized potential for progress, so the marginal association between dose and outcome tends to overstate the operator&apos;s effect. Because the scheduler is a known function of the logged state plus randomization, the back-door condition is satisfied by construction with respect to the logged covariates, and identification therefore reduces to the credibility of Assumption 1. Section 8 accordingly treats state sufficiency as the principal threat to validity rather than as a technicality.</p>
</sec>
</sec>
<sec id="sec-11"><label>4</label><title>The Interpretable Population Dynamics Algorithm</title>
<p>Three interlocking loops constitute IPD: An optimization loop that moves the population, an estimation loop that fits the causal models, and an explanation loop that converts estimates into decision-ready evidence. This section describes the operators, the causal population-dynamics model, the intervention-aware scheduler, the effect estimator, and the explainability pipeline, and closes with pseudocode and default parameters.</p>
<sec id="sec-12"><label>4.1</label><title>Architecture Overview</title>
<p>The optimization loop executes one population update per iteration: it computes the state, selects an action, generates and evaluates offspring, and applies elitist selection. Every five iterations, the estimation loop wakes and refits two models on the trailing window of W = 40 logged iterations, namely a propensity model for the probability of each factor&apos;s assignment given the state and the structural model h for state transitions. The explanation loop, largely amortized, maintains the running effect estimates used for attribution and, at the end of a run, fits the regime surrogate segmenting the trajectory into behavioral phases. All three loops read from and write to a trajectory store of triples (s^(t), a^(t), Y^(t+1)).</p>
<p>Separation of duties is what keeps the audit honest. The scheduler may use the fitted models to choose actions, yet the effects reported to users come from the estimator of Section 4.5, applied to the same store with overlap-preserving randomization rather than to the scheduler&apos;s internal predictions. IPD budgets the randomization rather than leaving it open-ended: a short uniform-exploration phase followed by a small action jitter, so that the regret paid for identifiability stays bounded and measurable.</p>
</sec>
<sec id="sec-13"><label>4.2</label><title>Geodesic-Based Variation Operators</title>
<p>Mutation draws a tangent perturbation and retracts it onto the manifold:</p>
<p>Xi = RX (Gi), Gi ∈ TX ℳ. (5)</p>
<p>Gaussian in tangent coordinates, the perturbation carries a covariance that adapts to recent success,</p>
<p>(t) (t)</p>
<p>G = σ L ξ , ξ ∼ (0, I ), (6)</p>
<p>i i i i i d</p>
<p>where the covariance is factored as Sigma_i^(t) = sigma_i^(t) L_i^(t) L_i^(t)-transpose, sigma_i^(t) is a global step size, and xi_i is standard normal in tangent coordinates. After each iteration, the rank-one update C_i^(t+1) = (1 - c) C_i^(t) + c * (ghat ghat-transpose) / tr(C_i^(t)), with learning rate c = 0.15 and ghat the normalized successful tangent step, rewards individuals whose offspring improved; C is refactored periodically so that L remains well-conditioned. Whenever the CA mode switches off, the covariance collapses to an isotropic diagonal, which preserves the operator while disabling adaptation.</p>
<p>On the SPD cone, the retraction admits a closed form that preserves positive definiteness exactly:</p>
<p>1 1 1 1</p>
<p>R (G) = X2 exp (X 2GX 2)X2. (7)</p>
<p>This map is the standard first-order approximation of the affine-invariant exponential <xref ref-type="bibr" rid="ref-15">[15]</xref>, <xref ref-type="bibr" rid="ref-16">[16]</xref>; it costs one matrix exponential, evaluated by scaling-and-squaring <xref ref-type="bibr" rid="ref-16">[16]</xref>. On the sphere and on oblique products of spheres, mutation uses the normalization retraction; on the Stiefel manifold, the QR retraction; on SO(3), the Rodrigues map. Blending two parents along their connecting geodesic, GC takes as child the point Exp_{X_i}(beta * Log_{Xi}(X_j)) with mixing coefficient beta = 0.5, implemented with the same retractions wherever exact logarithm maps are expensive. GLS performs a single Armijo-backtracking step along the negative Riemannian gradient from a promising individual, exploiting smoothness without abandoning the population view. Because offspring are generated in proportion to the operator doses u^(t), the dose vector is a property of the iteration rather than of any single individual.</p>
</sec>
<sec id="sec-14"><label>4.3</label><title>Causal Population-Dynamics Model</title>
<p>Instantiated as a locally linear map on engineered features, the structural model h operates on the state, the action, and their elementwise products, which capture first-order interactions between regime and dose. Prediction of s^(t+1) from these features uses ridge-regularized least squares with penalty 0.5, and the residuals form the empirical noise eps^(t). The normalized progress outcome is defined as Y^(t+1) = (F_best^(t) - F_best^(t+1)) / (Delta^(t) + eta), that is, progress measured in units of the current population spread, with eta = 10^-12 guarding the division. Effects are thereby comparable across problems and phases of a run, and, because the outcome is a deterministic functional of the state pair, h predicts it transitively. A grid hosts the doses and modes: u on the 3-simplex in increments of 0.25, giving 15 dose points, crossed with the two binary modes, giving 60 actions in total. Over the action grid, the scheduler plays a uniform policy for the first 20 iterations, and thereafter the procedure jitters each selected action to a neighboring grid point with probability 0.1. The deliberate randomization guarantees overlap: every state region retains positive probability of both high and low doses of each factor. That guarantee is the price paid for identifiable effects, and the exploration budget bounds its regret. Only in the window, the grid, and the randomization schedule does IPD spend effort that a purely greedy optimizer would not.</p>
</sec>
<sec id="sec-15"><label>4.4</label><title>Intervention-Aware Operator Scheduling</title>
<p>The scheduler scores every candidate action a with a value function Q-hat(s^(t), a), the model-predicted cumulative counterfactual progress when a is forced at the current state, and commits to any action attaining the maximum:</p>
<p>ˆ (t) (t) ˆ (t)</p>
<p>Q(s , a ) = maxa∈ Q(s , a). (8)</p>
<p>Approximation of Q-hat proceeds by rolling h forward over a horizon of H = 5 iterations with the action held fixed, averaging three randomized noise draws per candidate, and crediting the cumulative predicted progress. The construction reads as model-predictive control with a causal plant model: the do-conditioning inside Q-hat distinguishes it from bandit lookahead, which conditions on the scheduler&apos;s own past choices and therefore answers a different question.</p>
<p>More than the noise averaging, it is the horizon that matters. A one-step greedy scheduler is exactly the immediate-reward policy that the ablation in Section 6.7 shows to be clearly inferior, because exploration operators pay off with a lag of several iterations in the state dynamics. Across the benchmark set, H = 5 was the smallest horizon capturing this lag; longer horizons increased estimation variance without improving final gaps in preliminary sweeps.</p>
</sec>
<sec id="sec-16"><label>4.5</label><title>Estimation of Causal Effects</title>
<p>For factor k, the treatment indicator A_t^(k) equals one whenever the factor is applied at high dose, taken to be u_k^(t) &gt;= 0.5 for the generative operators and the mode bit for CA and IAS. On normalized progress, the estimand is the ATE:</p>
<p>ak ak</p>
<p>τk = E[Y = 1 − Y = 0]. (9)</p>
<p>Because assignment is confounded through s^(t), estimation proceeds by inverse-probability weighting. On the same window, with the current and lagged state as covariates, the procedure fits a ridge-penalized logistic propensity model e-hat^(k) and forms the Hajek weights as</p>
<p>(k) (k)</p>
<p>(k) A 1 − A</p>
<p>ω = + , (10)</p>
<p>t (k) (k)</p>
<p>e ‾ 1 − e ‾ from which the estimator follows:</p>
<p>(k) (0) (0) (0)</p>
<p>∑ ω A Y ∑t=w ω (1 − A ) Yt+1</p>
<p>t∈w t t t+1 t t</p>
<p>τ ˆk = − , (11)</p>
<p>(0) (k) (0) (k)</p>
<p>∑t∈w ω A ∑ ω (1 − A )</p>
<p>t t t∈w t t</p>
<p>where the sums run over the estimation window. CIs come from a block bootstrap that resamples whole runs (1,000 resamples) and thereby respects within-run dependence; the effective sample size of the weights, which stayed above 0.6 W in every reported run, and calibration plots of predicted versus observed assignment jointly monitor overlap. As a robustness check, a difference-in-differences variant exploiting the policy switches at refit boundaries agreed with the weighted estimator within 0.012 on every factor.</p>
<p>The same machinery supports the negative result this paper considers most instructive. Replacement of the propensity adjustment by an unadjusted contrast of high- and low-dose iterations yields the naive correlational attribution implicitly used whenever algorithms are tuned on observed improvement. Section 6.5 quantifies the gap between the two estimators and traces it to the diversity-state confounder identified in Section 3.3.</p>
</sec>
<sec id="sec-17"><label>4.6</label><title>The Explainability Pipeline</title>
<p>Attribution converts the estimated effects into shares,</p>
<p>max(0, τ ˙k)</p>
<p>ϕk = , (12)</p>
<p>∑ max(0, τ ˙j)</p>
<p>so that the positive contributions of the K = 5 factors sum to one; factors whose estimated effects are negligible or negative receive zero share rather than canceling the narrative. In the audit report, these shares appear alongside the CIs of the underlying effects and the propensity diagnostics of Section 4.5, so every number carries its own uncertainty statement.</p>
<p>Behavior over time is what regime segmentation explains. The pipeline standardizes six trajectory features, namely diversity, mean gradient norm, fitness spread, dose entropy, a stagnation counter counting iterations since the last relative improvement of two percent, and normalized progress; k-means with four centers then supplies reference labels that inspection maps to exploration-dominated, exploitation-dominated, stagnation-recovery, and convergence-refinement regimes. From the same features, a CART surrogate <xref ref-type="bibr" rid="ref-37">[36]</xref> constrained to depth five with a minimum leaf size of 50 predicts the label, reproducing the reference partition with 85.9% accuracy under 10-fold cross-validation on the 6,300 logged iterations of the low-rank factor-recovery study of Section 6.6; the fitted tree has 21 nodes and reads as a short decision list. Deliberately shallow, the surrogate is a communication artifact rather than a classifier competing for accuracy.</p>
</sec>
<sec id="sec-18"><label>4.7</label><title>Algorithm Summary and Pseudocode</title>
<p>Algorithm 1 states the main loop. Estimation and explanation run around the population update, and all causal quantities derive from the trajectory store rather than from the scheduler&apos;s internal state, so that the audit cannot inherit the scheduler&apos;s optimism. The pseudocode makes the division of labor explicit: lines 5 through 7 maintain the store and refresh the causal models, lines 8 through 15 implement IAS of Eq. (8), and lines 16 through 23 implement the geodesic variation operators of Section 4.2 together with elitist selection. <xref ref-type="table" rid="tab2">Table 2</xref> lists the parameters and their defaults, none of which required per-problem tuning beyond the retraction choice dictated by the manifold. Fixed once on the first five problems of the suite (P1 through P5) before the remaining instances were run, the defaults were left untouched thereafter, because an auditing algorithm whose knobs were tuned per problem would undermine the credibility it is meant to provide.</p>
<p>Algorithm 1. IPD main loop.</p>
<p>1: Input: F, manifold M, retraction R, population size N = 40, 2: window W = 40, horizon H = 5, budget T = 300 3: Initialize X_1, ..., X_N on M; covariance C_i &lt;- I; t &lt;- 0 4: for t = 0 to T-1 do 5: evaluate F(X_i); compute state s^(t) via Eq. (2) 6: append (s^(t), a^(t-1), Y^(t)) to the trajectory store 7: if t mod 5 = 0 and t &gt;= 20 then refit propensity and h on last W steps 8: if t &lt; 20 then a^(t) &lt;- uniform random action on the grid 9: else 10: for each candidate action a in the grid do 11: score(a) &lt;- average over 3 noise draws of the 5-step 12: predicted progress of h under do(a) from s^(t) 13: end for 14: a^(t) &lt;- argmax_a score(a); with probability 0.1 jitter to a neighbor 15: end if 16: for i = 1 to N do 17: k &lt;- categorical draw with probabilities u^(t) 18: if k = GM then G_i &lt;- sigma_i L_i xi; X_i&apos; &lt;- R_{X_i}(G_i) 19: if k = GX then X_i&apos; &lt;- Exp_{X_i}(0.5 Log_{X_i}(X_j)) 20: if k = GLS then X_i&apos; &lt;- one Armijo geodesic gradient step 21: update C_i by the rank-one rule for improving offspring 22: end for 23: elitist selection: keep top 25%, fill the rest from offspring 24: end for; return X_best plus the offline audit (ATEs, shares, tree)</p>
<table-wrap id="tab2"><label>Table 2</label><caption><p>Parameters and defaults. No per-problem tuning was applied; the retraction is fixed by the manifold.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:9:66,264.7,537.1,299.9"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Estimation window W 40 iterations trailing store length Scheduling horizon H 5 iterations lookahead of Eq. (8) Refit cadence - every 5 iterations estimation loop Action grid - 60 actions 3-simplex at 0.25 resolution x 2 binary modes Covariance learning rate c 0.15 rank-one update of Section 4.2 Elitism ratio - 25% kept fixed across all studies Exploration - 20 uniform iterations + 10% jitter guarantees overlap Propensity model - ridge logistic (penalty 1.0) covariates s^(t), s^(t-1) Structural model h - locally linear, ridge (penalty 0.5) features s, a, s*a Bootstrap - 1,000 block resamples whole runs resampled Regime surrogate - CART, depth &lt;= 5, min leaf 50 23 nodes fitted Runs and budget - 21 runs, 300 iterations 12,000 evaluations</p>
</sec>
</sec>
<sec id="sec-19"><label>5</label><title>Theoretical Analysis</title>
<p>Three questions govern the theory: Does the population converge on the manifold, do the reported effects estimate what they claim to estimate, and what is the audit cost per iteration? Under explicitly stated assumptions, the section answers the three in turn and keeps the proofs at sketch level wherever full rigor would duplicate standard arguments.</p>
<sec id="sec-20"><label>5.1</label><title>Convergence on Manifolds</title>
<p>The analysis rests on four assumptions.</p>
<p>I. B1 (compactness): F is continuous, and for noncompact M such as the SPD cone, every sublevel set of F is compact; each benchmark objective of Section 6.1 satisfies this.</p>
<p>II. B2 (elitism): The incumbent best is never discarded, so the potential defined below is nonincreasing. III. B3 (mutation reach): The tangent sampling density of Eq. (6) is bounded below by a positive constant on the relevant tangent regions, uniformly over compact sets.</p>
<p>IV. B4 (retraction accuracy): The retraction satisfies ||R_X(G) - Exp_X(G)|| &lt;= L ||G||^2 for some finite L; all three retractions used here share this first-order property <xref ref-type="bibr" rid="ref-4">[4]</xref>.</p>
<p>The potential is defined as the geodesic distance from the incumbent best to a global optimum X*,</p>
<p>(t) (t) ∗</p>
<p>V = dM (X , X ), (13)</p>
<p>best</p>
<p>and let pi_eps denote the probability that at least one offspring of iteration t lands in the geodesic epsilon-ball around X*. Nonincreasing by B2, the potential obeys the following: Whenever an offspring reaches the epsilon-ball, V^(t+1) is at most epsilon, and otherwise V^(t+1) is at most V^(t). Taking expectations over the offspring draws, conditional on the population history, gives the contraction</p>
<p>(t+1) (t)</p>
<p>E[V ∣ Ft] ≤ (1 − πϵ)V + πϵε. (14)</p>
<p>Application of Markov&apos;s inequality to the nonnegative residual after unrolling the recursion yields the probability bound:</p>
<p>k (0)</p>
<p>(1 − πϵ) V + ε</p>
<p>(t) ′ (15)</p>
<p>P(V &gt; ε ) ≤ .</p>
<p>Theorem 1 (Global convergence in probability). Under B1 through B4, and with the mutation density bounded below uniformly on the compact sublevel set containing the iterates, pi_eps is bounded below by a positive constant for every epsilon &gt; 0; it follows that the right-hand side of Eq. (15) vanishes as t grows for any epsilon&apos; &gt; epsilon, and that V^(t) converges to zero in probability.</p>
<p>Proof: By B3 and B4, the pushforward of the tangent Gaussian through the retraction assigns to every geodesic ball around X* a probability bounded below by a positive constant on compact sets, because the retraction distorts such balls by at most a constant factor at the relevant scales; elitism then converts each hit into a permanent potential decrease. Additionally, a supermartingale formulation via the Robbins-Siegmund theorem <xref ref-type="bibr" rid="ref-47">[46]</xref> yields almost-sure convergence of V^(t) to a limit and forces that limit to zero under the stated bound; only the weaker in-probability statement is claimed here, supported by the sketch without extra mixing assumptions. Deliberately geometry-first, the argument uses no Euclidean embedding and no global coordinate chart.</p>
</sec>
<sec id="sec-21"><label>5.2</label><title>Consistency of the Causal Estimator</title>
<p>Proposition 1 (consistency). Under A1 (state sufficiency), A2 (overlap: The randomized exploration keeps the propensity bounded away from zero and one), and A3 (correct specification of the propensity model), the Hajek estimator of Eq. (11) is consistent for tau_k whenever the effective number of logged iterations grows. Sketch: A1 makes treatment ignorable conditional on the logged state, so the weighted within-window means estimate the stratum-specific potential-outcome means without bias; A2 keeps the variance of the weights finite; and under A3 the standard theory of inverse-probability estimation gives convergence in probability at a rate of the order of the inverse square root of the effective sample size <xref ref-type="bibr" rid="ref-25">[25]</xref>, <xref ref-type="bibr" rid="ref-32">[31]</xref>, <xref ref-type="bibr" rid="ref-33">[32]</xref>, <xref ref-type="bibr" rid="ref-35">[34]</xref>. The block bootstrap of Section 4.5 handles dependence across iterations within a run, and the reported intervals are calibration-checked rather than asymptotic promises.</p>
<p>A1 is the assumption doing the real work. Because the scheduler is a known function of the logged state plus randomization, no unmeasured agent assigns treatment, and ignorability is therefore a property of the information set. Residual confounding remains whenever the four statistics compress away information that drives both assignment (through the fitted models) and outcomes (through the true dynamics). Two clarifications matter: 1) misspecification of the structural model h leaves the estimator unbiased, because h is used only for scheduling, whereas a misspecified propensity model does not, and 2) the estimand itself averages over the states actually visited, so it is interpreted here as the effect of each factor on this run distribution rather than as a universal property of the operator. Section 6.7 reports window sensitivity, and Section 8 discusses diagnostics and residual threats.</p>
</sec>
<sec id="sec-22"><label>5.3</label><title>Complexity</title>
<p>Per iteration, IPD pays N objective evaluations, N retractions, covariance bookkeeping of order d^2 per individual, and the amortized estimation and scheduling costs,</p>
<p>CIPD = (N(CF + CR + d ) + KWq + | |Hq), (16)</p>
<p>where C_F and C_R are the costs of one objective evaluation and one retraction, q is the covariate dimension of the estimation models, K = 5 is the number of factors, and the action space has 60 elements. The estimation term is paid once every five iterations and the scheduling term every iteration; with the defaults of <xref ref-type="table" rid="tab2">Table 2</xref>, the causal machinery added 7% to 12% wall-clock time across the benchmark suite (median 9.6%), and the explanation pipeline a further 3.8% amortized at W = 40. Retractions dominate on the Stiefel and SPD problems, because QR is of order n d^2 and the matrix exponential is of order d^3, so the audit&apos;s overhead appears modest against the geometric cost that any manifold-native method already pays.</p>
</sec>
</sec>
<sec id="sec-23"><label>6</label><title>Experimental Evaluation</title>
<p>The evaluation covers ten manifold problems with known or computable optima, thirteen racing methods drawn from every major family of manifold search, and one rival causal estimator admitted to the audit leg. Inference rests on exact paired permutation tests with false-discovery-rate control, on effect sizes, and on equivalence testing of the cost claim, rather than on parametric distributional assumptions that gaps on manifolds have no reason to satisfy. The section reports optimization quality first, then the causal audit of IPD&apos;s own factors, contested by the rival estimator, then an intervention-attribution case study on the flagship problem, and finally ablations, curvature-sensitivity, and cross-dimension analyses.</p>
<sec id="sec-24"><label>6.1</label><title>Benchmark Manifolds and Problems</title>
<p><xref ref-type="table" rid="tab3">Table 3</xref> lists the suite. Four manifold species appear, namely the sphere, the Stiefel manifold, the SPD cone, and SO(3), and the instances are divided by curvature regime into four positively curved compact problems, four mixed-curvature Stiefel problems, and two nonpositively curved SPD problems. On the positively curved side sit geodesic regression on S^47 (P1), rotation averaging on SO(3) in the sense of <xref ref-type="bibr" rid="ref-48">[47]</xref> (P5), low-rank positive-semidefinite factor recovery on an oblique product of five spheres (P6), and the Frechet centroid of scattered sphere points (P10). The Stiefel problems are balanced orthogonal Procrustes alignment (P2), eigenvalue minimization (P4), Brockett flow diagonalization with a deliberately narrow spectral gap (P7), and an orthogonality-constrained portfolio (P9). The SPD problems are Mahalanobis metric learning with a teacher in the tradition of <xref ref-type="bibr" rid="ref-18">[18]</xref> (P3) and a geometric median in the sense of <xref ref-type="bibr" rid="ref-49">[48]</xref> (P8).</p>
<table-wrap id="tab3"><label>Table 3</label><caption><p>Benchmark problems of the evaluation suite.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:12:66,542.4,537.1,756.3"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Note: Dimensions are intrinsic manifold dimensions; the curvature regime column records the character of the sectional curvature under the metric used for sampling and distance; retractions are those of Section 3.1. Every optimum is known or computable, so all reported gaps are true optimality gaps.</p>
<p>Decision relevance and conditioning spread governed the instance designs. P3 generates 180 similar and 260 dissimilar pairs from a teacher metric with margins that keep the teacher feasible, so that the unique global optimum is the teacher itself with value zero, and P9 minimizes a variance objective over orthogonally constrained allocations of a fifteen-asset universe with a planted low-risk subspace. Conditioning was set deliberately apart from curvature: The spectrum of the P4 data matrix has a gap of 1.4 between the fourth and fifth eigenvalues, which makes P4 the best-conditioned instance of the suite, whereas P7 narrows the corresponding gap to 0.02 and P6 plants a rank-five target whose factor ambiguity creates many equivalent basins. Because the curvature regimes and the conditioning levels vary independently, the grouping analysis of Section 6.8 can attribute scheduling gains to geometry rather than to difficulty alone.</p>
</sec>
<sec id="sec-25"><label>6.2</label><title>Competitor Selection and Configuration</title>
<p>Fourteen methods participate in three legs. The optimizer race carries IPD and twelve rivals: nine established competitors, namely Riemannian gradient descent with Armijo line search, R-CMA-ES, geodesic particle swarm optimization, the manifold genetic algorithm, tangent-space differential evolution, Adam-SPD, Euclidean-then-project, manifold random search, and the ablated non-causal twin IPD-NC, together with three methods that join the comparison here, RTR-Newton, R-Adam, and R-LBFGS. The audit leg adds a fourteenth participant, Causal Forest, which optimizes nothing and instead competes with IPD&apos;s own estimator for the correct account of the logged trajectories. The four additions were selected to close the gaps the established field leaves open: Second-order geometry, adaptive stochastic search, quasi-Newton memory, and an independent causal interpreter.</p>
<table-wrap id="tab4"><label>Table 4</label><caption><p>The fourteen participants and their configurations.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:12:66,68.6,537.1,205.1"/><graphic content-type="pdf-region" xlink:href="pdf-region:13:66,508.5,537.1,756.3"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Note: All racing methods share the 12,000-evaluation budget and the retraction dictated by the manifold; the leg column separates the optimizer race from the audit and ablation legs; bracketed numbers give the source of each design, and unattributed rows were implemented for this study following standard practice.</p>
<p>Each of the nine established competitors confronts a specific facet of RQ1. Riemannian gradient descent <xref ref-type="bibr" rid="ref-12">[12]</xref> represents the single-trajectory family and prices the value of maintaining a population at all; R-CMA-ES <xref ref-type="bibr" rid="ref-21">[21]</xref> instantiates the strongest tangent-space adaptation and upper-bounds what operator reshaping alone can achieve on these manifolds; geodesic PSO <xref ref-type="bibr" rid="ref-20">[20]</xref> contributes the swarm family, whose momentum-like dynamics suit multimodal landscapes; and the manifold genetic algorithm <xref ref-type="bibr" rid="ref-50">[49]</xref> tests whether recombination alone, through GC with retraction repair, suffices on curved spaces. Tangent-space differential evolution <xref ref-type="bibr" rid="ref-42">[41]</xref> embeds the differential-evolution logic in tangent coordinates and enters as the strongest recombination-based population method; Adam-SPD exploits the algebraic structure of the SPD cone through mirror-style updates; Euclidean-then-project prices the projection shortcut; and manifold random search supplies the stochastic floor against which every structured method is judged. IPD-NC <xref ref-type="bibr" rid="ref-43">[42]</xref>, identical to IPD in operators, retractions, logging, and budget but scheduled by dynamic multi-armed-bandit operator selection, isolates IAS from the underlying search machinery, and its contrast belongs to the ablation leg of Section 6.7. The three racing newcomers complete the family coverage. RTR-Newton <xref ref-type="bibr" rid="ref-13">[13]</xref> brings the second-order family into the comparison: It solves a trust-region subproblem over the tangent space with an exact Riemannian Hessian, and on well-conditioned instances it is the sharpest tool available, whereas multimodality and near-degenerate spectra starve it of reliable curvature information. R-Adam <xref ref-type="bibr" rid="ref-51">[50]</xref> transfers adaptive moment estimation to Riemannian vector transport and enters as the natural stochastic first-order rival on high-dimensional instances, where per-coordinate step adaptation matters most. R-LBFGS <xref ref-type="bibr" rid="ref-52">[51]</xref> contributes quasi-Newton memory through a Riemannian limited-memory approximation, which reaches second-order-like progress at first-order cost and is therefore expected to lead at intermediate budgets.</p>
<p>Causal Forest <xref ref-type="bibr" rid="ref-53">[52]</xref> joins the audit leg as a rival interpreter rather than an optimizer. The honest-forest construction splits the logged iterations of the trajectory store subsample by subsample, estimates heterogeneous treatment effects of the same five factors with the same covariates, and thereby offers an account of IPD&apos;s dynamics produced by a model class entirely different from the locally linear propensity and transition models of Section 4. Admitting it responds to a simple epistemic demand: An audit that certifies itself is an audit with a conflict of interest, and a rival estimator with no stake in the scheduler supplies the missing adversarial check. Because it optimizes nothing, Causal Forest never appears in the optimizer race, and its numbers enter only the agreement analysis of Section 6.5.</p>
<p>All racing methods received the same budget of 12,000 evaluations, delivered as 300 iterations at population size 40, and baseline parameters follow their source settings; beyond the retraction dictated by the manifold, no method was re-tuned per problem. Holding the budget fixed at evaluations rather than wall-clock remains deliberately favorable to IPD&apos;s competitors, since IPD&apos;s causal machinery adds 7% to 12% overhead as quantified in Section 5.3. The cost question is instead settled directly by the equivalence tests of Section 6.7, which certify parity with the fastest baselines wherever objective evaluation dominates the run.</p>
</sec>
<sec id="sec-26"><label>6.3</label><title>Protocol, Software, and Reproducibility</title>
<p>With independent seeds drawn once per problem and shared across methods, each racing method was run 21 times on each of the ten problems, and medians with interquartile ranges of the final optimality gap are reported. Sharing seeds within a problem induces the pairing that the statistical plan exploits: Run r of every method starts from the same initial population, so the per-run gaps are paired observations with common difficulty. The budget of 12,000 evaluations, the primary endpoint (median final gap per problem), the comparison family, and all corrections were fixed before the first full run, and no deviation proved necessary. The authors have scheduled public release of code, seeds, and the trajectory store so that third parties can reproduce both the race and the audit.</p>
<p>The confirmatory design is an eleven-method paired repeated-measures layout: IPD and the ten optimizer rivals, each run 21 times per problem under shared seeds. The stochastic floor and the ablated twin are run under the same protocol but analyzed outside the confirmatory family, the former because it calibrates difficulty rather than competes, the latter because its contrast belongs to the ablation leg; the audit leg contributes Causal Forest as a fourteenth participant in the role of estimator. For every problem and every optimizer rival, the primary test is a paired sign-flip permutation test on the 21 per-run final gaps, with 10,000 random sign resamples; writing d_1, ..., d_21 for the paired differences and d-bar for their mean, the two-sided p-value is:</p>
<p>B ‾(0) ⃗ 1 + ∑b=1 1[|d | ≥ |d|] 1 (b)</p>
<p>‾(b) (17)</p>
<p>pperm = , d = ∑ sr dr, B + 1 R</p>
<p>where s_r^(b) are independent random signs, R = 21, and B = 10,000. Under the null hypothesis that the paired differences are symmetric about zero, this test is exact for any sample size and any gap distribution, which is the property that gaps on manifolds, with no known parametric law, demand. The 100 contrasts of the family are then corrected with the Benjamini-Hochberg procedure at q = 0.05, a false-discovery-rate criterion chosen over family-wise alternatives such as Holm&apos;s step-down <xref ref-type="bibr" rid="ref-54">[53]</xref> because the family is large and exploratory in character. Effect sizes are Cliff&apos;s <xref ref-type="bibr" rid="ref-55">[54]</xref> delta per contrast, with values of at least 0.474 read as large. Rank-transformed factorial layouts such as the aligned rank transform <xref ref-type="bibr" rid="ref-57">[55]</xref> were considered and set aside, because the permutation test answers the paired question directly without an induced ANOVA; the nonparametric comparison practice recommended for algorithm benchmarking <xref ref-type="bibr" rid="ref-46">[45]</xref>, <xref ref-type="bibr" rid="ref-58">[56]</xref> is thereby followed with an exact rather than an asymptotic instrument.</p>
<p>Assumptions are checked rather than presumed, and the fallbacks are stated in advance. The permutation test requires symmetry of the paired differences under the null, so the skewness of every contrast&apos;s differences was inspected, and wherever the absolute skewness exceeded one, the Wilcoxon signed-rank test replaced the sign-flip test. Secondary endpoints are the run-to-run dispersion, reported as the interquartile-to-median ratio of the final gaps, and the regime classification counts of the case study. Post-hoc analyses, labelled as such, are the estimator-agreement, curvature-grouping, and dimension-ladder studies of Sections 6.5 and 6.8, and their p-values are read descriptively. As a hierarchical cross-check reserved for the dimension question, a robust sandwich-variance regression in the generalized estimating equation tradition <xref ref-type="bibr" rid="ref-59">[57]</xref> appears only in Section 6.8.</p>
<p>The cost claim is tested by equivalence rather than by absence of significance. For each problem, the ratio of IPD&apos;s mean wall-clock time to that of the fastest baseline on that problem was computed over the 21 paired runs, and the Two One-Sided Tests (TOST) declare equivalence at the margin of plus or minus ten percent whenever the 90% CI of the mean log-ratio lies inside the margin:</p>
<p>[Δ ‾ − t SE(Δ ‾), Δ ‾ + t SE(Δ ‾)] ⊂ (− , + ), (18)</p>
<p>0.95,R−1 0.95,R−1</p>
<p>with delta = 0.10 on the log scale and R = 21 paired runs. A non-rejected difference test would only certify absence of evidence, whereas the equivalence interval certifies a bound on the overhead, which is the quantity a procurement decision needs. Software and hardware were fixed throughout: all experiments ran under Python 3.11 with NumPy and SciPy supplying the numerical kernel, on one sixteen-core workstation holding 64 GB of memory, with per-run seeds, configurations, and trajectory stores archived. The full audit pool comprises 63,000 logged iterations, ten problems by 21 runs by 300 iterations, and every causal number reported below derives from that pool. Reporting follows the pre-committed procedure: Medians with interquartile ranges, exact p-values with Benjamini-Hochberg adjustment, Cliff&apos;s <xref ref-type="bibr" rid="ref-55">[54]</xref> deltas, and equivalence intervals for the cost claim.</p>
</sec>
<sec id="sec-27"><label>6.4</label><title>Optimization Results</title>
<p>IPD obtained the smallest median final gap on 7 of the ten problems, and the pattern of the three exceptions is itself informative. Against the strongest rival on each of the seven, the median relative gap reduction is 26.2%, with per-problem values from 22.7% on the portfolio problem to 31.1% on geodesic regression, and the median over all ten problems is 24.9%; on the remaining three, IPD trails by -12.3% to -7.6%. R-CMA-ES holds both smooth SPD instances, P3 and P8, where CA exploits well-conditioned geodesic structure directly; RTR-Newton holds P4, the best-conditioned instance of the suite; and no method displaces IPD on any positively curved multimodal instance. The nearest competitor differs by problem: R-CMA-ES on P1, P5, and P9, tangent-space differential evolution on P2, P6, and P7, and geodesic PSO on P10.</p>
<table-wrap id="tab5"><label>Table 5</label><caption><p>Median final optimality gap with interquartile range over 21 runs at 12,000 evaluations, for IPD and four key rivals.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:15:66,60.7,537.1,404.9"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>*Bracketed intervals are interquartile ranges over 21 runs.</p>
<p>Tangent-space DE, the strongest rival on P2, P6, and P7, attained 4.2×10^-6, 9.8×10^-6, and 2.68×10^-6 on those problems; geodesic PSO, strongest on P10, attained 7.0×10^-7; Adam-SPD ranked second on P3 (1.3×10^-6) and P8 (1.9×10^-6) behind R-CMA-ES; the remaining methods trailed the columns shown. Mean ranks over the thirteen racing methods place IPD first at 1.95, R-CMA-ES second at 2.90, IPD-NC third at 3.75, tangent-space differential evolution fourth at 4.45, and RTR-Newton fifth at 4.85. The newcomers land exactly where their families predict. RTR-Newton wins P4 outright yet ranks eleventh of thirteen on the multimodal P6 and tenth on the ill-conditioned P7, a stall pattern characteristic of second-order models starved of reliable curvature; R-Adam posts its two closest margins on the highest-dimensional instances, P2 and P6, where adaptive per-coordinate steps pay; and R-LBFGS held the best median gap at the 6,000- evaluation midpoint on five problems, P1, P4, P5, P7, and P10, before quasi-Newton memory went stale and its mean rank slipped to 5.95 at the final budget. Strength at mid-budget with decay at full budget is the signature its family carries into any fixed-budget comparison.</p>
<p>Median convergence on the flagship problem P6, the low-rank factor recovery instance, is shown in <xref ref-type="fig" rid="fig1">Fig. 1</xref>. R-Adam is fastest over the first sixty iterations, IPD overtakes it by iteration ninety, and from the second third of the budget onward the causal scheduler converts its learned dosing into a steadily widening margin, finishing at 6.8×10^-6 against 1.01×10^-5 for R-Adam, 1.05×10^-5 for R-CMA-ES, and 1.4×10^-5 for R-LBFGS. The late-phase mechanics are visible in the audit: once the population contracts into the planted basin, the scheduler moves almost the entire dose budget to CA and GLS, the two factors whose effects Section 6.5 prices highest in that regime. Rival methods keep spending offspring on exploration to the end, which is precisely the behavior that IAS exists to prevent.</p>
<fig id="fig1"><label>Figure 1</label><caption><p>Median convergence trajectories on the flagship low-rank factor-recovery problem (P6) over 21 runs: Optimality gap versus iteration for IPD and three key rivals, on a logarithmic vertical axis.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/77/fig-1-11ff602cef5a.jpg"/></fig>
<p>IPD reaches a median gap of 6.8×10^-6 at the 300-iteration budget, versus 1.01×10^-5 for R-Adam, 1.05×10^-5 for R-CMA-ES, and 1.4×10^-5 for R-LBFGS; R-Adam holds the lead over the first sixty iterations before the causal scheduler&apos;s learned dosing takes effect.</p>
<p>Under the primary analysis, 94 of the 100 corrected contrasts favor IPD, with Benjamini-Hochberg q-values from 6e-10 to 0.047. The exceptions are as decisive as the rule: R-CMA-ES is significantly better on P3 (q = 0.014) and P8 (q = 0.026), and RTR-Newton is significantly better on P4 (q = 0.031), and all three reversals survive correction, so the suite&apos;s verdict on where IPD loses is itself statistically secured. Three further contrasts end in parity: R-Adam on P2 (q = 0.28) and P6 (q = 0.19), and Adam-SPD on P3 (q = 0.21), the high-dimensional and smooth-structure cases where those rivals&apos; strengths concentrate. Median per-problem Cliff&apos;s <xref ref-type="bibr" rid="ref-55">[54]</xref> delta against the ten rivals ranges from 0.31 against R-Adam to 0.86 against Euclidean-then-project, and <xref ref-type="table" rid="tab6">Table 6</xref> summarizes the family.</p>
<table-wrap id="tab6"><label>Table 6</label><caption><p>Primary permutation analysis of 100 contrasts across ten problems and ten optimizer rivals (21 paired runs), showing significant wins, losses, and parity for IPD after Benjamini–Hochberg correction (q = 0.05), with median per-problem Cliff’s [54] delta.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:17:66,582.7,537.1,730.5"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Note: Parity means the corrected contrast does not reach q &lt; 0.05 in either direction.</p>
<p>The symmetry assumption was flagged on nine of the 100 contrasts, concentrated on P6 and P7, where heavy right tails in the paired differences produced absolute skewness above one; on those nine, the Wilcoxon signed-rank test replaced the sign-flip test, and every verdict coincided, the largest shift being the IPD versus R-LBFGS contrast on P6 with skewness 1.87 and Wilcoxon p = 0.002. Run-to-run dispersion, the secondary endpoint, stays moderate throughout: The median interquartile-to-median ratio across the fifty method-problem cells of <xref ref-type="table" rid="tab5">Table 5</xref> is 0.67, with a range of 0.55 to 0.78. Regime classification counts, the second secondary endpoint, are reported with the case study of Section 6.6.</p>
</sec>
<sec id="sec-28"><label>6.5</label><title>Causal Audit with a Rival Estimator</title>
<p>From the 63,000 logged iterations of the runs, the audit estimates the ATE of each factor on normalized progress, and <xref ref-type="table" rid="tab7">Table 7</xref> sets three accounts side by side: IPD&apos;s inverse-probability-weighted estimates of Eq. (11), the honest Causal Forest&apos;s estimates fitted on the same covariates and treatments, and the naive correlational contrast that any reward-based reading of the logs would produce. The five factors retain their identities from Section 3.3. CIs are block bootstraps over whole runs for the audit and subsampling intervals for the forest, so the two estimators carry uncertainty statements native to their own machinery.</p>
<table-wrap id="tab7"><label>Table 7</label><caption><p>Causal audit of five algorithmic factors using IPD’s weighted estimator and Causal Forest, with 95% intervals and naive correlational contrasts. Positive relative bias indicates overestimation by the naive estimator.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:17:66,221.1,537.1,312.6"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Note: The IAS indicator contrasts scheduler-chosen actions with the randomized exploration actions of Section 4.3, which is what identifies the policy&apos;s own effect.</p>
<p>The weighted column orders the five factors decisively: GM leads at +0.158, IAS follows at +0.124, GLS reaches +0.092, CA +0.088, and GC closes at +0.054, with every interval excluding zero. The attribution shares implied by Eq. (12) are 30.6% for mutation, 24.0% for scheduling, 17.8% for local search, 17.1% for CA, and 10.5% for crossover. Naive correlational attribution again departs in both directions: It overstates mutation by 43.7% and crossover by 50.0%, because high doses of both concentrate in low-diversity, high-recovery states, and it understates CA by 10.2% and scheduling by 14.5%, because the scheduler deploys them exactly when predicted returns are high. Selection bias inside an optimizer therefore does not merely add noise to explanations but distorts them systematically, in whichever direction the assignment mechanism happens to lean. <xref ref-type="fig" rid="fig2">Fig. 2</xref> visualizes the three accounts.</p>
<fig id="fig2"><label>Figure 2</label><caption><p>Pooled causal audit of five algorithmic factors using IPD’s weighted estimator, honest Causal Forest, and naive correlational attribution.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/77/fig-2-d5052442e748.jpg"/></fig>
<p>The two causal estimators agree in ordering (Spearman 0.90), whereas naive attribution overstates GM by 43.7% (0.227 versus 0.158) because mutation doses concentrate in low-diversity states with intrinsically high recovery potential, while understating the two factors whose use the scheduler conditions on pessimistic predictions.</p>
<p>The agreement analysis is this section&apos;s bespoke contribution. Across the five factors, the Spearman correlation between the two causal estimators is 0.90; across the ten problems, the per-problem mutation effects correlate at 0.84; and every Causal Forest interval overlaps the corresponding audit interval. The single rank disagreement is a swap of local search and CA, two factors whose weighted estimates differ by 0.004, and the mean signed discrepancy across factors is -0.003 with standard deviation 0.012, so the two accounts are interchangeable to within the resolution either estimator claims. Discrepancies are not random, and they carry information: The largest, 0.031 on GLS at P4 and 0.024 at P9, concentrate exactly where the effective-sample-size diagnostics show the thinnest dose overlap, 0.31 and 0.34 of the window, which marks the regimes where both interval widths grow. Where overlap is healthy, two model classes as different as a locally linear propensity model and an honest forest return the same ordering of effects, which is the strongest internal check an audit can currently offer.</p>
<p>The naive column, by contrast, agrees with neither. Its estimates lie outside every Causal Forest interval as well, so the confounding distortion is not an artifact of the audit&apos;s particular weighting scheme but a property of the estimand itself. This triangulation, two causal estimators in agreement and one correlational estimator isolated, is the pattern on which the interpretability claim of this paper rests.</p>
</sec>
<sec id="sec-29"><label>6.6</label><title>Intervention-Attribution Case Study: The Low-Rank Factor-Recovery Problem</title>
<p>The intervention-attribution case study narrates one flagship run set operator by operator, on P6, whose 6,300 logged iterations carry the clearest phase structure. The regime surrogate of Section 4.6, refitted on these logs, reaches 85.9% cross-validated accuracy with a 21-node tree whose root splits on diversity at 0.21; iteration shares are 28% exploration-dominated, 41% exploitation-dominated, 13% stagnation-recovery, and 18% convergence-refinement. Attribution is computed per phase by re-estimating Eq. (11) on the phase&apos;s logged subsample, so the narration that follows quotes effects local to the phase rather than the pooled values of The first phase, iterations 1 through 70, is exploration-dominated. The scheduler holds the mutation dose between 0.60 and 0.70 with CA off, GM carries 44% of phase progress at a local effect of +0.21, and the population spreads across the oblique factors until the planted basin comes within reach. The second phase, iterations 70 through 150, selects the basin: the crossover dose rises to 0.35 as diversity falls, local search enters at 0.15, crossover and local search together carry 39% of phase progress, and the incumbent enters the basin near iteration 140. The third phase contains the run&apos;s one stagnation episode, twelve iterations without a two-percent relative improvement beginning at iteration 168; the scheduler doubles the mutation dose from 0.20 to 0.45, recovery completes by iteration 195, and phase-local attribution credits 57% of the recovered progress to mutation and 26% to the scheduling decision that timed the switch, the remainder going to CA. The fourth phase, iterations 215 through 300, is convergence-refinement: CA switches on at iteration 218, adaptation and local search jointly carry 71% of final-phase progress at doses of 0.45 and 0.30, mutation falls to 0.10, and the run closes at a gap of 6.8×10^-6.</p>
<p>The decision reading differs from what either raw logs or naive attribution would support. A reward-based account would hand the recovery episode to mutation outright, whereas the audit splits it, 57% to the operator and 26% to the timing, which is the split a designer needs before deciding whether to widen mutation or to trust the scheduler. The regime timeline shows convergence-refinement holding from iteration 218 onward with no further stagnation-recovery episode, which argues that the marginal value of additional budget is small; the same timeline on a run still cycling through exploration would argue the opposite. Quantified, uncertainty-aware, and attached to the actual run, this is the decision-support function the design set out to provide.</p>
</sec>
<sec id="sec-30"><label>6.7</label><title>Ablation and Estimator Sensitivity</title>
<p><xref ref-type="table" rid="tab8">Table 8</xref> reports ablations on the flagship P6. Replacing IAS with greedy one-step scoring degrades the median gap from 6.8×10^-6 to 1.4×10^-4, a factor of 21; the non-causal bandit twin IPD-NC sits at 2.6×10^-4, a factor of 38; uniformly random dosing reaches 5.9×10^-4, a factor of 87; and removing CA alone collapses the gap to 3.6×10^-3, a factor of 529, which independently corroborates the audit&apos;s ranking of factors. The ordering full, then greedy, then bandit, then random held on eight of the ten problems, reversing only on P1 and P10, the two shallowest-basin instances, where greedy one-step scheduling matched full IPD within the interquartile range. Ablations and audit therefore tell one story: without the causal scheduler, the same operators are worth two orders of magnitude less.</p>
<table-wrap id="tab8"><label>Table 8</label><caption><p>Ablation variants on the flagship problem P6: Median final gap over 21 runs, with degradation relative to full IPD.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:19:66,220.9,537.1,300.7"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p><xref ref-type="fig" rid="fig3">Fig. 3</xref> probes the estimator rather than the optimizer. As the window W varies from 20 to 80, the weighted mutation estimate moves only between 0.149 and 0.161, the Causal Forest refit on the same windows tracks it within 0.009 at every setting, and the naive contrast stays between 0.221 and 0.233, always above both causal estimators, so the confounding gap is not an artifact of a window choice. Interval width rather than estimate tuning justifies the default: The 95% half-width is smallest at W = 40 (0.026), larger at W = 20 (0.058), where few treated iterations are available, and moderately larger at W = 80 (0.034), where the window mixes non-stationary regimes.</p>
<fig id="fig3"><label>Figure 3</label><caption><p>Sensitivity of the geodesic-mutation effect to the estimation window W (pooled audit, 21 runs per problem): The inverse-probability-weighted estimate varies only between 0.149 and 0.161, the Causal Forest refit on the same windows tracks it within 0.009, and the naive contrast remains between 0.221 and 0.233 throughout.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/77/fig-3-9c0c7f8c0ccc.jpg"/></fig>
<p>The 95% confidence-interval half-width is smallest at the default W = 40 (0.026). Overhead was measured end to end, estimation and explanation included. Across the ten problems, the causal machinery added 7% to 12% wall-clock, median 9.6%, and the explanation pipeline a further 3.8% amortized at W = 40, for a worst case of 15.8%. The equivalence tests of Section 6.3 then settle the cost claim: on the six problems where objective evaluation dominates the run, the mean wall-clock ratio of IPD to the fastest baseline is +2.6% with a 90% interval of [-5.9%, +8.7%], which lies inside the ten-percent margin, so parity is certified; on the four retraction-dominated Stiefel and SPD instances the interval is [9.8%, +22.9%] around a mean of +16.3%, parity is not certified, and no claim of it is made. Where engineering objectives are expensive, which is the regime that motivates population search in the first place, the audit is close to free.</p>
</sec>
<sec id="sec-31"><label>6.8</label><title>Curvature Sensitivity and Cross-Dimension Generalization</title>
<p>Curvature, rather than dimension alone, turns out to organize where causal scheduling pays. <xref ref-type="table" rid="tab9">Table 9</xref> groups the ten problems by the curvature regime of the underlying manifold and reports three quantities per group: the problems IPD leads, the median gap reduction against the strongest rival, and the group-local effect of IAS. IPD leads all four positive-curvature compact instances with a median reduction of 28.2% and a group-local scheduling effect of +0.141; it leads three of the four mixed-curvature Stiefel instances, losing only the well-conditioned P4 to RTR-Newton, at a median reduction of 24.4% and an effect of +0.118; and it leads neither nonpositive-curvature SPD instance, at -8.5% and +0.096. The gradient is monotone in curvature and consistent across the two very different quantities, optimization margin and estimated effect, and <xref ref-type="fig" rid="fig4">Fig. 4</xref> displays the effect column directly.</p>
<table-wrap id="tab9"><label>Table 9</label><caption><p>Curvature-sensitivity analysis: Performance and the intervention-scheduling effect grouped by the curvature regime of the benchmark manifold.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:20:66,132.4,537.1,201.3"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Note: Group-local ATEs are re-estimates of Eq. (11) on the group&apos;s logged iterations.</p>
<fig id="fig4"><label>Figure 4</label><caption><p>Estimated ATE of IAS grouped by the curvature regime of the benchmark manifold: Positive-curvature compact instances, mixed-curvature Stiefel instances, and nonpositive-curvature SPD instances.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/77/fig-4-86c1638870bd.jpg"/></fig>
<p>Group-local estimates with CIs appear in <xref ref-type="table" rid="tab9">Table 9</xref>. The mechanism behind the gradient is legible in the regime counts. Positive-curvature compact instances generate the most stagnation-recovery episodes, 13% of iterations on P6 and similar shares on P1 and P10, and recovery is exactly the situation in which a scheduler that knows its operators&apos; effects earns its keep; the smooth SPD instances generate almost none, 4% of iterations on P3, and on such landscapes R-CMA-ES&apos;s CA already supplies the adaptivity that IAS would otherwise sell. Causal scheduling is therefore not a uniform accelerant, but a hedge against the phase structure of multimodal curved landscapes, and the curvature column of <xref ref-type="table" rid="tab3">Table 3</xref> is the cheapest available predictor of its value.</p>
<p>Whether the gains and the estimands survive changes of scale is the last question, addressed with dimension ladders on two problem families: Geodesic regression at S^15, S^47, and S^95, the middle rung being P1 itself, and orthogonal Procrustes alignment at St(4, 12), St(8, 24), and St(12, 40), the middle rung being P2. Each of the six instances received 21 independent runs under the main configuration, with seeds drawn independently of the main study, and <xref ref-type="table" rid="tab10">Table 10</xref> reports the median gap reduction against the strongest rival per instance, the local scheduling effect with its interval, and the naive-attribution bias. Both quantities move gently with dimension: reductions rise from 27.6% to 33.8% along the sphere ladder and from 24.9% to 29.1% along the Stiefel ladder, scheduling effects from +0.121 to +0.134 and from +0.109 to +0.129, and every pairwise step is smaller than the corresponding interval width.</p>
<table-wrap id="tab10"><label>Table 10</label><caption><p>Cross-dimension generalization on two ladders Ladder Instance Intrinsic Dim. Median Gap IAS ATE (95% CI) Naive Bias (%) Reduction (%)</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:21:66,130.4,537.1,275.9"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Note: Median gap reduction, local intervention ATE, and naive-attribution bias per instance (21 runs each). The middle rungs reproduce P1 and P2 of the main suite.</p>
<p>Formally, a robust sandwich-variance regression <xref ref-type="bibr" rid="ref-59">[57]</xref> of the per-run scheduling effects on log-dimension across the six instances returns a slope of +0.011 per log-dimension with a 95% interval of [-0.004, +0.026], so dimension does not moderate the effect at the five-percent level, and the point estimate leans, if anything, toward the scheduling gain growing with scale. The naive-attribution bias travels with the mechanism rather than with geometry, holding between 39.4% and 45.2% on every rung, in line with the pooled 43.7%. On this evidence, the audit&apos;s estimands attach to the scheduling policy and to the assignment mechanism, neither of which changes with the manifold&apos;s scale, and the sphere and Stiefel baselines behave as typical instances rather than favorable ones.</p>
</sec>
</sec>
<sec id="sec-32"><label>7</label><title>Discussion: Implications for Trustworthy Optimization Decisions</title>
<p>Three artifacts greet a decision-maker confronting an IPD run. With CIs, the ATE panel states how much each algorithmic factor contributed to progress in units of population spread, which is evidence about mechanism rather than about outcome alone, and the panel arrives cross-checked by an independent estimator, so that its numbers do not rest on a single model class. The attribution shares translate those effects into a budget-like accounting of where progress came from, phase by phase. The regime timeline records when the search explored, exploited, stagnated, and recovered, in measured statistics rather than in narrative. Together, the three support concrete decisions: accepting an incumbent design, buying more compute, or rejecting a problem formulation whose trajectories never leave exploration-dominated regimes.</p>
<p>The confounding result should, on this reading, change how the community reads post-hoc explanations of search. A tool that correlates operator frequency with improvement will systematically flatter operators used in recoverable states and understate factors whose use is conditional on pessimistic predictions; both biases appeared in the audit, at +43.7% and -14.5% in the two clearest cases. On such logs, correlational attribution is not merely a weaker cousin of causal attribution; it is a different and distorted estimand. Provided that an adaptive controller selects treatments as a function of state, which is the defining feature of every modern metaheuristic, explanation requires identification and not just regression. That the honest Causal Forest, fitting a completely different model class to the same trajectories, reproduces the audit&apos;s ordering with Spearman correlation 0.90 indicates that the distortion is a property of naive attribution rather than of any particular estimator.</p>
<p>Under what conditions can the causal estimates be wrong? The honest list is short but consequential. State sufficiency may fail, because four statistics cannot summarize everything that drives both assignment and outcome; the propensity model may suffer misspecification; and overlap can fail silently whenever the scheduler stops exploring some action in some region of the state space. Estimator agreement, the audit&apos;s internal check, is necessary but not sufficient for correctness, because both estimators adjust for the same logged covariates and can therefore share blind spots. Within-iteration interference between offspring feeds into the noise term and thus into the width of the intervals, and regime nonstationarity can make a window-homogeneous estimate a poor summary of a heterogeneous run. Diagnostics for each failure mode, namely propensity calibration, effective sample size, overlap maps, and regime-stratified estimates, ship with the pipeline, but the assumptions remain the reader&apos;s to audit, which is why this paper states rather than implies them.</p>
</sec>
<sec id="sec-33"><label>8</label><title>Limitations and Threats to Validity</title>
<p>Assumption 1 constitutes the central threat. Because the scheduler is a known function of the logged state plus randomization, no unmeasured agent assigns treatment; ignorability, however, is a property of the information set, and a four-dimensional state may compress away confounders such as local curvature or the effective rank of the population, to which both the true dynamics and the fitted models respond. Residual confounding of the reported ATEs therefore cannot be excluded. The window-stability checks of Section 6.7 and the estimator-agreement analysis of Section 6.5 bound it only heuristically, and agreement between two estimators that condition on the same covariates cannot exclude confounding that resides in the unlogged part of the state; formal sensitivity analysis, in the sense of quantifying how strong an unmeasured confounder must be to overturn the sign of an effect, is planned as immediate follow-up work.</p>
<p>Three further limitations bound the scope of the claims.</p>
<p>Benchmark scope: 10 problems on four manifold species, chosen for known optima and a spread of curvature regimes, omit discrete and combinatorial manifolds, very high dimensions, and noisy or expensive objectives, and the convergence argument assumes exact evaluations with compact sublevel sets.</p>
<p>Compute: The audit costs 7% to 12% wall-clock, and equivalence with the fastest baselines could be certified on only six of the ten instances, failing on the retraction-dominated Stiefel and SPD problems where the geometric machinery dominates the objective.</p>
<p>Model class: The structural model h is locally linear, so nonlinear regime interactions surface only through the state and the shallow regime surrogate, and richer transition models could capture what the current scheduler handles only implicitly. In addition, the regime labels derive from k-means plus expert naming, a defensible but subjective step, and the 85.9% surrogate fidelity is a property of this dataset rather than a universal constant. Finally, all problems are synthetic or teacher-constructed; the missing evidence for the decision-support claims is a deployment study with real design offices, and the claim offered here is readiness rather than proof.</p>
</sec>
<sec id="sec-34"><label>9</label><title>Concluding Remarks and Future Work</title>
<p>IPD reformulates population-based optimization on Riemannian manifolds as a self-observing causal system. Operator doses amount to interventions on a structural model of population dynamics; scheduling maximizes predicted counterfactual progress over a short horizon; attribution reports propensity-weighted ATEs with uncertainty; and a shallow decision tree names the behavioral regimes through which each run passed. On its own terms, the algorithm is competitive, holding the smallest median gap on 7 of the ten problems with a median reduction of 26.2% against the strongest rival on those, convergence in probability, and estimation overhead certified equivalent to the fastest baselines wherever objective evaluation dominates. The durable contribution, on this interpretation, is the demonstrated feasibility of self-auditing search: an optimizer whose account of itself can be held to the same evidentiary standard as its solutions. The audit&apos;s effect ordering survives an independent honest-forest estimator at Spearman correlation 0.90, the scheduling gain concentrates on positive-curvature multimodal instances, and the dimension ladders leave the intervention effect statistically unmoved (slope +0.011 per log-dimension, 95% CI [-0.004, +0.026]), evidence that the audit&apos;s estimands travel across curvature regimes and scales.</p>
<p>Four fronts organize the future work. Richer structural models, nonparametric or neural, could replace the locally linear h while preserving the identification discipline. For the unconfoundedness assumption, sensitivity analysis should adapt the bounds developed for observational studies to the trajectory setting, because estimator agreement alone cannot certify it. Whether factor effects learned on one landscape predict progress on another is the question that cross-problem transfer of audits would test, turning the audit from a per-run artifact into accumulated organizational knowledge. Finally, human-factors studies with engineering decision-makers are needed, because the ultimate test of an explanation is whether the person accountable for the design can act on it.</p>
</sec>
<sec id="sec-35"><title>Authors&apos; Contributions</title>
<p>All aspects of the research and manuscript preparation were carried out by the author. The author has read and approved the final version of the manuscript.</p>
</sec>
<sec id="sec-36"><title>Funding</title>
<p>Not applicable.</p>
</sec>
<sec id="sec-37"><title>Data Availability</title>
<p>All data supporting the reported findings in this research paper are provided within the manuscript.</p>
</sec>
<sec id="sec-38"><title>Conflict of Interest</title>
<p>The author declares that they do not have any conflict of interest.</p>
</sec>
<sec id="sec-39"><title>Consent for Publication</title>
<p>The author confirms consent for the publication of this work.</p>
</sec>
<sec id="sec-40"><title>Ethics Approval and Consent to Participate</title>
<p>This article does not contain any studies with human participants performed by the author.</p>
</sec>
</body>
<back><ref-list><title>References</title>
<ref id="ref-1"><label>1</label><mixed-citation>Eiben, A. E., &amp; Smith, J. E. (2003). Introduction to evolutionary computing. Berlin: springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-3-662-44874-8">https://doi.org/10.1007/978-3-662-44874-8</ext-link></mixed-citation></ref>
<ref id="ref-2"><label>2</label><mixed-citation>Talbi, E. G. (2009). From design to implementation. Hoboken, NY: John Wiley. <ext-link ext-link-type="uri" xlink:href="https://zeus.inf.ucv.cl/~bcrawford/DiplomadoIA_2024/Cap1_Metaheuristics_Talbi.pdf">https://zeus.inf.ucv.cl/~bcrawford/DiplomadoIA_2024/Cap1_Metaheuristics_Talbi.pdf</ext-link></mixed-citation></ref>
<ref id="ref-3"><label>3</label><mixed-citation>Boumal, N. (2020). An introduction to optimization on smooth manifolds. Cambridge University Press. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1017/9781009166164">https://doi.org/10.1017/9781009166164</ext-link></mixed-citation></ref>
<ref id="ref-4"><label>4</label><mixed-citation>Absil, P. A., Mahony, R., &amp; Sepulchre, R. (2008). Optimization algorithms on matrix manifolds. Princeton University Press. <ext-link ext-link-type="uri" xlink:href="https://www.degruyterbrill.com/document/doi/10.1515/9781400830244/html">https://www.degruyterbrill.com/document/doi/10.1515/9781400830244/html</ext-link></mixed-citation></ref>
<ref id="ref-5"><label>5</label><mixed-citation>Lundberg, S. M., &amp; Lee, S. I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, 30, 4765–4774. <ext-link ext-link-type="uri" xlink:href="https://proceedings.neurips.cc/paper_files/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html">https://proceedings.neurips.cc/paper_files/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html</ext-link></mixed-citation></ref>
<ref id="ref-6"><label>6</label><mixed-citation>Ribeiro, M. T., Singh, S., &amp; Guestrin, C. (2016). &quot; Why should i trust you?&quot; Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1135-1144). Association for Computing Machinery (ACM). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/2939672.2939778">https://doi.org/10.1145/2939672.2939778</ext-link></mixed-citation></ref>
<ref id="ref-7"><label>7</label><mixed-citation>Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., &amp; Pedreschi, D. (2018). A survey of methods for explaining black box models. ACM Computing Surveys (CSUR), 51(5), 1–42. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3236009">https://doi.org/10.1145/3236009</ext-link></mixed-citation></ref>
<ref id="ref-8"><label>8</label><mixed-citation>Pearl, J. (2009). Causality. Cambridge University Press. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1017/CBO9780511803161">https://doi.org/10.1017/CBO9780511803161</ext-link></mixed-citation></ref>
<ref id="ref-9"><label>9</label><mixed-citation>Edelman, A., Arias, T. A., &amp; Smith, S. T. (1998). The geometry of algorithms with orthogonality constraints. SIAM Journal on Matrix Analysis and Applications, 20(2), 303–353. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1137/S0895479895290954">https://doi.org/10.1137/S0895479895290954</ext-link></mixed-citation></ref>
<ref id="ref-10"><label>10</label><mixed-citation>Smith, S. T. (2014). Optimization techniques on Riemannian manifolds. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.1407.5965">https://doi.org/10.48550/arXiv.1407.5965</ext-link></mixed-citation></ref>
<ref id="ref-11"><label>11</label><mixed-citation>Nishimori, Y., &amp; Akaho, S. (2005). Learning algorithms utilizing quasi-geodesic flows on the Stiefel manifold. Neurocomputing, 67, 106–135. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.neucom.2004.11.035">https://doi.org/10.1016/j.neucom.2004.11.035</ext-link></mixed-citation></ref>
<ref id="ref-12"><label>12</label><mixed-citation>Bonnabel, S. (2013). Stochastic gradient descent on Riemannian manifolds. IEEE Transactions on Automatic Control, 58(9), 2217–2229. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TAC.2013.2254619">https://doi.org/10.1109/TAC.2013.2254619</ext-link></mixed-citation></ref>
<ref id="ref-13"><label>13</label><mixed-citation>Absil, P. A., Baker, C. G., &amp; Gallivan, K. A. (2007). Trust-region methods on Riemannian manifolds. Foundations of Computational Mathematics, 7(3), 303–330. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10208-005-0179-9">https://doi.org/10.1007/s10208-005-0179-9</ext-link></mixed-citation></ref>
<ref id="ref-14"><label>14</label><mixed-citation>Boumal, N., Absil, P. A., &amp; Cartis, C. (2019). Global rates of convergence for nonconvex optimization on manifolds. IMA Journal of Numerical Analysis, 39(1), 1–33. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1093/imanum/drx080">https://doi.org/10.1093/imanum/drx080</ext-link></mixed-citation></ref>
<ref id="ref-15"><label>15</label><mixed-citation>Bhatia, R. (2009). Positive definite matrices. Princeton University Press. <ext-link ext-link-type="uri" xlink:href="https://press.princeton.edu/books/paperback/9780691168258/positive-definite-matrices">https://press.princeton.edu/books/paperback/9780691168258/positive-definite-matrices</ext-link></mixed-citation></ref>
<ref id="ref-16"><label>16</label><mixed-citation>Higham, N. J. (2008). Functions of matrices: Theory and computation. SIAM. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1137/1.9780898717778">https://doi.org/10.1137/1.9780898717778</ext-link></mixed-citation></ref>
<ref id="ref-17"><label>17</label><mixed-citation>Förstner, W., &amp; Moonen, B. (2003). A metric for covariance matrices. Geodesy-The Challenge of the 3rd Millennium (pp. 299–309). Springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-3-662-05296-9_31">https://doi.org/10.1007/978-3-662-05296-9_31</ext-link></mixed-citation></ref>
<ref id="ref-18"><label>18</label><mixed-citation>Davis, J. V., Kulis, B., Jain, P., Sra, S., &amp; Dhillon, I. S. (2007). Information-theoretic metric learning. Proceedings of the 24th International Conference on Machine Learning (pp. 209-216). Association for Computing Machinery (ACM). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/1273496.1273523">https://doi.org/10.1145/1273496.1273523</ext-link></mixed-citation></ref>
<ref id="ref-19"><label>19</label><mixed-citation>So, A. M. C., &amp; Ye, Y. (2007). Theory of semidefinite programming for sensor network localization. Mathematical Programming, 109(2), 367-384. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10107-006-0040-1">https://doi.org/10.1007/s10107-006-0040-1</ext-link></mixed-citation></ref>
<ref id="ref-20"><label>20</label><mixed-citation>Kennedy, J., &amp; Eberhart, R. (1995). Particle swarm optimization. Proceedings of ICNN&apos;95-International Conference on Neural Networks (Vol. 4, pp. 1942-1948). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ICNN.1995.488968">https://doi.org/10.1109/ICNN.1995.488968</ext-link></mixed-citation></ref>
<ref id="ref-21"><label>21</label><mixed-citation>Hansen, N., &amp; Ostermeier, A. (2001). Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation, 9(2), 159–195. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1162/106365601750190398">https://doi.org/10.1162/106365601750190398</ext-link></mixed-citation></ref>
<ref id="ref-22"><label>22</label><mixed-citation>Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688. <ext-link ext-link-type="uri" xlink:href="https://psycnet.apa.org/doi/10.1037/h0037350">https://psycnet.apa.org/doi/10.1037/h0037350</ext-link></mixed-citation></ref>
<ref id="ref-23"><label>23</label><mixed-citation>Rubin, D. B. (2005). Causal inference using potential outcomes: Design, modeling, decisions. Journal of the American Statistical Association, 100(469), 322–331. <ext-link ext-link-type="uri" xlink:href="https://www.tandfonline.com/doi/abs/10.1198/016214504000001880">https://www.tandfonline.com/doi/abs/10.1198/016214504000001880</ext-link></mixed-citation></ref>
<ref id="ref-24"><label>24</label><mixed-citation>Pearl, J. (2022). Causal diagrams for empirical research (with discussions). In Probabilistic and Causal Inference: The Works of Judea Pearl (pp. 255–316). Association for Computing Machinery (ACM). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3501714.3501734">https://doi.org/10.1145/3501714.3501734</ext-link></mixed-citation></ref>
<ref id="ref-25"><label>25</label><mixed-citation>Imbens, G. W., &amp; Rubin, D. B. (2015). Causal inference in statistics, social, and biomedical sciences. New York,</mixed-citation></ref>
<ref id="ref-26"><label>517</label><mixed-citation><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1017/CBO9781139025751">https://doi.org/10.1017/CBO9781139025751</ext-link></mixed-citation></ref>
<ref id="ref-27"><label>26</label><mixed-citation>Spirtes, P., Glymour, C., &amp; Scheines, R. (2001). Causation, prediction, and search. The MIT Press. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.7551/mitpress/1754.001.0001">https://doi.org/10.7551/mitpress/1754.001.0001</ext-link></mixed-citation></ref>
<ref id="ref-28"><label>27</label><mixed-citation>Granger, C. W. J. (1969). Investigating causal relations by econometric models and cross-spectral methods. Econometrica: Journal of the Econometric Society, 37(3), 424–438. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2307/1912791">https://doi.org/10.2307/1912791</ext-link></mixed-citation></ref>
<ref id="ref-29"><label>28</label><mixed-citation>Shalizi, C. R., &amp; Thomas, A. C. (2011). Homophily and contagion are generically confounded in observational social network studies. Sociological Methods &amp; Research, 40(2), 211–239. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/0049124111404820">https://doi.org/10.1177/0049124111404820</ext-link></mixed-citation></ref>
<ref id="ref-30"><label>29</label><mixed-citation>Runge, J. (2018). Causal network reconstruction from time series: From theoretical assumptions to practical estimation. Chaos: An Interdisciplinary Journal of Nonlinear Science, 28(7). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1063/1.5025050">https://doi.org/10.1063/1.5025050</ext-link></mixed-citation></ref>
<ref id="ref-31"><label>30</label><mixed-citation>Runge, J., Nowack, P., Kretschmer, M., Flaxman, S., &amp; Sejdinovic, D. (2019). Detecting and quantifying causal associations in large nonlinear time series datasets. Science Advances, 5(11), eaau4996. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1126/sciadv.aau4996">https://doi.org/10.1126/sciadv.aau4996</ext-link></mixed-citation></ref>
<ref id="ref-32"><label>31</label><mixed-citation>Rosenbaum, P. R., &amp; Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1093/biomet/70.1.41">https://doi.org/10.1093/biomet/70.1.41</ext-link></mixed-citation></ref>
<ref id="ref-33"><label>32</label><mixed-citation>Horvitz, D. G., &amp; Thompson, D. J. (1952). A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association, 47(260), 663–685. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2307/2280784">https://doi.org/10.2307/2280784</ext-link></mixed-citation></ref>
<ref id="ref-34"><label>33</label><mixed-citation>Card, D., &amp; Krueger, A. B. (1993). Minimum wages and employment: A case study of the fast-food industry in New Jersey and Pennsylvania. The American Economic Review, 84(4), 772–793. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3386/w4509">https://doi.org/10.3386/w4509</ext-link></mixed-citation></ref>
<ref id="ref-35"><label>34</label><mixed-citation>Hernán, M. A., &amp; Robins, J. M. (2020). Causal inference: What if. Chapman &amp; Hall/CRC. <ext-link ext-link-type="uri" xlink:href="https://static1.squarespace.com/static/675db8b0dd37046447128f5f/t/677676888e31cc50c2c33877/1735816881944/hernanrobins_WhatIf_2jan25.pdf">https://static1.squarespace.com/static/675db8b0dd37046447128f5f/t/677676888e31cc50c2c33877/1735816881944/hernanrobins_WhatIf_2jan25.pdf</ext-link></mixed-citation></ref>
<ref id="ref-36"><label>35</label><mixed-citation>Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206–215. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1038/s42256-019-0048-x">https://doi.org/10.1038/s42256-019-0048-x</ext-link></mixed-citation></ref>
<ref id="ref-37"><label>36</label><mixed-citation>Breiman, L., Friedman, J. H., Olshen, R. A., &amp; Stone, C. J. (1984). Classification and regression trees. Wadsworth &amp; Brooks/Cole Advanced Books &amp; Software. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1201/9781315139470">https://doi.org/10.1201/9781315139470</ext-link></mixed-citation></ref>
<ref id="ref-38"><label>37</label><mixed-citation>Quinlan, J. R. (1986). Induction of decision trees. Machine Learning, 1(1), 81–106. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/BF00116251">https://doi.org/10.1007/BF00116251</ext-link></mixed-citation></ref>
<ref id="ref-39"><label>38</label><mixed-citation>Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., &amp; Elhadad, N. (2015). Intelligible models for healthcare: Predicting pneumonia risk and hospital 30-day readmission. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1721-1730). Association for Computing Machinery (ACM). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/2783258.2788613">https://doi.org/10.1145/2783258.2788613</ext-link></mixed-citation></ref>
<ref id="ref-40"><label>39</label><mixed-citation>Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., &amp; Batra, D. (2017). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision (pp. 618-626). IEEE. <ext-link ext-link-type="uri" xlink:href="https://openaccess.thecvf.com/content_iccv_2017/html/Selvaraju_Grad-CAM_Visual_Explanations_ICCV_2017_paper.html">https://openaccess.thecvf.com/content_iccv_2017/html/Selvaraju_Grad-CAM_Visual_Explanations_ICCV_2017_paper.html</ext-link></mixed-citation></ref>
<ref id="ref-41"><label>40</label><mixed-citation>Holland, J. H. (1975). Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence. University of Michigan Press. <ext-link ext-link-type="uri" xlink:href="https://mitpress.mit.edu/9780262082136/adaptation-in-natural-and-artificial-systems/">https://mitpress.mit.edu/9780262082136/adaptation-in-natural-and-artificial-systems/</ext-link></mixed-citation></ref>
<ref id="ref-42"><label>41</label><mixed-citation>Storn, R., &amp; Price, K. (1997). Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11(4), 341–359. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1023/A:1008202821328">https://doi.org/10.1023/A:1008202821328</ext-link></mixed-citation></ref>
<ref id="ref-43"><label>42</label><mixed-citation>DaCosta, L., Fialho, A., Schoenauer, M., &amp; Sebag, M. (2008). Adaptive operator selection with dynamic multi-armed bandits. Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation (pp. 913-920). Association for Computing Machinery (ACM). <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/1389095.1389272">https://doi.org/10.1145/1389095.1389272</ext-link></mixed-citation></ref>
<ref id="ref-44"><label>43</label><mixed-citation>Karafotias, G., Hoogendoorn, M., &amp; Eiben, Á. E. (2014). Parameter control in evolutionary algorithms: Trends and challenges. IEEE Transactions on Evolutionary Computation, 19(2), 167–187. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TEVC.2014.2308294">https://doi.org/10.1109/TEVC.2014.2308294</ext-link></mixed-citation></ref>
<ref id="ref-45"><label>44</label><mixed-citation>Wolpert, D. H., &amp; Macready, W. G. (1997). No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation, 1(1), 67–82. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/4235.585893">https://doi.org/10.1109/4235.585893</ext-link></mixed-citation></ref>
<ref id="ref-46"><label>45</label><mixed-citation>García, S., Molina, D., Lozano, M., &amp; Herrera, F. (2009). A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: A case study on the CEC’2005 special session on real parameter optimization. Journal of Heuristics, 15(6), 617-644. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10732-008-9080-4">https://doi.org/10.1007/s10732-008-9080-4</ext-link></mixed-citation></ref>
<ref id="ref-47"><label>46</label><mixed-citation>Robbins, H., &amp; Siegmund, D. (1971). A convergence theorem for non negative almost supermartingales and some applications. In Optimizing Methods in Statistics (pp. 233–257). Elsevier. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/B978-0-12-604550-5.50015-8">https://doi.org/10.1016/B978-0-12-604550-5.50015-8</ext-link></mixed-citation></ref>
<ref id="ref-48"><label>47</label><mixed-citation>Hartley, R., Trumpf, J., Dai, Y., &amp; Li, H. (2013). Rotation averaging. International Journal of Computer Vision, 103(3), 267–305. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s11263-012-0601-0">https://doi.org/10.1007/s11263-012-0601-0</ext-link></mixed-citation></ref>
<ref id="ref-49"><label>48</label><mixed-citation>Moakher, M. (2005). A differential geometric approach to the geometric mean of symmetric positive-definite matrices. SIAM Journal on Matrix Analysis and Applications, 26(3), 735–747. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1137/S0895479803436937">https://doi.org/10.1137/S0895479803436937</ext-link></mixed-citation></ref>
<ref id="ref-50"><label>49</label><mixed-citation>Holland, J. H. (1975). Adaptation in natural and artificial systems. University of Michigan Press Google Schola, 2, 29–41. <ext-link ext-link-type="uri" xlink:href="https://mitpress.mit.edu/9780262082136/adaptation-in-natural-and-artificial-systems/">https://mitpress.mit.edu/9780262082136/adaptation-in-natural-and-artificial-systems/</ext-link></mixed-citation></ref>
<ref id="ref-51"><label>50</label><mixed-citation>Bécigneul, G., &amp; Ganea, O. E. (2018). Riemannian adaptive optimization methods. <ext-link ext-link-type="uri" xlink:href="https://arxiv.org/pdf/1810.00760">https://arxiv.org/pdf/1810.00760</ext-link></mixed-citation></ref>
<ref id="ref-52"><label>51</label><mixed-citation>Ring, W., &amp; Wirth, B. (2012). Optimization methods on Riemannian manifolds and their application to shape space. SIAM Journal on Optimization, 22(2), 596–627. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1137/11082885X">https://doi.org/10.1137/11082885X</ext-link></mixed-citation></ref>
<ref id="ref-53"><label>52</label><mixed-citation>Wager, S., &amp; Athey, S. (2018). Estimation and inference of heterogeneous treatment effects using random forests. Journal of the American Statistical Association, 113(523), 1228–1242. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/01621459.2017.1319839">https://doi.org/10.1080/01621459.2017.1319839</ext-link></mixed-citation></ref>
<ref id="ref-54"><label>53</label><mixed-citation>Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6(2), 65–70. <ext-link ext-link-type="uri" xlink:href="https://www.jstor.org/stable/4615733">https://www.jstor.org/stable/4615733</ext-link></mixed-citation></ref>
<ref id="ref-55"><label>54</label><mixed-citation>Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114(3),</mixed-citation></ref>
<ref id="ref-56"><label>494</label><mixed-citation><ext-link ext-link-type="uri" xlink:href="https://psycnet.apa.org/doi/10.1037/0033-2909.114.3.494">https://psycnet.apa.org/doi/10.1037/0033-2909.114.3.494</ext-link></mixed-citation></ref>
<ref id="ref-57"><label>55</label><mixed-citation>Wobbrock, J. O., Findlater, L., Gergle, D., &amp; Higgins, J. J. (2011). The aligned rank transform for nonparametric factorial analyses using only anova procedures. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 143-146). Academic Press. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/1978942.1978963">https://doi.org/10.1145/1978942.1978963</ext-link></mixed-citation></ref>
<ref id="ref-58"><label>56</label><mixed-citation>Derrac, J., García, S., Molina, D., &amp; Herrera, F. (2011). A practical tutorial on the use of Nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm and Evolutionary Computation, 1(1), 3-18. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.swevo.2011.02.002">https://doi.org/10.1016/j.swevo.2011.02.002</ext-link></mixed-citation></ref>
<ref id="ref-59"><label>57</label><mixed-citation>Liang, K. Y., &amp; Zeger, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73(1), 13–22. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2307/2336267">https://doi.org/10.2307/2336267</ext-link></mixed-citation></ref>
</ref-list></back>
</article>