Metaheuristic Optimization in Structural Engineering Design and Analysis: A SurveyJanardanBeheraSwainKharabelaDepartment of Statistics, Ravenshaw University, Cuttack, 753003, Odisha, India.Institute of Applied Sciences, Mangalayatan University, Aligarh-202146, India.
This paper presents a comprehensive review of metaheuristic algorithms across engineering disciplines over the period 2000-2025. We systematically analyze the literature on metaheuristic algorithms and their applications to structural design, power systems, control, manufacturing, aerospace, p. The review covers approximately 192 papers, providing a structured taxonomy of algorithms, applications, and evaluation methodologies. We identify key trends including the shift toward hybrid approaches, integration of Machine Learning (ML), and growing emphasis on explainability. The survey reveals that constraint handling, multi-objectivity, real-time, scalability, and robustness remain significant open problems. We provide detailed analysis of evaluation protocols, benchmark suites, and statistical methodologies. Future research directions include hybrid algorithm design, quantum-inspired methods, and standardized benchmarking frameworks.
Optimization is fundamental to computational science and engineering, underpinning applications from engineering design to scientific discovery. Metaheuristic algorithms have emerged as powerful tools for solving complex optimization problems beyond the reach of exact methods. Over the past two decades, the field has witnessed exponential growth, with hundreds of new algorithms proposed and thousands of applications documented. This review provides a comprehensive survey of metaheuristic algorithms across engineering disciplines, covering algorithmic developments, application domains, evaluation methodologies, and future directions.
The origins of metaheuristic optimization trace back to the 1960s with evolutionary strategies by Rechenberg [1] and Schwefel [2], followed by Holland's [3] Genetic Algorithm (GM) in 1975. The 1990s marked a turning point with swarm intelligence. Kennedy and Eberhart's [4] Particle Swarm Optimization (PSO) and Dorigo et al. [5] Ant Colony Optimization (ACO) demonstrated that collective behavior inspired by nature could effectively solve complex problems. The 2000s and 2010s brought a proliferation of nature-inspired algorithms including firefly, Cuckoo Search (CS), bat, and Flower Pollination Algorithms (FPAs). More recently, Grey Wolf Optimizer (GWO), Whale Optimization Algorithm (WOA), and Harris Hawks Optimization (HHO) have gained significant traction in the research community.
Despite this algorithmic abundance, the No Free Lunch theorem by Wolpert and Macready establishes that no single optimizer can dominate across all problem classes. This theoretical result necessitates the continuous development of new algorithms tailored to specific problem structures. Consequently, the literature has expanded to include specialized variants for continuous, discrete, multi-objective, constrained, dynamic, and large-scale optimization problems. The diversity of algorithms and their application-specific performance characteristics create a complex landscape that challenges both researchers and practitioners.
This review is motivated by several factors. First, the rapid growth makes it difficult for researchers to maintain a comprehensive understanding of the literature. A structured survey is needed to organize existing knowledge and identify gaps. Second, the quality of evaluation methodologies varies significantly, with many papers lacking rigorous statistical analysis or fair benchmark comparisons. Third, emerging technologies such as deep learning, quantum computing, and edge AI are creating new opportunities and challenges that warrant systematic analysis. We focus on PSO, GA, DE, GWO, WOA, HHO, SSA, ACO, ABC, TLBO, CMA-ES, and their applications to structural design, power systems, control, manufacturing, etc.
The main contributions of this review are: 1) a comprehensive taxonomy of metaheuristic algorithms organized by inspiration source and algorithmic structure, 2) a survey of applications across structural design, power systems, control, manufac, 3) analysis of evaluation methodologies including benchmark suites, performance metrics, and statistical testing protocols, 4) identification of key open problems and challenges, 5) practical guidelines for algorithm selection, parameter tuning, and experimental design. The remainder is organized as: Section 2 provides background; Section 3 describes methodology; Section 4 surveys algorithms; Section 5 reviews applications; Section 6 discusses challenges; Section 7 outlines future directions; Section 8 concludes.
The interdisciplinary nature of metaheuristic optimization has led to its adoption across diverse fields including engineering, computer science, biology, chemistry, economics, and social sciences. Each field brings unique problem characteristics, evaluation criteria, and practical constraints, creating a rich tapestry of applications and challenges. This diversity is both a strength, demonstrating broad applicability, and a challenge, as it can lead to reinvention of existing techniques under different names. Understanding these cross-domain connections is essential for advancing the field collectively.
Background and Context
This section provides foundational background, defining key concepts and tracing the historical evolution of metaheuristic optimization relevant to metaheuristic algorithms across engineering disciplines.
Definitions and Fundamental Concepts
A metaheuristic is a higher-level strategy that guides and modifies other heuristics to search for solutions to optimization problems. Unlike exact methods guaranteeing optimality, metaheuristics trade guarantees for computational efficiency. Key characteristics include: stochastic search using randomization; population-based or trajectory-based operation; exploration-exploitation balance mechanisms; and problem-agnostic design requiring minimal adaptation. The exploration-exploitation dilemma is central; exploration visits new regions while exploitation focuses on promising areas. Well-designed algorithms must balance both: excessive exploration leads to slow convergence, while excessive exploitation causes premature convergence at suboptimal solutions.
The distinction between heuristics and metaheuristics is important. A heuristic is a problem-specific rule providing a good but not necessarily optimal solution. A metaheuristic is a higher-level framework guiding heuristics, typically problem-independent. This generality comes at the cost of potentially lower efficiency compared to specialized methods, but the trade-off is favorable for problems lacking efficient specialized approaches. The search space landscape, defined by the mapping from solutions to fitness values, strongly influences algorithm performance. Landscape characteristics including modality, ruggedness, separability, and conditioning determine which algorithms will be effective.
Historical Evolution
The history spans four phases:
Phase 1 (1960s-1970s). Evolutionary Algorithms (EA) including evolutionary strategies by Rechenberg [1]/Schwefel [2], evolutionary programming by Fogel et al. [6], and GMs by Holland [3].
Phase 2 (1980s-1990s). Simulated Annealing (AS) by Kirkpatrick [7] and tabu search by Glover [8].
Phase 3 (1990s-2000s). Swarm intelligence, PSO by Kennedy/Eberhart [4] and ACO by Dorigo et al. [5]. Phase 4 (2000s-present). Proliferation of nature-inspired algorithms including GWO, WOA, HHO, and adaptive variants like SHADE and CMA-ES.
Landscape analysis has emerged as a powerful tool. Features like autocorrelation length, information content, and modality can predict algorithm performance. Exploratory Landscape Analysis (ELA) computes features from search space samples and uses Machine Learning (ML) to recommend algorithms. This approach represents a promising direction for making optimization more accessible to non-expert users. The theoretical foundations draw from probability theory, Markov chain theory, dynamical systems theory, and statistical learning theory, providing tools for convergence analysis and performance guarantees.
Mechanism illustration showing the transformation process.
Review Methodology
The literature search was conducted using IEEE Xplore, ScienceDirect, SpringerLink, Wiley, ACM DL, and Google Scholar. Search queries combined algorithm terms with application domain terms, restricted to 2000- 2025. Inclusion criteria: 1) presents or applies a metaheuristic algorithm, 2) includes an algorithmic description and experimental evaluation, 3) peer-reviewed, 4) English. The initial search yielded approximately 2,500 papers; after screening, 192 were selected for detailed analysis along multiple dimensions including algorithm type, problem type, application domain, and evaluation methodology.
Literature search results across academic databases.
This table is shown in the PDF version of the article.
Each selected paper was analyzed along multiple dimensions: algorithm type, problem type, application domain, evaluation methodology, performance metrics, statistical analysis, and reproducibility. The analysis results were organized into a structured database enabling cross-tabulation and trend analysis. Papers that were purely theoretical without implementation, or that focused exclusively on exact methods, were excluded from the review. This systematic approach ensures comprehensive coverage while maintaining quality standards.
Survey of Metaheuristic Algorithms
This section provides a detailed survey of the metaheuristic algorithms most frequently used in engineering disciplines, organized by inspiration source and algorithmic family.
3D response surface for parameter optimization.
Evolutionary Algorithms
EAs use selection, crossover, and mutation. The GA by Holland [3] is the most widely known EA, applied to structural design, power systems, control, and manufacturing with considerable success. Differential Evolution (DE) by Storn and Price [9] uses vector differences for mutation, particularly effective for continuous optimization. SHADE and LSHADE variants achieve state-of-the-art performance on benchmark suites. CMA-ES by Hansen [10] adapts the covariance matrix based on successful solutions, effective on ill-conditioned problems with theoretical guarantees.
In the reviewed applications, DE and its variants consistently rank among top performers for continuous optimization. GA dominates discrete problems with specialized operators. CMA-ES excels on problems with complex variable interactions, though its computational overhead limits high-dimensional applicability. Memetic algorithms combining EA with local search show superior performance by combining global search with local refinement. Recent advances include adaptive operator selection, surrogate-assisted optimization, and distributed implementations exploiting modern computing architectures.
Swarm Intelligence
PSO by Kennedy and Eberhart [4] simulates flocking behavior. Each particle adjusts position based on personal and global bests. ACO by Dorigo et al. [5] uses pheromone trails, effective for discrete problems. ABC by Karaboga [11] simulates honey bee foraging. GWO by Mirjalili et al. [12] simulates grey wolf social hierarchy. WOA by Mirjalili and Lewis [13] is inspired by humpback whale bubble-net feeding. HHO by Heidari et al. [14] simulates Harris Hawks cooperative hunting.
PSO remains the most popular swarm algorithm due to simplicity and effectiveness. ACO excels on combinatorial problems like routing and scheduling. GWO and WOA have gained rapid adoption due to few control parameters and competitive performance. The Salp Swarm Algorithm and HHO represent the latest generation of swarm methods, incorporating more sophisticated search mechanisms inspired by collective behaviors observed in nature. These algorithms have been applied to structural design, power systems, control, and manufacturing with varying degrees of success.
Physics- and Bio-Inspired Methods
SA by Kirkpatrick [7] is based on metallurgical annealing. The Gravitational Search Algorithm (GSA) by Rashedi et al. [15] uses gravity and mass interactions. The Firefly Algorithm (FA), CS, Bat Algorithm (BA), and FPA by Yang [16] represent bio-inspired approaches gaining popularity due to intuitive appeal and competitive performance on benchmark problems. These algorithms have been applied to structural design, power systems, control, and manufacturing with varying degrees of success.
Recent trends include hybrid algorithms combining multiple metaheuristics, adaptive parameter control, and surrogate-assisted optimization. Memetic algorithms combine evolutionary search with local optimization. Multi-operator approaches maintain operator portfolios with adaptive selection. Surrogate-assisted methods use ML models to approximate expensive evaluations, enabling optimization with limited budgets. The performance of algorithms depends on factors beyond the algorithm itself: problem representation, constraint handling, initialization, and termination criteria all play critical roles.
Reliability diagram showing calibration quality.
Applications
This section reviews the application of metaheuristic algorithms to structural design, power systems, control, manufacturing, aerospace, p, organized by application category.
Primary Application Areas
The reviewed literature reveals that continuous optimization dominates, reflecting the prevalence of real-valued parameters. Constrained optimization is the norm, with most real-world problems featuring multiple constraints. Multi-objective formulations are increasingly common. The computational budget varies enormously, from milliseconds (real-time control) to days (expensive simulations), driving different algorithmic choices. Algorithm selection patterns emerge: PSO and DE dominate continuous optimization; GA and ACO are preferred for discrete problems; NSGA-II and MOEA/D lead multi-objective optimization.
An important observation is the growing trend toward hybridization. Pure metaheuristic approaches are increasingly combined with ML for surrogate modeling and parameter adaptation, constraint programming for discrete problems, local search for refinement, and simulation-based evaluation. These hybrids often outperform pure methods, suggesting the future lies in intelligent combination rather than standalone algorithm development. The integration with simulation models is particularly important; many real-world systems are too complex for analytical optimization and require simulation-based evaluation.
The transition from research to practice presents unique challenges. Many algorithms performing well on benchmarks face difficulties in deployment due to noisy evaluations, non-stationary environments, safety constraints, and integration with existing systems. Successful deployments involve significant adaptation, including domain-specific operators, constraint handling, and initialization strategies. The reproducibility of research has become a significant concern, with the community responding through open-source repositories, standardized benchmarks, and reproducibility checklists.
Qualitative comparison of major metaheuristic algorithms.
This table is shown in the PDF version of the article.
Despite significant progress, several challenges remain in metaheuristic optimization for structural design, power systems, control, manufac. This section discusses the most critical issues.
Parameter Tuning
Most algorithms require careful parameter tuning. Optimal settings are problem-dependent, creating a meta-optimization problem. Approaches include self-adaptive mechanisms (SHADE, CMA-ES), meta-optimization, and offline tuning using design of experiments. Automated tools like Optuna help but add computational overhead. The parameter sensitivity varies significantly: CMA-ES is largely self-adaptive while PSO is highly sensitive to cognitive and social coefficients.
Benchmark Fairness and Reproducibility
Lack of standardized evaluation protocols hinders fair comparison. Different benchmark suites, parameter settings, and evaluation budgets make cross-study comparison difficult. Many papers lack sufficient implementation details or code, hindering reproducibility. The CEC benchmark suites help, but adoption is not universal. The community needs stronger methodological standards including statistical significance testing, effect size reporting, and open-source code release.
Theoretical Analysis and Scalability
Theoretical understanding lags behind empirical success. Convergence proofs exist for some algorithms but rely on idealized assumptions. The NFL theorem provides limitations but little practical guidance. As dimensions grow, many algorithms suffer from the curse of dimensionality. Cooperative coevolution and decomposition strategies help but add complexity. The proliferation of new algorithms with marginal improvements has been criticized. The community needs principled design with rigorous analysis.
The statistical validation of algorithm performance has received increasing attention. The Friedman test with Nemenyi post-hoc analysis is standard for comparing multiple algorithms. For pairwise comparisons, Wilcoxon rank-sum with Holm-Bonferroni correction is used. Effect sizes (Cohen's d, Cliff's delta) complement p-values by quantifying the magnitude of differences. Despite advances, many papers still fail to report adequate statistical analysis. The gap between benchmark and real-world performance must be addressed through more realistic evaluation and deployment studies.
Ranking heatmap across functions and algorithms.
Future Research Directions
Based on identified challenges and emerging trends, we outline promising future research directions for metaheuristic optimization in structural design, power systems, control, manufac.
First, integrating metaheuristic optimization with ML is rapidly growing. ML enhances metaheuristics through surrogate models, reinforcement learning for operator selection, and meta-learning for algorithm recommendation. Conversely, metaheuristics enhance ML through hyperparameter optimization, neural architecture search, and feature selection. This symbiotic relationship is expected to drive significant advances in both fields, particularly as deep learning creates new optimization challenges.
Second, quantum-inspired metaheuristics use concepts like superposition and entanglement. Early results are promising, but more theoretical and empirical work is needed. Third, federated and distributed optimization is critical for IoT, edge computing, and federated learning, requiring algorithms that operate in decentralized, privacy-preserving settings. Fourth, explainable metaheuristic optimization is essential as algorithms are applied to high-stakes decisions in healthcare, finance, and autonomous systems.
Fifth, standardized benchmarking and open-source repositories are needed for reproducibility. Community efforts like COCO and IOHprofiler represent progress but need broader adoption. Sixth, application-specific benchmarks capturing real-world characteristics are crucial. Seventh, theoretical analysis needs advancement. Finally, ethical implications deserve attention. Fairness-constrained optimization, privacy-preserving methods, and explainable search are needed for responsible deployment of metaheuristic methods in high-stakes applications.
The role of metaheuristics in the broader AI ecosystem is evolving. Integration with LLMs and foundation models creates new optimization challenges: fine-tuning, prompt engineering, architecture search. The sustainability of computational research (energy consumption and carbon footprint) also deserves consideration, promoting green optimization practices. Educational initiatives and user-friendly platforms are essential for training the next generation of researchers and practitioners.
Conclusion
This review surveyed metaheuristic algorithms across engineering disciplines over the period 2000-2025, analyzing 192 papers. The field has experienced exponential growth with hundreds of new algorithms proposed and thousands of applications documented. PSO, GA, DE, GWO, and WOA are the most popular algorithms. Key challenges include parameter tuning, benchmark fairness, theoretical analysis, and scalability. Future directions include ML integration, quantum-inspired methods, federated optimization, and explainable metaheuristics. This review serves as a comprehensive reference for researchers and practitioners in metaheuristic optimization.
Several lessons emerge. First, algorithm selection should be driven by problem characteristics rather than popularity. Second, rigorous evaluation with standardized benchmarks, statistical significance, and effect sizes is critical. Third, hybridization often yields better results than pure approaches. Fourth, the benchmark-to-real-world gap must be addressed through realistic evaluation and deployment studies. We hope this review stimulates further advances in this important and rapidly evolving field.
As metaheuristic algorithms continue evolving and finding new applications, we expect integration with emerging technologies (AI, quantum computing, edge computing) to drive the next wave of innovation. The community must balance scientific rigor with openness to new ideas, ensuring that metaheuristic optimization continues making valuable contributions to science and society in the decades to come.
Authors' Contributions
All aspects of the research and manuscript preparation were carried out by the author. The author has read and approved the final version of the manuscript.
Funding
Not applicable.
Data Availability
All data supporting the reported findings in this research paper are provided within the manuscript.
Conflict of Interest
The author declares that they do not have any conflict of interest.
Consent for Publication
The author confirms consent for the publication of this work.
Ethics Approval and Consent to Participate
This article does not contain any studies with human participants performed by the author.
ReferencesRechenberg, I. (1973). Evolutionsstrategie: Optimierung technischer systeme nach prinzipien der biologischen evolution. Frommann-Holzboog. https://gwern.net/doc/reinforcement-learning/exploration/1973-rechenberg.pdfSchwefel, H. P. (1975). Evolutionsstrategie und numerische optimierung [Thesis]. https://doi.org/10.1007/978-3-0348-5927-1_5Holland, J. H. (1992). Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence. MIT Press. https://mitpress.mit.edu/9780262581110/adaptation-in-natural-and-artificial-systems/Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. Proceedings of ICNN'95-international conference on neural networks (Vol. 4, pp. 1942-1948). IEEE. https://doi.org/10.1109/ICNN.1995.488968Dorigo, M., Maniezzo, V., & Colorni, A. (1996). Ant system: Optimization by a colony of cooperating agents. IEEE transactions on systems, man, and cybernetics, part b (cybernetics), 26(1), 29–41. https://doi.org/10.1109/3477.484436Fogel, L. J., Owens, A. J., & Walsh, M. J. (1966). Artificial intelligence through simulated evolution. John Wiley & Sons. https://doi.org/10.1002/bs.3830110403Kirkpatrick, S. (1983). Improvement of reliabilities of regulations using a hierarchical structure in a genetic network. Science, 220, 671–680. https://doi.org/10.1126/science.220.4598.671Glover, F. (1989). Tabu search—part I. ORSA journal on computing, 1(3), 190–206. https://doi.org/10.1287/ijoc.1.3.190Storn, R., & Price, K. (1997). Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. Journal of global optimization, 11(4), 341–359. https://doi.org/10.1023/A:1008202821328Hansen, N. (2006). The CMA evolution strategy: A comparing review. In Towards a new evolutionary computation: Advances on estimation of distribution algorithms (pp. 75–102). Springer. https://doi.org/10.1007/3-540-32494-1_4Karaboga, D. (2005). An idea based on honey bee swarm for numerical optimization. https://abc.erciyes.edu.tr/pub/tr06_2005.pdfMirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in engineering software, 69, 46-61 (In Persian). https://doi.org/10.1016/j.advengsoft.2013.12.007Mirjalili, S., & Lewis, A. (2016). The whale optimization algorithm. Advances in engineering software, 95, 51–https://doi.org/10.1016/j.advengsoft.2016.01.008Heidari, A. A., Mirjalili, S., Faris, H., Aljarah, I., Mafarja, M., & Chen, H. (2019). Harris Hawks optimization: Algorithm and applications. Future generation computer systems, 97, 849–872. https://doi.org/10.1016/j.future.2019.02.028.Rashedi, E., Nezamabadi-Pour, H., & Saryazdi, S. (2009). GSA: A gravitational search algorithm. Information sciences, 179(13), 2232–2248. https://doi.org/10.1016/j.ins.2009.03.004Yang, X. S. (2010). Firefly algorithm, stochastic test functions and design optimisation. International journal of bio-inspired computation, 2(2), 78–84. https://doi.org/10.1504/IJBIC.2010.032124