Review: Evolution of Nature-Inspired Metaheuristic Algorithms: Developments, Trends, and Applications from 1990 to 2025
Abstract
This paper presents a comprehensive review of metaheuristic optimization algorithms across engineering and scientific domains over the period 2000-2025. We systematically analyze the literature on metaheuristic algorithms and their applications to engineering design, scheduling, Machine Learning (ML), signal processing, c. The review covers approximately 165 papers, providing a structured taxonomy of algorithms, applications, and evaluation methodologies. We identify key trends including the shift toward hybrid approaches, integration of ML, and growing emphasis on explainability. The survey reveals that parameter tuning, premature convergence, scalability, benchmark fairne remain significant open problems. We provide detailed analysis of evaluation protocols, benchmark suites, and statistical methodologies. Future research directions include hybrid algorithm design, quantum-inspired methods, and standardized benchmarking frameworks.
Keywords:
Metaheuristic optimization, General, Review, Survey, Engineering design, Scheduling, MachineReferences
- [1] Rechenberg, I. (1973). Evolutionsstrategie: Optimierung technischer systeme nach prinzipien der biologischen evolution. Frommann-Holzboog. https://gwern.net/doc/reinforcement-learning/exploration/1973-rechenberg.pdf
- [2] Schwefel, H. P. (1977). Numerical optimization of computer models using the evolution strategy. Birkhäuser. (In German). https://doi.org/10.1007/978-3-0348-5927-1
- [3] Holland, J. H. (1975). Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence. University of Michigan Press. https://doi.org/10.7551/mitpress/1090.001.0001
- [4] Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. Proceedings of ICNN'95-International Conference on Neural Networks (Vol. 4, pp. 1942-1948). IEEE. https://doi.org/10.1109/ICNN.1995.488968
- [5] Dorigo, M., Maniezzo, V., & Colorni, A. (1996). Ant system: Optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 26(1), 29–41. https://doi.org/10.1109/3477.484436
- [6] Dorigo, M., & Di Caro, G. (1999). The ant colony optimization meta-heuristic. In New Ideas in Optimization (pp. 11–32). McGraw-Hill. https://web2.qatar.cmu.edu/~gdicaro/15382/additional/aco-book.pdf
- [7] Fogel, L. J., Owens, A. J., & Walsh, M. J. (1966). Artificial intelligence through simulated evolution. John Wiley & Sons. https://doi.org/10.1109/9780470544600.ch7
- [8] Kirkpatrick, S., Gelatt, C. D., Jr., & Vecchi, M. P. (1983). Optimization by simulated annealing. Science, 220(4598), 671–680. https://doi.org/10.1126/science.220.4598.671
- [9] Glover, F. (1989). Tabu search—part I. ORSA Journal on Computing, 1(3), 190–206. https://doi.org/10.1287/ijoc.1.3.190
- [10] Storn, R., & Price, K. (1997). Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11(4), 341–359. https://doi.org/10.1023/A:1008202821328
- [11] Hansen, N., & Ostermeier, A. (2001). Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation, 9(2), 159–195. https://doi.org/10.1162/106365601750190398
- [12] Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46-61. (In Persian). https://doi.org/10.1016/j.advengsoft.2013.12.007
- [13] Mirjalili, S., & Lewis, A. (2016). The whale optimization algorithm. Advances in Engineering Software, 95, 51–67. https://doi.org/10.1016/j.advengsoft.2016.01.008
- [14] Heidari, A. A., Mirjalili, S., Faris, H., Aljarah, I., Mafarja, M., & Chen, H. (2019). Harris Hawks optimization: Algorithm and applications. Future Generation Computer Systems, 97, 849–872. https://doi.org/10.1016/j.future.2019.02.028
- [15] Rashedi, E., Nezamabadi-Pour, H., & Saryazdi, S. (2009). GSA: A gravitational search algorithm. Information Sciences, 179(13), 2232–2248. https://doi.org/10.1016/j.ins.2009.03.004
- [16] Yang, X. S. (2009). Firefly algorithms for multimodal optimization. Stochastic Algorithms: Foundations and Applications (pp. 169–178). Springer. https://doi.org/10.1007/978-3-642-04944-6_14
- [17] Cohen, J. (2013). Statistical power analysis for the behavioral sciences. Routledge. https://doi.org/10.4324/9780203771587
- [18] Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114(3), 494. https://psycnet.apa.org/doi/10.1037/0033-2909.114.3.494