Harris Hawks Optimizer for High-Dimensional Biomarker Discovery: A Statistically Rigorous Comparative Study of Eleven Metaheuristic Algorithms on Leukemia Gene Expression Data
Abstract
The rapid accumulation of high-throughput omics data has transformed disease diagnosis, yet the extreme dimensionality of gene expression profiles continues to impose severe computational and statistical obstacles for biomarker discovery. Although many nature-inspired metaheuristic algorithms have been proposed for Feature Selection (FS), the literature lacks rigorous, large-scale, statistically validated comparative studies on noisy, epistatic biological landscapes. This study presents an exhaustive evaluation of the Harris Hawks Optimizer (HHO) against ten state-of-the-art metaheuristics for binary FS on the benchmark Leukemia (ALL versus AML) microarray dataset. A Binary HHO (BHHO) wrapper built around a Support Vector Machine (SVM) with Radial Basis Function (RBF) kernel is benchmarked against ten competitors under strictly unified budgets of 30 agents, 100 iterations, 30 independent runs, and stratified 10-fold cross-validation. Algorithms are assessed on accuracy, F1-score, Matthews Correlation Coefficient (MCC), area under the curve, subset size, and runtime, with significance verified by Wilcoxon signed-rank and Friedman tests. HHO attained 98.61% accuracy, an Area Under the Curve (AUC) of 0.992, and an MCC of 0.971 using only 12.4 genes on average, significantly outperforming every competitor at p < 0.05 and ranking first under the Friedman test with a mean rank of 1.00. Biological enrichment analysis confirmed that the selected genes are established leukemia drivers. The dynamic escape energy mechanism of HHO provides an exceptional exploration-exploitation balance for high-dimensional biological FS, offering a reliable, interpretable, and clinically translatable biomarker discovery tool.
Keywords:
Feature selection, Harris hawks optimizer, Gene expression, Biomarker discovery, Leukemia classification, Wrapper methodsReferences
- [1] Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2015). Recent advances and emerging challenges of feature selection in the context of big data. Knowledge-Based Systems, 86, 33–45. https://doi.org/10.1016/j.knosys.2015.05.014
- [2] Guyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, 3(Mar), 1157–1182. https://dl.acm.org/doi/10.5555/944919.944968
- [3] Saeys, Y., Inza, I., & Larrañaga, P. (2007). A review of feature selection techniques in bioinformatics. Bioinformatics, 23(19), 2507–2517. https://doi.org/10.1093/bioinformatics/btm344
- [4] Xue, B., Zhang, M., & Browne, W. N. (2012). Particle swarm optimization for feature selection in classification: A multi-objective approach. IEEE Transactions on Cybernetics, 43(6), 1656–1671. https://doi.org/10.1109/TSMCB.2012.2227469
- [5] Fister Jr., I., Yang, X. S., Fister, I., Brest, J., & Fister, D. (2013). A brief review of nature-inspired algorithms for optimization. Elektrotehniški Vestnik, 80(3), 116–122. https://www.semanticscholar.org/paper/A-Brief-Review-of-Nature-Inspired-Algorithms-for-Fister-Yang/9f2b23818faf29412faeecef21cfbaa0d28cd9e6
- [6] Holland, J. H. (1975). Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence. University of Michigan Press. https://doi.org/10.7551/mitpress/1090.001.0001
- [7] Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. Proceedings of ICNN'95-International Conference on Neural Networks (Vol. 4, pp. 1942-1948). IEEE. https://doi.org/10.1109/ICNN.1995.488968
- [8] Storn, R., & Price, K. (1997). Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11(4), 341–359. https://doi.org/10.1023/A:1008202821328
- [9] Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46-61. (In Persian). https://doi.org/10.1016/j.advengsoft.2013.12.007
- [10] Mirjalili, S., & Lewis, A. (2016). The whale optimization algorithm. Advances in Engineering Software, 95, 51–67. https://doi.org/10.1016/j.advengsoft.2016.01.008
- [11] Mirjalili, S., Gandomi, A. H., Mirjalili, S. Z., Saremi, S., Faris, H., & Mirjalili, S. M. (2017). Salp swarm algorithm: A bio-inspired optimizer for engineering design problems. Advances in Engineering Software, 114, 163–191. https://doi.org/10.1016/j.advengsoft.2017.07.002
- [12] Karaboga, D., & Basturk, B. (2007). A powerful and efficient algorithm for numerical function optimization: Artificial bee colony (ABC) algorithm. Journal of Global Optimization, 39(3), 459–471. https://doi.org/10.1007/s10898-007-9149-x
- [13] Faramarzi, A., Heidarinejad, M., Mirjalili, S., & Gandomi, A. H. (2020). Marine predators algorithm: A nature-inspired metaheuristic. Expert Systems with Applications, 152, 113377. https://doi.org/10.1016/j.eswa.2020.113377
- [14] Li, S., Chen, H., Wang, M., Heidari, A. A., & Mirjalili, S. (2020). Slime mould algorithm: A new method for stochastic optimization. Future Generation Computer Systems, 111, 300–323. https://doi.org/10.1016/j.future.2020.03.055
- [15] Abualigah, L., Yousri, D., Abd Elaziz, M., Ewees, A. A., Al-Qaness, M. A. A., & Gandomi, A. H. (2021). Aquila optimizer: A novel meta-heuristic optimization algorithm. Computers & Industrial Engineering, 157, 107250. https://doi.org/10.1016/j.cie.2021.107250
- [16] Fausto, F., Reyna-Orta, A., Cuevas, E., Andrade, Á. G., & Perez-Cisneros, M. (2020). From ants to whales: Metaheuristics for all tastes. Artificial Intelligence Review, 53(1), 753–810. https://doi.org/10.1007/s10462-018-09676-2
- [17] Nakamura, R. Y., Pereira, L. A., Costa, K. A., Rodrigues, D., Papa, J. P., & Yang, X. S. (2012). BBA: A binary bat algorithm for feature selection. 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images (pp. 291-297). IEEE. https://doi.org/10.1109/SIBGRAPI.2012.47
- [18] Yang, X. S. (2014). Swarm intelligence based algorithms: A critical analysis. Evolutionary Intelligence, 7(1), 17–28. https://doi.org/10.1007/s12065-013-0102-2
- [19] Heidari, A. A., Mirjalili, S., Faris, H., Aljarah, I., Mafarja, M., & Chen, H. (2019). Harris Hawks optimization: Algorithm and applications. Future Generation Computer Systems, 97, 849–872. https://doi.org/10.1016/j.future.2019.02.028
- [20] Daliri, A., Roudposhti, K. K., Alimoradi, M., Sheikhha, M., Saraei, M. R. S., & Mohammadzadeh, J. (2025). Optimized categorical boosting for gastric cancer classification using heptagonal reinforcement learning and the water optimization algorithm. 2025 7th International Conference on Pattern Recognition and Image Analysis (IPRIA) (pp. 1-6). IEEE. https://doi.org/10.1109/IPRIA68579.2025.11263556
- [21] Alimoradi, M., Azgomi, H., & Asghari, A. (2022). Trees social relations optimization algorithm: A new swarm-based metaheuristic technique to solve continuous and discrete optimization problems. Mathematics and Computers in Simulation, 194, 629–664. https://doi.org/10.1016/j.matcom.2021.12.010
- [22] Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7(Jan), 1–30. https://www.jmlr.org/papers/volume7/demsar06a/demsar06a.pdf
- [23] Hancer, E., Xue, B., & Zhang, M. (2018). Differential evolution for filter feature selection based on information theory and feature ranking. Knowledge-Based Systems, 140, 103–119. https://doi.org/10.1016/j.knosys.2017.10.028
- [24] Al-Tashi, Q., Mirjalili, S., Wu, J., Abdulkadir, S. J., Shami, T. M., Khodadadi, N., & Alqushaibi, A. (2022). Moth-flame optimization algorithm for feature selection: A review and future trends. CRC Press. https://dx.doi.org/10.1201/9781003205326-3
- [25] Cui, Z., Zhang, J., Wang, Y., Cao, Y., Cai, X., Zhang, W., & Chen, J. (2019). A pigeon-inspired optimization algorithm for many-objective optimization problems. Science China. Information Sciences, 62(7), 70212. https://doi.org/10.1007/s11432-018-9729-5
- [26] Lin, S. W., Ying, K. C., Chen, S. C., & Lee, Z. J. (2008). Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Systems with Applications, 35(4), 1817–1824. https://doi.org/10.1016/j.eswa.2007.08.088
- [27] Too, J., Abdullah, A. R., & Mohd Saad, N. (2019). A new quadratic binary harris hawk optimization for feature selection. Electronics, 8(10), 1130. https://doi.org/10.3390/electronics8101130
- [28] Wang, M., Chen, H., Yang, B., Zhao, X., Hu, L., Cai, Z., ... & Tong, C. (2017). Toward an optimal kernel extreme learning machine using a chaotic moth-flame optimization strategy with applications in medical diagnoses. Neurocomputing, 267, 69-84. https://doi.org/10.1016/j.neucom.2017.04.060
- [29] Davis, J., & Goadrich, M. (2006). The relationship between Precision-Recall and ROC curves. Proceedings of the 23rd International Conference on Machine Learning (pp. 233-240). Association for Computing Machinery (ACM). https://doi.org/10.1145/1143844.1143874
- [30] Huang, S., Cai, N., Pacheco, P. P., Narrandes, S., Wang, Y., & Xu, W. (2018). Applications of support vector machine (SVM) learning in cancer genomics. Cancer Genomics-Proteomics, 15(1), 41–51. https://cgp.iiarjournals.org/content/15/1/41.short
- [31] Shahrjooihaghighi, A., Frigui, H., Zhang, X., Wei, X., Shi, B., & Trabelsi, A. (2017). An ensemble feature selection method for biomarker discovery. 2017 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT) (pp. 416-421). IEEE. https://doi.org/10.1109/ISSPIT.2017.8388679
- [32] Chandra, B., & Gupta, M. (2011). An efficient statistical feature selection approach for classification of gene expression data. Journal of Biomedical Informatics, 44(4), 529–535. https://doi.org/10.1016/j.jbi.2011.01.001
- [33] Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., ... & Lander, E. S. (1999). Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science, 286(5439), 531-537. https://doi.org/10.1126/science.286.5439.531
- [34] Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., ... & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. The Journal of Machine Learning Research, 12, 2825-2830. https://www.jmlr.org/papers/volume12/pedregosa11a/pedregosa11a.pdf