A World Hyper Heuristic Reinforcement Learning Algorithm for Feature Selection in EEG Motor Imagery Based BCI Systems

Authors

https://doi.org/10.48313/maa.v2i3.54

Abstract

Motor Imagery–based Brain–Computer Interface (MI BCI) systems rely heavily on the extraction and selection of discriminative features from  Electroencephalography (EEG) signals. However, EEG data are inherently noisy, high dimensional, and non stationary, making feature selection a challenging optimization problem. This paper introduces a novel reinforcement learning–driven optimization framework called the World Hyper Heuristic (WHH) algorithm. Unlike traditional metaheuristics that depend on fixed operators, WHH dynamically selects among multiple Low Level Heuristics (LLHs) based on environmental feedback, enabling a more effective balance between exploration and exploitation. The algorithm is evaluated on benchmark MI datasets from the BCI Competition series and compared with five widely used optimization algorithms: Genetic Algorithm (GA), Particle Swarm Optimization (PSO), Differential Evolution (DE), Grey Wolf Optimizer (GWO), and Random Search (RS). Results demonstrate that WHH consistently outperforms all baselines in classification accuracy, F1 score, kappa coefficient, feature reduction rate, convergence speed, and cross session stability. WHH achieves up to 12.4% higher accuracy, reduces feature dimensionality by 43–57%, and improves stability by 18% compared to the best competing method. These findings highlight the potential of reinforcement learning–based hyper heuristics as a powerful and adaptive optimization paradigm for next generation BCI systems.

Keywords:

Imagery–based brain–computer interface, World hyper heuristic, Electroencephalography, Genetic algorithm

References

  1. [1] Santhanam, G., Ryu, S. I., Yu, B. M., Afshar, A., & Shenoy, K. V. (2006). A high-performance brain–computer interface. Nature, 442(7099), 195–198. https://doi.org/10.1038/nature04968
  2. [2] Pires, G., Cruz, A., Jesus, D., Yasemin, M., Nunes, U. J., Sousa, T., & Castelo-Branco, M. (2022). A new error-monitoring brain–computer interface based on reinforcement learning for people with autism spectrum disorders. Journal of neural engineering, 19(6), 66032. https://doi.org/10.1088/1741-2552/aca798
  3. [3] Drigas, A., & Sideraki, A. (2024). Brain neuroplasticity leveraging virtual reality and brain–computer interface technologies. Sensors, 24(17), 5725. https://doi.org/10.3390/s24175725
  4. [4] Cong, F. (2019). Blind source separation. In EEG signal processing and feature extraction (pp. 117–140). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-13-9113-2_7
  5. [5] Wu, D. (2017). Online and offline domain adaptation for reducing BCI calibration effort. IEEE transactions on human-machine systems, 47(4), 550–563. https://doi.org/10.1109/THMS.2016.2608931
  6. [6] Bai, Y., Li, X., & Liang, Z. (2019). Nonlinear neural dynamics. In EEG signal processing and feature extraction (pp. 215–240). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-13-9113-2_11
  7. [7] Alhassan, B., Bala, N., & Musa, H. (2025). Numerical solution of systems of first order stiff oscillatory differential equations using diagonally implicit super class of block backward differentiation formula. Computational algorithms and numerical dimensions, 4(2), 157–179. https://doi.org/10.22105/cand.2025.503444.1182
  8. [8] SFakheri, S., Alimoradi, M., & Yamaghani, M. R. (2026). Colour image multilevel thresholding segmentation using trees social relationship algorithm. International journal of computer information systems and industrial management applications, 18, 34-34. https://doi.org/10.21203/rs.3.rs-4479475/v1
  9. [9] Kaongoen, N., Choi, J., & Jo, S. (2022). A novel online BCI system using speech imagery and ear-EEG for home appliances control. Computer methods and programs in biomedicine, 224, 107022. https://doi.org/10.1016/j.cmpb.2022.107022
  10. [10] Tremmel, C., Fernandez-Vargas, J., Stamos, D., Cinel, C., Pontil, M., Citi, L., & Poli, R. (2022). A meta-learning BCI for estimating decision confidence. Journal of neural engineering, 19(4), 046009. 10.1088/1741-2552/ac7ba8
  11. [11] Rahman, N., Khan, D. M., Masroor, K., Arshad, M., Rafiq, A., & Fahim, S. M. (2024). Advances in brain-computer interface for decoding speech imagery from EEG signals: A systematic review. Cognitive neurodynamics, 18(6), 3565–3583. https://doi.org/10.1007/s11571-024-10167-0
  12. [12] Nicolas-Alonso, L. F., & Gomez-Gil, J. (2012). Brain computer interfaces, a review. Sensors, 12(2), 1211–1279. https://doi.org/10.3390/s120201211
  13. [13] Lamtar Gholipoor, M. ‎, Alimoradi, M., & Fakheri, S. (2024). A novel metaheuristic approach inspired by trees social relationships and models for fermentation medium. Metaheuristic algorithms with applications, 1(1), 1–11. https://doi.org/10.22105/maa.v1i1.17
  14. [14] Lamtar-Gholipoor, M., Fakheri, S., & Alimoradi, M. (2024). Artificial neural network TSR for optimization of actinomycin production. Big data and computing visions, 4(1), 57–66. https://doi.org/10.22105/bdcv.2024.474793.1184
  15. [15] Daliri, A., Alimoradi, M., Zabihimayvan, M., & Sadeghi, R. (2024). World hyper-heuristic: A novel reinforcement learning approach for dynamic exploration and exploitation. Expert systems with applications, 244, 122931. https://doi.org/10.1016/j.eswa.2023.122931
  16. [16] Chaudhary, U., Birbaumer, N., & Curado, M. R. (2015). Brain-machine interface (BMI) in paralysis. Annals of physical and rehabilitation medicine, 58(1), 9–13. https://doi.org/10.1016/j.rehab.2014.11.002
  17. [17] Krzywanski, J., Sosnowski, M., Grabowska, K., Zylka, A., Lasek, L., & Kijo-Kleczkowska, A. (2024). Advanced computational methods for modeling, prediction and optimization, a review. Materials, 17(14), 3521. https://doi.org/10.3390/ma17143521
  18. [18] Hill, N. J., & Schölkopf, B. (2012). An online brain–computer interface based on shifting attention to concurrent streams of auditory stimuli. Journal of neural engineering, 9(2), 26011. https://doi.org/10.1088/1741-2560/9/2/026011
  19. [19] Amin, S. U., Altaheri, H., Muhammad, G., Abdul, W., & Alsulaiman, M. (2021). Attention-inception and long-short-term memory-based electroencephalography classification for motor imagery tasks in rehabilitation. IEEE transactions on industrial informatics, 18(8), 5412–5421. https://doi.org/10.1109/TII.2021.3132340
  20. [20] Gao, Z., Yuan, T., Zhou, X., Ma, C., Ma, K., & Hui, P. (2020). A deep learning method for improving the classification accuracy of SSMVEP-based BCI. IEEE transactions on circuits and systems II: Express briefs, 67(12), 3447–3451. https://doi.org/10.1109/TCSII.2020.2983389
  21. [21] Grizou, J., Iturrate, I., Montesano, L., Oudeyer, P. Y., & Lopes, M. (2014). Calibration-free BCI based control. Proceedings of the AAAI conference on artificial intelligence (pp. 1-8). Association for the Advancement of Artificial Intelligence (AAAI). https://doi.org/10.1609/aaai.v28i1.8923.
  22. [22] Friehs, G. M., Zerris, V. A., Ojakangas, C. L., Fellows, M. R., & Donoghue, J. P. (2004). Brain–Machine and brain–computer interfaces. Stroke, 35(11_suppl_1), 2702–2705. https://doi.org/10.1161/01.STR.0000143235.93497.03
  23. [23] Daly, J. J., & Wolpaw, J. R. (2008). Brain-computer interfaces in neurological rehabilitation. The lancet neurology, 7(11), 1032–1043. https://doi.org/10.1016/S1474-4422(08)70223-0
  24. [24] Alimoradi, M., Azgomi, H., & Asghari, A. (2022). Trees social relations optimization algorithm: A new swarm-based metaheuristic technique to solve continuous and discrete optimization problems. Mathematics and computers in simulation, 194, 629–664. https://doi.org/10.1016/j.matcom.2021.12.010

Downloads

Published

2025-06-19

Issue

Vol. 2 No. 3 (2025): Metaheuristic Algorithms with Applications

Section

Articles

How to Cite

Ghasemabadi, N. (2025). A World Hyper Heuristic Reinforcement Learning Algorithm for Feature Selection in EEG Motor Imagery Based BCI Systems. Metaheuristic Algorithms With Applications, 2(3), 332–343. https://doi.org/10.48313/maa.v2i3.54

Similar Articles

1-10 of 21

You may also start an advanced similarity search for this article.