Cover
Vol. 19 No. 1 (2023)

Published: June 30, 2023

Pages: 47-56

Original Article

Wavelet-based Hybrid Learning Framework for Motor Imagery Classification

Z. T. Al-Qaysi 1 Ali Al-Saegh 2 Ahmed Faeq Hussein 3 M. A. Ahmed
1Department of Computer Science, Computer Science and Mathematics College, Tikrit University, Tikrit, Iraq
2Computer Engineering Department, College of Engineering, University of Mosul, Mosul, Iraq
3Biomedical Engineering Department, Faculty of Engineering, Al-Nahrain University, 10072, Baghdad, Iraq
History
  • Received: July 19, 2022
  • Revised: August 28, 2022
  • Accepted: August 28, 2022
  • Available Online: January 4, 2023
DOI

https://doi.org/10.37917/ijeee.19.1.6

Abstract

Due to their vital applications in many real-world situations, researchers are still presenting bunches of methods for better analysis of motor imagery (MI) electroencephalograph (EEG) signals. However, in general, EEG signals are complex because of their nonstationary and high-dimensionality properties. Therefore, high consideration needs to be taken in both feature extraction and classification. In this paper, several hybrid classification models are built and their performance is compared. Three famous wavelet mother functions are used for generating scalograms from the raw signals. The scalograms are used for transfer learning of the well-known VGG-16 deep network. Then, one of six classifiers is used to determine the class of the input signal. The performance of different combinations of mother functions and classifiers are compared on two MI EEG datasets. Several evaluation metrics show that a model of VGG-16 feature extractor with a neural network classifier using the Amor mother wavelet function has outperformed the results of state-of-the-art studies.

Keywords

References

  1. A. Al-Saegh, et al., "Deep learning for motor imagery EEG-based classification: A review," Biomedical Signal Processing and Control, vol. 63, p. 102172, 2021.
  2. Z. Al-Qaysi, et al., "A review of disability EEG based wheelchair control system: Coherent taxonomy, open challenges and recommendations," Computer methods and programs in biomedicine, vol. 164, pp. 221-237, 2018.
  3. S. Sreeja and D. Samanta, "Classification of multiclass motor imagery EEG signal using sparsity approach," Neurocomputing, vol. 368, pp. 133-145, 2019.
  4. S. U. Amin, et al., "Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion," Future Generation computer systems, vol. 101, pp. 542-554, 2019.
  5. S. Aggarwal and N. Chugh, "Signal processing techniques for motor imagery brain computer interface: A review," Array, vol. 1, p. 100003, 2019.
  6. X. Tang, et al., "Motor imagery EEG recognition with KNN-based smooth auto-encoder," Artificial intelligence in medicine, vol. 101, p. 101747, 2019.
  7. A. Al-Saegh, et al., "CutCat: An augmentation method for EEG classification," Neural Networks, vol. 141, pp. 433-443, 2021.
  8. C. H. Nguyen and P. Artemiadis, "EEG feature descriptors and discriminant analysis under Riemannian Manifold perspective," Neurocomputing, vol. 275, pp. 1871-1883, 2018.
  9. W. Qiao and X. Bi, "Ternary-task convolutional bidirectional neural turing machine for assessment of EEG-based cognitive workload," Biomedical Signal Processing and Control, vol. 57, p. 101745, 2020. Al-Qaysi1, Al-Saegh, Hussein & Ahmed | 53 Al-Qaysi1, Al-Saegh, Hussein & Ahmed (a) (b) hybrid model, and different wavelet mother functions.
  10. Z. Al-Qaysi, et al., "Systematic review of training environments with motor imagery brain–computer interface: Coherent taxonomy, open issues and recommendation pathway solution," Health and Technology, vol. 11, pp. 783-801, 2021.
  11. D. Freer and G.-Z. Yang, "Data augmentation for self- paced motor imagery classification with C-LSTM," Journal of neural engineering, vol. 17, p. 016041, 2020.
  12. X. Wang, et al., "A Hybrid Transfer Learning Approach for Motor Imagery Classification in Brain-Computer Interface," in 2021 IEEE 3rd Global Conference on Life Sciences and Technologies (LifeTech), 2021, pp. 496-500.
  13. W. Wei, et al., "A transfer learning framework for RSVP-based brain computer interface," in 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2020, pp. 2963- 2968.
  14. X. Wei, et al., "Inter-subject deep transfer learning for motor imagery eeg decoding," in 2021 10th International IEEE/EMBS Conference on Neural Engineering (NER), 2021, pp. 21-24.
  15. D.-K. Kim, et al., "Sequential Transfer Learning via Segment After Cue Enhances the Motor Imagery-based Brain-Computer Interface," in 2021 9th International Winter Conference on Brain-Computer Interface (BCI), 2021, pp. 1-5.
  16. K.-T. Kim, et al., "Subject-Transfer Approach based on Convolutional Neural Network for the SSSEP-BCIs," in 2021 9th International Winter Conference on Brain- Computer Interface (BCI), 2021, pp. 1-3.
  17. N. K. Al-Qazzaz, et al., "Selection of mother wavelet functions for multi-channel EEG signal analysis during a working memory task," Sensors, vol. 15, pp. 29015-29035, 2015.
  18. N. K. Al-Qazzaz, et al., "EEG Feature Fusion for Motor Imagery: A New Robust Framework Towards Stroke Patients Rehabilitation," Computers in biology and medicine, p. 104799, 2021.
  19. G. Xu, et al., "A deep transfer convolutional neural network framework for EEG signal classification," IEEE Access, vol. 7, pp. 112767-112776, 2019.
  20. R. Mahamune and S. H. Laskar, "Classification of the four‐class motor imagery signals using continuous wavelet transform filter bank‐based two‐dimensional images," International Journal of Imaging Systems and Technology, 2021.
  21. A. M. Álvarez-Meza, et al., "Time-series discrimination using feature relevance analysis in motor imagery classification," Neurocomputing, vol. 151, pp. 122-129, 2015.
  22. J. Wang, et al., "Toward optimal feature and time segment selection by divergence method for EEG signals classification," Computers in biology and medicine, vol. 97, pp. 161-170, 2018.
  23. C. Xu, et al., "Two-level multi-domain feature extraction on sparse representation for motor imagery classification," Biomedical Signal Processing and Control, vol. 62, p. 102160, 2020.
  24. S.-H. Oh, et al., "A novel EEG feature extraction method using Hjorth parameter," International Journal of Al-Qaysi1, Al-Saegh, Hussein & Ahmed Electronics and Electrical Engineering, vol. 2, pp. 106- 110, 2014.
  25. N. Bagh and M. R. Reddy, "Hilbert transform-based event-related patterns for motor imagery brain computer interface," Biomedical Signal Processing and Control, vol. 62, p. 102020, 2020.
  26. X. Zhu, et al., "Separated channel convolutional neural network to realize the training free motor imagery BCI systems," Biomedical Signal Processing and Control, vol. 49, pp. 396-403, 2019.
  27. G. Dai, et al., "HS-CNN: a CNN with hybrid convolution scale for EEG motor imagery classification," Journal of neural engineering, vol. 17, p. 016025, 2020.
  28. C. Kim, et al., "An effective feature extraction method by power spectral density of EEG signal for 2-class motor imagery-based BCI," Medical & biological engineering & computing, vol. 56, pp. 1645-1658, 2018.
  29. L. Sun, et al., "A contralateral channel guided model for EEG based motor imagery classification," Biomedical Signal Processing and Control, vol. 41, pp. 1-9, 2018.
  30. P. Kant, et al., "CWT Based transfer learning for motor imagery classification for brain computer interfaces," Journal of Neuroscience Methods, vol. 345, p. 108886, 2020.
  31. M. Z. Baig, et al., "Filtering techniques for channel selection in motor imagery EEG applications: a survey," Artificial intelligence review, pp. 1-26, 2019.
  32. D. Cvetkovic, et al., "Wavelet transform feature extraction from human PPG, ECG, and EEG signal responses to ELF PEMF exposures: A pilot study," Digital signal processing, vol. 18, pp. 861-874, 2008.
  33. T. Kaur and T. K. Gandhi, "Automated brain image classification based on VGG-16 and transfer learning," in 2019 International Conference on Information Technology (ICIT), 2019, pp. 94-98.
  34. W. Mumtaz, et al., "Electroencephalogram (EEG)- based computer-aided technique to diagnose major depressive disorder (MDD)," Biomedical Signal Processing and Control, vol. 31, pp. 108-115, 2017.
  35. R. Masoomi and A. Khadem, "Enhancing LDA-based discrimination of left and right hand motor imagery: Outperforming the winner of BCI Competition II," in 2015 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI), 2015, pp. 392-398.
  36. T.-U. Jang, et al., "Motor-imagery EEG signal classification using position matching and vector quantisation," International Journal of Telemedicine and Clinical Practices, vol. 1, pp. 306-313, 2016.
  37. A. B. Das and M. I. H. Bhuiyan, "Discrimination and classification of focal and non-focal EEG signals using entropy-based features in the EMD-DWT domain," Biomedical Signal Processing and Control, vol. 29, pp. 11-21, 2016.
  38. S. K. Bashar and M. I. H. Bhuiyan, "Classification of motor imagery movements using multivariate empirical mode decomposition and short time Fourier transform based hybrid method," Engineering science and technology, an international journal, vol. 19, pp. 1457- 1464, 2016.
  39. R. Chatterjee, et al., "Dimensionality reduction of EEG signal using fuzzy discernibility matrix," in 2017 10th International Conference on Human System Interactions (HSI), 2017, pp. 131-136.
  40. S. V. Eslahi, et al., "A GA-based feature selection of the EEG signals by classification evaluation: Application in BCI systems," arXiv preprint arXiv:1903.02081, 2019.
  41. T. H. Shovon, et al., "Classification of motor imagery EEG signals with multi-input convolutional neural network by augmenting STFT," in 2019 5th International Conference on Advances in Electrical Engineering (ICAEE), 2019, pp. 398-403.
  42. H. K. Lee and Y.-S. Choi, "Application of continuous wavelet transform and convolutional neural network in decoding motor imagery brain-computer interface," Entropy, vol. 21, p. 1199, 2019.
  43. M. Wei, et al., "Motor Imagery EEG Signal Classification based on Deep Transfer Learning," in 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS), 2021, pp. 85-90.