Cover
Vol. 16 No. 1 (2020)

Published: June 30, 2020

Pages: 62-71

Original Article

Interactive Real-Time Control System for The Artificial Hand

Hanadi Abbas Jaber 1 Mofeed Turky Rashid 2 Luigi Fortuna 3
1Computer Engineering Department, University of Basrah, Basrah, Iraq
2Electrical Engineering Department, University of Basrah, Basrah, Iraq
3Department of Electrical, Electronic, Information Engineering, University of Catania, Catania, Italy
History
  • Received: April 26, 2020
  • Revised: May 11, 2020
  • Accepted: May 11, 2020
  • Available Online: May 11, 2020
DOI

https://doi.org/10.37917/ijeee.16.1.8

Abstract

In recent years, the number of researches in the field of artificial limbs has increased significantly in order to improve the performance of the use of these limbs by amputees. During this period, High-Density surface Electromyography (HD-sEMG) signals have been employed for hand gesture identification, in which the performance of the classification process can be improved by using robust spatial features extracted from HD-sEMG signals. In this paper, several algorithms of spatial feature extraction have been proposed to increase the accuracy of the SVM classifier, while the histogram oriented gradient (HOG) has been used to achieve this mission. So, several feature sets have been extracted from HD-sEMG signals such as; features extracted based on HOG denoted by (H); features have been generated by combine intensity feature with H features denoted as (HI); features have been generated by combine average intensity with H features denoted as (AIH). The proposed system has been simulated by MATLAB to calculate the accuracy of the classification process, in addition, the proposed system is practically validated in order to show the ability to use this system by amputees. The results show the high accuracy of the classifier in real-time which leads to an increase in the possibility of using this system as an artificial hand.

Keywords

References

  1. P. M. Pilarski, M. R. Dawson and R. S. Sutton, “Adaptive artificial limbs, A real time approach to prediction and anticipation", IEEE Robotic and Automation Magazine, IEEE Robotics & Automation Magazine, Vol. 20, Issue 1, pp. 53-64, March 2013.
  2. Hanadi A. Jaber, Mofeed T. Rashid and L Fortuna, "Using the Robust High Density-surface Electromyography Features for Real-Time Hand Gestures Classification", IOP Conference Series: Materials Science and Engineering, 1 Feb. 2020.
  3. D. Farina, N. Jiang, H. Rehbaum, "The extraction of neural information from surface EMG for the control of upper limb prosthesis Emerging and challenging", IEEE Trans. Neural Syst. Rehabil. Eng., Vol. 22, No. 4, pp. 797-808, July 2014.
  4. H. A. Jaber, M. T. Rashid, L. Fortuna, “Robust Hand Gesture Identification Using Envelope of HD-sEMG Signal”, ACM international conference proceeding series, 2019.
  5. N. Meselmani, M. Khrayzat, K. Chahine, "pattern recognition of EMG signals: towards adaptive control of Robotic Arm", IEEE International Multidisciplinary Conf. on Eng. Tech., 2016.
  6. M. Rojas-Martinez, M. A. Mananas, J. F. Alonso, R. Merletti, “Identification of isometric contractions based on High Density EMG maps”, Journal of Electromyography and Kinesiology, Vol. 23, pp. 33–42, 2013.
  7. H. A. Jaber, M.T. Rashid, “HD-sEMG Gestures Recognition by SVM Classifier for Controlling Prosthesis”, Iraqi Journal of Computers, Communications, Control and System Engineering(IJCCCE), Vol. 19, No. 1, 2019.
  8. Phinyomark A., Quaine F., Charbonnier S., Serviere C., Tarpin-Bernard F., Laurillau Y., “EMG Feature Evaluation for Improving Myoelectric Pattern Recognition Robustness”, Expert Syst. Appl., Vol. 40, pp. 4832–4840, 2013.
  9. Tkach D., Huang H., Kuiken T. A., “Study of Stability of Time-Domain Features for Electromyographic Pattern Recognition”, J. NeuroEng. Rehabilit, Vol. 7, No. 21, 2010.
  10. Phinyomark A., Quaine F., Charbonnier S., Serviere C., Tarpin-Bernard F., Laurillau Y., “A Feasibility Study on the Use of Anthropometric Variables to Make Muscle–Computer Interface More Practical”, Eng. Appl. Artif. Intell., Vol. 26, pp. 1681–1688, 2013.
  11. Khushaba R. N., Al-Timemy A., Kodagoda S., Nazarpour K., “Combined Influence of Forearm Orientation and Muscular Contraction on EMG Pattern Recognition”, Expert Syst. Appl., Vol. 61, pp. 154–161, 2016.
  12. Oskoei M. A., Hu H., “Myoelectric control systems-A survey”, Biomed. Signal Process. Control, Vol. 2, pp. 275–294, 2007.
  13. A. Stango, F. Negro, D. Farina, " Spatial correlation of High Density EMG signals provided features robust to electrode number shift in pattern recognition for Myocontrol", IEEE Trans. Neural Syst. Rehabil. Eng., Vol. 23, No. 2, pp.189-198, March 2015.
  14. M. Jordanic, M. Rojas, M. A. Mananas, J. F. Alonso, Sensors, V17, 2017, “A novel spatial features for the identification of motor tasks using HD-EMG”.
  15. Geng W., Du Y., Jin W., Wei W., Hu Y., Li J., “Gesture recognition by instantaneous surface EMG images”, Sci. Rep., Vol.6, 2016.
  16. Du Y., Jin W., Wei W., Hu Y., Geng W., “Surface EMG-based inter-session gesture recognition enhanced by deep domain adaptation”, Sensors, Vol. 17, 2017.
  17. Ali Moin, Andy Zhou, Abbas Rahimi et al., “An EMG Gesture Recognition System with Flexible High-Density Sensors and Brain-Inspired High-Dimensional Classifier”, IEEE International Symposium on Circuits and Systems (ISCAS), 2018.
  18. Rubana H. Chowdhury, Mamun B. I. Reaz, Mohd Alauddin Bin Mohd Ali, Ashrif A. A. Bakar, Kalaivani Chellappan and Tae G. Chang, “Surface Electromyography Signal Processing and Classification Techniques”, Sensors, Vol. 13, pp.12431-12466, 2013.
  19. Hargrove L. J., Englehart K., Hudgins B., “A comparison of surface and intramuscular myoelectric signal classification”, IEEE Trans. Biomed. Eng., Vol. 54, pp. 847–853, 2007. Jaber & Rashid | 71
  20. Hakonen M., Piitulainen H., Visala A., “Current state of digital signal processing in myoelectric interfaces and related applications”, Biomed. Signal Process. Control, Vol.18, pp. 334–359, 2015.
  21. Huang H., Zhou P., Li G., Kuiken T., “Spatial filtering improves EMG classification accuracy following targeted muscle reinnervation”, Ann. Biomed. Eng., Vol. 37, pp. 1849–1857, 2009.
  22. Celadon N., Dosen S., Binder I., Ariano P., Farina D., “Proportional estimation of finger movements from high-density surface electromyography”, J. Neuroeng. Rehabil., Vol. 13, No. 73, 2016.
  23. Ameri A., Englehart K. B., Parker P. A., “A comparison between force and position control strategies in myoelectric prostheses”, In Proceedings of the 2012 Annual International Conference of the IEEE on Engineering in Medicine and Biology Society (EMBC), San Diego, CA, USA, pp. 1342–1345, 28 August–1 September 2012.
  24. Li Z., Wang B., Yang C., Xie Q., Su C. Y., “Boosting-based EMG patterns classification scheme for robustness enhancement”, IEEE J. Biomed. Heal. Inform., Vol. 17, pp. 545–552, 2013.
  25. Jordanic M., Rojas-Martínez M., Mananas M. A., Alonso J. F., “Spatial distribution of HD-EMG improves identification of task and force in patients with incomplete spinal cord injury”, J. Neuroeng. Rehabil., Vol. 13, No. 41, 2016.
  26. Jordani´c M., Rojas-Martínez M., Mananas M. A., Alonso J. F., “Prediction of isometric motor tasks and effort levels based on high-density EMG in patients with incomplete spinal cord injury”, J. Neural Eng., Vol. 13, 2016.
  27. Nazmi N., Abdul Rahman M., Yamamoto S. I., Ahmad S., Zamzuri H., Mazlan S., “A Review of Classification Techniques of EMG Signals during Isotonic and Isometric Contractions”, Sensors, Vol. 16, 2016.
  28. Vidovic M. M. C., Hwang H. J., Amsuss S., Hahne J. M., Farina D., Muller K. R., “Improving the robustness of myoelectric pattern recognition for upper limb prostheses by covariate shift adaptation”, IEEE Trans. Neural Syst. Rehabil. Eng., Vol. 24, pp. 961–970, 2016.
  29. Liu J., Sheng X., Zhang D., Jiang N., Zhu X., “Towards zero retraining for myoelectric control based on common model component analysis”, IEEE Trans. Neural Syst. Rehabil. Eng., Vol. 24, pp. 444–454, 2016.
  30. Li Y., Chen X., Zhang X., Zhou P., “Several practical issues toward implementing myoelectric pattern recognition for stroke rehabilitation”, Med. Eng. Phys., Vol. 36, 754–760, 2014.
  31. E. Scheme and K. B. Englehart, “Electromyogram pattern recognition for control of powered upper-limb prostheses: State of the art and challenges for clinical use”, J. Rehab. Res. Develop., Vol. 48, No. 6, pp. 643–660, 2011.
  32. Naik G. R., Kumar D. K., Palaniswami M., “Surface EMG based hand gesture identification using semi blind ICA: Validation of ICA matrix analysis”, Electromyogr Clin Neurophysiol, Vol. 48, pp.169–80, 2008.
  33. Dick F. Stegeman, Bert U. Kleine, Bernd G. Lapatki, Johannes P. Van Dijk, “High-density Surface EMG: Techniques and Applications at a Motor Unit Level”, Biocybernetics and Biomedical Engineering, Vol. 32, No. 3, pp. 3–27, 2012.
  34. J. Kilby, K. Prasad , G. Mawston, “Mutli-channel surface electromyography electrodes: A Review”, IEEE Sensors Journal, Vol. 16, Issue 14, pp. 5510–5519, 2016.
  35. C. C. Cordova, C. Ramirez, " EMG signal pattern recognition based on feedforward artificial neural network applied to robotic prosthesis Myoelectric control," Future technology conference, 2016.
  36. Phinyomark, A. Phukpattaranont, P. Limsakul, “Feature reduction and selection for EMG signal classification”, Expert Systems with Applications, Vol. 39, Issue 8, pp. 7420-7431, 15 June 2012.
  37. L.H. Smith, L.J. Hargrove, B.A. Lock, T.A. Kuiken, “Determining the optimal window length for pattern recognition based myoelectric control: Balancing the competing effects of classification error and controller”, IEEE Trans. Neural Syst. Rehabil. Eng., Vol. 19, No. 2 pp. 186-192, Aprilm 2011.
  38. Hakonen M, Piitulainen H, Visala A, "Current state of digital signal processing in myoelectric interfaces and related applications", Biomed Signal Process Control Elsevier Ltd., Vol. 18, pp. 334–59, 2015.
  39. Zhang X, Zhou P., “High-Density Myoelectric Pattern Recognition Toward Improved Stroke Rehabilitation”, IEEE Trans Biomed Eng., Vol. 59, No. 6, pp. 1649–57, 2012.
  40. Staudenmann D., Roeleveld K., Stegeman D. F., Dieen J. H., “Methodological aspects of SEMG recordings for force estimation - A tutorial and review”, J. Electromyography Kinesiol, Vol. 20, No. 3, pp. 375–87, 2010.
  41. Luo H., Yu X., Liu H., Ding Q., “A method for real-time implementation of HOG feature extraction”, Proc. of SPIE, Vol. 8193, 2011.
  42. M. Rojas, M.A. Mananas, J. F. Alonso, “High-Density surface EMG maps from upper –arm and forearm muscles”, J. of Nuero Eng. and Rehabil., Vol. 9, No. 85, 2012.
  43. A. Phinyomark, Rami N. Khushaba, and Erik Scheme, “Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors”, sensors MPDI, Vol. 18, 1615, 2018.