View Article

Abstract

The Electromyography (EMG) signal is a nonsta- tionary bio-signal that is based on an evaluation of the electrical activity of the muscles. In many fields, including the diagnosis of neuromuscular disorders, human-computer interfaces, console gaming, sign language identification, virtual reality applications, and amputee device controls, EMG-based recognition systems are significant. This work proposes a novel deep learning-based method to improve hand movement prediction precision. 30 par- ticipants first recorded 4-channel surface EMG (sEMG) signals while simulating the Ulnar Deviation, Radial Deviation, Punch, Open Hand, Radial Flexion, and Extension hand movements [21]. Each movement was located in a separate area of the sEMG signals that were collected. The segmented sEMG signals were then turned into spectrogram images using the ShortTime Fourier Transform (STFT). A 50-layer Convolutional Neural Network (CNN) built on ResNet was trained to produce the coloured spectrogram images. For seven different categories of hand gestures, the suggested technique produced test accuracy of 99.59 percent and an F1 Score of 99.57 percent.

Keywords

CNN, Deep Learning, EMG, Hand Gesture, ResNet, Spectrogram, STFT

Introduction

Change may be seen as a sign of physical or emotional attitude. In order to function in daily life, humans need to be able to move. Movements are crucial for carrying out tasks and communicating. MG is used to analyse and compare the neurological effects of various muscle contraction mechanics. Noninvasively recorded sEMG signals are rapidly being used to drive myoelectric-based devices and rehabilitation equip- ment used in prosthetics, treatment, and diagnostics. Using electromyography (EMG) signals, the technology called EMG- based Hand Gesture Recognition with Deep Learning can anal- yse and comprehend human hand movements. To record the electrical activity produced during muscle contractions, EMG sensors are positioned on the skin’s surface, usually close to the forearm muscles. In order to extract crucial information about hand motions, these EMG signals are then processed and analysed using deep learning techniques, such as convolutional neural networks (CNNs) or recurrent neural networks (RNNs). The deep learning models can learn complicated patterns and correlations between the signals and gestures since they are trained on massive datasets of EMG recordings linked with related hand motions. Once trained, the models can quickly and reliably identify and recognise a wide range of hand gestures, enabling natural and effective human-computer interaction. Deep learning- based EMG-based hand gesture recognition opens up new opportunities for enriching user experiences and quality of life in a variety of industries, including prosthetics, virtual reality, and human-robot interaction. Human-computer interaction has been completely transformed thanks to EMG-based hand gesture recognition utilising deep learning, which offers a non- intrusive and extremely accurate approach for analysing hand movements. This technique uses the processing and analysis capabilities of deep learning algorithms, such as deep neural networks (DNNs) or recurrent neural networks (RNNs), to deal with the complex EMG signals produced by the forearm muscles. These signals convey important details about the purpose and execution of particular hand motions. The deep learning algorithms can learn the intricate mapping between the signals and the desired gestures by being trained on large datasets of EMG recordings and corresponding hand gestures. The trained models can then quickly and accurately categorise and recognise a variety of hand motions. This technology has a wide range of uses, including virtual reality, robotics for rehabilitation, and assistive technologies for those with motor disabilities. Through intuitive and natural hand motions, EMG- based Hand Gesture Recognition utilising Deep Learning has the potential to revolutionise how we interact with machines. Convolutional neural networks (CNNs) and recurrent neural networks (RNNs), in particular, have shown to be highly accurate at recognising hand motions and extracting useful characteristics from raw EMG data. Gathering a labelled dataset of EMG signals captured as people make various hand motions is the initial step in the process. The training data for the deep learning model comes from this dataset. The deep learning model is made to identify intricate correlations and patterns in the EMG signals. RNNs can describe temporal relationships over time, whereas CNNs are excellent at capturing spatial dependencies in the EMG data. combining hybrid architectures. The deep learning model gains the ability to link particular EMG signal patterns with matching hand motions throughout the training phase. Through gradient descent and backpropagation, the model modifies its internal parameters to improve performance iteratively. When the model has been trained, it can be used in real-time applications where it can accept raw EMG signals as input and output a recognised hand gesture. Deep learning-based EMG-based hand gesture detection has several uses, including prosthesis control and rehabilitation systems, virtual reality interfaces, and smart home automation. It provides people with a simple, intuitive approach to use their natural hand movements to engage with technology. Future gesture recognition systems will be more seamless and reliable thanks to ongoing research that aims to significantly improve the models’ accuracy and robustness.

II. EMG-Based Hand Gesture Recognition:

The fundamentals of electromyography are described in this section, along with how it can be used to record muscle activity. Signal acquisition, noise removal, and feature extraction are discussed along with the benefits and drawbacks of EMG-based hand gesture detection. Electromyography (EMG) signals are used to recognise and categorise hand movements in a method known as EMG-based Hand Gesture Recognition. The electrical activity of muscles during hand motions pro- duces EMG signals. These signals can be analysed to identify information that can be utilised to distinguish between various hand movements. [18]

Key applications include the following:

1. Human-Computer Interaction: Without the use of physical input devices, EMG-based hand gesture recognition can enable intuitive and natural interaction with computers, cellphones, and other electronic devices. In gaming, virtual reality, and augmented reality contexts, it can improve user experience and make gesture-based control possible.

2. Prosthetics and Rehabilitation: The creation of prosthetic devices can make use of EMG-based hand gesture recognition. Amputees can regain functional control over their prosthetic limbs because the prosthesis can imitate the desired hand ges- tures by deciphering the user’s muscle signals. Additionally, EMG-based systems in rehabilitation settings can help with the restoration of motor functions by giving biofeedback during therapy sessions.

3. Assistive Technologies: It is possible to include hand gesture identification based on EMG into assistive technology for people with disabilities. These technologies let people with limited mobility operate equipment, communicate, and carry out everyday duties more independently by reading hand gestures.

III. EMG Signal Collection

The sEMG signals utilised to evaluate hand gestures were recorded in this study using the BIOPAC MP36 instrument. To record EMG signals, electrodes are placed close to the muscle groups. The electrodes, skin, and muscle all move in respect to one another while a muscle contracts, shortening its length. At

Reference

  1. Hassan Ashraf, U Shafiq, Q Sajjad, A Waris, O Gilani, Mohamed Boutaayamou, and O Bru¨ls. Variational mode decomposition for surface and intramuscular emg signal denoising. Biomedical Signal Processing and Control, 82:104560, 2023.
  2. Hassan Ashraf, Asim Waris, Syed Omer Gilani, Muhammad Umair Tariq, and Hani Alquhayz. Threshold parameters selection for empirical mode decomposition-based emg signal denoising. Intelligent Automation and Soft Computing, 27(3), 2021.
  3. Luzheng Bi, Cuntai Guan, et al. A review on emg-based motor intention prediction of continuous human upper limb motion for human-robot collaboration. Biomedical Signal Processing and Control, 51:113–127, 2019.
  4. Sijia Chen, Zhizeng Luo, Tong Hua, et al. Research on ar-akf model denoising of the emg signal. Computational and Mathematical Methods in Medicine, 2021, 2021.
  5. Zhi-hua Chen, Jung-Tae Kim, Jianning Liang, Jing Zhang, and Yu-Bo Yuan. Real-time hand gesture recognition using finger segmentation. The Scientific World Journal, 2014, 2014.
  6. Ulysse Coˆte´-Allard, Cheikh Latyr Fall, Alexandre Campeau-Lecours, Cle´ment Gosselin, Franc¸ois Laviolette, and Benoit Gosselin. Transfer learning for semg hand gestures recognition using convolutional neural networks. In 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pages 1663–1668. IEEE, 2017.
  7. Ulysse Coˆte´-Allard, Cheikh Latyr Fall, Alexandre Drouin, Alexandre Campeau-Lecours, Cle´ment Gosselin, Kyrre Glette, Franc¸ois Laviolette, and Benoit Gosselin. Deep learning for electromyographic hand gesture signal classification using transfer learning. IEEE transactions on neural systems and rehabilitation engineering, 27(4):760–771, 2019.
  8. Athira Devaraj and Aswathy K Nair. Hand gesture signal classification using machine learning. In 2020 International Conference on Com- munication and Signal Processing (ICCSP), pages 0390–0394. IEEE, 2020.
  9. Yazan Dweiri, Yumna Hajjar, and Ola Hatahet. A novel neuroevolution model for emg-based hand gesture classification. Neural Computing and Applications, pages 1–15, 2023.
  10. Daojun Gong and Xuewen Wang. Deep learning-based hand gesture recognition using electromyography signals. In Proceedings of the 2025 8th International Conference on Computer Information Science and Artificial Intelligence, pages 960–967, 2025.
  11. Daniel Go´mez-Verde, Sergio Esteban-Romero, Manuel Gil-Mart´?n, and Rube´n San-Segundo. Gesture recognition using electromyography and deep learning. Engineering Proceedings, 82(1), 2024.
  12. Md Mehedi Hasan, Arifur Rahaman, Md Faisal Shuvo, Md Abu Saleh Ovi, and Md Mostafizur Rahman. Human hand gesture detection based on emg signal using ann. In 2014 International Conference on Informatics, Electronics & Vision (ICIEV), pages 1–5. IEEE, 2014.
  13. Engin Kaya and Tufan Kumbasar. Hand gesture recognition systems with the wearable myo armband. In 2018 6th international conference on control engineering & information technology (CEIT), pages 1–6. IEEE, 2018.
  14. Lijing Lu, Jingna Mao, Wuqi Wang, Guangxin Ding, and Zhiwei Zhang. A study of personal recognition method based on emg signal. IEEE Transactions on Biomedical Circuits and Systems, 14(4):681–691, 2020.
  15. Bhattiprolu Nagasirisha and VVKDV Prasad. Emg signal denoising us- ing adaptive filters through hybrid optimization algorithms. Biomedical Engineering: Applications, Basis and Communications, 33(02):2150009, 2021.
  16. Ana Antonia Neacsu, George Cioroiu, Anamaria Radoi, and Corneliu Burileanu. Automatic emg-based hand gesture recognition system using time-domain descriptors and fully-connected neural networks. In 2019 42nd International Conference on Telecommunications and Signal Processing (TSP), pages 232–235. IEEE, 2019.
  17. Ana Antonia Neacsu, George Cioroiu, Anamaria Radoi, and Corneliu Burileanu. Automatic emg-based hand gesture recognition system using time-domain descriptors and fully-connected neural networks. In 2019 42nd International Conference on Telecommunications and Signal Processing (TSP), pages 232–235, 2019.
  18. D. C. Oh and Y. U. Jo. Emg-based hand gesture classification by scale average wavelet transform and cnn. In 2019 19th International Conference on Control, Automation and Systems (ICCAS), pages 533– 538, 2019.
  19. Mehmet Akif Ozdemir, Deniz Hande Kisa, Onan Guren, Aytug Onan, and Aydin Akan. Emg based hand gesture recognition using deep learning. In 2020 Medical Technologies Congress (TIPTEKNO), pages 1–4. IEEE, 2020.
  20. Md Hafizur Rahman, Jinia Afrin, et al. Hand gesture recognition using multiclass support vector machine. International Journal of Computer Applications, 74(1):39–43, 2013.
  21. Ali Samadani. Gated recurrent neural networks for emg-based hand gesture classification. a comparative study. In 2018 40th annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pages 1–4. IEEE, 2018.
  22. Ziyang Sun, Xugang Xi, Changmin Yuan, Yong Yang, Xian Hua, et al. Surface electromyography signal denoising via eemd and im- proved wavelet thresholds. Mathematical Biosciences and Engineering, 17(6):6945–6962, 2020.

Photo
Devika K. P.
Corresponding author

Department of Electronics and Communication Vidya Academy of Science and Technology Technical Campus, Kilimanor, India

Photo
Shyna Nazar
Co-author

Department of Electronics and Communication Vidya Academy of Science and Technology Technical Campus, Kilimanor, India

Photo
Aswini Dutt
Co-author

Department of Electronics and Communication Vidya Academy of Science and Technology Technical Campus, Kilimanor, India

Photo
Lekshmy S.
Co-author

Department of Electronics and Communication Vidya Academy of Science and Technology Technical Campus, Kilimanor, India

Devika K. P.*, Shyna Nazar, Aswini Dutt, Lekshmy S., Review on EMG based Hand Gesture Recognition using Deep Learning, Int. J. Sci. R. Tech., 2026, 3 (3), 208-216. https://doi.org/10.5281/zenodo.18942193

More related articles
Advance Machine Learning Methods for Dyslexia Biom...
Anupriya S., Divya M., Nandhika G., Dr. K. N. Sivabalan, ...
Youth at Risk: Exploring Internet Addiction and It...
Dr. Pankaj Jain, Sughosh Upasani, ...
Hormone Replacement Therapy in Menopause: Evidence-Based Benefits, Risks, and E...
Pallavi Kandale, Vaibhav Shikare, Pratiksha Varhade, Anisha Awachar, Rupali Chopade, Shatrughna Nagr...
Beyond Alkylation – Cyclophosphamide’s Expanding Role in Cancer Therapy and ...
Mohalkar Krushna, Dr. Tarde Vijay, Dahatonde Abhijit, Munfan Sumit, ...
Related Articles
Voice Assistive System for Visually Impaired: Development, Applications, Challen...
Tharun D. C., Sandeep K., Diganth A. B., Saish H. Salian, Ganesh, ...
Artificial Intelligence in Medication Adherence and Personalized Treatment Plans...
Akanksha Kukade , Sayali Kawade , Sonakshi Lokare , Ankita Kharage , ...
Assessing the Anatomical Variations in Route CT Scan of Paranasal Sinuses in Pat...
Mohit Sharma, Saurav Singh Gusain , Amisha Kharola, Arushi Thakur, ...
Advance Machine Learning Methods for Dyslexia Biomarker Detection...
Anupriya S., Divya M., Nandhika G., Dr. K. N. Sivabalan, ...