IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v13y2021i5p2961-d513321.html
   My bibliography  Save this article

Hand Gesture Recognition Based on Auto-Landmark Localization and Reweighted Genetic Algorithm for Healthcare Muscle Activities

Author

Listed:
  • Hira Ansar

    (Department of Computer Science, Air University, Islamabad 44000, Pakistan)

  • Ahmad Jalal

    (Department of Computer Science, Air University, Islamabad 44000, Pakistan)

  • Munkhjargal Gochoo

    (Department of Computer Science and Software Engineering, United Arab Emirates University, Al Ain 15551, United Arab Emirates)

  • Kibum Kim

    (Department of Human-Computer Interaction, Hanyang University, Ansan 15588, Korea)

Abstract

Due to the constantly increasing demand for the automatic localization of landmarks in hand gesture recognition, there is a need for a more sustainable, intelligent, and reliable system for hand gesture recognition. The main purpose of this study was to develop an accurate hand gesture recognition system that is capable of error-free auto-landmark localization of any gesture dateable in an RGB image. In this paper, we propose a system based on landmark extraction from RGB images regardless of the environment. The extraction of gestures is performed via two methods, namely, fused and directional image methods. The fused method produced greater extracted gesture recognition accuracy. In the proposed system, hand gesture recognition (HGR) is done via several different methods, namely, (1) HGR via point-based features, which consist of (i) distance features, (ii) angular features, and (iii) geometric features; (2) HGR via full hand features, which are composed of (i) SONG mesh geometry and (ii) active model. To optimize these features, we applied gray wolf optimization. After optimization, a reweighted genetic algorithm was used for classification and gesture recognition. Experimentation was performed on five challenging datasets: Sign Word, Dexter1, Dexter + Object, STB, and NYU. Experimental results proved that auto landmark localization with the proposed feature extraction technique is an efficient approach towards developing a robust HGR system. The classification results of the reweighted genetic algorithm were compared with Artificial Neural Network (ANN) and decision tree. The developed system plays a significant role in healthcare muscle exercise.

Suggested Citation

  • Hira Ansar & Ahmad Jalal & Munkhjargal Gochoo & Kibum Kim, 2021. "Hand Gesture Recognition Based on Auto-Landmark Localization and Reweighted Genetic Algorithm for Healthcare Muscle Activities," Sustainability, MDPI, vol. 13(5), pages 1-26, March.
    • Handle: RePEc:gam:jsusta:v:13:y:2021:i:5:p:2961-:d:513321
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/13/5/2961/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/13/5/2961/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ahmad Jalal & Mouazma Batool & Kibum Kim, 2020. "Sustainable Wearable System: Human Behavior Modeling for Life-Logging Activities Using K-Ary Tree Hashing Classifier," Sustainability, MDPI, vol. 12(24), pages 1-21, December.
    2. Shiming Dai & Wei Liu & Wenji Yang & Lili Fan & Jihao Zhang, 2020. "Cascaded Hierarchical CNN for RGB-Based 3D Hand Pose Estimation," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-13, July.
    3. Ghada Aldabbagh & Daniyal M. Alghazzawi & Syed Hamid Hasan & Mohammed Alhaddad & Areej Malibari & Li Cheng, 2020. "Optimal Learning Behavior Prediction System Based on Cognitive Style Using Adaptive Optimization-Based Neural Network," Complexity, Hindawi, vol. 2020, pages 1-13, November.
    4. Ahmad Jalal & Israr Akhtar & Kibum Kim, 2020. "Human Posture Estimation and Sustainable Events Classification via Pseudo-2D Stick Model and K-ary Tree Hashing," Sustainability, MDPI, vol. 12(23), pages 1-24, November.
    5. Juan Cheng & Fulin Wei & Yu Liu & Chang Li & Qiang Chen & Xun Chen, 2020. "Chinese Sign Language Recognition Based on DTW-Distance-Mapping Features," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-13, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mahwish Pervaiz & Yazeed Yasin Ghadi & Munkhjargal Gochoo & Ahmad Jalal & Shaharyar Kamal & Dong-Seong Kim, 2021. "A Smart Surveillance System for People Counting and Tracking Using Particle Flow and Modified SOM," Sustainability, MDPI, vol. 13(10), pages 1-20, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mahwish Pervaiz & Yazeed Yasin Ghadi & Munkhjargal Gochoo & Ahmad Jalal & Shaharyar Kamal & Dong-Seong Kim, 2021. "A Smart Surveillance System for People Counting and Tracking Using Particle Flow and Modified SOM," Sustainability, MDPI, vol. 13(10), pages 1-20, May.
    2. Madiha Javeed & Munkhjargal Gochoo & Ahmad Jalal & Kibum Kim, 2021. "HF-SPHR: Hybrid Features for Sustainable Physical Healthcare Pattern Recognition Using Deep Belief Networks," Sustainability, MDPI, vol. 13(4), pages 1-28, February.
    3. Nida Khalid & Munkhjargal Gochoo & Ahmad Jalal & Kibum Kim, 2021. "Modeling Two-Person Segmentation and Locomotion for Stereoscopic Action Identification: A Sustainable Video Surveillance System," Sustainability, MDPI, vol. 13(2), pages 1-30, January.
    4. Jiacheng Wu & Han Cui & Naim Dahnoun, 2023. "A Voxelization Algorithm for Reconstructing mmWave Radar Point Cloud and an Application on Posture Classification for Low Energy Consumption Platform," Sustainability, MDPI, vol. 15(4), pages 1-13, February.
    5. Agnieszka Dudziak & Monika Stoma & Emilia Osmólska, 2023. "Analysis of Consumer Behaviour in the Context of the Place of Purchasing Food Products with Particular Emphasis on Local Products," IJERPH, MDPI, vol. 20(3), pages 1-23, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:13:y:2021:i:5:p:2961-:d:513321. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.