IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i18p13363-d1234208.html
   My bibliography  Save this article

Improved Multi-Person 2D Human Pose Estimation Using Attention Mechanisms and Hard Example Mining

Author

Listed:
  • Lixin Zhang

    (School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing 100083, China)

  • Wenteng Huang

    (School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing 100083, China)

  • Chenliang Wang

    (School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China)

  • Hui Zeng

    (School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing 100083, China
    School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China)

Abstract

In recent years, human pose estimation, as a subfield of computer vision and artificial intelligence, has achieved significant performance improvements due to its wide applications in human-computer interaction, virtual reality, and smart security. However, most existing methods are designed for single-person scenes and suffer from low accuracy and long inference time in multi-person scenes. To address this issue, increasing attention has been paid to developing methods for multi-person pose estimation, such as utilizing Partial Affinity Field (PAF)-based bottom-up methods to estimate 2D poses of multiple people. In this study, we propose a method that addresses the problems of low network accuracy and poor estimation of flexible joints. This method introduces the attention mechanism into the network and utilizes the joint point extraction method based on hard example mining. Integrating the attention mechanism into the network improves its overall performance. In contrast, the joint point extraction method improves the localization accuracy of the flexible joints of the network without increasing the complexity. Experimental results demonstrate that our proposed method significantly improves the accuracy of 2D human pose estimation. Our network achieved a notably elevated Average Precision (AP) score of 60.0 and outperformed competing methods on the standard benchmark COCO test dataset, signifying its exceptional performance.

Suggested Citation

  • Lixin Zhang & Wenteng Huang & Chenliang Wang & Hui Zeng, 2023. "Improved Multi-Person 2D Human Pose Estimation Using Attention Mechanisms and Hard Example Mining," Sustainability, MDPI, vol. 15(18), pages 1-17, September.
  • Handle: RePEc:gam:jsusta:v:15:y:2023:i:18:p:13363-:d:1234208
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/18/13363/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/15/18/13363/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:18:p:13363-:d:1234208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.