IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2022i1p178-d1019053.html
   My bibliography  Save this article

A Novel Deep Reinforcement Learning Based Framework for Gait Adjustment

Author

Listed:
  • Ang Li

    (School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou 215009, China
    Jiangsu Province Key Laboratory of Intelligent Building Energy Efficiency, Suzhou University of Science and Technology, Suzhou 215009, China)

  • Jianping Chen

    (Jiangsu Province Key Laboratory of Intelligent Building Energy Efficiency, Suzhou University of Science and Technology, Suzhou 215009, China
    School of Architecture and Urban Planning, Suzhou University of Science and Technology, Suzhou 215009, China)

  • Qiming Fu

    (School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou 215009, China
    Jiangsu Province Key Laboratory of Intelligent Building Energy Efficiency, Suzhou University of Science and Technology, Suzhou 215009, China)

  • Hongjie Wu

    (School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou 215009, China
    Jiangsu Province Key Laboratory of Intelligent Building Energy Efficiency, Suzhou University of Science and Technology, Suzhou 215009, China)

  • Yunzhe Wang

    (School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou 215009, China
    Jiangsu Province Key Laboratory of Intelligent Building Energy Efficiency, Suzhou University of Science and Technology, Suzhou 215009, China)

  • You Lu

    (School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou 215009, China
    Jiangsu Province Key Laboratory of Intelligent Building Energy Efficiency, Suzhou University of Science and Technology, Suzhou 215009, China)

Abstract

Nowadays, millions of patients suffer from physical disabilities, including lower-limb disabilities. Researchers have adopted a variety of physical therapies based on the lower-limb exoskeleton, in which it is difficult to adjust equipment parameters in a timely fashion. Therefore, intelligent control methods, for example, deep reinforcement learning (DRL), have been used to control the medical equipment used in human gait adjustment. In this study, based on the key-value attention mechanism, we reconstructed the agent’s observations by capturing the self-dependent feature information for decision-making in regard to each state sampled from the replay buffer. Moreover, based on Softmax Deep Double Deterministic policy gradients (SD3), a novel DRL-based framework, key-value attention-based SD3 (AT_SD3), has been proposed for gait adjustment. We demonstrated the effectiveness of our proposed framework in gait adjustment by comparing different gait trajectories, including the desired trajectory and the adjusted trajectory. The results showed that the simulated trajectories were closer to the desired trajectory, both in their shapes and values. Furthermore, by comparing the results of our experiments with those of other state-of-the-art methods, the results proved that our proposed framework exhibited better performance.

Suggested Citation

  • Ang Li & Jianping Chen & Qiming Fu & Hongjie Wu & Yunzhe Wang & You Lu, 2022. "A Novel Deep Reinforcement Learning Based Framework for Gait Adjustment," Mathematics, MDPI, vol. 11(1), pages 1-18, December.
  • Handle: RePEc:gam:jmathe:v:11:y:2022:i:1:p:178-:d:1019053
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/1/178/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/1/178/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2022:i:1:p:178-:d:1019053. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.