IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i12p9405-d1168943.html
   My bibliography  Save this article

A Feature Fusion Method for Driving Fatigue of Shield Machine Drivers Based on Multiple Physiological Signals and Auto-Encoder

Author

Listed:
  • Kun Liu

    (School of Mechanical Engineering, Shenyang University of Technology, Shenyang 110870, China
    College of Business Administration, Northeast University, Shenyang 110819, China)

  • Guoqi Feng

    (College of Business Administration, Northeast University, Shenyang 110819, China)

  • Xingyu Jiang

    (School of Mechanical Engineering, Shenyang University of Technology, Shenyang 110870, China)

  • Wenpeng Zhao

    (School of Mechanical Engineering, Shenyang University of Technology, Shenyang 110870, China)

  • Zhiqiang Tian

    (School of Mechanical Engineering, Shenyang University of Technology, Shenyang 110870, China)

  • Rizheng Zhao

    (School of Mechanical Engineering, Shenyang University of Technology, Shenyang 110870, China)

  • Kaihang Bi

    (School of Mechanical Engineering, Shenyang University of Technology, Shenyang 110870, China)

Abstract

The driving fatigue state of shield machine drivers directly affects the safe operation and tunneling efficiency of shield machines during metro construction. To cope with the problem that it is challenging to simulate the working conditions and operation process of shield machine drivers using driving simulation platforms and that the existing fatigue feature fusion methods usually show low recognition accuracy, shield machine drivers at Shenyang metro line 4 in China were taken as the research subjects, and a multi-modal physiological feature fusion method based on an L2-regularized stacked auto-encoder was designed. First, the ErgoLAB cloud platform was used to extract the combined energy feature (E), the reaction time, the HRV (heart rate variability) time-domain SDNN (standard deviation of normal-to-normal intervals) index, the HRV frequency-domain LF/HF (energy ratio of low frequency to high frequency) index and the pupil diameter index from EEG (electroencephalogram) signals, skin signals, pulse signals and eye movement data, respectively. Second, the physiological signal characteristics were extracted based on the WPT (wavelet packet transform) method and time–frequency analysis. Then, a method for driving fatigue feature fusion based on an auto-encoder was designed aiming at the characteristics of the L2-regularization method to solve the over-fitting problem of small sample data sets in the process of model training. The optimal hyper-parameters of the model were verified with the experimental method of the control variable, which reduces the loss of multi-modal feature data in compression fusion and the information loss rate of the fused index. The results show that the method proposed outperforms its competitors in recognition accuracy and can effectively reduce the loss rate of deep features in existing decision-making-level fusion.

Suggested Citation

  • Kun Liu & Guoqi Feng & Xingyu Jiang & Wenpeng Zhao & Zhiqiang Tian & Rizheng Zhao & Kaihang Bi, 2023. "A Feature Fusion Method for Driving Fatigue of Shield Machine Drivers Based on Multiple Physiological Signals and Auto-Encoder," Sustainability, MDPI, vol. 15(12), pages 1-25, June.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:12:p:9405-:d:1168943
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/12/9405/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/12/9405/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zuojin Li & Qing Yang & Shengfu Chen & Wei Zhou & Liukui Chen & Lei Song, 2019. "A fuzzy recurrent neural network for driver fatigue detection based on steering-wheel angle sensor data," International Journal of Distributed Sensor Networks, , vol. 15(9), pages 15501477198, September.
    2. Xiangbing Zhao & Jianhui Zhou & Xiaofeng Li, 2022. "Fast Recognition Algorithm for Human Motion Posture Using Multimodal Bioinformation Fusion," Mathematical Problems in Engineering, Hindawi, vol. 2022, pages 1-9, April.
    3. Wei Sun & Xiaorui Zhang & Jian Wang & Jun He & Srinivas Peeta, 2015. "Blink Number Forecasting Based on Improved Bayesian Fusion Algorithm for Fatigue Driving Detection," Mathematical Problems in Engineering, Hindawi, vol. 2015, pages 1-13, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ping-Huan Kuo & Ssu-Ting Lin & Jun Hu, 2020. "DNAE-GAN: Noise-free acoustic signal generator by integrating autoencoder and generative adversarial network," International Journal of Distributed Sensor Networks, , vol. 16(5), pages 15501477209, May.
    2. Zhang, Yu & He, Yingying & Zhang, Likai, 2023. "Recognition method of abnormal driving behavior using the bidirectional gated recurrent unit and convolutional neural network," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 609(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:12:p:9405-:d:1168943. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.