IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v239y2023ics0951832023004283.html
   My bibliography  Save this article

A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units

Author

Listed:
  • Li, Yuanfu
  • Chen, Yifan
  • Shao, Haonan
  • Zhang, Huisheng

Abstract

Improving Remaining Useful Life (RUL) prediction accuracy in Prognostic and Health Management (PHM) is the primary pursuit of researchers. Deep learning provides opportunities to address critical reliability engineering and safety analysis challenges. However, the performance could be improved due to the quantity and quality of sensor data. Knowledge is available to enhance the deep learning effect to improve RUL prediction performance. This paper proposes a novel RUL prediction approach that implements an encoder/decoder architecture with Gated Recurrent Units (GRUs) and dual attention mechanism combined with domain knowledge. The dual attention mechanism includes time and knowledge attention: knowledge attention reviews the information across the feature axis using domain knowledge to decide which sensor data is more critical. And time attention extracts the relatively necessary multiple time steps from the essential features. Compared to other deep learning models with attention using the NASA open dataset C-MAPSS, the approach reached first place in the overall ranking, demonstrating the reliability of utilizing domain knowledge in deep learning training. The results indicate that the proposed approach not only produces a superior accuracy of estimation accuracy but also benefits the efficiency and interpretability of the prediction.

Suggested Citation

  • Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
  • Handle: RePEc:eee:reensy:v:239:y:2023:i:c:s0951832023004283
    DOI: 10.1016/j.ress.2023.109514
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023004283
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109514?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    2. Cao, Yudong & Ding, Yifei & Jia, Minping & Tian, Rushuai, 2021. "A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    3. Pan, Tongyang & Chen, Jinglong & Ye, Zhisheng & Li, Aimin, 2022. "A multi-head attention network with adaptive meta-transfer learning for RUL prediction of rocket engines," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    4. Xu, Danyang & Qiu, Haobo & Gao, Liang & Yang, Zan & Wang, Dapeng, 2022. "A novel dual-stream self-attention neural network for remaining useful life estimation of mechanical systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    5. Chen, Jinglong & Jing, Hongjie & Chang, Yuanhong & Liu, Qian, 2019. "Gated recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 372-382.
    6. Liu, Junqiang & Lei, Fan & Pan, Chunlu & Hu, Dongbin & Zuo, Hongfu, 2021. "Prediction of remaining useful life of multi-stage aero-engine based on clustering and LSTM fusion," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    7. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    8. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    9. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    10. Wei, Yupeng & Wu, Dazhong, 2023. "Prediction of state of health and remaining useful life of lithium-ion battery using graph convolutional network with dual attention mechanisms," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    11. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    2. Xiang, Sheng & Qin, Yi & Luo, Jun & Pu, Huayan & Tang, Baoping, 2021. "Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    3. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    4. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    5. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    6. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    7. Huang, Zhifu & Yang, Yang & Hu, Yawei & Ding, Xiang & Li, Xuanlin & Liu, Yongbin, 2023. "Attention-augmented recalibrated and compensatory network for machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    8. Cao, Lixiao & Zhang, Hongyu & Meng, Zong & Wang, Xueping, 2023. "A parallel GRU with dual-stage attention mechanism model integrating uncertainty quantification for probabilistic RUL prediction of wind turbine bearings," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    9. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    10. Xu, Danyang & Qiu, Haobo & Gao, Liang & Yang, Zan & Wang, Dapeng, 2022. "A novel dual-stream self-attention neural network for remaining useful life estimation of mechanical systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    11. Xiao, Lei & Tang, Junxuan & Zhang, Xinghui & Bechhoefer, Eric & Ding, Siyi, 2021. "Remaining useful life prediction based on intentional noise injection and feature reconstruction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    12. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    13. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    14. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    15. Zhou, Kai-Li & Cheng, De-Jun & Zhang, Han-Bing & Hu, Zhong-tai & Zhang, Chun-Yan, 2023. "Deep learning-based intelligent multilevel predictive maintenance framework considering comprehensive cost," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    16. Tang, Ting & Yuan, Huimei, 2022. "A hybrid approach based on decomposition algorithm and neural network for remaining useful life prediction of lithium-ion battery," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    17. Yang, Ningning & Wang, Zhijian & Cai, Wenan & Li, Yanfeng, 2023. "Data Regeneration Based on Multiple Degradation Processes for Remaining Useful Life Estimation," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    18. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    19. Youdao Wang & Yifan Zhao, 2022. "Multi-Scale Remaining Useful Life Prediction Using Long Short-Term Memory," Sustainability, MDPI, vol. 14(23), pages 1-19, November.
    20. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:239:y:2023:i:c:s0951832023004283. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.