IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v243y2024ics0951832023007354.html
   My bibliography  Save this article

A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction

Author

Listed:
  • Shi, Jiayu
  • Zhong, Jingshu
  • Zhang, Yuxuan
  • Xiao, Bin
  • Xiao, Lei
  • Zheng, Yu

Abstract

Accurate remaining useful life (RUL) prediction of degrading systems is crucial to predict failures in advance and develop maintenance plans. As systems degrade gradually over time, sequential degradation feature (SDF) is very important. However, in attention mechanism (AM) based RUL prediction approaches, the sequential operation at each time step is abandoned. Further, these methods are modeled based on numerous parameters, making it difficult to enable timely RUL prediction. Therefore, this paper proposes a dual attention and long short-term memory (LSTM) lightweight model (DA-LSTM). LSTM compensates for the shortcomings of AM in modeling SDF, and exponential smoothing is adopted to train a lightweight model. Specifically, the SDF is divided into aggregated encoding feature (AEF) and aggregated original feature (AOF). AEF is obtained by the encoder which includes a novel soft attention mechanism and an LSTM network. To prevent losing useful information during the encoding process, the second attention layer aggregates the original sensor signal to obtain AOF. Finally, the decoder LSTM network combines AEF with AOF and calculates RUL based on a weighting average method. Extensive experiments are conducted on the C-MAPSS dataset to verify model effectiveness. The results show the superiority of DA-LSTM in prediction accuracy and computational quantity.

Suggested Citation

  • Shi, Jiayu & Zhong, Jingshu & Zhang, Yuxuan & Xiao, Bin & Xiao, Lei & Zheng, Yu, 2024. "A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
  • Handle: RePEc:eee:reensy:v:243:y:2024:i:c:s0951832023007354
    DOI: 10.1016/j.ress.2023.109821
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023007354
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109821?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Si, Xiao-Sheng & Wang, Wenbin & Hu, Chang-Hua & Zhou, Dong-Hua, 2011. "Remaining useful life estimation - A review on the statistical data driven approaches," European Journal of Operational Research, Elsevier, vol. 213(1), pages 1-14, August.
    2. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    3. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    4. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    5. Yu Mo & Qianhui Wu & Xiu Li & Biqing Huang, 2021. "Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1997-2006, October.
    6. Gregory W. Vogl & Brian A. Weiss & Moneer Helu, 2019. "A review of diagnostic and prognostic capabilities and best practices for manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 30(1), pages 79-95, January.
    7. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    8. Wei, Yupeng & Wu, Dazhong, 2023. "Prediction of state of health and remaining useful life of lithium-ion battery using graph convolutional network with dual attention mechanisms," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    9. Lefa Zhao & Yafei Zhu & Tianyu Zhao, 2022. "Deep Learning-Based Remaining Useful Life Prediction Method with Transformer Module and Random Forest," Mathematics, MDPI, vol. 10(16), pages 1-15, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    2. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    3. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    4. Chen, Xi & Wang, Hui & Lu, Siliang & Xu, Jiawen & Yan, Ruqiang, 2023. "Remaining useful life prediction of turbofan engine using global health degradation representation in federated learning," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    5. Zhang, Jiusi & Jiang, Yuchen & Li, Xiang & Huo, Mingyi & Luo, Hao & Yin, Shen, 2022. "An adaptive remaining useful life prediction approach for single battery with unlabeled small sample data and parameter uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    6. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    7. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Vrignat, Pascal & Kratz, Frédéric & Avila, Manuel, 2022. "Sustainable manufacturing, maintenance policies, prognostics and health management: A literature review," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    9. Han Cheng & Xianguang Kong & Qibin Wang & Hongbo Ma & Shengkang Yang & Gaige Chen, 2023. "Deep transfer learning based on dynamic domain adaptation for remaining useful life prediction under different working conditions," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 587-613, February.
    10. Zhang, Yuru & Su, Chun & Wu, Jiajun & Liu, Hao & Xie, Mingjiang, 2024. "Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    11. Chen, Chong & Liu, Ying & Sun, Xianfang & Cairano-Gilfedder, Carla Di & Titmus, Scott, 2021. "An integrated deep learning-based approach for automobile maintenance prediction with GIS data," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    12. Matteo Barbieri & Khan T. P. Nguyen & Roberto Diversi & Kamal Medjaher & Andrea Tilli, 2021. "RUL prediction for automatic machines: a mixed edge-cloud solution based on model-of-signals and particle filtering techniques," Journal of Intelligent Manufacturing, Springer, vol. 32(5), pages 1421-1440, June.
    13. Zhang, Huixin & Xi, Xiaopeng & Pan, Rong, 2023. "A two-stage data-driven approach to remaining useful life prediction via long short-term memory networks," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    14. Yu Mo & Liang Li & Biqing Huang & Xiu Li, 2023. "Few-shot RUL estimation based on model-agnostic meta-learning," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2359-2372, June.
    15. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    16. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    17. Wang, Chu & Dou, Manfeng & Li, Zhongliang & Outbib, Rachid & Zhao, Dongdong & Zuo, Jian & Wang, Yuanlin & Liang, Bin & Wang, Peng, 2023. "Data-driven prognostics based on time-frequency analysis and symbolic recurrent neural network for fuel cells under dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    18. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    19. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    20. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:243:y:2024:i:c:s0951832023007354. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.