IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v243y2024ics0951832023007354.html

A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction

Author

Listed:
  • Shi, Jiayu
  • Zhong, Jingshu
  • Zhang, Yuxuan
  • Xiao, Bin
  • Xiao, Lei
  • Zheng, Yu

Abstract

Accurate remaining useful life (RUL) prediction of degrading systems is crucial to predict failures in advance and develop maintenance plans. As systems degrade gradually over time, sequential degradation feature (SDF) is very important. However, in attention mechanism (AM) based RUL prediction approaches, the sequential operation at each time step is abandoned. Further, these methods are modeled based on numerous parameters, making it difficult to enable timely RUL prediction. Therefore, this paper proposes a dual attention and long short-term memory (LSTM) lightweight model (DA-LSTM). LSTM compensates for the shortcomings of AM in modeling SDF, and exponential smoothing is adopted to train a lightweight model. Specifically, the SDF is divided into aggregated encoding feature (AEF) and aggregated original feature (AOF). AEF is obtained by the encoder which includes a novel soft attention mechanism and an LSTM network. To prevent losing useful information during the encoding process, the second attention layer aggregates the original sensor signal to obtain AOF. Finally, the decoder LSTM network combines AEF with AOF and calculates RUL based on a weighting average method. Extensive experiments are conducted on the C-MAPSS dataset to verify model effectiveness. The results show the superiority of DA-LSTM in prediction accuracy and computational quantity.

Suggested Citation

  • Shi, Jiayu & Zhong, Jingshu & Zhang, Yuxuan & Xiao, Bin & Xiao, Lei & Zheng, Yu, 2024. "A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
  • Handle: RePEc:eee:reensy:v:243:y:2024:i:c:s0951832023007354
    DOI: 10.1016/j.ress.2023.109821
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023007354
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109821?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Gregory W. Vogl & Brian A. Weiss & Moneer Helu, 2019. "A review of diagnostic and prognostic capabilities and best practices for manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 30(1), pages 79-95, January.
    2. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    3. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    4. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    5. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    6. Wei, Yupeng & Wu, Dazhong, 2023. "Prediction of state of health and remaining useful life of lithium-ion battery using graph convolutional network with dual attention mechanisms," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    7. Si, Xiao-Sheng & Wang, Wenbin & Hu, Chang-Hua & Zhou, Dong-Hua, 2011. "Remaining useful life estimation - A review on the statistical data driven approaches," European Journal of Operational Research, Elsevier, vol. 213(1), pages 1-14, August.
    8. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    9. Yu Mo & Qianhui Wu & Xiu Li & Biqing Huang, 2021. "Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1997-2006, October.
    10. Lefa Zhao & Yafei Zhu & Tianyu Zhao, 2022. "Deep Learning-Based Remaining Useful Life Prediction Method with Transformer Module and Random Forest," Mathematics, MDPI, vol. 10(16), pages 1-15, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shi, Peiming & Jia, Tiejun & Xu, Xuefang & Han, Dongying, 2026. "A generative dual-input model based on architectural computational optimization and multi-attention mechanism for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 266(PB).
    2. Wu, Xia & Liu, Zhiwen & Wang, Lei, 2025. "Spatio-temporal degradation model with graph neural network and structured state space model for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 256(C).
    3. Han, Jihun & Kwon, Yejin & Yoon, Hyunsoo, 2026. "Mamba-attention: A self-supervised framework for efficient remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 265(PB).
    4. Zhang, Yuru & Su, Chun & Wu, Jiajun & Liu, Hao & Xie, Mingjiang, 2024. "Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    5. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    6. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    7. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    9. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    10. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    11. A., Faizanbasha & Rizwan, U., 2025. "Deep learning-stochastic ensemble for RUL prediction and predictive maintenance with dynamic mission abort policies," Reliability Engineering and System Safety, Elsevier, vol. 259(C).
    12. Ding, Shousheng & Meng, Lei & Shang, Jie & Jiang, Chen & Qiu, Haobo & Gao, Liang, 2025. "A soft actor-critic reinforcement learning-based method for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 261(C).
    13. Zhang, Huixin & Xi, Xiaopeng & Pan, Rong, 2023. "A two-stage data-driven approach to remaining useful life prediction via long short-term memory networks," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    14. Chen, Xi & Wang, Hui & Lu, Siliang & Xu, Jiawen & Yan, Ruqiang, 2023. "Remaining useful life prediction of turbofan engine using global health degradation representation in federated learning," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    15. Lin, Chaojing & Chen, Yunxiao & Bai, Mingliang & Long, Zhenhua & Yao, Peng & Liu, Jinfu & Yu, Daren, 2025. "Improved multiple penalty mechanism based loss function for more realistic aeroengine RUL advanced prediction," Reliability Engineering and System Safety, Elsevier, vol. 255(C).
    16. Cao, Yudong & Zhuang, Jichao & Miao, Qiuhua & Jia, Minping & Feng, Ke & Zhao, Xiaoli & Yan, Xiaoan & Ding, Peng, 2024. "Source-free domain adaptation for transferable remaining useful life prediction of machine considering source data absence," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    17. Cai, Xiao & Zhang, Dingcheng & Yu, Yang & Xie, Min, 2025. "Knowledge embedded spatial–temporal graph convolutional networks for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 259(C).
    18. Shih-Hsien Tseng & Khoa-Dang Tran, 2024. "Predicting maintenance through an attention long short-term memory projected model," Journal of Intelligent Manufacturing, Springer, vol. 35(2), pages 807-824, February.
    19. Jiang, Weixiong & Wu, Jun & Yang, Yifan & Li, Xinyu & Zhu, Haiping, 2025. "Health evaluation techniques towards rotating machinery: A systematic literature review and implementation guideline," Reliability Engineering and System Safety, Elsevier, vol. 260(C).
    20. Fu, En & Hu, Yanyan & Peng, Kaixiang & Chu, Yuxin, 2024. "Supervised contrastive learning based dual-mixer model for Remaining Useful Life prediction," Reliability Engineering and System Safety, Elsevier, vol. 251(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:243:y:2024:i:c:s0951832023007354. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.