IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v250y2024ics0951832024003600.html
   My bibliography  Save this article

An attention-based multi-scale temporal convolutional network for remaining useful life prediction

Author

Listed:
  • Xu, Zhiqiang
  • Zhang, Yujie
  • Miao, Qiang

Abstract

Remaining Useful Life (RUL) prediction is one of the key technologies in Prognostics and Health Management (PHM). Accurate RUL prediction is crucial for equipment reliability, and equipment sensor data contains information at different scales that can be used for RUL prediction. Current mainstream methods usually extract features from only a single scale, neglecting the information from other scales. Additionally, the attention mechanisms used in these methods do not incorporate multi-dimensional information, which can lead to a loss in prediction performance. To address this issue, this paper proposes an end-to-end framework which utilizes Multi-Scale Temporal Convolutional Network (MSTCN) to extract multi-scale features and introduces Self-Attention (SA) and Global Fusion Attention (GFA) mechanisms to assist MSTCN's work. SA is located at the head of MSTCN, emphasizing the features of those steps that are particularly important, thereby improving the extraction efficiency of MSTCN. GFA is an original design of attention mechanism located at the end of MSTCN that intelligently integrates multi-dimensional attention information, suppressing redundant information in the multi-scale features. To validate the effectiveness of the proposed method, we conduct experiments on the C-MAPSS dataset released by NASA. The results show that our method outperforms other state-of-the-art prediction methods in terms of RUL prediction performance.

Suggested Citation

  • Xu, Zhiqiang & Zhang, Yujie & Miao, Qiang, 2024. "An attention-based multi-scale temporal convolutional network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
  • Handle: RePEc:eee:reensy:v:250:y:2024:i:c:s0951832024003600
    DOI: 10.1016/j.ress.2024.110288
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024003600
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110288?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    2. Zhang, Xin & Sun, Jiankai & Wang, Jiaxu & Jin, Yulin & Wang, Lei & Liu, Zhiwen, 2023. "PAOLTransformer: Pruning-adaptive optimal lightweight Transformer model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 240(C).
    3. Shi, Jiayu & Zhong, Jingshu & Zhang, Yuxuan & Xiao, Bin & Xiao, Lei & Zheng, Yu, 2024. "A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    4. Xiang, Sheng & Li, Penghua & Huang, Yi & Luo, Jun & Qin, Yi, 2024. "Single gated RNN with differential weighted information storage mechanism and its application to machine RUL prediction," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    5. Tae San Kim & So Young Sohn, 2021. "Multitask learning for health condition identification and remaining useful life prediction: deep convolutional neural network approach," Journal of Intelligent Manufacturing, Springer, vol. 32(8), pages 2169-2179, December.
    6. Cao, Yudong & Ding, Yifei & Jia, Minping & Tian, Rushuai, 2021. "A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    7. Chen, Jinglong & Jing, Hongjie & Chang, Yuanhong & Liu, Qian, 2019. "Gated recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 372-382.
    8. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    9. Li, Wanxiang & Shang, Zhiwu & Gao, Maosheng & Qian, Shiqi & Feng, Zehua, 2022. "Remaining useful life prediction based on transfer multi-stage shrinkage attention temporal convolutional network under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    10. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    11. Wang, Yilin & Li, Yuanxiang & Zhang, Yuxuan & Lei, Jia & Yu, Yifei & Zhang, Tongtong & Yang, Yongshen & Zhao, Honghua, 2024. "Incorporating prior knowledge into self-supervised representation learning for long PHM signal," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    12. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    2. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    3. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    4. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    5. Yan, Jianhai & Ye, Zhi-Sheng & He, Shuguang & He, Zhen, 2024. "A feature disentanglement and unsupervised domain adaptation of remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    6. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    7. Yang, Shilong & Tang, Baoping & Wang, Weiying & Yang, Qichao & Hu, Cheng, 2024. "Physics-informed multi-state temporal frequency network for RUL prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    8. Wu, Jinxin & He, Deqiang & Li, Jiayi & Miao, Jian & Li, Xianwang & Li, Hongwei & Shan, Sheng, 2024. "Temporal multi-resolution hypergraph attention network for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    9. Xiang, Sheng & Qin, Yi & Luo, Jun & Pu, Huayan & Tang, Baoping, 2021. "Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    10. Cao, Yudong & Zhuang, Jichao & Miao, Qiuhua & Jia, Minping & Feng, Ke & Zhao, Xiaoli & Yan, Xiaoan & Ding, Peng, 2024. "Source-free domain adaptation for transferable remaining useful life prediction of machine considering source data absence," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    11. Lin, Yan-Hui & Chang, Liang & Guan, Lu-Xin, 2024. "Enhanced stochastic recurrent hybrid model for RUL Predictions via Semi-supervised learning," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    12. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    13. Zhu, Ting & Chen, Zhen & Zhou, Di & Xia, Tangbin & Pan, Ershun, 2024. "Adaptive staged remaining useful life prediction of roller in a hot strip mill based on multi-scale LSTM with multi-head attention," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    14. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    15. Gao, Pengjie & Wang, Junliang & Shi, Ziqi & Ming, Weiwei & Chen, Ming, 2024. "Long-term temporal attention neural network with adaptive stage division for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    16. Pengcheng Xia & Yixiang Huang & Chengjin Qin & Chengliang Liu, 2024. "Towards prognostic generalization: a domain conditional invariance and specificity disentanglement network for remaining useful life prediction," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3459-3477, October.
    17. Yang, Jing & Wang, Xiaomin, 2024. "Meta-learning with deep flow kernel network for few shot cross-domain remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    18. Zhu, Qixiang & Zhou, Zheng & Li, Yasong & Yan, Ruqiang, 2024. "Contrastive BiLSTM-enabled Health Representation Learning for Remaining Useful Life Prediction," Reliability Engineering and System Safety, Elsevier, vol. 249(C).
    19. Hu, Tao & Guo, Yiming & Gu, Liudong & Zhou, Yifan & Zhang, Zhisheng & Zhou, Zhiting, 2022. "Remaining useful life prediction of bearings under different working conditions using a deep feature disentanglement based transfer learning method," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    20. Yu Mo & Liang Li & Biqing Huang & Xiu Li, 2023. "Few-shot RUL estimation based on model-agnostic meta-learning," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2359-2372, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:250:y:2024:i:c:s0951832024003600. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.