IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v230y2023ics0951832022005294.html
   My bibliography  Save this article

Deep transfer learning based on Bi-LSTM and attention for remaining useful life prediction of rolling bearing

Author

Listed:
  • Dong, Shaojiang
  • Xiao, Jiafeng
  • Hu, Xiaolin
  • Fang, Nengwei
  • Liu, Lanhui
  • Yao, Jinbao

Abstract

Many transfer learning methods focus on training models between domains with large differences. However, the data feature distribution varies greatly in different bearing degradation processes, which affects the prediction accuracy of Remaining useful life (RUL). To solve this problem, a novel method for RUL prediction with more refined transfer is proposed, which added failure behavior judgment. Firstly, a failure behavior judgment method is proposed by using the convolutional autoencoder (CAE) and Pearson correlation coefficient to determine whether the bearing fails gradually or suddenly. Then, a multi-channel transfer network is proposed for extracting multi-scale features of bearing degradation. Each channel uses convolutional network and bidirectional long short-term memory (Bi-LSTM) to extract global and temporal information. To reduce the difference in feature distribution between the training and test bearing data, a domain adaptive structure is added after feature fusion in each channel to enable the model to learn domain invariant features. By applying this method to experimental data and comparing it with other methods, the superiority and effectiveness of the proposed method are verified.

Suggested Citation

  • Dong, Shaojiang & Xiao, Jiafeng & Hu, Xiaolin & Fang, Nengwei & Liu, Lanhui & Yao, Jinbao, 2023. "Deep transfer learning based on Bi-LSTM and attention for remaining useful life prediction of rolling bearing," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
  • Handle: RePEc:eee:reensy:v:230:y:2023:i:c:s0951832022005294
    DOI: 10.1016/j.ress.2022.108914
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832022005294
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2022.108914?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chen, Zewang & Shi, Na & Ji, Yufan & Niu, Mu & Wang, Youren, 2021. "Lithium-ion batteries remaining useful life prediction based on BLS-RVM," Energy, Elsevier, vol. 234(C).
    2. Zhang, Yong & Xin, Yuqi & Liu, Zhi-wei & Chi, Ming & Ma, Guijun, 2022. "Health status assessment and remaining useful life prediction of aero-engine based on BiGRU and MMoE," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    3. Pradeep Kundu & Seema Chopra & Bhupesh K. Lad, 2019. "Multiple failure behaviors identification and remaining useful life prediction of ball bearings," Journal of Intelligent Manufacturing, Springer, vol. 30(4), pages 1795-1807, April.
    4. Ding, Yifei & Zhuang, Jichao & Ding, Peng & Jia, Minping, 2022. "Self-supervised pretraining via contrast learning for intelligent incipient fault detection of bearings," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    5. Zhang, Wei & Li, Xiang & Ma, Hui & Luo, Zhong & Li, Xu, 2021. "Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    6. Miao, Mengqi & Yu, Jianbo & Zhao, Zhihong, 2022. "A sparse domain adaption network for remaining useful life prediction of rolling bearings under different working conditions," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    7. Li, Naipeng & Gebraeel, Nagi & Lei, Yaguo & Fang, Xiaolei & Cai, Xiao & Yan, Tao, 2021. "Remaining useful life prediction based on a multi-sensor data fusion model," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    8. Zhuang, Jichao & Jia, Minping & Ding, Yifei & Ding, Peng, 2021. "Temporal convolution-based transferable cross-domain adaptation approach for remaining useful life estimation under variable failure behaviors," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    9. Ding, Yifei & Jia, Minping & Miao, Qiuhua & Huang, Peng, 2021. "Remaining useful life estimation using deep metric transfer learning for kernel regression," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiang, Sheng & Li, Penghua & Huang, Yi & Luo, Jun & Qin, Yi, 2024. "Single gated RNN with differential weighted information storage mechanism and its application to machine RUL prediction," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    2. Zhang, Zhiyao & Chen, Xiaohui & Zio, Enrico & Li, Longxiao, 2023. "Multi-task learning boosted predictions of the remaining useful life of aero-engines under scenarios of working-condition shift," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    3. Liang, Tao & Wang, Fuli & Wang, Shu & Li, Kang & Mo, Xuelei & Lu, Di, 2024. "Machinery health prognostic with uncertainty for mineral processing using TSC-TimeGAN," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    4. Naheliya, Bharti & Redhu, Poonam & Kumar, Kranti, 2024. "MFOA-Bi-LSTM: An optimized bidirectional long short-term memory model for short-term traffic flow prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 634(C).
    5. Xu, Xiaodong & Tang, Shengjin & Han, Xuebing & Lu, Languang & Wu, Yu & Yu, Chuanqiang & Sun, Xiaoyan & Xie, Jian & Feng, Xuning & Ouyang, Minggao, 2023. "Fast capacity prediction of lithium-ion batteries using aging mechanism-informed bidirectional long short-term memory network," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    6. Yan, Jianhai & Ye, Zhi-Sheng & He, Shuguang & He, Zhen, 2024. "A feature disentanglement and unsupervised domain adaptation of remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    7. Zhu, Ting & Chen, Zhen & Zhou, Di & Xia, Tangbin & Pan, Ershun, 2024. "Adaptive staged remaining useful life prediction of roller in a hot strip mill based on multi-scale LSTM with multi-head attention," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    8. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang & Xu, Kun, 2023. "Remaining useful life prediction combined dynamic model with transfer learning under insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 236(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kumar, Anil & Parkash, Chander & Vashishtha, Govind & Tang, Hesheng & Kundu, Pradeep & Xiang, Jiawei, 2022. "State-space modeling and novel entropy-based health indicator for dynamic degradation monitoring of rolling element bearing," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    2. Liyuan Shao & Yong Zhang & Xiujuan Zheng & Xin He & Yufeng Zheng & Zhiwei Liu, 2023. "A Review of Remaining Useful Life Prediction for Energy Storage Components Based on Stochastic Filtering Methods," Energies, MDPI, vol. 16(3), pages 1-22, February.
    3. Yan, Jianhai & Ye, Zhi-Sheng & He, Shuguang & He, Zhen, 2024. "A feature disentanglement and unsupervised domain adaptation of remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    4. Zhuang, Jichao & Jia, Minping & Ding, Yifei & Ding, Peng, 2021. "Temporal convolution-based transferable cross-domain adaptation approach for remaining useful life estimation under variable failure behaviors," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    5. Zhu, Ting & Chen, Zhen & Zhou, Di & Xia, Tangbin & Pan, Ershun, 2024. "Adaptive staged remaining useful life prediction of roller in a hot strip mill based on multi-scale LSTM with multi-head attention," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    6. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    7. Wang, Yuan & Lei, Yaguo & Li, Naipeng & Yan, Tao & Si, Xiaosheng, 2023. "Deep multisource parallel bilinear-fusion network for remaining useful life prediction of machinery," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    8. Ding, Yifei & Jia, Minping & Zhuang, Jichao & Cao, Yudong & Zhao, Xiaoli & Lee, Chi-Guhn, 2023. "Deep imbalanced domain adaptation for transfer learning fault diagnosis of bearings under multiple working conditions," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    9. Wei, Yupeng & Wu, Dazhong & Terpenny, Janis, 2021. "Learning the health index of complex systems using dynamic conditional variational autoencoders," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    10. Chen, Chong & Liu, Ying & Sun, Xianfang & Cairano-Gilfedder, Carla Di & Titmus, Scott, 2021. "An integrated deep learning-based approach for automobile maintenance prediction with GIS data," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    11. Zhang, Huixin & Xi, Xiaopeng & Pan, Rong, 2023. "A two-stage data-driven approach to remaining useful life prediction via long short-term memory networks," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    12. Li, Tianfu & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    13. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    14. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang, 2022. "The two-stage RUL prediction across operation conditions using deep transfer learning and insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    15. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    16. Chen, Jiaxian & Li, Dongpeng & Huang, Ruyi & Chen, Zhuyun & Li, Weihua, 2023. "Aero-engine remaining useful life prediction method with self-adaptive multimodal data fusion and cluster-ensemble transfer regression," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    17. Nejjar, Ismail & Geissmann, Fabian & Zhao, Mengjie & Taal, Cees & Fink, Olga, 2024. "Domain adaptation via alignment of operation profile for Remaining Useful Lifetime prediction," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    18. Guan, Yang & Meng, Zong & Sun, Dengyun & Liu, Jingbo & Fan, Fengjie, 2021. "2MNet: Multi-sensor and multi-scale model toward accurate fault diagnosis of rolling bearing," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    19. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang & Xu, Kun, 2023. "Remaining useful life prediction combined dynamic model with transfer learning under insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    20. Hu, Tao & Guo, Yiming & Gu, Liudong & Zhou, Yifan & Zhang, Zhisheng & Zhou, Zhiting, 2022. "Remaining useful life estimation of bearings under different working conditions via Wasserstein distance-based weighted domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 224(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:230:y:2023:i:c:s0951832022005294. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.