IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v211y2021ics0951832021001095.html
   My bibliography  Save this article

Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions

Author

Listed:
  • Zhang, Wei
  • Li, Xiang
  • Ma, Hui
  • Luo, Zhong
  • Li, Xu

Abstract

Intelligent data-driven system prognostic methods have been popularly developed in the recent years. Despite the promising results, most approaches assume the training and testing data are from the same operating condition. In the real industries, it is quite common that different machine entities work under different scenarios, that results in performance deteriorations of the data-driven prognostic methods. This paper proposes a transfer learning method for remaining useful life predictions using deep representation regularization. The practical and challenging scenario is investigated, where the training and testing data are from different machinery operating conditions, and no target-domain run-to-failure data is available for training. In the deep learning framework, data alignment schemes are proposed in the representation sub-space, including healthy state alignment, degradation direction alignment, degradation level regularization and degradation fusion. In this way, the life-cycle data of different machine entities across domains can follow the same degradation trace, thus achieving prognostic knowledge transfer. Extensive experiments on the aero-engine dataset validate the effectiveness of the proposed method, which offers a promising solution for industrial prognostics.

Suggested Citation

  • Zhang, Wei & Li, Xiang & Ma, Hui & Luo, Zhong & Li, Xu, 2021. "Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
  • Handle: RePEc:eee:reensy:v:211:y:2021:i:c:s0951832021001095
    DOI: 10.1016/j.ress.2021.107556
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021001095
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107556?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fink, Olga & Zio, Enrico & Weidmann, Ulrich, 2014. "Predicting component reliability and level of degradation with complex-valued neural networks," Reliability Engineering and System Safety, Elsevier, vol. 121(C), pages 198-206.
    2. Zhu, Shun-Peng & Huang, Hong-Zhong & Peng, Weiwen & Wang, Hai-Kun & Mahadevan, Sankaran, 2016. "Probabilistic Physics of Failure-based framework for fatigue life prediction of aircraft gas turbine discs under uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 146(C), pages 1-12.
    3. Listou Ellefsen, André & Bjørlykhaug, Emil & Æsøy, Vilmar & Ushakov, Sergey & Zhang, Houxiang, 2019. "Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 240-251.
    4. Fan, Yuantao & Nowaczyk, Sławomir & Rögnvaldsson, Thorsteinn, 2020. "Transfer learning for remaining useful life prediction based on consensus self-organizing models," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    5. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    6. Zhao, Zeqi & Bin Liang, & Wang, Xueqian & Lu, Weining, 2017. "Remaining useful life prediction of aircraft engine based on degradation pattern learning," Reliability Engineering and System Safety, Elsevier, vol. 164(C), pages 74-83.
    7. da Costa, Paulo Roberto de Oliveira & Akçay, Alp & Zhang, Yingqian & Kaymak, Uzay, 2020. "Remaining useful lifetime prediction via deep domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang, 2022. "The two-stage RUL prediction across operation conditions using deep transfer learning and insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    2. Nannan Xu & Xinze Cui & Xin Wang & Wei Zhang & Tianyu Zhao, 2022. "An Intelligent Athlete Signal Processing Methodology for Balance Control Ability Assessment with Multi-Headed Self-Attention Mechanism," Mathematics, MDPI, vol. 10(15), pages 1-16, August.
    3. Zhang, Wei & Wang, Ziwei & Li, Xiang, 2023. "Blockchain-based decentralized federated transfer learning methodology for collaborative machinery fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    4. Liu, Junqiang & Pan, Chunlu & Lei, Fan & Hu, Dongbin & Zuo, Hongfu, 2021. "Fault prediction of bearings based on LSTM and statistical process analysis," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    5. Wei, Yupeng & Wu, Dazhong & Terpenny, Janis, 2021. "Learning the health index of complex systems using dynamic conditional variational autoencoders," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    6. Guan, Yang & Meng, Zong & Sun, Dengyun & Liu, Jingbo & Fan, Fengjie, 2021. "2MNet: Multi-sensor and multi-scale model toward accurate fault diagnosis of rolling bearing," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    7. Lefa Zhao & Yafei Zhu & Tianyu Zhao, 2022. "Deep Learning-Based Remaining Useful Life Prediction Method with Transformer Module and Random Forest," Mathematics, MDPI, vol. 10(16), pages 1-15, August.
    8. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    9. Jiapei Peng & Lefa Zhao & Tianyu Zhao, 2022. "Study on Dynamic Characteristics of a Rotating Sandwich Porous Pre-Twist Blade with a Setting Angle Reinforced by Graphene Nanoplatelets," Mathematics, MDPI, vol. 10(15), pages 1-15, August.
    10. Murray, Brian & Perera, Lokukaluge Prasad, 2021. "An AIS-based deep learning framework for regional ship behavior prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    11. Xin Wang & Seyed Mehdi Abtahi & Mahmood Chahari & Tianyu Zhao, 2022. "An Adaptive Neuro-Fuzzy Model for Attitude Estimation and Control of a 3 DOF System," Mathematics, MDPI, vol. 10(6), pages 1-16, March.
    12. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Jiang, Yuchen & Luo, Hao & Yin, Shen, 2023. "A variational local weighted deep sub-domain adaptation network for remaining useful life prediction facing cross-domain condition," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    13. Xia, Jun & Feng, Yunwen & Teng, Da & Chen, Junyu & Song, Zhicen, 2022. "Distance self-attention network method for remaining useful life estimation of aeroengine with parallel computing," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    14. Chen, Chong & Liu, Ying & Sun, Xianfang & Cairano-Gilfedder, Carla Di & Titmus, Scott, 2021. "An integrated deep learning-based approach for automobile maintenance prediction with GIS data," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    15. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang & Xu, Kun, 2023. "Remaining useful life prediction combined dynamic model with transfer learning under insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    16. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    17. Dong, Shaojiang & Xiao, Jiafeng & Hu, Xiaolin & Fang, Nengwei & Liu, Lanhui & Yao, Jinbao, 2023. "Deep transfer learning based on Bi-LSTM and attention for remaining useful life prediction of rolling bearing," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. González-Muñiz, Ana & Díaz, Ignacio & Cuadrado, Abel A. & García-Pérez, Diego, 2022. "Health indicator for machine condition monitoring built in the latent space of a deep autoencoder," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    19. Li, Tianfu & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    20. Yi Lyu & Qichen Zhang & Zhenfei Wen & Aiguo Chen, 2022. "Remaining Useful Life Prediction Based on Multi-Representation Domain Adaptation," Mathematics, MDPI, vol. 10(24), pages 1-18, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhuang, Jichao & Jia, Minping & Ding, Yifei & Ding, Peng, 2021. "Temporal convolution-based transferable cross-domain adaptation approach for remaining useful life estimation under variable failure behaviors," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    2. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    3. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    4. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    5. Xiao, Lei & Tang, Junxuan & Zhang, Xinghui & Bechhoefer, Eric & Ding, Siyi, 2021. "Remaining useful life prediction based on intentional noise injection and feature reconstruction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    6. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    7. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    8. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    9. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    10. Chen, Jiaxian & Li, Dongpeng & Huang, Ruyi & Chen, Zhuyun & Li, Weihua, 2023. "Aero-engine remaining useful life prediction method with self-adaptive multimodal data fusion and cluster-ensemble transfer regression," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    11. Fan, Yuantao & Nowaczyk, Sławomir & Rögnvaldsson, Thorsteinn, 2020. "Transfer learning for remaining useful life prediction based on consensus self-organizing models," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    12. Jiao, Ruihua & Peng, Kaixiang & Dong, Jie & Zhang, Chuanfang, 2020. "Fault monitoring and remaining useful life prediction framework for multiple fault modes in prognostics," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    13. Ding, Yifei & Jia, Minping & Miao, Qiuhua & Huang, Peng, 2021. "Remaining useful life estimation using deep metric transfer learning for kernel regression," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    14. Yu, Wennian & Kim, II Yong & Mechefske, Chris, 2020. "An improved similarity-based prognostic algorithm for RUL estimation using an RNN autoencoder scheme," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    15. Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    16. Fu, Song & Zhang, Yongjian & Lin, Lin & Zhao, Minghang & Zhong, Shi-sheng, 2021. "Deep residual LSTM with domain-invariance for remaining useful life prediction across domains," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    17. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    18. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    19. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    20. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:211:y:2021:i:c:s0951832021001095. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.