IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v234y2023ics0951832023000789.html
   My bibliography  Save this article

A contrastive learning framework enhanced by unlabeled samples for remaining useful life prediction

Author

Listed:
  • Kong, Ziqian
  • Jin, Xiaohang
  • Xu, Zhengguo
  • Chen, Zian

Abstract

Deep learning (DL)-based methods for remaining useful life (RUL) prediction have received increasing research attention due to excellent feature extraction abilities. Most DL methods rely on abundant labeled samples for supervised training. However, because of the adoption of the over-maintenance strategy of equipment, the monitored data for the degradation of equipment usually consists of few labeled samples and a large amount of unlabeled samples, which limits the performance of DL methods. To take advantage of the value of unlabeled samples, this paper proposed a contrastive learning framework for RUL prediction. First, an unlabeled sample augmentation is developed firstly to extend the sample set. Then, an unlabeled sample learning (USL) architecture is proposed to learn the information of degradation from unlabeled samples to promote general DL models’ performance on RUL prediction. Based on the proposed framework, USL-convolutional neural network and USL-long short-term memory network are used to validate its performance based on datasets of turbofan engine and bearing. Results show that the performance of RUL prediction based on the proposed framework can be enhanced by unlabeled samples and verify the good scalability and generalization ability of the proposed framework.

Suggested Citation

  • Kong, Ziqian & Jin, Xiaohang & Xu, Zhengguo & Chen, Zian, 2023. "A contrastive learning framework enhanced by unlabeled samples for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
  • Handle: RePEc:eee:reensy:v:234:y:2023:i:c:s0951832023000789
    DOI: 10.1016/j.ress.2023.109163
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023000789
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109163?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    2. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    3. Ding, Yifei & Jia, Minping & Miao, Qiuhua & Huang, Peng, 2021. "Remaining useful life estimation using deep metric transfer learning for kernel regression," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    4. Listou Ellefsen, André & Bjørlykhaug, Emil & Æsøy, Vilmar & Ushakov, Sergey & Zhang, Houxiang, 2019. "Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 240-251.
    5. Li, Tianfu & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    6. Fu, Song & Zhang, Yongjian & Lin, Lin & Zhao, Minghang & Zhong, Shi-sheng, 2021. "Deep residual LSTM with domain-invariance for remaining useful life prediction across domains," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    7. Yu, Wennian & Kim, II Yong & Mechefske, Chris, 2020. "An improved similarity-based prognostic algorithm for RUL estimation using an RNN autoencoder scheme," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    8. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    9. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Tianmei & Pei, Hong & Si, Xiaosheng & Lei, Yaguo, 2023. "Prognosis for stochastic degrading systems with massive data: A data-model interactive perspective," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    2. Hou, WanJun & Peng, Yizhen, 2023. "Adaptive ensemble gaussian process regression-driven degradation prognosis with applications to bearing degradation," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    3. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    2. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    3. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    4. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    5. Pan, Tongyang & Chen, Jinglong & Ye, Zhisheng & Li, Aimin, 2022. "A multi-head attention network with adaptive meta-transfer learning for RUL prediction of rocket engines," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    6. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    7. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    8. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    9. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    10. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    11. Huang, Zhifu & Yang, Yang & Hu, Yawei & Ding, Xiang & Li, Xuanlin & Liu, Yongbin, 2023. "Attention-augmented recalibrated and compensatory network for machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    12. Wei, Yupeng & Wu, Dazhong & Terpenny, Janis, 2021. "Learning the health index of complex systems using dynamic conditional variational autoencoders," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    13. Zhang, Yuru & Su, Chun & Wu, Jiajun & Liu, Hao & Xie, Mingjiang, 2024. "Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    14. Li, Tianmei & Pei, Hong & Si, Xiaosheng & Lei, Yaguo, 2023. "Prognosis for stochastic degrading systems with massive data: A data-model interactive perspective," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    15. Hu, Tao & Guo, Yiming & Gu, Liudong & Zhou, Yifan & Zhang, Zhisheng & Zhou, Zhiting, 2022. "Remaining useful life prediction of bearings under different working conditions using a deep feature disentanglement based transfer learning method," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    16. Azar, Kamyar & Hajiakhondi-Meybodi, Zohreh & Naderkhani, Farnoosh, 2022. "Semi-supervised clustering-based method for fault diagnosis and prognosis: A case study," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    17. Yu Mo & Qianhui Wu & Xiu Li & Biqing Huang, 2021. "Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1997-2006, October.
    18. de Pater, Ingeborg & Reijns, Arthur & Mitici, Mihaela, 2022. "Alarm-based predictive maintenance scheduling for aircraft engines with imperfect Remaining Useful Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    19. Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    20. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:234:y:2023:i:c:s0951832023000789. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.