IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v254y2025ipas0951832024006689.html
   My bibliography  Save this article

Label-guided contrastive learning with weighted pseudo-labeling: A novel mechanical fault diagnosis method with insufficient annotated data

Author

Listed:
  • Li, Xinyu
  • Cheng, Changming
  • Peng, Zhike

Abstract

Exploring fault diagnosis methods for mechanical equipment with weak dependency on annotated data is essential for industrial production. Contrastive learning (CL), capable of learning representations without labeling information, has achieved satisfactory performance in mechanical fault diagnosis. However, current CL-based approaches mainly encounter two limitations. First, the pre-training stage uses either unannotated or annotated samples exclusively while the fine-tuning stage solely relies on annotated ones, leading to inefficient sample utilization. Second, the representation learned by contrastive loss alone in the pretext task is sub-optimal for downstream diagnostic tasks. To address these issues, this paper proposed a novel diagnostic framework based on label-guided contrastive learning (LgCL) and weighted pseudo-labeling (WPL) strategy to improve fault diagnosis accuracy. In the pre-training stage, the proposed LgCL integrates two types of contrastive loss together with classification loss, enabling the encoder to learn discriminative representations that directly benefit the downstream diagnostic task. The devised hybrid fine-tuning strategy allows both labeled and unlabeled data to participate in fine-tuning via pseudo-labeling, enhancing model generalization. The pertinently designed WPL strategy mitigates the defect of noisy pseudo labels. Comparison and ablation experiments on two public datasets and one self-designed dataset validate the superiority of the proposed method for fault diagnosis with limited annotated data, with diagnostic accuracies improved by 25.30%, 5.47% and 10.02% over supervised, semi-supervised and contrastive learning methods, respectively.

Suggested Citation

  • Li, Xinyu & Cheng, Changming & Peng, Zhike, 2025. "Label-guided contrastive learning with weighted pseudo-labeling: A novel mechanical fault diagnosis method with insufficient annotated data," Reliability Engineering and System Safety, Elsevier, vol. 254(PA).
  • Handle: RePEc:eee:reensy:v:254:y:2025:i:pa:s0951832024006689
    DOI: 10.1016/j.ress.2024.110597
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024006689
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110597?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ding, Yifei & Zhuang, Jichao & Ding, Peng & Jia, Minping, 2022. "Self-supervised pretraining via contrast learning for intelligent incipient fault detection of bearings," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    2. Zheng, Minglei & Man, Junfeng & Wang, Dian & Chen, Yanan & Li, Qianqian & Liu, Yong, 2023. "Semi-supervised multivariate time series anomaly detection for wind turbines using generator SCADA data," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    3. Miao, Mengqi & Yu, Jianbo, 2024. "Deep feature interactive network for machinery fault diagnosis using multi-source heterogeneous data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    4. Hu, Kui & He, Qingbo & Cheng, Changming & Peng, Zhike, 2024. "Adaptive incremental diagnosis model for intelligent fault diagnosis with dynamic weight correction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    5. Wang, Jun & Ren, He & Shen, Changqing & Huang, Weiguo & Zhu, Zhongkui, 2024. "Multi-scale style generative and adversarial contrastive networks for single domain generalization fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    6. Xiang Li & Wei Zhang & Qian Ding & Jian-Qiao Sun, 2020. "Intelligent rotating machinery fault diagnosis based on deep learning using data augmentation," Journal of Intelligent Manufacturing, Springer, vol. 31(2), pages 433-452, February.
    7. Manjurul Islam, M.M. & Kim, Jong-Myon, 2019. "Reliable multiple combined fault diagnosis of bearings using heterogeneous feature models and multiclass support vector Machines," Reliability Engineering and System Safety, Elsevier, vol. 184(C), pages 55-66.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ding, Yifei & Jia, Minping & Zhuang, Jichao & Cao, Yudong & Zhao, Xiaoli & Lee, Chi-Guhn, 2023. "Deep imbalanced domain adaptation for transfer learning fault diagnosis of bearings under multiple working conditions," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    2. Wu, Zhangjun & Xu, Renli & Luo, Yuansheng & Shao, Haidong, 2024. "A holistic semi-supervised method for imbalanced fault diagnosis of rotational machinery with out-of-distribution samples," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    3. Zuo, Lin & Xu, Fengjie & Zhang, Changhua & Xiahou, Tangfan & Liu, Yu, 2022. "A multi-layer spiking neural network-based approach to bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    4. Zhu, Yunyi & Xie, Bin & Wang, Anqi & Qian, Zheng, 2025. "Wind turbine fault detection and identification via self-attention-based dynamic graph representation learning and variable-level normalizing flow," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    5. Yiwei Wang & Jian Zhou & Lianyu Zheng & Christian Gogu, 2022. "An end-to-end fault diagnostics method based on convolutional neural network for rotating machinery with multiple case studies," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 809-830, March.
    6. Guo, Jianchun & Si, Zetian & Liu, Yi & Li, Jiahao & Li, Yanting & Xiang, Jiawei, 2022. "Dynamic time warping using graph similarity guided symplectic geometry mode decomposition to detect bearing faults," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    7. Kim, Yong Chae & Lee, Jinwook & Kim, Taehun & Baek, Jonghwa & Ko, Jin Uk & Jung, Joon Ha & Youn, Byeng D., 2024. "Gradient Alignment based Partial Domain Adaptation (GAPDA) using a domain knowledge filter for fault diagnosis of bearing," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    8. Bai, Ruxue & Meng, Zong & Xu, Quansheng & Fan, Fengjie, 2023. "Fractional Fourier and time domain recurrence plot fusion combining convolutional neural network for bearing fault diagnosis under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    9. Li, Qi & Chen, Liang & Kong, Lin & Wang, Dong & Xia, Min & Shen, Changqing, 2023. "Cross-domain augmentation diagnosis: An adversarial domain-augmented generalization method for fault diagnosis under unseen working conditions," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    10. Lu, Feiyu & Tong, Qingbin & Jiang, Xuedong & Feng, Ziwei & Liu, Ruifang & Xu, Jianjun & Huo, Jingyi, 2024. "DPICEN: Deep physical information consistency embedded network for bearing fault diagnosis under unknown domain," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    11. Zou, Xinyu & Tao, Laifa & Sun, Lulu & Wang, Chao & Ma, Jian & Lu, Chen, 2023. "A case-learning-based paradigm for quantitative recommendation of fault diagnosis algorithms: A case study of gearbox," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    12. Shi, Yaowei & Deng, Aidong & Deng, Minqiang & Xu, Meng & Liu, Yang & Ding, Xue & Bian, Wenbin, 2023. "Domain augmentation generalization network for real-time fault diagnosis under unseen working conditions," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    13. Prashant Kumar & Salman Khalid & Heung Soo Kim, 2023. "Prognostics and Health Management of Rotating Machinery of Industrial Robot with Deep Learning Applications—A Review," Mathematics, MDPI, vol. 11(13), pages 1-37, July.
    14. Vrignat, Pascal & Kratz, Frédéric & Avila, Manuel, 2022. "Sustainable manufacturing, maintenance policies, prognostics and health management: A literature review," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    15. Park, Chan Hee & Kim, Hyeongmin & Suh, Chaehyun & Chae, Minseok & Yoon, Heonjun & Youn, Byeng D., 2022. "A health image for deep learning-based fault diagnosis of a permanent magnet synchronous motor under variable operating conditions: Instantaneous current residual map," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    16. Ze Wei & Hui Liu & Xuewen Tao & Kai Pan & Rui Huang & Wenjing Ji & Jianhai Wang, 2023. "Insights into the Application of Machine Learning in Industrial Risk Assessment: A Bibliometric Mapping Analysis," Sustainability, MDPI, vol. 15(8), pages 1-29, April.
    17. Zhu, Dongping & Huang, Xiaogang & Ding, Zhixia & Zhang, Wei, 2024. "Estimation of wind turbine responses with attention-based neural network incorporating environmental uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    18. Panjapornpon, Chanin & Bardeeniz, Santi & Hussain, Mohamed Azlan, 2023. "Deep learning approach for energy efficiency prediction with signal monitoring reliability for a vinyl chloride monomer process," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    19. Li, Gang & Hu, Jiayao & Ding, Yaping & Tang, Aimin & Ao, Jiaxing & Hu, Dalong & Liu, Yang, 2024. "A novel method for fault diagnosis of fluid end of drilling pump under complex working conditions," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    20. Leoni, Leonardo & De Carlo, Filippo & Abaei, Mohammad Mahdi & BahooToroody, Ahmad & Tucci, Mario, 2023. "Failure diagnosis of a compressor subjected to surge events: A data-driven framework," Reliability Engineering and System Safety, Elsevier, vol. 233(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:254:y:2025:i:pa:s0951832024006689. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.