IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v263y2025ics0951832025004727.html

Adaptive frequency attention-based interpretable Transformer network for few-shot fault diagnosis of rolling bearings

Author

Listed:
  • Liu, Keying
  • Li, Yifan
  • Cui, Zhaoyang
  • Qi, Guangdong
  • Wang, Biao

Abstract

In recent years, deep learning-based approaches have demonstrated superior performance in few-shot fault diagnosis. Nevertheless, many of these methods lack explicit interpretability, making it difficult to intuitively understand their diagnostic logic. To tackle this issue, an interpretable deep learning model called the adaptive frequency attention-based interpretable Transformer network is proposed for few-shot fault diagnosis of rolling bearings. From a frequency interpretability perspective, the standard Transformer network architecture has been innovatively improved. First, an adaptive frequency attention mechanism is developed that quantifies the importance of various frequency components during the diagnostic process, adaptively identifying and emphasizing key frequency components closely associated with fault modes. This boosts both diagnostic performance and model interpretability. Second, to enhance the diversity of fault features under limited sample conditions, a multiscale convolutional architecture is developed to replace the linear projection layer in input embedding. This architecture employs parallel multiscale convolution kernels to extract both local and global fault features, enabling a comprehensive capture of fault information and further supporting the interpretability of the diagnostic model. Finally, Experiments on interpretable few-shot fault diagnosis are carried out on three rolling bearing datasets, and the diagnostic results further validate the effectiveness and interpretability of the proposed method.

Suggested Citation

  • Liu, Keying & Li, Yifan & Cui, Zhaoyang & Qi, Guangdong & Wang, Biao, 2025. "Adaptive frequency attention-based interpretable Transformer network for few-shot fault diagnosis of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 263(C).
  • Handle: RePEc:eee:reensy:v:263:y:2025:i:c:s0951832025004727
    DOI: 10.1016/j.ress.2025.111271
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832025004727
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2025.111271?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Yadong & Yan, Xiaoan & Sun, Beibei & Liu, Zheng, 2022. "Global contextual residual convolutional neural networks for motor fault diagnosis under variable-speed conditions," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    2. Jiang, Yuan & Liu, Zheng & Kabirzadeh, Pouya & Wu, Yulun & Li, Yumeng & Miljkovic, Nenad & Wang, Pingfeng, 2025. "Multi-fidelity physics-informed convolutional neural network for heat map prediction of battery packs," Reliability Engineering and System Safety, Elsevier, vol. 256(C).
    3. Cheng, Yongbo & Qv, Junheng & Feng, Ke & Han, Te, 2024. "A Bayesian adversarial probsparse Transformer model for long-term remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    4. Gao, Dawei & Huang, Kai & Zhu, Yongsheng & Zhu, Linbo & Yan, Ke & Ren, Zhijun & Guedes Soares, C., 2024. "Semi-supervised small sample fault diagnosis under a wide range of speed variation conditions based on uncertainty analysis," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    5. Su, Yunsheng & Shi, Luojie & Zhou, Kai & Bai, Guangxing & Wang, Zequn, 2024. "Knowledge-informed deep networks for robust fault diagnosis of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    6. Wang, Fujin & Zhao, Zhibin & Zhai, Zhi & Shang, Zuogang & Yan, Ruqiang & Chen, Xuefeng, 2023. "Explainability-driven model improvement for SOH estimation of lithium-ion battery," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liang, Shuang & Yu, Jinsong & Tang, Diyin & Ke, Xu, 2026. "Interpretable attention-based prototype network for UAV fault diagnosis under small sample conditions," Reliability Engineering and System Safety, Elsevier, vol. 265(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Haoyu & Li, Chuanjiang & Ding, Peng & Li, Shaobo & Li, Tandong & Liu, Chenyu & Zhang, Xiangjie & Hong, Zejian, 2024. "A novel transformer-based few-shot learning method for intelligent fault diagnosis with noisy labels under varying working conditions," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    2. Li, Xinglin & Xie, Luofeng & Deng, Bo & Lu, Houhong & Zhu, Yangyang & Yin, Ming & Yin, Guofu & Gao, Wenxiang, 2024. "Deep dynamic high-order graph convolutional network for wear fault diagnosis of hydrodynamic mechanical seal," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    3. Dong, Jie & Li, Daye & Cong, Zhiyu & Peng, Kaixiang, 2025. "A new fault detection method based on an updatable hybrid model for hard-to-detect faults in nonstationary processes," Reliability Engineering and System Safety, Elsevier, vol. 259(C).
    4. Yu, Tian & Li, Chaoshun & Huang, Jie & Xiao, Xiangqu & Zhang, Xiaoyuan & Li, Yuhong & Fu, Bitao, 2024. "ReF-DDPM: A novel DDPM-based data augmentation method for imbalanced rolling bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    5. Qi, Junyu & Chen, Zhuyun & Kong, Yun & Qin, Wu & Qin, Yi, 2025. "Attention-guided graph isomorphism learning: A multi-task framework for fault diagnosis and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 263(C).
    6. Mo, Renpeng & Zhou, Han & Yin, Hongpeng & Si, Xiaosheng, 2025. "A survey on few-shot learning for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 257(PB).
    7. Liu, Rui & Ding, Xiaoxi & Liu, Shenglan & Zheng, Hebin & Xu, Yuanyaun & Shao, Yimin, 2025. "Knowledge-informed FIR-based cross-category filtering framework for interpretable machinery fault diagnosis under small samples," Reliability Engineering and System Safety, Elsevier, vol. 254(PB).
    8. Hairui Wang & Xin Ye & Yuanbo Li & Guifu Zhu, 2023. "Remaining Useful Life Prediction for Lithium-Ion Batteries Based on Improved Mode Decomposition and Time Series," Sustainability, MDPI, vol. 15(12), pages 1-23, June.
    9. Li, Yanming & Qin, Xiaojuan & Chai, Min & Wu, Haoran & Zhang, Fujing & Jiang, Fenghe & Wen, Changbao, 2025. "SOH evaluation and RUL estimation of lithium-ion batteries based on MC-CNN-TimesNet model," Reliability Engineering and System Safety, Elsevier, vol. 261(C).
    10. Wu, Rui & Tian, Jinpeng & Yao, Jiachi & Han, Te & Hu, Chunsheng, 2025. "Confidence-aware quantile Transformer for reliable degradation prediction of battery energy storage systems," Reliability Engineering and System Safety, Elsevier, vol. 260(C).
    11. Xiao, Xiao & Song, Meiqi & Liu, Xiaojing, 2025. "A reliable and adaptive prediction framework for nuclear power plant system through an improved Transformer model and Bayesian uncertainty analysis," Reliability Engineering and System Safety, Elsevier, vol. 261(C).
    12. Huang, Xucong & Peng, Zhaoqin & Tang, Diyin & Chen, Juan & Zio, Enrico & Zheng, Zaiping, 2024. "A physics-informed autoencoder for system health state assessment based on energy-oriented system performance," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    13. Jiang, Ming & Zhou, Kuang & Gao, Jiahui & Zhang, Fode, 2025. "Integrating causal representations with domain adaptation for fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 260(C).
    14. Liu, Jie & He, Zihan & Miao, Yonghao, 2024. "Causality-based adversarial attacks for robust GNN modelling with application in fault detection," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    15. Kim, Sunghyun & Seo, Yun-Ho & Park, Junhong, 2024. "Transformer-based novel framework for remaining useful life prediction of lubricant in operational rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    16. Wang, Zisheng & Xuan, Jianping & Shi, Tielin & Li, Yan-Fu, 2025. "Multi-label domain adversarial reinforcement learning for unsupervised compound fault recognition," Reliability Engineering and System Safety, Elsevier, vol. 254(PB).
    17. Liu, Zhao-Hua & Chen, Liang & Wei, Hua-Liang & Wu, Fa-Ming & Chen, Lei & Chen, Ya-Nan, 2023. "A Tensor-based domain alignment method for intelligent fault diagnosis of rolling bearing in rotating machinery," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. Wang, Lin & Guo, Wannian & Guo, Junyu & Zheng, Shaocong & Wang, Zhiyuan & Kang, Hooi Siang & Li, He, 2025. "An integrated deep learning model for intelligent recognition of long-distance natural gas pipeline features," Reliability Engineering and System Safety, Elsevier, vol. 255(C).
    19. Xia, Pengcheng & Huang, Yixiang & Tao, Zhiyu & Liu, Chengliang & Liu, Jie, 2023. "A digital twin-enhanced semi-supervised framework for motor fault diagnosis based on phase-contrastive current dot pattern," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    20. Li, Sheng & Ji, J.C. & Xu, Yadong & Sun, Xiuquan & Feng, Ke & Sun, Beibei & Wang, Yulin & Gu, Fengshou & Zhang, Ke & Ni, Qing, 2023. "IFD-MDCN: Multibranch denoising convolutional networks with improved flow direction strategy for intelligent fault diagnosis of rolling bearings under noisy conditions," Reliability Engineering and System Safety, Elsevier, vol. 237(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:263:y:2025:i:c:s0951832025004727. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.