IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v215y2021ics0951832021003975.html
   My bibliography  Save this article

Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction

Author

Listed:
  • Li, Tianfu
  • Zhao, Zhibin
  • Sun, Chuang
  • Yan, Ruqiang
  • Chen, Xuefeng

Abstract

Deep learning-based prognostic methods have achieved great success in remaining useful life (RUL) prediction, since degradation information of machine can be adequately mined by deep learning techniques. However, these methods suffer from following weaknesses, that is, 1) interactions among multiple sensors are not explicitly considered; 2) they are more inclined to model temporal dependencies while ignoring spatial dependencies of sensors. To address those weaknesses, the multiple sensors are constructed to a sensor network and hierarchical attention graph convolutional network (HAGCN) is proposed in this paper for modeling the sensor network. In HAGCN, the hierarchical graph representation layer is proposed for modeling spatial dependencies of sensors and bi-directional long short-term memory network is used for modeling temporal dependencies of sensor measurements. Moreover, a regularized self-attention graph pooling is designed in HAGCN to achieve effective information fusion of the sensors. To realize prognostics, the spatial-temporal graphs are firstly generated based on the sensor network. Then, HAGCN is applied to model the spatial and temporal dependencies of the graphs simultaneously. The experimental results of two case studies show the superiority of HAGCN over state-of-the-art methods for RUL prediction.

Suggested Citation

  • Li, Tianfu & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
  • Handle: RePEc:eee:reensy:v:215:y:2021:i:c:s0951832021003975
    DOI: 10.1016/j.ress.2021.107878
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021003975
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107878?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Wei & Li, Xiang & Ma, Hui & Luo, Zhong & Li, Xu, 2021. "Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    2. Wang, Jia & Li, Zhigang & Bai, Guanghan & Zuo, Ming J., 2020. "An improved model for dependent competing risks considering continuous degradation and random shocks," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    3. Chen, Zhen & Li, Yaping & Xia, Tangbin & Pan, Ershun, 2019. "Hidden Markov model with auto-correlated observations for remaining useful life prediction and optimal maintenance policy," Reliability Engineering and System Safety, Elsevier, vol. 184(C), pages 123-136.
    4. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    5. Li, Naipeng & Gebraeel, Nagi & Lei, Yaguo & Fang, Xiaolei & Cai, Xiao & Yan, Tao, 2021. "Remaining useful life prediction based on a multi-sensor data fusion model," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    6. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    7. Minhee Kim & Kaibo Liu, 2020. "A Bayesian deep learning framework for interval estimation of remaining useful life in complex systems by incorporating general degradation characteristics," IISE Transactions, Taylor & Francis Journals, vol. 53(3), pages 326-340, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Varbella, Anna & Gjorgiev, Blazhe & Sansavini, Giovanni, 2023. "Geometric deep learning for online prediction of cascading failures in power grids," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    2. Huang, Zhifu & Yang, Yang & Hu, Yawei & Ding, Xiang & Li, Xuanlin & Liu, Yongbin, 2023. "Attention-augmented recalibrated and compensatory network for machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    3. Liu, Jie & Zheng, Shuwen & Wang, Chong, 2023. "Causal Graph Attention Network with Disentangled Representations for Complex Systems Fault Detection," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    4. Yan, Shen & Shao, Haidong & Min, Zhishan & Peng, Jiangji & Cai, Baoping & Liu, Bin, 2023. "FGDAE: A new machinery anomaly detection method towards complex operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    5. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    6. Pan, Tongyang & Chen, Jinglong & Ye, Zhisheng & Li, Aimin, 2022. "A multi-head attention network with adaptive meta-transfer learning for RUL prediction of rocket engines," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    7. Li, Wanxiang & Shang, Zhiwu & Gao, Maosheng & Qian, Shiqi & Feng, Zehua, 2022. "Remaining useful life prediction based on transfer multi-stage shrinkage attention temporal convolutional network under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    8. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    9. Tang, Shengnan & Zhu, Yong & Yuan, Shouqi, 2022. "Intelligent fault identification of hydraulic pump using deep adaptive normalized CNN and synchrosqueezed wavelet transform," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    10. He, Xinxin & Wang, Zhijian & Li, Yanfeng & Khazhina, Svetlana & Du, Wenhua & Wang, Junyuan & Wang, Wenzhao, 2022. "Joint decision-making of parallel machine scheduling restricted in job-machine release time and preventive maintenance with remaining useful life constraints," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    11. Abubakar Ahmad Musa & Adamu Hussaini & Weixian Liao & Fan Liang & Wei Yu, 2023. "Deep Neural Networks for Spatial-Temporal Cyber-Physical Systems: A Survey," Future Internet, MDPI, vol. 15(6), pages 1-24, May.
    12. Mitici, Mihaela & de Pater, Ingeborg & Barros, Anne & Zeng, Zhiguo, 2023. "Dynamic predictive maintenance for multiple components using data-driven probabilistic RUL prognostics: The case of turbofan engines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    13. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    14. Yang, Ningning & Wang, Zhijian & Cai, Wenan & Li, Yanfeng, 2023. "Data Regeneration Based on Multiple Degradation Processes for Remaining Useful Life Estimation," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    15. Zhu, Rong & Chen, Yuan & Peng, Weiwen & Ye, Zhi-Sheng, 2022. "Bayesian deep-learning for RUL prediction: An active learning perspective," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    16. Chen, Dingliang & Qin, Yi & Qian, Quan & Wang, Yi & Liu, Fuqiang, 2023. "Transfer life prediction of gears by cross-domain health indicator construction and multi-hierarchical long-term memory augmented network," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    17. Kong, Ziqian & Jin, Xiaohang & Xu, Zhengguo & Chen, Zian, 2023. "A contrastive learning framework enhanced by unlabeled samples for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    18. Xu, Xiaodong & Tang, Shengjin & Han, Xuebing & Lu, Languang & Wu, Yu & Yu, Chuanqiang & Sun, Xiaoyan & Xie, Jian & Feng, Xuning & Ouyang, Minggao, 2023. "Fast capacity prediction of lithium-ion batteries using aging mechanism-informed bidirectional long short-term memory network," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    19. Xia, Liqiao & Liang, Yongshi & Leng, Jiewu & Zheng, Pai, 2023. "Maintenance planning recommendation of complex industrial equipment based on knowledge graph and graph neural network," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    20. de Pater, Ingeborg & Reijns, Arthur & Mitici, Mihaela, 2022. "Alarm-based predictive maintenance scheduling for aircraft engines with imperfect Remaining Useful Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 221(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    2. Chen, Chong & Liu, Ying & Sun, Xianfang & Cairano-Gilfedder, Carla Di & Titmus, Scott, 2021. "An integrated deep learning-based approach for automobile maintenance prediction with GIS data," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    3. Xiao, Lei & Tang, Junxuan & Zhang, Xinghui & Bechhoefer, Eric & Ding, Siyi, 2021. "Remaining useful life prediction based on intentional noise injection and feature reconstruction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    4. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    5. Ding, Yifei & Jia, Minping & Miao, Qiuhua & Huang, Peng, 2021. "Remaining useful life estimation using deep metric transfer learning for kernel regression," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    6. Nguyen, Khanh T.P. & Medjaher, Kamal & Gogu, Christian, 2022. "Probabilistic deep learning methodology for uncertainty quantification of remaining useful lifetime of multi-component systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    7. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    8. Marcin Witczak & Marcin Mrugalski & Bogdan Lipiec, 2021. "Remaining Useful Life Prediction of MOSFETs via the Takagi–Sugeno Framework," Energies, MDPI, vol. 14(8), pages 1-23, April.
    9. Yaping Li & Enrico Zio & Ershun Pan, 2021. "An MEWMA-based segmental multivariate hidden Markov model for degradation assessment and prediction," Journal of Risk and Reliability, , vol. 235(5), pages 831-844, October.
    10. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    11. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    12. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    13. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    14. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    15. Youdao Wang & Yifan Zhao, 2022. "Multi-Scale Remaining Useful Life Prediction Using Long Short-Term Memory," Sustainability, MDPI, vol. 14(23), pages 1-19, November.
    16. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    17. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang, 2022. "The two-stage RUL prediction across operation conditions using deep transfer learning and insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    18. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    19. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    20. Fallahdizcheh, Amirhossein & Wang, Chao, 2022. "Transfer learning of degradation modeling and prognosis based on multivariate functional analysis with heterogeneous sampling rates," Reliability Engineering and System Safety, Elsevier, vol. 223(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:215:y:2021:i:c:s0951832021003975. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.