IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v217y2022ics0951832021004725.html
   My bibliography  Save this article

Fusing physics-based and deep learning models for prognostics

Author

Listed:
  • Arias Chao, Manuel
  • Kulkarni, Chetan
  • Goebel, Kai
  • Fink, Olga

Abstract

Physics-based and data-driven models for remaining useful lifetime (RUL) prediction typically suffer from two major challenges that limit their applicability to complex real-world domains: (1) the incompleteness of physics-based models and (2) the limited representativeness of the training dataset for data-driven models. Combining the advantages of these two approaches while overcoming some of their limitations, we propose a novel hybrid framework for fusing the information from physics-based performance models with deep learning algorithms for prognostics of complex safety-critical systems. In the proposed framework, we use physics-based performance models to infer unobservable model parameters related to a system’s components health by solving a calibration problem. These parameters are subsequently combined with sensor readings and used as input to a deep neural network, thereby generating a data-driven prognostics model with physics-augmented features. The performance of the hybrid framework is evaluated on an extensive case study comprising run-to-failure degradation trajectories from a fleet of nine turbofan engines under real flight conditions. The experimental results show that the hybrid framework outperforms purely data-driven approaches by extending the prediction horizon by nearly 127%. Furthermore, it requires less training data and is less sensitive to the limited representativeness of the dataset as compared to purely data-driven approaches. Furthermore, we demonstrated the feasibility of the proposed framework on the original CMAPSS dataset, thereby confirming its superior performance.

Suggested Citation

  • Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
  • Handle: RePEc:eee:reensy:v:217:y:2022:i:c:s0951832021004725
    DOI: 10.1016/j.ress.2021.107961
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021004725
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107961?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrés Ruiz-Tagle Palazuelos & Enrique López Droguett & Rodrigo Pascual, 2020. "A novel deep capsule neural network for remaining useful life estimation," Journal of Risk and Reliability, , vol. 234(1), pages 151-167, February.
    2. Listou Ellefsen, André & Bjørlykhaug, Emil & Æsøy, Vilmar & Ushakov, Sergey & Zhang, Houxiang, 2019. "Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 240-251.
    3. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    4. Rutter, Carolyn M. & Miglioretti, Diana L. & Savarino, James E., 2009. "Bayesian Calibration of Microsimulation Models," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1338-1350.
    5. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    6. Yu Mo & Qianhui Wu & Xiu Li & Biqing Huang, 2021. "Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1997-2006, October.
    7. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    8. Li, Xiang & Zhang, Wei & Ding, Qian, 2019. "Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 208-218.
    9. Yu, Wennian & Kim, II Yong & Mechefske, Chris, 2020. "An improved similarity-based prognostic algorithm for RUL estimation using an RNN autoencoder scheme," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    10. da Costa, Paulo Roberto de Oliveira & Akçay, Alp & Zhang, Yingqian & Kaymak, Uzay, 2020. "Remaining useful lifetime prediction via deep domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Varbella, Anna & Gjorgiev, Blazhe & Sansavini, Giovanni, 2023. "Geometric deep learning for online prediction of cascading failures in power grids," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    2. Dehghan Shoorkand, Hassan & Nourelfath, Mustapha & Hajji, Adnène, 2024. "A hybrid CNN-LSTM model for joint optimization of production and imperfect predictive maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    3. Xu, Yanwen & Kohtz, Sara & Boakye, Jessica & Gardoni, Paolo & Wang, Pingfeng, 2023. "Physics-informed machine learning for reliability and systems safety applications: State of the art and challenges," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    4. Wang, Yilin & Shen, Lei & Zhang, Yuxuan & Li, Yuanxiang & Zhang, Ruixin & Yang, Yongshen, 2023. "Self-supervised Health Representation Decomposition based on contrast learning," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    5. He, Rui & Tian, Zhigang & Wang, Yifei & Zuo, Mingjian & Guo, Ziwei, 2023. "Condition-based maintenance optimization for multi-component systems considering prognostic information and degraded working efficiency," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    6. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    7. Giannakeas, Ilias N. & Mazaheri, Fatemeh & Bacarreza, Omar & Khodaei, Zahra Sharif & Aliabadi, Ferri M.H., 2023. "Probabilistic residual strength assessment of smart composite aircraft panels using guided waves," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    8. Lv, Haichao & Kang, Lixia & Liu, Yongzhong, 2023. "Analysis of strategies to maximize the cycle life of lithium-ion batteries based on aging trajectory prediction," Energy, Elsevier, vol. 275(C).
    9. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    10. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    11. Gjorgiev, Blazhe & Das, Laya & Merkel, Seline & Rohrer, Martina & Auger, Etienne & Sansavini, Giovanni, 2023. "Simulation-driven deep learning for locating faulty insulators in a power line," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    12. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    13. Zhu, Rong & Chen, Yuan & Peng, Weiwen & Ye, Zhi-Sheng, 2022. "Bayesian deep-learning for RUL prediction: An active learning perspective," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    14. Wang, Yilin & Li, Yuanxiang & Zhang, Yuxuan & Lei, Jia & Yu, Yifei & Zhang, Tongtong & Yang, Yongshen & Zhao, Honghua, 2024. "Incorporating prior knowledge into self-supervised representation learning for long PHM signal," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    15. Li, Zhanhang & Zhou, Jian & Nassif, Hani & Coit, David & Bae, Jinwoo, 2023. "Fusing physics-inferred information from stochastic model with machine learning approaches for degradation prediction," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    16. Lee, Juseong & Mitici, Mihaela, 2023. "Deep reinforcement learning for predictive aircraft maintenance using probabilistic Remaining-Useful-Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    17. Lewis, Austin D. & Groth, Katrina M., 2022. "Metrics for evaluating the performance of complex engineering system health monitoring models," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    18. Tian, Yuan & Han, Minghao & Kulkarni, Chetan & Fink, Olga, 2022. "A prescriptive Dirichlet power allocation policy with deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    19. Aizpurua, J.I. & Stewart, B.G. & McArthur, S.D.J. & Penalba, M. & Barrenetxea, M. & Muxika, E. & Ringwood, J.V., 2022. "Probabilistic forecasting informed failure prognostics framework for improved RUL prediction under uncertainty: A transformer case study," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    20. Hughes, William & Zhang, Wei & Cerrai, Diego & Bagtzoglou, Amvrossios & Wanik, David & Anagnostou, Emmanouil, 2022. "A Hybrid Physics-Based and Data-Driven Model for Power Distribution System Infrastructure Hardening and Outage Simulation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    21. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    22. Lin, Yan-Hui & Ruan, Sheng-Jia & Chen, Yun-Xia & Li, Yan-Fu, 2023. "Physics-informed deep learning for lithium-ion battery diagnostics using electrochemical impedance spectroscopy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    23. Zhou, Liang & Wang, Huawei & Xu, Shanshan, 2023. "Aero-engine prognosis strategy based on multi-scale feature fusion and multi-task parallel learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    2. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    3. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    4. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    5. Azar, Kamyar & Hajiakhondi-Meybodi, Zohreh & Naderkhani, Farnoosh, 2022. "Semi-supervised clustering-based method for fault diagnosis and prognosis: A case study," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    6. Xiao, Lei & Tang, Junxuan & Zhang, Xinghui & Bechhoefer, Eric & Ding, Siyi, 2021. "Remaining useful life prediction based on intentional noise injection and feature reconstruction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    7. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    8. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    9. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    10. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    11. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    12. Wang, Yuan & Lei, Yaguo & Li, Naipeng & Yan, Tao & Si, Xiaosheng, 2023. "Deep multisource parallel bilinear-fusion network for remaining useful life prediction of machinery," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    13. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    14. Xu, Danyang & Qiu, Haobo & Gao, Liang & Yang, Zan & Wang, Dapeng, 2022. "A novel dual-stream self-attention neural network for remaining useful life estimation of mechanical systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    15. de Pater, Ingeborg & Reijns, Arthur & Mitici, Mihaela, 2022. "Alarm-based predictive maintenance scheduling for aircraft engines with imperfect Remaining Useful Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    16. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    17. Fu, Song & Zhang, Yongjian & Lin, Lin & Zhao, Minghang & Zhong, Shi-sheng, 2021. "Deep residual LSTM with domain-invariance for remaining useful life prediction across domains," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    18. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    19. Zhuang, Jichao & Jia, Minping & Ding, Yifei & Ding, Peng, 2021. "Temporal convolution-based transferable cross-domain adaptation approach for remaining useful life estimation under variable failure behaviors," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    20. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:217:y:2022:i:c:s0951832021004725. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.