IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v211y2021ics0951832021000892.html
   My bibliography  Save this article

Machine learning for reliability engineering and safety applications: Review of current status and future opportunities

Author

Listed:
  • Xu, Zhaoyi
  • Saleh, Joseph Homer

Abstract

Machine learning (ML) pervades an increasing number of academic disciplines and industries. Its impact is profound, and several fields have been fundamentally altered by it, autonomy and computer vision for example; reliability engineering and safety will undoubtedly follow suit. There is already a large but fragmented literature on ML for reliability and safety applications, and it can be overwhelming to navigate and integrate into a coherent whole. In this work, we facilitate this task by providing a synthesis of, and a roadmap to this ever-expanding analytical landscape and highlighting its major landmarks and pathways. We first provide an overview of the different ML categories and sub-categories or tasks, and we note several of the corresponding models and algorithms. We then look back and review the use of ML in reliability and safety applications. We examine several publications in each category/sub-category, and we include a short discussion on the use of Deep Learning to highlight its growing popularity and distinctive advantages. Finally, we look ahead and outline several promising future opportunities for leveraging ML in service of advancing reliability and safety considerations. Overall, we argue that ML is capable of providing novel insights and opportunities to solve important challenges in reliability and safety applications. It is also capable of teasing out more accurate insights from accident datasets than with traditional analysis tools, and this in turn can lead to better informed decision-making and more effective accident prevention.

Suggested Citation

  • Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
  • Handle: RePEc:eee:reensy:v:211:y:2021:i:c:s0951832021000892
    DOI: 10.1016/j.ress.2021.107530
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021000892
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107530?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ling, Chunyan & Lu, Zhenzhou & Zhu, Xianming, 2019. "Efficient methods by active learning Kriging coupled with variance reduction based sampling methods for time-dependent failure probability," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 23-35.
    2. Sun, Zhili & Wang, Jian & Li, Rui & Tong, Cao, 2017. "LIF: A new Kriging based learning function and its application to structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 152-165.
    3. Bian, Chong & Yang, Shunkun & Huang, Tingting & Xu, Qingyang & Liu, Jie & Zio, Enrico, 2019. "Degradation state mining and identification for railway point machines," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 432-443.
    4. Mohajer, Amin & Bavaghar, Maryam & Farrokhi, Hamid, 2020. "Mobility-aware load Balancing for Reliable Self-Organization Networks: Multi-agent Deep Reinforcement Learning," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    5. Perrin, G., 2016. "Active learning surrogate models for the conception of systems with multiple failure modes," Reliability Engineering and System Safety, Elsevier, vol. 149(C), pages 130-136.
    6. Chang, Yang & Fang, Huajing, 2019. "A hybrid prognostic method for system degradation based on particle filter and relevance vector machine," Reliability Engineering and System Safety, Elsevier, vol. 186(C), pages 51-63.
    7. Tang, Kayu & Parsons, David J. & Jude, Simon, 2019. "Comparison of automatic and guided learning for Bayesian networks to analyse pipe failures in the water distribution system," Reliability Engineering and System Safety, Elsevier, vol. 186(C), pages 24-36.
    8. Worrell, Clarence & Luangkesorn, Louis & Haight, Joel & Congedo, Thomas, 2019. "Machine learning of fire hazard model simulations for use in probabilistic safety assessments at nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 128-142.
    9. Martin Leo & Suneel Sharma & K. Maddulety, 2019. "Machine Learning in Banking Risk Management: A Literature Review," Risks, MDPI, vol. 7(1), pages 1-22, March.
    10. Marseguerra, M., 2014. "Early detection of gradual concept drifts by text categorization and Support Vector Machine techniques: The TRIO algorithm," Reliability Engineering and System Safety, Elsevier, vol. 129(C), pages 1-9.
    11. Wang, Jinyong & Zhang, Ce, 2018. "Software reliability prediction using a deep learning model based on the RNN encoder–decoder," Reliability Engineering and System Safety, Elsevier, vol. 170(C), pages 73-82.
    12. Fink, Olga & Zio, Enrico & Weidmann, Ulrich, 2014. "Predicting component reliability and level of degradation with complex-valued neural networks," Reliability Engineering and System Safety, Elsevier, vol. 121(C), pages 198-206.
    13. Gehl, Pierre & Cavalieri, Francesco & Franchin, Paolo, 2018. "Approximate Bayesian network formulation for the rapid loss assessment of real-world infrastructure systems," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 80-93.
    14. Zhang, Nailong & Si, Wujun, 2020. "Deep reinforcement learning for condition-based maintenance planning of multi-component systems under dependent competing risks," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    15. Hernandez-Perdomo, Elvis & Guney, Yilmaz & Rocco, Claudio M., 2019. "A reliability model for assessing corporate governance using machine learning techniques," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 220-231.
    16. Liu, Yingchao & Hu, Xiaofeng & Zhang, Wenjuan, 2019. "Remaining useful life prediction based on health index similarity," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 502-510.
    17. Moura, Márcio das Chagas & Zio, Enrico & Lins, Isis Didier & Droguett, Enrique, 2011. "Failure and reliability prediction by support vector machines regression of time series data," Reliability Engineering and System Safety, Elsevier, vol. 96(11), pages 1527-1534.
    18. Gerassis, S. & Albuquerque, M.T.D. & García, J.F. & Boente, C. & Giráldez, E. & Taboada, J. & Martín, J.E., 2019. "Understanding complex blasting operations: A structural equation model combining Bayesian networks and latent class clustering," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 195-204.
    19. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    20. Papakonstantinou, K.G. & Shinozuka, M., 2014. "Planning structural inspection and maintenance policies via dynamic programming and Markov processes. Part I: Theory," Reliability Engineering and System Safety, Elsevier, vol. 130(C), pages 202-213.
    21. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    22. Andriotis, C.P. & Papakonstantinou, K.G., 2019. "Managing engineering systems with large state and action spaces through deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    23. Xiang, Zhengliang & Bao, Yuequan & Tang, Zhiyi & Li, Hui, 2020. "Deep reinforcement learning-based sampling method for structural reliability assessment," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    24. Vanderhaegen, Frédéric & Zieba, Stéphane & Enjalbert, Simon & Polet, Philippe, 2011. "A Benefit/Cost/Deficit (BCD) model for learning from human errors," Reliability Engineering and System Safety, Elsevier, vol. 96(7), pages 757-766.
    25. Zhao, Zeqi & Bin Liang, & Wang, Xueqian & Lu, Weining, 2017. "Remaining useful life prediction of aircraft engine based on degradation pattern learning," Reliability Engineering and System Safety, Elsevier, vol. 164(C), pages 74-83.
    26. Nguyen, Khanh T.P. & Medjaher, Kamal, 2019. "A new dynamic predictive maintenance framework using deep learning for failure prognostics," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 251-262.
    27. Zio, E., 2009. "Reliability engineering: Old problems and new challenges," Reliability Engineering and System Safety, Elsevier, vol. 94(2), pages 125-141.
    28. Listou Ellefsen, André & Bjørlykhaug, Emil & Æsøy, Vilmar & Ushakov, Sergey & Zhang, Houxiang, 2019. "Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 240-251.
    29. Stern, R.E. & Song, J. & Work, D.B., 2017. "Accelerated Monte Carlo system reliability analysis through machine-learning-based surrogate models of network connectivity," Reliability Engineering and System Safety, Elsevier, vol. 164(C), pages 1-9.
    30. Fang, Yi-Ping & Zio, Enrico, 2013. "Unsupervised spectral clustering for hierarchical modelling and criticality analysis of complex networks," Reliability Engineering and System Safety, Elsevier, vol. 116(C), pages 64-74.
    31. Jiang, Chen & Qiu, Haobo & Yang, Zan & Chen, Liming & Gao, Liang & Li, Peigen, 2019. "A general failure-pursuing sampling framework for surrogate-based reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 47-59.
    32. He, Rui & Dai, Yiyang & Lu, Jiachen & Mou, Chuanlin, 2018. "Developing ladder network for intelligent evaluation system: Case of remaining useful life prediction for centrifugal pumps," Reliability Engineering and System Safety, Elsevier, vol. 180(C), pages 385-393.
    33. Wei, Pengfei & Liu, Fuchao & Tang, Chenghu, 2018. "Reliability and reliability-based importance analysis of structural systems using multiple response Gaussian process model," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 183-195.
    34. María Teresa Ballestar & Pilar Grau-Carles & Jorge Sainz, 2019. "Predicting customer quality in e-commerce social networks: a machine learning approach," Review of Managerial Science, Springer, vol. 13(3), pages 589-603, June.
    35. Rachman, Andika & Ratnayake, R.M. Chandima, 2019. "Machine learning approach for risk-based inspection screening assessment," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 518-532.
    36. Stephen Johnson, 1967. "Hierarchical clustering schemes," Psychometrika, Springer;The Psychometric Society, vol. 32(3), pages 241-254, September.
    37. Busby, Daniel, 2009. "Hierarchical adaptive experimental design for Gaussian process emulators," Reliability Engineering and System Safety, Elsevier, vol. 94(7), pages 1183-1193.
    38. Zhang, Jinhao & Xiao, Mi & Gao, Liang, 2019. "An active learning reliability method combining Kriging constructed with exploration and exploitation of failure region and subset simulation," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 90-102.
    39. Li, Xiang & Zhang, Wei & Ding, Qian, 2019. "Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 208-218.
    40. García Nieto, P.J. & García-Gonzalo, E. & Sánchez Lasheras, F. & de Cos Juez, F.J., 2015. "Hybrid PSO–SVM-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 219-231.
    41. Reder, Maik & Yürüşen, Nurseda Y. & Melero, Julio J., 2018. "Data-driven learning framework for associating weather conditions and wind turbine failures," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 554-569.
    42. Papakonstantinou, K.G. & Shinozuka, M., 2014. "Planning structural inspection and maintenance policies via dynamic programming and Markov processes. Part II: POMDP implementation," Reliability Engineering and System Safety, Elsevier, vol. 130(C), pages 214-224.
    43. Alireza Ermagun & David Levinson, 2018. "Spatiotemporal traffic forecasting: review and proposed directions," Transport Reviews, Taylor & Francis Journals, vol. 38(6), pages 786-814, November.
    44. Yang, Xufeng & Liu, Yongshou & Mi, Caiying & Tang, Chenghu, 2018. "System reliability analysis through active learning Kriging model with truncated candidate region," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 235-241.
    45. Chen, Jinglong & Jing, Hongjie & Chang, Yuanhong & Liu, Qian, 2019. "Gated recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 372-382.
    46. Manjurul Islam, M.M. & Kim, Jong-Myon, 2019. "Reliable multiple combined fault diagnosis of bearings using heterogeneous feature models and multiclass support vector Machines," Reliability Engineering and System Safety, Elsevier, vol. 184(C), pages 55-66.
    47. Naderpour, Mohsen & Rizeei, Hossein Mojaddadi & Khakzad, Nima & Pradhan, Biswajeet, 2019. "Forest fire induced Natech risk assessment: A survey of geospatial technologies," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    48. Tamilselvan, Prasanna & Wang, Pingfeng, 2013. "Failure diagnosis using deep belief learning based health state classification," Reliability Engineering and System Safety, Elsevier, vol. 115(C), pages 124-135.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    2. Jiang, Chen & Qiu, Haobo & Gao, Liang & Wang, Dapeng & Yang, Zan & Chen, Liming, 2020. "EEK-SYS: System reliability analysis through estimation error-guided adaptive Kriging approximation of multiple limit state surfaces," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    3. Zhang, Jinhao & Gao, Liang & Xiao, Mi, 2020. "A composite-projection-outline-based approximation method for system reliability analysis with hybrid uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    4. Lee, Dongkyu & Song, Junho, 2023. "Risk-informed operation and maintenance of complex lifeline systems using parallelized multi-agent deep Q-network," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    5. Saraygord Afshari, Sajad & Enayatollahi, Fatemeh & Xu, Xiangyang & Liang, Xihui, 2022. "Machine learning-based methods in structural reliability analysis: A review," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    6. Shi, Yan & Lu, Zhenzhou & He, Ruyang & Zhou, Yicheng & Chen, Siyu, 2020. "A novel learning function based on Kriging for reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    7. Wang, Run-Zi & Gu, Hang-Hang & Zhu, Shun-Peng & Li, Kai-Shang & Wang, Ji & Wang, Xiao-Wei & Hideo, Miura & Zhang, Xian-Cheng & Tu, Shan-Tung, 2022. "A data-driven roadmap for creep-fatigue reliability assessment and its implementation in low-pressure turbine disk at elevated temperatures," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    8. de Pater, Ingeborg & Reijns, Arthur & Mitici, Mihaela, 2022. "Alarm-based predictive maintenance scheduling for aircraft engines with imperfect Remaining Useful Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    9. Tang, Ting & Yuan, Huimei, 2022. "A hybrid approach based on decomposition algorithm and neural network for remaining useful life prediction of lithium-ion battery," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    10. Jiang, Chen & Qiu, Haobo & Yang, Zan & Chen, Liming & Gao, Liang & Li, Peigen, 2019. "A general failure-pursuing sampling framework for surrogate-based reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 47-59.
    11. Zhang, Wei & Li, Xiang & Ma, Hui & Luo, Zhong & Li, Xu, 2021. "Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    12. Nguyen, Khanh T.P. & Medjaher, Kamal, 2019. "A new dynamic predictive maintenance framework using deep learning for failure prognostics," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 251-262.
    13. Morato, P.G. & Andriotis, C.P. & Papakonstantinou, K.G. & Rigo, P., 2023. "Inference and dynamic decision-making for deteriorating systems with probabilistic dependencies through Bayesian networks and deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    14. Wang, Jian & Sun, Zhili & Cao, Runan, 2021. "An efficient and robust Kriging-based method for system reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    15. Miao, Mengqi & Yu, Jianbo & Zhao, Zhihong, 2022. "A sparse domain adaption network for remaining useful life prediction of rolling bearings under different working conditions," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    16. Andriotis, C.P. & Papakonstantinou, K.G., 2019. "Managing engineering systems with large state and action spaces through deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    17. Mohammadi, Reza & He, Qing, 2022. "A deep reinforcement learning approach for rail renewal and maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    18. Li, Xingyu & Krivtsov, Vasiliy & Arora, Karunesh, 2022. "Attention-based deep survival model for time series data," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    19. de Pater, Ingeborg & Mitici, Mihaela, 2021. "Predictive maintenance for multi-component systems of repairables with Remaining-Useful-Life prognostics and a limited stock of spare components," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    20. Jiao, Ruihua & Peng, Kaixiang & Dong, Jie & Zhang, Chuanfang, 2020. "Fault monitoring and remaining useful life prediction framework for multiple fault modes in prognostics," Reliability Engineering and System Safety, Elsevier, vol. 203(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:211:y:2021:i:c:s0951832021000892. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.