IDEAS home Printed from https://ideas.repec.org/a/sae/risrel/v237y2023i5p910-921.html
   My bibliography  Save this article

Toward a framework for risk monitoring of complex engineering systems with online operational data: A deep learning-based solution

Author

Listed:
  • Ramin Moradi
  • Andrés Ruiz-Tagle Palazuelos
  • Enrique Lopez Droguett
  • Katrina M Groth

Abstract

A mathematical architecture is developed for system-level condition monitoring. This architecture is built toward performing end-to-end operation risk and condition monitoring. The streaming monitoring data is given to the architecture as the input and system-level and component-level operation health states are computed as the output. This architecture integrates fault trees as the system-level modeling method and Deep Learning (DL) as the components condition monitoring method. A number of different deep learning models are trained using both operation and maintenance data for the components. Then, the fault tree fuses the continuous components’ assessments to provide system-level health insight. The applicability of this architecture is tested by implementing it on a real-world mining stone crusher system. This approach is extendable to dynamic risk assessment of complex engineering systems. However, DL models should be used with caution for safety-critical applications. We show that having DL models with high accuracy is not enough for trusting their predictions. We discuss the calibration of DL-based condition monitoring models and demonstrate how they can improve the trustworthiness and interpretability of DL models in risk and reliability applications.

Suggested Citation

  • Ramin Moradi & Andrés Ruiz-Tagle Palazuelos & Enrique Lopez Droguett & Katrina M Groth, 2023. "Toward a framework for risk monitoring of complex engineering systems with online operational data: A deep learning-based solution," Journal of Risk and Reliability, , vol. 237(5), pages 910-921, October.
  • Handle: RePEc:sae:risrel:v:237:y:2023:i:5:p:910-921
    DOI: 10.1177/1748006X221079964
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1748006X221079964
    Download Restriction: no

    File URL: https://libkey.io/10.1177/1748006X221079964?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Khakzad, Nima & Landucci, Gabriele & Reniers, Genserik, 2017. "Application of dynamic Bayesian network to performance assessment of fire protection systems during domino effects," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 232-247.
    2. Khakzad, Nima & Khan, Faisal & Amyotte, Paul, 2012. "Dynamic risk analysis using bow-tie approach," Reliability Engineering and System Safety, Elsevier, vol. 104(C), pages 36-44.
    3. Xing, Jinduo & Zeng, Zhiguo & Zio, Enrico, 2019. "A framework for dynamic risk assessment with condition monitoring data and inspection data," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    4. Zio, E., 2018. "The future of risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 176-190.
    5. Moradi, Ramin & Groth, Katrina M., 2020. "Modernizing risk assessment: A systematic integration of PRA and PHM techniques," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moradi, Ramin & Cofre-Martel, Sergio & Lopez Droguett, Enrique & Modarres, Mohammad & Groth, Katrina M., 2022. "Integration of deep learning and Bayesian networks for condition and operation risk monitoring of complex engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    2. Alsulieman, Abdullah & Ge, Xihe & Zeng, Zhiguo & Butenko, Sergiy & Khan, Faisal & El-Halwagi, Mahmoud, 2024. "Dynamic risk analysis of evolving scenarios in oil and gas separator," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    3. He, Rui & Zhu, Jingyu & Chen, Guoming & Tian, Zhigang, 2022. "A real-time probabilistic risk assessment method for the petrochemical industry based on data monitoring," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    4. Michael Felix Pacevicius & Marilia Ramos & Davide Roverso & Christian Thun Eriksen & Nicola Paltrinieri, 2022. "Managing Heterogeneous Datasets for Dynamic Risk Analysis of Large-Scale Infrastructures," Energies, MDPI, vol. 15(9), pages 1-40, April.
    5. Feng, Jian Rui & Yu, Guanghui & Zhao, Mengke & Zhang, Jiaqing & Lu, Shouxiang, 2022. "Dynamic risk assessment framework for industrial systems based on accidents chain theory: The case study of fire and explosion risk of UHV converter transformer," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    6. Martínez-Galán Fernández, Pablo & Guillén López, Antonio J. & Márquez, Adolfo Crespo & Gomez Fernández, Juan Fco. & Marcos, Jose Antonio, 2022. "Dynamic Risk Assessment for CBM-based adaptation of maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    7. Hong, Bingyuan & Shao, Bowen & Guo, Jian & Fu, Jianzhong & Li, Cuicui & Zhu, Baikang, 2023. "Dynamic Bayesian network risk probability evolution for third-party damage of natural gas pipelines," Applied Energy, Elsevier, vol. 333(C).
    8. Xiaoxia Liang & Fang Duan & Ian Bennett & David Mba, 2020. "A Comprehensive Health Indicator Integrated by the Dynamic Risk Profile from Condition Monitoring Data and the Function of Financial Losses," Energies, MDPI, vol. 14(1), pages 1-25, December.
    9. Wu, Xingguang & Huang, Huirong & Xie, Jianyu & Lu, Meixing & Wang, Shaobo & Li, Wang & Huang, Yixuan & Yu, Weichao & Sun, Xiaobo, 2023. "A novel dynamic risk assessment method for the petrochemical industry using bow-tie analysis and Bayesian network analysis method based on the methodological framework of ARAMIS project," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    10. Yu, Jianxing & Zeng, Qingze & Yu, Yang & Zhang, Baolei & Ma, Wentao & Wu, Shibo & Ding, Hongyu & Li, Zhenmian, 2025. "Resilience assessment of FPSO leakage emergency response based on quantitative FRAM," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    11. Lewis, Austin D. & Groth, Katrina M., 2023. "A comparison of DBN model performance in SIPPRA health monitoring based on different data stream discretization methods," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    12. Moradi, Ramin & Groth, Katrina M., 2020. "Modernizing risk assessment: A systematic integration of PRA and PHM techniques," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    13. Wang, Yuchen & Ji, Zuzhen & Cao, Yi & Yang, Shuang-Hua, 2025. "Dynamic risk assessment for process operational safety based on reachability analysis," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    14. Liu, Aihua & Chen, Ke & Huang, Xiaofei & Li, Didi & Zhang, Xiaochun, 2021. "Dynamic risk assessment model of buried gas pipelines based on system dynamics," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    15. Zhiqiang Liu & Wenbo Zhu & Hongzhou Zhang & Shengjin Wang & Lu Fang & Weijun Hong & Hua Shao & Guopeng Wang, 2020. "Reliability evaluation of dynamic face recognition systems based on improved Fuzzy Dynamic Bayesian Network," International Journal of Distributed Sensor Networks, , vol. 16(3), pages 15501477209, March.
    16. Chen, Chao & Yang, Ming & Reniers, Genserik, 2021. "A dynamic stochastic methodology for quantifying HAZMAT storage resilience," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    17. Khastgir, Siddartha & Brewerton, Simon & Thomas, John & Jennings, Paul, 2021. "Systems Approach to Creating Test Scenarios for Automated Driving Systems," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    18. Li, Mei & Liu, Zixian & Li, Xiaopeng & Liu, Yiliu, 2019. "Dynamic risk assessment in healthcare based on Bayesian approach," Reliability Engineering and System Safety, Elsevier, vol. 189(C), pages 327-334.
    19. Bhardwaj, U. & Teixeira, A.P. & Guedes Soares, C., 2022. "Casualty analysis methodology and taxonomy for FPSO accident analysis," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    20. Qiao, Wanguan, 2021. "Analysis and measurement of multifactor risk in underground coal mine accidents based on coupling theory," Reliability Engineering and System Safety, Elsevier, vol. 208(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:risrel:v:237:y:2023:i:5:p:910-921. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.