IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v202y2020ics0951832020305445.html
   My bibliography  Save this article

A data-based comparison of BN-HRA models in assessing human error probability: An offshore evacuation case study

Author

Listed:
  • Abrishami, Shokoufeh
  • Khakzad, Nima
  • Hosseini, Seyed Mahmoud

Abstract

Bayesian Network (BN) has been increasingly exploited to improve different aspects of Human Reliability Analysis (HRA), resulting in a new generation of HRA techniques, known as BN-HRA models. However, validating and evaluating the accuracy of BN-HRA models is still a challenging task. In this study, we have assessed and compared the performance of some of well-known BN-HRA techniques using human performance data obtained from an offshore evacuation simulation. Based on the role of data in quantifying the BN-HRA models, three categories of BN-HRA models have been considered: (i) BN-CREAM and BN-SPARH, which are based on predefined rules (rule-based methods), (ii) Bayesian Parameter Learning (BPL), which is entirely based on the available data (data-based method), and (iii) BN-SLIM model which is based on both the available data and the predefined rules (hybrid method). The results of the present study show that the data-based methods, i.e., BN-SLIM and BPL, in general outperform the rule-based methods. Cross-validation analysis further demonstrates the superiority of BN-SLIM over BPL, particularly in case of data scarcity.

Suggested Citation

  • Abrishami, Shokoufeh & Khakzad, Nima & Hosseini, Seyed Mahmoud, 2020. "A data-based comparison of BN-HRA models in assessing human error probability: An offshore evacuation case study," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
  • Handle: RePEc:eee:reensy:v:202:y:2020:i:c:s0951832020305445
    DOI: 10.1016/j.ress.2020.107043
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832020305445
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2020.107043?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Khakzad, Nima & Khan, Faisal & Amyotte, Paul, 2011. "Safety analysis in process facilities: Comparison of fault tree and Bayesian network approaches," Reliability Engineering and System Safety, Elsevier, vol. 96(8), pages 925-932.
    2. Trucco, P. & Cagno, E. & Ruggeri, F. & Grande, O., 2008. "A Bayesian Belief Network modelling of organisational factors in risk analysis: A case study in maritime transportation," Reliability Engineering and System Safety, Elsevier, vol. 93(6), pages 845-856.
    3. James Chang, Y. & Bley, Dennis & Criscione, Lawrence & Kirwan, Barry & Mosleh, Ali & Madary, Todd & Nowell, Rodney & Richards, Robert & Roth, Emilie M. & Sieben, Scott & Zoulis, Antonios, 2014. "The SACADA database for human reliability and human performance," Reliability Engineering and System Safety, Elsevier, vol. 125(C), pages 117-133.
    4. Bing Wu & Xinping Yan & Yang Wang & C. Guedes Soares, 2017. "An Evidential Reasoning‐Based CREAM to Human Reliability Analysis in Maritime Accident Process," Risk Analysis, John Wiley & Sons, vol. 37(10), pages 1936-1957, October.
    5. Mohaghegh, Zahra & Kazemi, Reza & Mosleh, Ali, 2009. "Incorporating organizational factors into Probabilistic Risk Assessment (PRA) of complex socio-technical systems: A hybrid technique formalization," Reliability Engineering and System Safety, Elsevier, vol. 94(5), pages 1000-1018.
    6. Ekanem, Nsimah J. & Mosleh, Ali & Shen, Song-Hua, 2016. "Phoenix – A model-based Human Reliability Analysis methodology: Qualitative Analysis Procedure," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 301-315.
    7. Bevilacqua, Maurizio & Ciarapica, Filippo Emanuele, 2018. "Human factor risk management in the process industry: A case study," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 149-159.
    8. Mkrtchyan, L. & Podofillini, L. & Dang, V.N., 2015. "Bayesian belief networks for human reliability analysis: A review of applications and gaps," Reliability Engineering and System Safety, Elsevier, vol. 139(C), pages 1-16.
    9. Podofillini, L. & Dang, V.N., 2013. "A Bayesian approach to treat expert-elicited probabilities in human reliability analysis model construction," Reliability Engineering and System Safety, Elsevier, vol. 117(C), pages 52-64.
    10. Park, Jinkyun & Kim, Yochan & Jung, Wondea, 2018. "Calculating nominal human error probabilities from the operation experience of domestic nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 170(C), pages 215-225.
    11. Musharraf, Mashrura & Bradbury-Squires, David & Khan, Faisal & Veitch, Brian & MacKinnon, Scott & Imtiaz, Syed, 2014. "A virtual experimental technique for data collection for a Bayesian network approach to human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 132(C), pages 1-8.
    12. Groth, Katrina M. & Smith, Reuel & Moradi, Ramin, 2019. "A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    13. Abrishami, Shokoufeh & Khakzad, Nima & Hosseini, Seyed Mahmoud & van Gelder, Pieter, 2020. "BN-SLIM: A Bayesian Network methodology for human reliability assessment based on Success Likelihood Index Method (SLIM)," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    14. Groth, Katrina M. & Mosleh, Ali, 2012. "A data-informed PIF hierarchy for model-based Human Reliability Analysis," Reliability Engineering and System Safety, Elsevier, vol. 108(C), pages 154-174.
    15. Groth, Katrina M. & Swiler, Laura P., 2013. "Bridging the gap between HRA research and HRA practice: A Bayesian network version of SPAR-H," Reliability Engineering and System Safety, Elsevier, vol. 115(C), pages 33-42.
    16. Noroozi, Alireza & Khakzad, Nima & Khan, Faisal & MacKinnon, Scott & Abbassi, Rouzbeh, 2013. "The role of human error in risk analysis: Application to pre- and post-maintenance procedures of process facilities," Reliability Engineering and System Safety, Elsevier, vol. 119(C), pages 251-258.
    17. Khakzad, Nima & Van Gelder, Pieter, 2018. "Vulnerability of industrial plants to flood-induced natechs: A Bayesian network approach," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 403-411.
    18. Kim, Man Cheol & Seong, Poong Hyun & Hollnagel, Erik, 2006. "A probabilistic approach for determining the control mode in CREAM," Reliability Engineering and System Safety, Elsevier, vol. 91(2), pages 191-199.
    19. Mojgan Aalipour & Yonas Zewdu Ayele & Abbas Barabadi, 2016. "Human reliability assessment (HRA) in maintenance of production process: a case study," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 7(2), pages 229-238, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Xinjian & Xia, Guoqing & Zhao, Jian & Wang, Jin & Yang, Zaili & Loughney, Sean & Fang, Siming & Zhang, Shukai & Xing, Yongheng & Liu, Zhengjiang, 2023. "A novel method for the risk assessment of human evacuation from cruise ships in maritime transportation," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    2. Bhardwaj, U. & Teixeira, A.P. & Guedes Soares, C. & Ariffin, A.K. & Singh, S.S., 2021. "Evidence based risk analysis of fire and explosion accident scenarios in FPSOs," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    3. Liu, Zhichen & Li, Ying & Zhang, Zhaoyi & Yu, Wenbo, 2022. "A new evacuation accessibility analysis approach based on spatial information," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    4. Xu, Yanwen & Kohtz, Sara & Boakye, Jessica & Gardoni, Paolo & Wang, Pingfeng, 2023. "Physics-informed machine learning for reliability and systems safety applications: State of the art and challenges," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    5. Zarei, Esmaeil & Khan, Faisal & Abbassi, Rouzbeh, 2021. "Importance of human reliability in process operation: A critical analysis," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    6. Catelani, Marcantonio & Ciani, Lorenzo & Guidi, Giulia & Patrizi, Gabriele, 2021. "An enhanced SHERPA (E-SHERPA) method for human reliability analysis in railway engineering," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    7. Sezer, Sukru Ilke & Akyuz, Emre & Arslan, Ozcan, 2022. "An extended HEART Dempster–Shafer evidence theory approach to assess human reliability for the gas freeing process on chemical tankers," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    8. Fan, Shiqi & Yang, Zaili, 2024. "Accident data-driven human fatigue analysis in maritime transport using machine learning," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    9. Liu, Hu-Chen & Wang, Jing-Hui & Zhang, Ling & Zhang, Qi-Zhen, 2022. "New success likelihood index model for large group human reliability analysis considering noncooperative behaviors and social network," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    10. Hu, Yunwei & Parhizkar, Tarannom & Mosleh, Ali, 2022. "Guided simulation for dynamic probabilistic risk assessment of complex systems: Concept, method, and application," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    11. Panjapornpon, Chanin & Bardeeniz, Santi & Hussain, Mohamed Azlan, 2023. "Deep learning approach for energy efficiency prediction with signal monitoring reliability for a vinyl chloride monomer process," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    12. Maturana, Marcos Coelho & Martins, Marcelo Ramos & Frutuoso e Melo, Paulo Fernando Ferreira, 2021. "Application of a quantitative human performance model to the operational procedure design of a fuel storage pool cooling system," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    13. Wang, Xinjian & Liu, Zhengjiang & Loughney, Sean & Yang, Zaili & Wang, Yanfu & Wang, Jin, 2022. "Numerical analysis and staircase layout optimisation for a Ro-Ro passenger ship during emergency evacuation," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    14. Asadayoobi, N. & Taghipour, S. & Jaber, M.Y., 2022. "Predicting human reliability based on probabilistic mission completion time using Bayesian Network," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    15. Kim, Yochan & Park, Jinkyun & Presley, Mary, 2021. "Selecting significant contextual factors and estimating their effects on operator reliability in computer-based control rooms," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    16. Zhou, Jian-Lan & Yu, Ze-Tai & Xiao, Ren-Bin, 2022. "A large-scale group Success Likelihood Index Method to estimate human error probabilities in the railway driving process," Reliability Engineering and System Safety, Elsevier, vol. 228(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Bing & Yip, Tsz Leung & Yan, Xinping & Guedes Soares, C., 2022. "Review of techniques and challenges of human and organizational factors analysis in maritime transportation," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    2. Mkrtchyan, L. & Podofillini, L. & Dang, V.N., 2015. "Bayesian belief networks for human reliability analysis: A review of applications and gaps," Reliability Engineering and System Safety, Elsevier, vol. 139(C), pages 1-16.
    3. Patriarca, Riccardo & Ramos, Marilia & Paltrinieri, Nicola & Massaiu, Salvatore & Costantino, Francesco & Di Gravio, Giulio & Boring, Ronald Laurids, 2020. "Human reliability analysis: Exploring the intellectual structure of a research field," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    4. Paglioni, Vincent P. & Groth, Katrina M., 2022. "Dependency definitions for quantitative human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    5. Abrishami, Shokoufeh & Khakzad, Nima & Hosseini, Seyed Mahmoud & van Gelder, Pieter, 2020. "BN-SLIM: A Bayesian Network methodology for human reliability assessment based on Success Likelihood Index Method (SLIM)," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    6. Liu, Peng & Qiu, Yongping & Hu, Juntao & Tong, Jiejuan & Zhao, Jun & Li, Zhizhong, 2020. "Expert judgments for performance shaping Factors’ multiplier design in human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    7. Zarei, Esmaeil & Khan, Faisal & Abbassi, Rouzbeh, 2021. "Importance of human reliability in process operation: A critical analysis," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    8. Morais, Caroline & Estrada-Lugo, Hector Diego & Tolo, Silvia & Jacques, Tiago & Moura, Raphael & Beer, Michael & Patelli, Edoardo, 2022. "Robust data-driven human reliability analysis using credal networks," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    9. Kim, Yochan & Park, Jinkyun & Jung, Wondea, 2017. "A quantitative measure of fitness for duty and work processes for human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 595-601.
    10. Groth, Katrina M. & Smith, Reuel & Moradi, Ramin, 2019. "A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    11. Maturana, Marcos Coelho & Martins, Marcelo Ramos & Frutuoso e Melo, Paulo Fernando Ferreira, 2021. "Application of a quantitative human performance model to the operational procedure design of a fuel storage pool cooling system," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    12. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 1 — methodology," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    13. Podofillini, Luca & Reer, Bernhard & Dang, Vinh N., 2021. "Analysis of recent operational events involving inappropriate actions: influencing factors and root causes," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    14. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zio, Enrico & Yuan, Chengwei & Wang, Taorui & Jiang, Jianjun, 2022. "A Bayesian belief network framework for nuclear power plant human reliability analysis accounting for dependencies among performance shaping factors," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    15. Zhou, Jian-Lan & Yu, Ze-Tai & Xiao, Ren-Bin, 2022. "A large-scale group Success Likelihood Index Method to estimate human error probabilities in the railway driving process," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    16. Podofillini, Luca & Reer, Bernhard & Dang, Vinh N., 2023. "A traceable process to develop Bayesian networks from scarce data and expert judgment: A human reliability analysis application," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    17. Zwirglmaier, Kilian & Straub, Daniel & Groth, Katrina M., 2017. "Capturing cognitive causal paths in human reliability analysis with Bayesian network models," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 117-129.
    18. Chen, Shuai & Zhang, Li & Qing, Tao, 2021. "A human reliability analysis methodology based on an extended Phoenix method for severe accidents in nuclear power plants: Qualitative analysis framework," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    19. Pandya, Dhruv & Podofillini, Luca & Emert, Frank & Lomax, Antony J. & Dang, Vinh N. & Sansavini, Giovanni, 2020. "Quantification of a human reliability analysis method for radiotherapy applications based on expert judgment aggregation," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    20. Shirley, Rachel Benish & Smidts, Carol & Zhao, Yunfei, 2020. "Development of a quantitative Bayesian network mapping objective factors to subjective performance shaping factor evaluations: An example using student operators in a digital nuclear power plant simul," Reliability Engineering and System Safety, Elsevier, vol. 194(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:202:y:2020:i:c:s0951832020305445. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.