IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v191y2019ics0951832018312456.html
   My bibliography  Save this article

A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science

Author

Listed:
  • Groth, Katrina M.
  • Smith, Reuel
  • Moradi, Ramin

Abstract

Over the past 10 years, there have been significant international efforts to modernize Human Reliability Analysis (HRA), with most efforts focused on one of two directions: developing new sources of HRA data from control room simulators, and developing new HRA methods based in cognitive science. However, these efforts have proceeded largely independently, and there has been little research into how to leverage these scientific advances in data together with the scientific advances in modeling and methods. This is a significant gap for HRA, and motivates a need for methodologies to unify the efforts of the modeling and data collection communities. In this paper we define a comprehensive hybrid algorithm for using causal models and multiple types of HRA data to provide a rigorous quantitative basis for cognitively based Human Reliability Analysis (HRA) methods such as PHOENIX and IDHEAS. The algorithm uses causal models built from and parameterized by a combination of data from cognitive literature, systems engineering, existing HRA methods, simulator data, and expert elicitation. The main elements of the hybrid algorithm include a comprehensive set of causal factors, human–machine team tasks and events, Bayesian Network causal models, and Bayesian parameter updating methods. The algorithm enhances both the qualitative and the quantitative basis of HRA, adding significant scientific depth and technical traceability to the highly complicated problem of modeling human–machine team failures in complex engineering systems.

Suggested Citation

  • Groth, Katrina M. & Smith, Reuel & Moradi, Ramin, 2019. "A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
  • Handle: RePEc:eee:reensy:v:191:y:2019:i:c:s0951832018312456
    DOI: 10.1016/j.ress.2019.106507
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832018312456
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2019.106507?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James Chang, Y. & Bley, Dennis & Criscione, Lawrence & Kirwan, Barry & Mosleh, Ali & Madary, Todd & Nowell, Rodney & Richards, Robert & Roth, Emilie M. & Sieben, Scott & Zoulis, Antonios, 2014. "The SACADA database for human reliability and human performance," Reliability Engineering and System Safety, Elsevier, vol. 125(C), pages 117-133.
    2. Liao, Huafei & Groth, Katrina & Stevens-Adams, Susan, 2015. "Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method," Reliability Engineering and System Safety, Elsevier, vol. 144(C), pages 159-169.
    3. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1041-1060.
    4. Ekanem, Nsimah J. & Mosleh, Ali & Shen, Song-Hua, 2016. "Phoenix – A model-based Human Reliability Analysis methodology: Qualitative Analysis Procedure," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 301-315.
    5. Katrina M Groth & Ali Mosleh, 2012. "Deriving causal Bayesian networks from human reliability analysis data: A methodology and example model," Journal of Risk and Reliability, , vol. 226(4), pages 361-379, August.
    6. Park, Jinkyun & Jung, Wondea, 2007. "OPERA—a human performance database under simulated emergencies of nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 92(4), pages 503-519.
    7. Mkrtchyan, L. & Podofillini, L. & Dang, V.N., 2015. "Bayesian belief networks for human reliability analysis: A review of applications and gaps," Reliability Engineering and System Safety, Elsevier, vol. 139(C), pages 1-16.
    8. Ross D. Shachter, 1986. "Evaluating Influence Diagrams," Operations Research, INFORMS, vol. 34(6), pages 871-882, December.
    9. Kim, Yochan & Park, Jinkyun & Jung, Wondea, 2017. "A classification scheme of erroneous behaviors for human error probability estimations based on simulator data," Reliability Engineering and System Safety, Elsevier, vol. 163(C), pages 1-13.
    10. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1076-1101.
    11. Zwirglmaier, Kilian & Straub, Daniel & Groth, Katrina M., 2017. "Capturing cognitive causal paths in human reliability analysis with Bayesian network models," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 117-129.
    12. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 2: IDAC performance influencing factors model," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1014-1040.
    13. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 4: IDAC causal model of operator problem-solving response," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1061-1075.
    14. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 997-1013.
    15. Groth, Katrina M. & Smith, Curtis L. & Swiler, Laura P., 2014. "A Bayesian method for using simulator data to enhance human error probabilities assigned by existing HRA methods," Reliability Engineering and System Safety, Elsevier, vol. 128(C), pages 32-40.
    16. Groth, Katrina M. & Mosleh, Ali, 2012. "A data-informed PIF hierarchy for model-based Human Reliability Analysis," Reliability Engineering and System Safety, Elsevier, vol. 108(C), pages 154-174.
    17. Groth, Katrina M. & Swiler, Laura P., 2013. "Bridging the gap between HRA research and HRA practice: A Bayesian network version of SPAR-H," Reliability Engineering and System Safety, Elsevier, vol. 115(C), pages 33-42.
    18. Kim, Yochan & Park, Jinkyun & Jung, Wondea & Choi, Sun Yeong & Kim, Seunghwan, 2018. "Estimating the quantitative relation between PSFs and HEPs from full-scope simulator data," Reliability Engineering and System Safety, Elsevier, vol. 173(C), pages 12-22.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Moradi, Ramin & Cofre-Martel, Sergio & Lopez Droguett, Enrique & Modarres, Mohammad & Groth, Katrina M., 2022. "Integration of deep learning and Bayesian networks for condition and operation risk monitoring of complex engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    2. Paglioni, Vincent P. & Groth, Katrina M., 2022. "Dependency definitions for quantitative human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    3. Wu, Bing & Yip, Tsz Leung & Yan, Xinping & Guedes Soares, C., 2022. "Review of techniques and challenges of human and organizational factors analysis in maritime transportation," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    4. Abrishami, Shokoufeh & Khakzad, Nima & Hosseini, Seyed Mahmoud, 2020. "A data-based comparison of BN-HRA models in assessing human error probability: An offshore evacuation case study," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    5. Morais, Caroline & Estrada-Lugo, Hector Diego & Tolo, Silvia & Jacques, Tiago & Moura, Raphael & Beer, Michael & Patelli, Edoardo, 2022. "Robust data-driven human reliability analysis using credal networks," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    6. Abreu, Danilo T.M.P. & Maturana, Marcos C. & Droguett, Enrique Lopez & Martins, Marcelo R., 2022. "Human reliability analysis of conventional maritime pilotage operations supported by a prospective model," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    7. Robinson, Allen C. & Drake, Richard R. & Swan, M. Scot & Bennett, Nichelle L. & Smith, Thomas M. & Hooper, Russell & Laity, George R., 2021. "A software environment for effective reliability management for pulsed power design," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    8. Maturana, Marcos Coelho & Martins, Marcelo Ramos & Frutuoso e Melo, Paulo Fernando Ferreira, 2021. "Application of a quantitative human performance model to the operational procedure design of a fuel storage pool cooling system," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    9. Stephen Thomas & Katrina M Groth, 2023. "Toward a hybrid causal framework for autonomous vehicle safety analysis," Journal of Risk and Reliability, , vol. 237(2), pages 367-388, April.
    10. Park, Jooyoung & Boring, Ronald L. & Ulrich, Thomas A. & Lew, Roger & Lee, Sungheon & Park, Bumjun & Kim, Jonghyun, 2022. "A framework to collect human reliability analysis data for nuclear power plants using a simplified simulator and student operators," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    11. Zhou, Jian-Lan & Lei, Yi, 2020. "A slim integrated with empirical study and network analysis for human error assessment in the railway driving process," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    12. Xu, Yanwen & Kohtz, Sara & Boakye, Jessica & Gardoni, Paolo & Wang, Pingfeng, 2023. "Physics-informed machine learning for reliability and systems safety applications: State of the art and challenges," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    13. Podofillini, Luca & Reer, Bernhard & Dang, Vinh N., 2023. "A traceable process to develop Bayesian networks from scarce data and expert judgment: A human reliability analysis application," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    14. Li, Jue & Li, Heng & Wang, Fan & Cheng, Andy S.K. & Yang, Xincong & Wang, Hongwei, 2021. "Proactive analysis of construction equipment operators’ hazard perception error based on cognitive modeling and a dynamic Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    15. Podofillini, Luca & Reer, Bernhard & Dang, Vinh N., 2021. "Analysis of recent operational events involving inappropriate actions: influencing factors and root causes," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    16. Chen, Shuai & Zhang, Li & Qing, Tao, 2021. "A human reliability analysis methodology based on an extended Phoenix method for severe accidents in nuclear power plants: Qualitative analysis framework," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    17. Garg, Vipul & Vinod, Gopika & Prasad, Mahendra & Chattopadhyay, J. & Smith, Curtis & Kant, Vivek, 2023. "Human reliability analysis studies from simulator experiments using Bayesian inference," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    18. Asadayoobi, N. & Taghipour, S. & Jaber, M.Y., 2022. "Predicting human reliability based on probabilistic mission completion time using Bayesian Network," Reliability Engineering and System Safety, Elsevier, vol. 221(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 1 — methodology," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    2. Shirley, Rachel Benish & Smidts, Carol & Zhao, Yunfei, 2020. "Development of a quantitative Bayesian network mapping objective factors to subjective performance shaping factor evaluations: An example using student operators in a digital nuclear power plant simul," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    3. Li, Jue & Li, Heng & Wang, Fan & Cheng, Andy S.K. & Yang, Xincong & Wang, Hongwei, 2021. "Proactive analysis of construction equipment operators’ hazard perception error based on cognitive modeling and a dynamic Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    4. Zarei, Esmaeil & Khan, Faisal & Abbassi, Rouzbeh, 2021. "Importance of human reliability in process operation: A critical analysis," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    5. Jung, Wondea & Park, Jinkyun & Kim, Yochan & Choi, Sun Yeong & Kim, Seunghwan, 2020. "HuREX – A framework of HRA data collection from simulators in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    6. Paglioni, Vincent P. & Groth, Katrina M., 2022. "Dependency definitions for quantitative human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    7. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 2 — Application," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    8. Abrishami, Shokoufeh & Khakzad, Nima & Hosseini, Seyed Mahmoud & van Gelder, Pieter, 2020. "BN-SLIM: A Bayesian Network methodology for human reliability assessment based on Success Likelihood Index Method (SLIM)," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    9. Zwirglmaier, Kilian & Straub, Daniel & Groth, Katrina M., 2017. "Capturing cognitive causal paths in human reliability analysis with Bayesian network models," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 117-129.
    10. Wang, Lijing & Wang, Yanlong & Chen, Yingchun & Pan, Xing & Zhang, Wenjin & Zhu, Yanzhi, 2020. "Methodology for assessing dependencies between factors influencing airline pilot performance reliability: A case of taxiing tasks," Journal of Air Transport Management, Elsevier, vol. 89(C).
    11. Al-Douri, Ahmad & Levine, Camille S. & Groth, Katrina M., 2023. "Identifying human failure events (HFEs) for external hazard probabilistic risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    12. Zhang, Xiaoge & Mahadevan, Sankaran & Lau, Nathan & Weinger, Matthew B., 2020. "Multi-source information fusion to assess control room operator performance," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    13. Mkrtchyan, L. & Podofillini, L. & Dang, V.N., 2015. "Bayesian belief networks for human reliability analysis: A review of applications and gaps," Reliability Engineering and System Safety, Elsevier, vol. 139(C), pages 1-16.
    14. Griffith, Candice D. & Mahadevan, Sankaran, 2015. "Human reliability under sleep deprivation: Derivation of performance shaping factor multipliers from empirical data," Reliability Engineering and System Safety, Elsevier, vol. 144(C), pages 23-34.
    15. Ekanem, Nsimah J. & Mosleh, Ali & Shen, Song-Hua, 2016. "Phoenix – A model-based Human Reliability Analysis methodology: Qualitative Analysis Procedure," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 301-315.
    16. Wang, Zengkai & Zeng, Shengkui & Guo, Jianbin & Che, Haiyang, 2021. "A Bayesian network for reliability assessment of man-machine phased-mission system considering the phase dependencies of human cognitive error," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    17. Abílio Ramos, M. & López Droguett, E. & Mosleh, A. & Das Chagas Moura, M., 2020. "A human reliability analysis methodology for oil refineries and petrochemical plants operation: Phoenix-PRO qualitative framework," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    18. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zhang, Li & Liu, Xueyang & Ding, Qianqiao & Qin, Zhuomin & ÄŒepin, Marko, 2021. "Analysis of dependencies among performance shaping factors in human reliability analysis based on a system dynamics approach," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    19. Kim, Yochan & Park, Jinkyun & Jung, Wondea, 2017. "A classification scheme of erroneous behaviors for human error probability estimations based on simulator data," Reliability Engineering and System Safety, Elsevier, vol. 163(C), pages 1-13.
    20. Maturana, Marcos Coelho & Martins, Marcelo Ramos & Frutuoso e Melo, Paulo Fernando Ferreira, 2021. "Application of a quantitative human performance model to the operational procedure design of a fuel storage pool cooling system," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:191:y:2019:i:c:s0951832018312456. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.