IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v213y2021ics095183202100301x.html
   My bibliography  Save this article

CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 2 — Application

Author

Listed:
  • Zhao, Yunfei
  • Smidts, Carol

Abstract

Human operators play a critical role in the operation of complex engineered systems, in particular under abnormal conditions. It is important to assess human performance under conditions of interest and to improve upon the performance by taking effective measures. In this paper we present the application of a previously developed cognitive modeling and simulation environment to address these two problems. The developed environment simulates how a human operator dynamically interacts with the external system, with focus on the operator’s cognitive activities. Based on the Three Mile Island accident, specifically the stuck-open failure of the pilot operated relief valve, we demonstrate how the developed environment can be used for human reliability analysis and human performance improvement. For human reliability analysis, besides providing a single human error probability value the proposed environment allows us to examine in detail how an operator reached a decision or missed an action. For human performance improvement, the proposed environment provides an easy approach for investigating the effects of changes, for example, in operator training and system design, on human performance and therefore identifying the most effective changes to improve human performance.

Suggested Citation

  • Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 2 — Application," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
  • Handle: RePEc:eee:reensy:v:213:y:2021:i:c:s095183202100301x
    DOI: 10.1016/j.ress.2021.107775
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S095183202100301X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107775?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James Chang, Y. & Bley, Dennis & Criscione, Lawrence & Kirwan, Barry & Mosleh, Ali & Madary, Todd & Nowell, Rodney & Richards, Robert & Roth, Emilie M. & Sieben, Scott & Zoulis, Antonios, 2014. "The SACADA database for human reliability and human performance," Reliability Engineering and System Safety, Elsevier, vol. 125(C), pages 117-133.
    2. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1041-1060.
    3. Ekanem, Nsimah J. & Mosleh, Ali & Shen, Song-Hua, 2016. "Phoenix – A model-based Human Reliability Analysis methodology: Qualitative Analysis Procedure," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 301-315.
    4. Jung, Wondea & Park, Jinkyun & Kim, Yochan & Choi, Sun Yeong & Kim, Seunghwan, 2020. "HuREX – A framework of HRA data collection from simulators in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    5. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 2: IDAC performance influencing factors model," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1014-1040.
    6. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 4: IDAC causal model of operator problem-solving response," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1061-1075.
    7. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 997-1013.
    8. Greco, Salvatore F. & Podofillini, Luca & Dang, Vinh N., 2021. "A Bayesian model to treat within-category and crew-to-crew variability in simulator data for Human Reliability Analysis," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    9. Petrit (Pete) Dode & Michael Greig & Saeed Zolfaghari & W. Patrick Neumann, 2016. "Integrating human factors into discrete event simulation: a proactive approach to simultaneously design for system performance and employees’ well being," International Journal of Production Research, Taylor & Francis Journals, vol. 54(10), pages 3105-3117, May.
    10. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    11. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1076-1101.
    12. Zwirglmaier, Kilian & Straub, Daniel & Groth, Katrina M., 2017. "Capturing cognitive causal paths in human reliability analysis with Bayesian network models," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 117-129.
    13. Abílio Ramos, M. & López Droguett, E. & Mosleh, A. & Das Chagas Moura, M., 2020. "A human reliability analysis methodology for oil refineries and petrochemical plants operation: Phoenix-PRO qualitative framework," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    14. Burns, Kevin & Bonaceto, Craig, 2020. "An empirically benchmarked human reliability analysis of general aviation," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    15. Liu, Peng & Qiu, Yongping & Hu, Juntao & Tong, Jiejuan & Zhao, Jun & Li, Zhizhong, 2020. "Expert judgments for performance shaping Factors’ multiplier design in human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    16. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 1 — methodology," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    17. Shirley, Rachel Benish & Smidts, Carol & Zhao, Yunfei, 2020. "Development of a quantitative Bayesian network mapping objective factors to subjective performance shaping factor evaluations: An example using student operators in a digital nuclear power plant simul," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Yunfei, 2022. "A Bayesian approach to comparing human reliability analysis methods using human performance data," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    2. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 1 — methodology," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    3. Zhou, Jian-Lan & Yu, Ze-Tai & Xiao, Ren-Bin, 2022. "A large-scale group Success Likelihood Index Method to estimate human error probabilities in the railway driving process," Reliability Engineering and System Safety, Elsevier, vol. 228(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Yunfei & Smidts, Carol, 2021. "CMS-BN: A cognitive modeling and simulation environment for human performance assessment, part 1 — methodology," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    2. Zarei, Esmaeil & Khan, Faisal & Abbassi, Rouzbeh, 2021. "Importance of human reliability in process operation: A critical analysis," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    3. Groth, Katrina M. & Smith, Reuel & Moradi, Ramin, 2019. "A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    4. Li, Jue & Li, Heng & Wang, Fan & Cheng, Andy S.K. & Yang, Xincong & Wang, Hongwei, 2021. "Proactive analysis of construction equipment operators’ hazard perception error based on cognitive modeling and a dynamic Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    5. Al-Douri, Ahmad & Levine, Camille S. & Groth, Katrina M., 2023. "Identifying human failure events (HFEs) for external hazard probabilistic risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    6. Shirley, Rachel Benish & Smidts, Carol & Zhao, Yunfei, 2020. "Development of a quantitative Bayesian network mapping objective factors to subjective performance shaping factor evaluations: An example using student operators in a digital nuclear power plant simul," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    7. Wang, Zengkai & Zeng, Shengkui & Guo, Jianbin & Che, Haiyang, 2021. "A Bayesian network for reliability assessment of man-machine phased-mission system considering the phase dependencies of human cognitive error," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    8. Jung, Wondea & Park, Jinkyun & Kim, Yochan & Choi, Sun Yeong & Kim, Seunghwan, 2020. "HuREX – A framework of HRA data collection from simulators in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    9. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zhang, Li & Liu, Xueyang & Ding, Qianqiao & Qin, Zhuomin & ÄŒepin, Marko, 2021. "Analysis of dependencies among performance shaping factors in human reliability analysis based on a system dynamics approach," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    10. Maturana, Marcos Coelho & Martins, Marcelo Ramos & Frutuoso e Melo, Paulo Fernando Ferreira, 2021. "Application of a quantitative human performance model to the operational procedure design of a fuel storage pool cooling system," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    11. Ramos, M.A. & Thieme, Christoph A. & Utne, Ingrid B. & Mosleh, A., 2020. "Human-system concurrent task analysis for maritime autonomous surface ship operation and safety," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    12. Abrishami, Shokoufeh & Khakzad, Nima & Hosseini, Seyed Mahmoud & van Gelder, Pieter, 2020. "BN-SLIM: A Bayesian Network methodology for human reliability assessment based on Success Likelihood Index Method (SLIM)," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    13. Zhang, Xiaoge & Mahadevan, Sankaran & Lau, Nathan & Weinger, Matthew B., 2020. "Multi-source information fusion to assess control room operator performance," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    14. Ekanem, Nsimah J. & Mosleh, Ali & Shen, Song-Hua, 2016. "Phoenix – A model-based Human Reliability Analysis methodology: Qualitative Analysis Procedure," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 301-315.
    15. Abílio Ramos, M. & López Droguett, E. & Mosleh, A. & Das Chagas Moura, M., 2020. "A human reliability analysis methodology for oil refineries and petrochemical plants operation: Phoenix-PRO qualitative framework," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    16. Vaurio, Jussi K., 2009. "Human factors, human reliability and risk assessment in license renewal of a nuclear power plant," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1818-1826.
    17. París, C. & Queral, C. & Mula, J. & Gómez-Magán, J. & Sánchez-Perea, M. & Meléndez, E. & Gil, J., 2019. "Quantitative risk reduction by means of recovery strategies," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 13-32.
    18. Wang, Lijing & Wang, Yanlong & Chen, Yingchun & Pan, Xing & Zhang, Wenjin & Zhu, Yanzhi, 2020. "Methodology for assessing dependencies between factors influencing airline pilot performance reliability: A case of taxiing tasks," Journal of Air Transport Management, Elsevier, vol. 89(C).
    19. Di Pasquale, Valentina & Miranda, Salvatore & Iannone, Raffaele & Riemma, Stefano, 2015. "A Simulator for Human Error Probability Analysis (SHERPA)," Reliability Engineering and System Safety, Elsevier, vol. 139(C), pages 17-32.
    20. Bandeira, Michelle Carvalho Galvão Silva Pinto & Correia, Anderson Ribeiro & Martins, Marcelo Ramos, 2018. "General model analysis of aeronautical accidents involving human and organizational factors," Journal of Air Transport Management, Elsevier, vol. 69(C), pages 137-146.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:213:y:2021:i:c:s095183202100301x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.