IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v121y2014icp289-293.html
   My bibliography  Save this article

Comparison of task complexity measures for emergency operating procedures: Convergent validity and predictive validity

Author

Listed:
  • Liu, Peng
  • Li, Zhizhong

Abstract

Human performance while executing operating procedures is critically important for the safety of complex industrial systems. To predict and model human performance, several complexity measures have been developed. This study aims to compare the convergent validity and predictive validity of three existing complexity measures, step complexity (SC), task size, and task complexity (TC), using operator performance data collected from an emergency operating procedure (EOP) experiment. This comparative study shows that these measures have a high convergent validity with each other, most likely because all of them involve the size dimension of complexity. These measures and their sub-measures also have a high predictive validity for operation time and a moderate-to-high predictive validity for error rate, except the step logic complexity (SLC) measure, a component of the SC measure. SLC appears not to contribute to the predictive validity in the experimental EOPs. The use of visual, auditory, cognitive, and psychomotor (VACP) rating scales in the TC measure seems to be significantly beneficial for explaining the human error rate; however, these rating scales appear not to adequately reflect the complexity differences among the meta-operations in EOPs.

Suggested Citation

  • Liu, Peng & Li, Zhizhong, 2014. "Comparison of task complexity measures for emergency operating procedures: Convergent validity and predictive validity," Reliability Engineering and System Safety, Elsevier, vol. 121(C), pages 289-293.
    • Handle: RePEc:eee:reensy:v:121:y:2014:i:c:p:289-293
    DOI: 10.1016/j.ress.2013.09.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832013002639
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2013.09.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Griffith, Candice D. & Mahadevan, Sankaran, 2011. "Inclusion of fatigue effects in human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 96(11), pages 1437-1447.
    2. Xu, Song & Li, Zhizhong & Song, Fei & Luo, Wei & Zhao, Qianyi & Salvendy, Gavriel, 2009. "Influence of step complexity and presentation style on step performance of computerized emergency operating procedures," Reliability Engineering and System Safety, Elsevier, vol. 94(2), pages 670-674.
    3. Jinkyun Park, 2009. "The Complexity of Proceduralized Tasks," Springer Series in Reliability Engineering, Springer, number 978-1-84882-791-2, December.
    4. Ham, Dong-Han & Park, Jinkyun & Jung, Wondea, 2012. "Model-based identification and use of task complexity factors of human integrated systems," Reliability Engineering and System Safety, Elsevier, vol. 100(C), pages 33-47.
    5. Park, Jinkyun & Jung, Wondea, 2008. "A study on the validity of a task complexity measure for emergency operating procedures of nuclear power plants—Comparing task complexity scores with two sets of operator response time data obtained," Reliability Engineering and System Safety, Elsevier, vol. 93(4), pages 557-566.
    6. Park, Jinkyun & Jung, Wondea, 2007. "A study on the development of a task complexity measure for emergency operating procedures of nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1102-1116.
    7. Wood, Robert E., 1986. "Task complexity: Definition of the construct," Organizational Behavior and Human Decision Processes, Elsevier, vol. 37(1), pages 60-82, February.
    8. Xu, Song & Song, Fei & Li, Zhizhong & Zhao, Qianyi & Luo, Wei & He, Xuhong & Salvendy, Gavriel, 2008. "An ergonomics study of computerized emergency operating procedures: Presentation style, task complexity, and training level," Reliability Engineering and System Safety, Elsevier, vol. 93(10), pages 1500-1511.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zhang, Li & Liu, Xueyang & Ding, Qianqiao & Qin, Zhuomin & ÄŒepin, Marko, 2021. "Analysis of dependencies among performance shaping factors in human reliability analysis based on a system dynamics approach," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    2. Ke Niu & Wenbo Liu & Jia Zhang & Mengxuan Liang & Huimin Li & Yaqiong Zhang & Yihang Du, 2023. "A Task Complexity Analysis Method to Study the Emergency Situation under Automated Metro System," IJERPH, MDPI, vol. 20(3), pages 1-19, January.
    3. Liu, Peng & Lyu, Xi & Qiu, Yongping & He, Jiandong & Tong, Jiejuan & Zhao, Jun & Li, Zhizhong, 2017. "Identifying key performance shaping factors in digital main control rooms of nuclear power plants: A risk-based approach," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 264-275.
    4. Park, Jinkyun, 2014. "Investigating the TACOM measure as a general tool for quantifying the complexity of procedure guided tasks," Reliability Engineering and System Safety, Elsevier, vol. 129(C), pages 66-75.
    5. Hendrik Stouten & Andreas Größler, 2017. "Task Complexity in Individual Stock Control Tasks for Laboratory Experiments on Human Understanding of Dynamic Systems," Systems Research and Behavioral Science, Wiley Blackwell, vol. 34(1), pages 62-77, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ham, Dong-Han & Park, Jinkyun & Jung, Wondea, 2012. "Model-based identification and use of task complexity factors of human integrated systems," Reliability Engineering and System Safety, Elsevier, vol. 100(C), pages 33-47.
    2. Ge, Xiangyu & Zhou, Qianxiang & Liu, Zhongqi, 2020. "Assessment of space station on-orbit maintenance task complexity," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    3. Liu, Jianqiao & Zou, Yanhua & Wang, Wei & Zhang, Li & Liu, Xueyang & Ding, Qianqiao & Qin, Zhuomin & ÄŒepin, Marko, 2021. "Analysis of dependencies among performance shaping factors in human reliability analysis based on a system dynamics approach," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    4. Park, Jinkyun, 2014. "Investigating the TACOM measure as a general tool for quantifying the complexity of procedure guided tasks," Reliability Engineering and System Safety, Elsevier, vol. 129(C), pages 66-75.
    5. Jang, Inseok & Kim, Yochan & Park, Jinkyun, 2021. "Investigating the Effect of Task Complexity on the Occurrence of Human Errors observed in a Nuclear Power Plant Full-Scope Simulator," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    6. Peng Liu & Zhizhong Li, 2014. "Human Error Data Collection and Comparison with Predictions by SPAR‐H," Risk Analysis, John Wiley & Sons, vol. 34(9), pages 1706-1719, September.
    7. Venkataraghavan Krishnaswamy & R. P. Sundarraj, 2017. "Organizational implications of a comprehensive approach for cloud-storage sourcing," Information Systems Frontiers, Springer, vol. 19(1), pages 57-73, February.
    8. Kim, Yochan & Park, Jinkyun & Jung, Wondea & Jang, Inseok & Hyun Seong, Poong, 2015. "A statistical approach to estimating effects of performance shaping factors on human error probabilities of soft controls," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 378-387.
    9. Liu, Peng & Lyu, Xi & Qiu, Yongping & He, Jiandong & Tong, Jiejuan & Zhao, Jun & Li, Zhizhong, 2017. "Identifying key performance shaping factors in digital main control rooms of nuclear power plants: A risk-based approach," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 264-275.
    10. Hendrik Stouten & Andreas Größler, 2017. "Task Complexity in Individual Stock Control Tasks for Laboratory Experiments on Human Understanding of Dynamic Systems," Systems Research and Behavioral Science, Wiley Blackwell, vol. 34(1), pages 62-77, January.
    11. Liu, Peng & Qiu, Yongping & Hu, Juntao & Tong, Jiejuan & Zhao, Jun & Li, Zhizhong, 2020. "Expert judgments for performance shaping Factors’ multiplier design in human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 194(C).
    12. Zarei, Esmaeil & Khan, Faisal & Abbassi, Rouzbeh, 2021. "Importance of human reliability in process operation: A critical analysis," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    13. Matthijs J. Verhulst & Anne-Françoise Rutkowski, 2018. "Decision-Making in the Police Work Force: Affordances Explained in Practice," Group Decision and Negotiation, Springer, vol. 27(5), pages 827-852, October.
    14. Shahla Ghobadi & John Campbell & Stewart Clegg, 2017. "Pair programming teams and high-quality knowledge sharing: A comparative study of coopetitive reward structures," Information Systems Frontiers, Springer, vol. 19(2), pages 397-409, April.
    15. Odette M. Pinto, 2015. "Effects of Advice on Effectiveness and Efficiency of Tax Planning Tasks," Accounting Perspectives, John Wiley & Sons, vol. 14(4), pages 307-329, December.
    16. Stocks, Morris H. & Harrell, Adrian, 1995. "The impact of an increase in accounting information level on the judgment quality of individuals and groups," Accounting, Organizations and Society, Elsevier, vol. 20(7-8), pages 685-700.
    17. Gist, Marilyn E. & Stevens, Cynthia Kay, 1998. "Effects of Practice Conditions and Supplemental Training Method on Cognitive Learning and Interpersonal Skill Generalization," Organizational Behavior and Human Decision Processes, Elsevier, vol. 75(2), pages 142-169, August.
    18. Kim, Yochan & Park, Jinkyun & Jung, Wondea, 2017. "A quantitative measure of fitness for duty and work processes for human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 595-601.
    19. Hong Jiang & Wentao Liu & Lili Jia, 2019. "How Humble Leadership Influences the Innovation of Technology Standards: A Moderated Mediation Model," Sustainability, MDPI, vol. 11(19), pages 1-20, October.
    20. Fengchun Tang, 2020. "The more interactivity the better? Investigating interactivity, task complexity, and product knowledge in online purchase decisions," Information Technology and Management, Springer, vol. 21(3), pages 179-189, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:121:y:2014:i:c:p:289-293. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.