IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v33y2013i8p1510-1531.html
   My bibliography  Save this article

The Quantitative Estimation of IT‐Related Risk Probabilities

Author

Listed:
  • Andrea Herrmann

Abstract

How well can people estimate IT‐related risk? Although estimating risk is a fundamental activity in software management and risk is the basis for many decisions, little is known about how well IT‐related risk can be estimated at all. Therefore, we executed a risk estimation experiment with 36 participants. They estimated the probabilities of IT‐related risks and we investigated the effect of the following factors on the quality of the risk estimation: the estimator's age, work experience in computing, (self‐reported) safety awareness and previous experience with this risk, the absolute value of the risk's probability, and the effect of knowing the estimates of the other participants (see: Delphi method). Our main findings are: risk probabilities are difficult to estimate. Younger and inexperienced estimators were not significantly worse than older and more experienced estimators, but the older and more experienced subjects better used the knowledge gained by knowing the other estimators' results. Persons with higher safety awareness tend to overestimate risk probabilities, but can better estimate ordinal ranks of risk probabilities. Previous own experience with a risk leads to an overestimation of its probability (unlike in other fields like medicine or disasters, where experience with a disease leads to more realistic probability estimates and nonexperience to an underestimation).

Suggested Citation

  • Andrea Herrmann, 2013. "The Quantitative Estimation of IT‐Related Risk Probabilities," Risk Analysis, John Wiley & Sons, vol. 33(8), pages 1510-1531, August.
    • Handle: RePEc:wly:riskan:v:33:y:2013:i:8:p:1510-1531
    DOI: 10.1111/risa.12001
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/risa.12001
    Download Restriction: no
    File URL: https://libkey.io/10.1111/risa.12001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lennart Sjöberg & Jana Fromm, 2001. "Information Technology Risks as Seen by the Public," Risk Analysis, John Wiley & Sons, vol. 21(3), pages 427-442, June.
    2. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    3. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    4. Oecd, 2004. "A Note on Benefit Security," Financial Market Trends, OECD Publishing, vol. 2004(1), pages 133-198.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anca M. Hanea & Marissa F. McBride & Mark A. Burgman & Bonnie C. Wintle, 2018. "The Value of Performance Weights and Discussion in Aggregated Expert Judgments," Risk Analysis, John Wiley & Sons, vol. 38(9), pages 1781-1794, September.
    2. Jiayuan Dong & Jiankan Liao & Xun Huan & Daniel Cooper, 2023. "Expert elicitation and data noise learning for material flow analysis using Bayesian inference," Journal of Industrial Ecology, Yale University, vol. 27(4), pages 1105-1122, August.
    3. Prommer, Lisa & Tiberius, Victor & Kraus, Sascha, 2020. "Exploring the future of startup leadership development," Journal of Business Venturing Insights, Elsevier, vol. 14(C).
    4. Bas Kolen & Matthijs Kok & Ira Helsloot & Bob Maaskant, 2013. "EvacuAid: A Probabilistic Model to Determine the Expected Loss of Life for Different Mass Evacuation Strategies During Flood Threats," Risk Analysis, John Wiley & Sons, vol. 33(7), pages 1312-1333, July.
    5. Meissner, Philip & Brands, Christian & Wulf, Torsten, 2017. "Quantifiying blind spots and weak signals in executive judgment: A structured integration of expert judgment into the scenario development process," International Journal of Forecasting, Elsevier, vol. 33(1), pages 244-253.
    6. Kenneth Gillingham & William D. Nordhaus & David Anthoff & Geoffrey Blanford & Valentina Bosetti & Peter Christensen & Haewon McJeon & John Reilly & Paul Sztorc, 2015. "Modeling Uncertainty in Climate Change: A Multi-Model Comparison," NBER Working Papers 21637, National Bureau of Economic Research, Inc.
    7. Fabio Salamanca-Buentello & Mary V Seeman & Abdallah S Daar & Ross E G Upshur, 2020. "The ethical, social, and cultural dimensions of screening for mental health in children and adolescents of the developing world," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-25, August.
    8. Prianto Budi Saptono & Gustofan Mahmud & Intan Pratiwi & Dwi Purwanto & Ismail Khozen & Muhamad Akbar Aditama & Siti Khodijah & Maria Eurelia Wayan & Rina Yuliastuty Asmara & Ferry Jie, 2023. "Development of Climate-Related Disclosure Indicators for Application in Indonesia: A Delphi Method Study," Sustainability, MDPI, vol. 15(14), pages 1-25, July.
    9. Avner Engel & Shalom Shachar, 2006. "Measuring and optimizing systems' quality costs and project duration," Systems Engineering, John Wiley & Sons, vol. 9(3), pages 259-280, September.
    10. Tsai, Ming-Chih, 2006. "Constructing a logistics tracking system for preventing smuggling risk of transit containers," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(6), pages 526-536, July.
    11. Heiskanen, Aleksi & Hurmekoski, Elias & Toppinen, Anne & Näyhä, Annukka, 2022. "Exploring the unknowns – State of the art in qualitative forest-based sector foresight research," Forest Policy and Economics, Elsevier, vol. 135(C).
    12. Lin, Tun & De Guzman, Franklin, 2007. "Tourism for pro-poor and sustainable growth: economic analysis of tourism projects," MPRA Paper 24994, University Library of Munich, Germany.
    13. Di Zio, Simone & Bolzan, Mario & Marozzi, Marco, 2021. "Classification of Delphi outputs through robust ranking and fuzzy clustering for Delphi-based scenarios," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    14. Litsiou, Konstantia & Polychronakis, Yiannis & Karami, Azhdar & Nikolopoulos, Konstantinos, 2022. "Relative performance of judgmental methods for forecasting the success of megaprojects," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1185-1196.
    15. Philip Rogiers & Stijn Viaene & Jan Leysen, 2020. "The digital future of internal staffing: A vision for transformational electronic human resource management," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 27(4), pages 182-196, October.
    16. Atanasov, Pavel & Witkowski, Jens & Ungar, Lyle & Mellers, Barbara & Tetlock, Philip, 2020. "Small steps to accuracy: Incremental belief updaters are better forecasters," Organizational Behavior and Human Decision Processes, Elsevier, vol. 160(C), pages 19-35.
    17. Yaniv, Ilan, 2011. "Group diversity and decision quality: Amplification and attenuation of the framing effect," International Journal of Forecasting, Elsevier, vol. 27(1), pages 41-49.
    18. Alyami, Saleh. H. & Rezgui, Yacine & Kwan, Alan, 2013. "Developing sustainable building assessment scheme for Saudi Arabia: Delphi consultation approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 43-54.
    19. Arkadiusz Wisniowski & Nico Keilman & Jakub Bijak & Solveig Christiansen & Jonathan J. Forster & Peter W.F Smith & James Raymer, 2012. "Augmenting migration statistics with expert knowledge," Norface Discussion Paper Series 2012005, Norface Research Programme on Migration, Department of Economics, University College London.
    20. Ngoy Kabemba S. & Mwiya Balimu & Mwanaumo Erastus & Chisumbe Sampa & Petere Gaida, 2023. "Factors Influencing Professional Indemnity Insurance Use in Construction Risk Management," Baltic Journal of Real Estate Economics and Construction Management, Sciendo, vol. 11(1), pages 199-220, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:33:y:2013:i:8:p:1510-1531. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.