IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v12y1992i1p83-93.html

Expert Judgment in Risk Analysis and Management: Process, Context, and Pitfalls

Author

Listed:
  • Harry Otway
  • Detlof von Winterfeldt

Abstract

The regulation and management of hazardous industrial activities increasingly rely on formal expert judgment processes to provide wisdom in areas of science and technology where traditional “good science” is, in practice, unable to supply unambiguous “facts.” Expert judgment has always played a significant, if often unrecognized, role in analysis; however, recent trends are to make it formal, explicit, and documented so it can be identified and reviewed by others. We propose four categories of expert judgment and present three case studies which illustrate some of the pitfalls commonly encountered in its use. We conclude that there will be an expanding policy role for formal expert judgment and that the openness, transparency, and documentation that it requires have implications for enhanced public involvement in scientific and technical affairs.

Suggested Citation

  • Harry Otway & Detlof von Winterfeldt, 1992. "Expert Judgment in Risk Analysis and Management: Process, Context, and Pitfalls," Risk Analysis, John Wiley & Sons, vol. 12(1), pages 83-93, March.
    • Handle: RePEc:wly:riskan:v:12:y:1992:i:1:p:83-93
    DOI: 10.1111/j.1539-6924.1992.tb01310.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1539-6924.1992.tb01310.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1539-6924.1992.tb01310.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Miley W. Merkhofer & Ralph L. Keeney, 1987. "A Multiattribute Utility Analysis of Alternative Sites for the Disposal of Nuclear Waste," Risk Analysis, John Wiley & Sons, vol. 7(2), pages 173-194, June.
    2. Martin Weber & Franz Eisenführ & Detlof von Winterfeldt, 1988. "The Effects of Splitting Attributes on Weights in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 34(4), pages 431-445, April.
    3. Harry Otway & Aniello Amendola, 1989. "Major Hazard Information Policy in the European Community: Implications for Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 9(4), pages 505-512, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Henrik Hassel & Alexander Cedergren, 2019. "Exploring the Conceptual Foundation of Continuity Management in the Context of Societal Safety," Risk Analysis, John Wiley & Sons, vol. 39(7), pages 1503-1519, July.
    2. Roland W. Scholz & Ralf Hansmann, 2007. "Combining Experts' Risk Judgments on Technology Performance of Phytoremediation: Self‐Confidence Ratings, Averaging Procedures, and Formative Consensus Building," Risk Analysis, John Wiley & Sons, vol. 27(1), pages 225-240, February.
    3. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    4. A. Procter & T. McDaniels & R. Vignola, 2017. "Using expert judgments to inform economic evaluation of ecosystem-based adaptation decisions: watershed management for enhancing water supply for Tegucigalpa, Honduras," Environment Systems and Decisions, Springer, vol. 37(4), pages 410-422, December.
    5. Brito, Mario & Griffiths, Gwyn, 2016. "A Bayesian approach for predicting risk of autonomous underwater vehicle loss during their missions," Reliability Engineering and System Safety, Elsevier, vol. 146(C), pages 55-67.
    6. Luca Podofillini & Vinh Dang & Enrico Zio & Piero Baraldi & Massimo Librizzi, 2010. "Using Expert Models in Human Reliability Analysis—A Dependence Assessment Method Based on Fuzzy Logic," Risk Analysis, John Wiley & Sons, vol. 30(8), pages 1277-1297, August.
    7. Gillenwater, Michael, 2013. "Probabilistic decision model of wind power investment and influence of green power market," Energy Policy, Elsevier, vol. 63(C), pages 1111-1125.
    8. Ine H. J. Van Der Fels‐Klerx & Louis H. J. Goossens & Helmut W. Saatkamp & Suzan H. S. Horst, 2002. "Elicitation of Quantitative Data from a Heterogeneous Expert Panel: Formal Process and Application in Animal Health," Risk Analysis, John Wiley & Sons, vol. 22(1), pages 67-81, February.
    9. Paoletti, J. Mitchell & Shortridge, Julie E., 2020. "Improved representation of uncertainty in farm-level financial cost-benefit analyses of supplemental irrigation in humid regions," Agricultural Water Management, Elsevier, vol. 239(C).
    10. John S. Evans & John D. Graham & George M. Gray & Robert L. Sielken, 1994. "A Distributional Approach to Characterizing Low‐Dose Cancer Risk," Risk Analysis, John Wiley & Sons, vol. 14(1), pages 25-34, February.
    11. A. H. S. Garmabaki & Adithya Thaduri & Stephen Famurewa & Uday Kumar, 2021. "Adapting Railway Maintenance to Climate Change," Sustainability, MDPI, vol. 13(24), pages 1-27, December.
    12. Prager, Fynnwin & Rhoads, Mohja & Martínez, Jose N., 2022. "The COVID-19 economic shutdown and the future of flexible workplace practices in the South Bay region of Los Angeles County," Transport Policy, Elsevier, vol. 125(C), pages 241-255.
    13. Damian Morgan & Joan Ozanne-Smith, 2019. "A configural model of expert judgement as a preliminary epidemiological study of injury problems: An application to drowning," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-17, October.
    14. Mario P. Brito & Ian G. J. Dawson, 2020. "Predicting the Validity of Expert Judgments in Assessing the Impact of Risk Mitigation Through Failure Prevention and Correction," Risk Analysis, John Wiley & Sons, vol. 40(10), pages 1928-1943, October.
    15. Hoffmann, Sandra & Fischbeck, Paul & Krupnick, Alan & McWilliams, Michael, 2008. "Informing risk-mitigation priorities using uncertainty measures derived from heterogeneous expert panels: A demonstration using foodborne pathogens," Reliability Engineering and System Safety, Elsevier, vol. 93(5), pages 687-698.
    16. Radboud J. Duintjer Tebbens & Mark A. Pallansch & Konstantin M. Chumakov & Neal A. Halsey & Tapani Hovi & Philip D. Minor & John F. Modlin & Peter A. Patriarca & Roland W. Sutter & Peter F. Wright & S, 2013. "Review and Assessment of Poliovirus Immunity and Transmission: Synthesis of Knowledge Gaps and Identification of Research Needs," Risk Analysis, John Wiley & Sons, vol. 33(4), pages 606-646, April.
    17. Julia Reis & Julie Shortridge, 2020. "Impact of Uncertainty Parameter Distribution on Robust Decision Making Outcomes for Climate Change Adaptation under Deep Uncertainty," Risk Analysis, John Wiley & Sons, vol. 40(3), pages 494-511, March.
    18. Mario Paulo Brito & Gwyn Griffiths & Peter Challenor, 2010. "Risk Analysis for Autonomous Underwater Vehicle Operations in Extreme Environments," Risk Analysis, John Wiley & Sons, vol. 30(12), pages 1771-1788, December.
    19. Roland W. Scholz & Yann B. Blumer & Fridolin S. Brand, 2012. "Risk, vulnerability, robustness, and resilience from a decision-theoretic perspective," Journal of Risk Research, Taylor & Francis Journals, vol. 15(3), pages 313-330, March.
    20. Gregory F. Nemet & Laura Diaz Anadon & Elena Verdolini, 2017. "Quantifying the Effects of Expert Selection and Elicitation Design on Experts’ Confidence in Their Judgments About Future Energy Technologies," Risk Analysis, John Wiley & Sons, vol. 37(2), pages 315-330, February.
    21. George M. Gray & Jon C. Allen & David E. Burmaster & Stuart H. Gage & James K. Hammitt & Stanley Kaplan & Ralph L. Keeney & Joseph G. Morse & D. Warner North & Jan P. Nyrop & Alina Stahevitch & Richar, 1998. "Principles for Conduct of Pest Risk Analyses: Report of an Expert Work hop," Risk Analysis, John Wiley & Sons, vol. 18(6), pages 773-780, December.
    22. Sjöberg, Lennart, 2003. "Risk communication between experts and the public: perceptions and intentions," SSE/EFI Working Paper Series in Business Administration 2003:13, Stockholm School of Economics.
    23. Robert J. Budnitz & George Apostolakis & David M. Boore & Lloyd S. Cluff & Kevin J. Coppersmith & C. Allin Cornell & Peter A. Morris, 1998. "Use of Technical Expert Panels: Applications to Probabilistic Seismic Hazard Analysis," Risk Analysis, John Wiley & Sons, vol. 18(4), pages 463-469, August.
    24. Justin M. Ross & Sarah E. Larson & Chad Wall, 2012. "Are Surveys Of Experts Unbiased? Evidence From College Football Rankings," Contemporary Economic Policy, Western Economic Association International, vol. 30(4), pages 502-522, October.
    25. Mostafa Aliyari & Yonas Z Ayele & Abbas Barabadi & Enrique Lopez Droguett, 2019. "Risk analysis in low-voltage distribution systems," Journal of Risk and Reliability, , vol. 233(2), pages 118-138, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Craig R. Fox & Robert T. Clemen, 2005. "Subjective Probability Assessment in Decision Analysis: Partition Dependence and Bias Toward the Ignorance Prior," Management Science, INFORMS, vol. 51(9), pages 1417-1432, September.
    2. Lai, Po‐Lin & Potter, Andrew & Beynon, Malcolm & Beresford, Anthony, 2015. "Evaluating the efficiency performance of airports using an integrated AHP/DEA-AR technique," Transport Policy, Elsevier, vol. 42(C), pages 75-85.
    3. Dertwinkel-Kalt, Markus & Köster, Mats, 2015. "Violations of first-order stochastic dominance as salience effects," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 59(C), pages 42-46.
    4. Lahtinen, Tuomas J. & Hämäläinen, Raimo P., 2016. "Path dependence and biases in the even swaps decision analysis method," European Journal of Operational Research, Elsevier, vol. 249(3), pages 890-898.
    5. David A. Hensher, 2006. "How do respondents process stated choice experiments? Attribute consideration under varying information load," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 861-878, September.
    6. Rex Brown, 2005. "The Operation Was a Success but the Patient Died: Aider Priorities Influence Decision Aid Usefulness," Interfaces, INFORMS, vol. 35(6), pages 511-521, December.
    7. Ralph L. Keeney, 1995. "Understanding Life‐Threatening Risks," Risk Analysis, John Wiley & Sons, vol. 15(6), pages 627-637, December.
    8. Vincent T. Covello, 1987. "Decision Analysis and Risk Management Decision Making: Issues and Methods," Risk Analysis, John Wiley & Sons, vol. 7(2), pages 131-139, June.
    9. Howard Kunreuther & Douglas Easterling & William Desvousges & Paul Slovic, 1990. "Public Attitudes Toward Siting a High‐Level Nuclear Waste Repository in Nevada," Risk Analysis, John Wiley & Sons, vol. 10(4), pages 469-484, December.
    10. Steven J. Humphrey & Luke Lindsay & Chris Starmer, 2017. "Consumption experience, choice experience and the endowment effect," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(2), pages 109-120, December.
    11. Robin L. Dillon & Vicki M. Bier & Richard Sheffield John & Abdullah Althenayyan, 2023. "Closing the Gap Between Decision Analysis and Policy Analysts Before the Next Pandemic," Decision Analysis, INFORMS, vol. 20(2), pages 109-132, June.
    12. Yousaf Ali & Zain Aslam & Hammad Sajid Dar & UbaidUllah Mumtaz, 2018. "A multi-criteria decision analysis of solid waste treatment options in Pakistan: Lahore City—a case in point," Environment Systems and Decisions, Springer, vol. 38(4), pages 528-543, December.
    13. Francesco Galioto & Chiara Paffarini & Massimo Chiorri & Biancamaria Torquati & Lucio Cecchini, 2017. "Economic, Environmental, and Animal Welfare Performance on Livestock Farms: Conceptual Model and Application to Some Case Studies in Italy," Sustainability, MDPI, vol. 9(9), pages 1-22, September.
    14. Doyle, J. R. & Arthurs, A. J. & Green, R. H. & McAulay, L. & Pitt, M. R. & Bottomley, P. A. & Evans, W., 1996. "The judge, the model of the judge, and the model of the judged as judge: Analyses of the UK 1992 research assessment exercise data for business and management studies," Omega, Elsevier, vol. 24(1), pages 13-28, February.
    15. Mustajoki, Jyri, 2012. "Effects of imprecise weighting in hierarchical preference programming," European Journal of Operational Research, Elsevier, vol. 218(1), pages 193-201.
    16. Michael H. Birnbaum & Ulrich Schmidt & Miriam D. Schneider, 2017. "Testing independence conditions in the presence of errors and splitting effects," Journal of Risk and Uncertainty, Springer, vol. 54(1), pages 61-85, February.
    17. Joseé CM. Van Eijndhoven & Rob A.P.M. Weterings & Cor W. Worrell & Joop de Boer & Joop van der Pligt & Pieter‐Jan M. Stallen, 1994. "Risk Communication in The Netherlands: The Monitored Introduction of the EC “Post‐Seveso” Directive," Risk Analysis, John Wiley & Sons, vol. 14(1), pages 87-96, February.
    18. John C. Butler & James S. Dyer & Jianmin Jia, 2006. "Using Attributes to Predict Objectives in Preference Models," Decision Analysis, INFORMS, vol. 3(2), pages 100-116, June.
    19. Yan Sun & Shu Li & Nicolao Bonini & Yang Liu, 2016. "Effect of Graph Scale on Risky Choice: Evidence from Preference and Process in Decision-Making," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-12, January.
    20. Strager, Michael P. & Rosenberger, Randall S., 2006. "Incorporating stakeholder preferences for land conservation: Weights and measures in spatial MCA," Ecological Economics, Elsevier, vol. 57(4), pages 627-639, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:12:y:1992:i:1:p:83-93. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.