IDEAS home Printed from https://ideas.repec.org/a/inm/ordeca/v20y2023i2p109-132.html
   My bibliography  Save this article

Closing the Gap Between Decision Analysis and Policy Analysts Before the Next Pandemic

Author

Listed:
  • Robin L. Dillon

    (Georgetown University, Washington, District of Columbia 20057)

  • Vicki M. Bier

    (University of Wisconsin–Madison, Madison, Wisconsin 53706)

  • Richard Sheffield John

    (University of Southern California, Los Angeles, California 90007)

  • Abdullah Althenayyan

    (Columbia University, New York, New York 10027)

Abstract

Decision analysis (DA) is an explicitly prescriptive discipline that separates beliefs about uncertainties from value preferences in modeling to support decision making. Researchers have been advancing DA tools for the last 60 years to support decision makers handling complex decisions requiring subjective judgments. Recently, some DA researchers and practitioners wondered whether the difficult decisions made during the COVID-19 pandemic regarding testing, masking, closing and reopening businesses, allocating ventilators, and prioritizing vaccines would have been improved with more DA involvement. With its focus on quantifying uncertainties, value trade-offs, and risk attitudes, DA should have been a valuable tool for decision makers during the pandemic. To influence decisions, DA applications require interactions with policymakers and experts to construct formal representations of the decision frame, elicit uncertainties, and assess risk tolerances and trade-offs among competing objectives. Unfortunately, such involvement of decision analysts in the process of decision making and policy setting did not occur during much of the COVID-19 pandemic. This lack of participation may have been partly because many decision makers were unaware of when DA could be valuable in helping with the challenges of the COVID-19 pandemic. In addition, decision analysts were perhaps not sufficiently adept at inserting themselves into the policy process at critical junctures when their expertise could have been helpful.

Suggested Citation

  • Robin L. Dillon & Vicki M. Bier & Richard Sheffield John & Abdullah Althenayyan, 2023. "Closing the Gap Between Decision Analysis and Policy Analysts Before the Next Pandemic," Decision Analysis, INFORMS, vol. 20(2), pages 109-132, June.
  • Handle: RePEc:inm:ordeca:v:20:y:2023:i:2:p:109-132
    DOI: 10.1287/deca.2023.0468
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/deca.2023.0468
    Download Restriction: no

    File URL: https://libkey.io/10.1287/deca.2023.0468?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. James L. Corner & Craig W. Kirkwood, 1991. "Decision Analysis Applications in the Operations Research Literature, 1970–1989," Operations Research, INFORMS, vol. 39(2), pages 206-219, April.
    2. Niyazi Onur Bakır, 2008. "A Decision Tree Model for Evaluating Countermeasures to Secure Cargo at United States Southwestern Ports of Entry," Decision Analysis, INFORMS, vol. 5(4), pages 230-248, December.
    3. Martine J. Barons & Sophia K. Wright & Jim Q. Smith, 2018. "Eliciting Probabilistic Judgements for Integrating Decision Support Systems," International Series in Operations Research & Management Science, in: Luis C. Dias & Alec Morton & John Quigley (ed.), Elicitation, chapter 0, pages 445-478, Springer.
    4. Grace Guan & Yotam Dery & Matan Yechezkel & Irad Ben-Gal & Dan Yamin & Margaret L Brandeau, 2021. "Early detection of COVID-19 outbreaks using human mobility data," PLOS ONE, Public Library of Science, vol. 16(7), pages 1-17, July.
    5. Jonathan Karnon, 2020. "A Simple Decision Analysis of a Mandatory Lockdown Response to the COVID-19 Pandemic," Applied Health Economics and Health Policy, Springer, vol. 18(3), pages 329-331, June.
    6. Tom M. Logan & Seth D. Guikema, 2020. "Reframing Resilience: Equitable Access to Essential Services," Risk Analysis, John Wiley & Sons, vol. 40(8), pages 1538-1553, August.
    7. Seth G. Benzell & Avinash Collis & Christos Nicolaides, 2020. "Rationing social contact during the COVID-19 pandemic: Transmission risk and social benefits of US locations," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(26), pages 14642-14644, June.
    8. Loic BERGER & Nicolas BERGER & Valentina BOSETTI & Itzhak GILBOA & Lars Peter HANSEN & Christopher JARVIS & Massimo MARINACCI & Richard D. Smith, 2020. "Rational policymaking during a pandemic," Working Papers 2020-iRisk-01, IESEG School of Management.
    9. Miley W. Merkhofer & Ralph L. Keeney, 1987. "A Multiattribute Utility Analysis of Alternative Sites for the Disposal of Nuclear Waste," Risk Analysis, John Wiley & Sons, vol. 7(2), pages 173-194, June.
    10. Paul L. Ewing & William Tarantino & Gregory S. Parnell, 2006. "Use of Decision Analysis in the Army Base Realignment and Closure (BRAC) 2005 Military Value Analysis," Decision Analysis, INFORMS, vol. 3(1), pages 33-49, March.
    11. Gregory W. Fischer & Nirmala Damodaran & Kathryn B. Laskey & David Lincoln, 1987. "Preferences for Proxy Attributes," Management Science, INFORMS, vol. 33(2), pages 198-214, February.
    12. Ralph L. Keeney & Detlof von Winterfeldt & Thomas Eppel, 1990. "Eliciting Public Values for Complex Policy Decisions," Management Science, INFORMS, vol. 36(9), pages 1011-1030, September.
    13. Alan J. Brothers & Shas V. Mattigod & Denis M. Strachan & Gordon H. Beeman & Paul K. Kearns & Angelo Papa & Carlo Monti, 2009. "Resource-Limited Multiattribute Value Analysis of Alternatives for Immobilizing Radioactive Liquid Process Waste Stored in Saluggia, Italy," Decision Analysis, INFORMS, vol. 6(2), pages 98-114, June.
    14. Freya M Shearer & Robert Moss & Jodie McVernon & Joshua V Ross & James M McCaw, 2020. "Infectious disease pandemic planning and response: Incorporating decision analysis," PLOS Medicine, Public Library of Science, vol. 17(1), pages 1-12, January.
    15. Rex V. Brown, 2009. "Working with Policy Makers on Their Choices: A Decision Analyst Reminisces," Decision Analysis, INFORMS, vol. 6(1), pages 14-24, March.
    16. Haoxiang Yang & Özge Sürer & Daniel Duque & David P. Morton & Bismark Singh & Spencer J. Fox & Remy Pasco & Kelly Pierce & Paul Rathouz & Victoria Valencia & Zhanwei Du & Michael Pignone & Mark E. Esc, 2021. "Design of COVID-19 staged alert systems to ensure healthcare capacity with minimal closures," Nature Communications, Nature, vol. 12(1), pages 1-7, December.
    17. Matteo Ruggeri & Chiara Cadeddu & Paolo Roazzi & Donatella Mandolini & Mauro Grigioni & Marco Marchetti, 2020. "Multi–Criteria–Decision–Analysis (MCDA) for the Horizon Scanning of Health Innovations an Application to COVID 19 Emergency," IJERPH, MDPI, vol. 17(21), pages 1-9, October.
    18. James E. Smith, 2004. "Risk Sharing, Fiduciary Duty, and Corporate Risk Attitudes," Decision Analysis, INFORMS, vol. 1(2), pages 114-127, June.
    19. Naraphorn Haphuriwat & Vicki M. Bier & Henry H. Willis, 2011. "Deterring the Smuggling of Nuclear Weapons in Container Freight Through Detection and Retaliation," Decision Analysis, INFORMS, vol. 8(2), pages 88-102, June.
    20. Robin L. Dillon & Richard John & Detlof von Winterfeldt, 2002. "Assessment of Cost Uncertainties for Large Technology Projects: A Methodology and an Application," Interfaces, INFORMS, vol. 32(4), pages 52-66, August.
    21. Simon Risanger & Bismark Singh & David Morton & Lauren Ancel Meyers, 2021. "Selecting pharmacies for COVID-19 testing to ensure access," Health Care Management Science, Springer, vol. 24(2), pages 330-338, June.
    22. Ralph L. Keeney, 2002. "Common Mistakes in Making Value Trade-Offs," Operations Research, INFORMS, vol. 50(6), pages 935-945, December.
    23. J. O. Lloyd-Smith & S. J. Schreiber & P. E. Kopp & W. M. Getz, 2005. "Superspreading and the effect of individual variation on disease emergence," Nature, Nature, vol. 438(7066), pages 355-359, November.
    24. Fischer, Gregory W., 1995. "Range Sensitivity of Attribute Weights in Multiattribute Value Models," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(3), pages 252-266, June.
    25. William K. Klimack & Jack M. Kloeber, 2006. "Multiobjective Value Analysis of Army Basic Training," Decision Analysis, INFORMS, vol. 3(1), pages 50-58, March.
    26. Keeney,Ralph L. & Raiffa,Howard, 1993. "Decisions with Multiple Objectives," Cambridge Books, Cambridge University Press, number 9780521438834.
    27. Eva D. Regnier, 2020. "What Is Six Hours Worth? The Impact of Lead Time on Tropical-Storm Preparation Decisions," Decision Analysis, INFORMS, vol. 17(1), pages 9-23, March.
    28. Scott Atran & Robert Axelrod & Richard Davis, 2007. "Sacred barriers to conflict resolution," Post-Print ijn_00505181, HAL.
    29. Weber, Martin & Borcherding, Katrin, 1993. "Behavioral influences on weight judgments in multiattribute decision making," European Journal of Operational Research, Elsevier, vol. 67(1), pages 1-12, May.
    30. Loic BERGER & Nicolas BERGER & Valentina BOSETTI & Itzhak GILBOA & Lars Peter HANSEN & Christopher JARVIS & Massimo MARINACCI & Richard D. Smith, 2020. "Rational policymaking during a pandemic," Working Papers 2020-iRisk-02, IESEG School of Management.
    31. Hazhir Rahmandad & Tse Yang Lim & John Sterman, 2021. "Behavioral dynamics of COVID‐19: estimating underreporting, multiple waves, and adherence fatigue across 92 nations," System Dynamics Review, System Dynamics Society, vol. 37(1), pages 5-31, January.
    32. Simon French & Nikolaos Argyris, 2018. "Decision Analysis and Political Processes," Decision Analysis, INFORMS, vol. 15(4), pages 208-222, December.
    33. Keeney, Ralph L. & Renn, Ortwin & von Winterfeldt, Detlof, 1987. "Structuring West Germany's energy objectives," Energy Policy, Elsevier, vol. 15(4), pages 352-362, August.
    34. Manuele Leonelli & James Smith, 2015. "Bayesian decision support for complex systems with many distributed experts," Annals of Operations Research, Springer, vol. 235(1), pages 517-542, December.
    35. Tianjun Feng & L. Robin Keller, 2006. "A Multiple-Objective Decision Analysis for Terrorism Protection: Potassium Iodide Distribution in Nuclear Incidents," Decision Analysis, INFORMS, vol. 3(2), pages 76-93, June.
    36. Robin L. Dillon & Catherine H. Tinsley, 2008. "How Near-Misses Influence Decision Making Under Risk: A Missed Opportunity for Learning," Management Science, INFORMS, vol. 54(8), pages 1425-1440, August.
    37. Rüdiger von Nitzsch & Martin Weber, 1993. "The Effect of Attribute Ranges on Weights in Multiattribute Utility Measurements," Management Science, INFORMS, vol. 39(8), pages 937-943, August.
    38. Gilberto Montibeller & Detlof Winterfeldt, 2018. "Individual and Group Biases in Value and Uncertainty Judgments," International Series in Operations Research & Management Science, in: Luis C. Dias & Alec Morton & John Quigley (ed.), Elicitation, chapter 0, pages 377-392, Springer.
    39. Don N. Kleinmuntz, 1985. "Cognitive Heuristics and Feedback in a Dynamic Decision Environment," Management Science, INFORMS, vol. 31(6), pages 680-702, June.
    40. Robert Goble & Vicki Bier & Ortwin Renn, 2018. "Two Types of Vigilance Are Essential to Effective Hazard Management: Maintaining Both Together Is Difficult," Risk Analysis, John Wiley & Sons, vol. 38(9), pages 1795-1801, September.
    41. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    42. Detlof von Winterfeldt & Eric Schweitzer, 1998. "An Assessment of Tritium Supply Alternatives in Support of the US Nuclear Weapons Stockpile," Interfaces, INFORMS, vol. 28(1), pages 92-112, February.
    43. Sterman, John D., 1989. "Misperceptions of feedback in dynamic decision making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(3), pages 301-335, June.
    44. Jason R. W. Merrick & Laura A. McLay, 2010. "Is Screening Cargo Containers for Smuggled Nuclear Threats Worthwhile?," Decision Analysis, INFORMS, vol. 7(2), pages 155-171, June.
    45. Dominika A. Kalkowska & Kimberly M. Thompson, 2021. "Health and Economic Outcomes Associated with Polio Vaccine Policy Options: 2019–2029," Risk Analysis, John Wiley & Sons, vol. 41(2), pages 364-375, February.
    46. Robin L. Dillon & William J. Burns & Richard S. John, 2018. "Insights for Critical Alarm-Based Warning Systems from a Risk Analysis of Commercial Aviation Passenger Screening," Decision Analysis, INFORMS, vol. 15(3), pages 154-173, September.
    47. Liyin Jin & Yunhui Huang & Yongheng Liang & Qiang Zhang, 2021. "Who Gets the Ventilator? Moral Decision Making Regarding Medical Resource Allocation in a Pandemic," Journal of the Association for Consumer Research, University of Chicago Press, vol. 6(1), pages 159-167.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. L. Robin Keller & Kelly M. Kophazi, 2012. "From the Editors ---Copulas, Group Preferences, Multilevel Defenders, Sharing Rewards, and Communicating Analytics," Decision Analysis, INFORMS, vol. 9(3), pages 213-218, September.
    2. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    3. Rakesh K. Sarin & L. Robin Keller, 2013. "From the Editors: Probability Approximations, Anti-Terrorism Strategy, and Bull's-Eye Display for Performance Feedback," Decision Analysis, INFORMS, vol. 10(1), pages 1-5, March.
    4. L. Robin Keller & Ali Abbas & Manel Baucells & Vicki M. Bier & David Budescu & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Ahti Salo & George Wu, 2010. "From the Editors..," Decision Analysis, INFORMS, vol. 7(4), pages 327-330, December.
      • L. Robin Keller & Manel Baucells & Kevin F. McCardle & Gregory S. Parnell & Ahti Salo, 2007. "From the Editors..," Decision Analysis, INFORMS, vol. 4(4), pages 173-175, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2008. "From the Editors..," Decision Analysis, INFORMS, vol. 5(4), pages 173-176, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2009. "From the Editors ..," Decision Analysis, INFORMS, vol. 6(4), pages 199-201, December.
    5. Jason R. W. Merrick & Fabrizio Ruggeri & Refik Soyer & L. Robin Keller, 2012. "From the Editors---Games and Decisions in Reliability and Risk," Decision Analysis, INFORMS, vol. 9(2), pages 81-85, June.
    6. L. Robin Keller & Craig W. Kirkwood & Nancy S. Jones, 2010. "Assessing stakeholder evaluation concerns: An application to the Central Arizona water resources system," Systems Engineering, John Wiley & Sons, vol. 13(1), pages 58-71, March.
    7. L. Robin Keller & Kelly M. Kophazi, 2010. "From the Editors..," Decision Analysis, INFORMS, vol. 7(2), pages 151-154, June.
    8. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    9. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    10. William N. Caballero & Ethan Gharst & David Banks & Jeffery D. Weir, 2023. "Multipolar Security Cooperation Planning: A Multiobjective, Adversarial-Risk-Analysis Approach," Decision Analysis, INFORMS, vol. 20(1), pages 16-39, March.
    11. Scholz, Michael & Dorner, Verena & Schryen, Guido & Benlian, Alexander, 2017. "A configuration-based recommender system for supporting e-commerce decisions," European Journal of Operational Research, Elsevier, vol. 259(1), pages 205-215.
    12. Suk, Kwanho & Yoon, Song-Oh, 2012. "The moderating role of decision task goals in attribute weight convergence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 118(1), pages 37-45.
    13. L. Robin Keller, 2012. "From the Editor---Decisions over Time (Exploding Offers or Purchase Regret), in Game Settings (Embedded Nash Bargaining or Adversarial Games), and in Influence Diagrams," Decision Analysis, INFORMS, vol. 9(1), pages 1-5, March.
    14. L. Robin Keller & Kelly M. Kophazi, 2011. "From the Editors---Deterrence, Multiattribute Utility, and Probability and Bayes' Updating," Decision Analysis, INFORMS, vol. 8(2), pages 83-87, June.
    15. L. Robin Keller & Ali Abbas & J. Eric Bickel & Vicki M. Bier & David V. Budescu & John C. Butler & Philippe Delquié & Kenneth C. Lichtendahl & Jason R. W. Merrick & Ahti Salo & George Wu, 2011. "From the Editors ---Probability Scoring Rules, Ambiguity, Multiattribute Terrorist Utility, and Sensitivity Analysis," Decision Analysis, INFORMS, vol. 8(4), pages 251-255, December.
    16. L. Robin Keller, 2010. "From the Editor..," Decision Analysis, INFORMS, vol. 7(3), pages 235-237, September.
    17. Sumitra Sri Bhashyam & Gilberto Montibeller, 2016. "In the Opponent's Shoes: Increasing the Behavioral Validity of Attackers’ Judgments in Counterterrorism Models," Risk Analysis, John Wiley & Sons, vol. 36(4), pages 666-680, April.
    18. Vicki M. Bier & Simon French, 2020. "From the Editors: Decision Analysis Focus and Trends," Decision Analysis, INFORMS, vol. 17(1), pages 1-8, March.
    19. Hämäläinen, Raimo P. & Alaja, Susanna, 2008. "The threat of weighting biases in environmental decision analysis," Ecological Economics, Elsevier, vol. 68(1-2), pages 556-569, December.
    20. L. Robin Keller & Ali Abbas & J. Eric Bickel & Vicki M. Bier & David V. Budescu & John C. Butler & Enrico Diecidue & Robin L. Dillon-Merrill & Raimo P. Hämäläinen & Kenneth C. Lichtendahl & Jason R. W, 2012. "From the Editors ---Brainstorming, Multiplicative Utilities, Partial Information on Probabilities or Outcomes, and Regulatory Focus," Decision Analysis, INFORMS, vol. 9(4), pages 297-302, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ordeca:v:20:y:2023:i:2:p:109-132. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.