IDEAS home Printed from
   My bibliography  Save this paper

How Quantifying Probability Assessments Influences Analysis and Decision Making: Experimental Evidence from National Security Professionals


  • Friedman, Jeffrey A.

    (Dartmouth College)

  • Lerner, Jennifer S.

    (Harvard University)

  • Zeckhauser, Richard

    (Harvard University)


National security is one of many fields where public officials offer imprecise probability assessments when evaluating high-stakes decisions. This practice is often justified with arguments about how quantifying subjective judgments would bias analysts and decision makers toward overconfident action. We translate these arguments into testable hypotheses, and evaluate their validity through survey experiments involving national security professionals. Results reveal that when decision makers receive numerals (as opposed to words) for probability assessments, they are less likely to support risky actions and more receptive to gathering additional information, disconfirming the idea of a bias toward action. Yet when respondents generate probabilities themselves, using numbers (as opposed to words) magnifies overconfidence, especially among low-performing assessors. These results hone directions for research among both proponents and skeptics of quantifying probability estimates in national security and other fields. Given that uncertainty surrounds virtually all intelligence reports, military plans, and national security decisions, understanding how national security officials form and interpret probability assessments has wide-ranging implications for theory and practice.

Suggested Citation

  • Friedman, Jeffrey A. & Lerner, Jennifer S. & Zeckhauser, Richard, 2015. "How Quantifying Probability Assessments Influences Analysis and Decision Making: Experimental Evidence from National Security Professionals," Working Paper Series 16-016, Harvard University, John F. Kennedy School of Government.
  • Handle: RePEc:ecl:harjfk:16-016

    Download full text from publisher

    File URL:
    Download Restriction: no

    References listed on IDEAS

    1. Edward T. Cokely & Mirta Galesic & Eric Schulz & Saima Ghazal & Rocio Garcia-Retamero, 2012. "Measuring risk literacy: The Berlin Numeracy Test," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 7(1), pages 25-47, January.
    2. repec:cup:apsrev:v:107:y:2013:i:04:p:849-865_00 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecl:harjfk:16-016. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.