IDEAS home Printed from https://ideas.repec.org/p/wrk/wrkemf/22.html
   My bibliography  Save this paper

Communicating uncertainty about facts, numbers, and science

Author

Listed:
  • van der Bles, Anne Marthe

    (University of Cambridge)

  • van der Liden, Sander

    (University of Cambridge)

  • Freeman, Alessandra L. J.

    (University of Cambridge)

  • Mitchell, James

    (University of Warwick)

  • Galvao, Ana Beatriz

    (University of Warwick)

  • Spiegelhalter, David J.

    (University of Cambridge)

Abstract

Uncertainty is an inherent part of knowledge, and yet in an era of contested expertise, many shy away from openly communicating their uncertainty about what they know, fearful of their audience’s reaction. But what effect does communication of such epistemic uncertainty have? Empirical research is widely scattered across many disciplines. This interdisciplinary review structures and summarises current practice and research across domains, combining a statistical and psychological perspective. This informs a framework for uncertainty communication in which we identify three objects of uncertainty - facts, numbers, and science - and two levels of uncertainty: direct and indirect. An examination of current practices provides a scale of nine expressions of direct uncertainty. We discuss attempts to codify indirect uncertainty in terms of quality of the underlying evidence. We review the limited literature about the effects of communicating epistemic uncertainty on cognition, affect, trust, and decision-making. While there is some evidence that communicating epistemic uncertainty does not necessarily affect audiences negatively, impact can vary between individuals and communication formats. Case studies in economic statistics and climate change illustrate our framework in action. We conclude with advice to guide both communicators and future researchers in this important but so far rather neglected field.

Suggested Citation

  • van der Bles, Anne Marthe & van der Liden, Sander & Freeman, Alessandra L. J. & Mitchell, James & Galvao, Ana Beatriz & Spiegelhalter, David J., 2019. "Communicating uncertainty about facts, numbers, and science," EMF Research Papers 22, Economic Modelling and Forecasting Group.
  • Handle: RePEc:wrk:wrkemf:22
    as

    Download full text from publisher

    File URL: https://warwick.ac.uk/fac/soc/wbs/subjects/finance/mpf/working-papers/emf_wp_22.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paul Slovic, 1993. "Perceived Risk, Trust, and Democracy," Risk Analysis, John Wiley & Sons, vol. 13(6), pages 675-682, December.
    2. Ali Faraji-Rad & Michel Tuan Pham, 2017. "Uncertainty Increases the Reliance on Affect in Decisions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(1), pages 1-21.
    3. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    4. Gilbert, Thomas, 2011. "Information aggregation around macroeconomic announcements: Revisions matter," Journal of Financial Economics, Elsevier, vol. 101(1), pages 114-131, July.
    5. Teigen, Karl Halvor & Brun, Wibecke, 1999. "The Directionality of Verbal Probability Expressions: Effects on Decisions, Predictions, and Probabilistic Reasoning, , , ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 80(2), pages 155-190, November.
    6. Brun, Wibecke & Teigen, Karl Halvor, 1988. "Verbal probabilities: Ambiguous, context-dependent, or both?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 41(3), pages 390-404, June.
    7. David Budescu & Han-Hui Por & Stephen Broomell, 2012. "Effective communication of uncertainty in the IPCC reports," Climatic Change, Springer, vol. 113(2), pages 181-200, July.
    8. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    9. Smithson, Michael, 1999. "Conflict Aversion: Preference for Ambiguity vs Conflict in Sources and Evidence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 79(3), pages 179-198, September.
    10. Charles F. Manski, 2015. "Communicating Uncertainty in Official Economic Statistics: An Appraisal Fifty Years after Morgenstern," Journal of Economic Literature, American Economic Association, vol. 53(3), pages 631-653, September.
    11. Nathan F. Dieckmann & Robin Gregory & Ellen Peters & Robert Hartman, 2017. "Seeing What You Want to See: How Imprecise Uncertainty Ranges Enhance Motivated Reasoning," Risk Analysis, John Wiley & Sons, vol. 37(3), pages 471-486, March.
    12. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    13. Sander Linden & Anthony Leiserowitz & Geoffrey Feinberg & Edward Maibach, 2014. "How to communicate the scientific consensus on climate change: plain facts, pie charts or metaphors?," Climatic Change, Springer, vol. 126(1), pages 255-262, September.
    14. Nathan F. Dieckmann & Ellen Peters & Robin Gregory, 2015. "At Home on the Range? Lay Interpretations of Numerical Uncertainty Ranges," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1281-1295, July.
    15. Sander van der Linden & Anthony Leiserowitz & Edward Maibach, 2018. "Scientific agreement can neutralize politicization of facts," Nature Human Behaviour, Nature, vol. 2(1), pages 2-3, January.
    16. Kathleen Higgins, 2016. "Post-truth: a guide for the perplexed," Nature, Nature, vol. 540(7631), pages 9-9, December.
    17. David V. Budescu & Han-Hui Por & Stephen B. Broomell & Michael Smithson, 2014. "The interpretation of IPCC probabilistic statements around the world," Nature Climate Change, Nature, vol. 4(6), pages 508-512, June.
    18. Paul K. J. Han & William M. P. Klein & Tom Lehman & Bill Killam & Holly Massett & Andrew N. Freedman, 2011. "Communication of Uncertainty Regarding Individualized Cancer Risk Estimates," Medical Decision Making, , vol. 31(2), pages 354-366, March.
    19. Branden B. Johnson, 2003. "Further Notes on Public Response to Uncertainty in Risks and Science," Risk Analysis, John Wiley & Sons, vol. 23(4), pages 781-789, August.
    20. Marilyn M. Schapira & Ann B. Nattinger & Colleen A. McHorney, 2001. "Frequency or Probability? A Qualitative Study of Risk Communication Formats Used in Health Care," Medical Decision Making, , vol. 21(6), pages 459-467, December.
    21. Rob Swart & Lenny Bernstein & Minh Ha-Duong & Arthur Petersen, 2009. "Agreeing to disagree: uncertainty management in assessing climate change, impacts and responses by the IPCC," Climatic Change, Springer, vol. 92(1), pages 1-29, January.
    22. Manski, Charles F., 2016. "Credible interval estimates for official statistics with survey nonresponse," Journal of Econometrics, Elsevier, vol. 191(2), pages 293-301.
    23. Rebecca M. Turner & David J. Spiegelhalter & Gordon C. S. Smith & Simon G. Thompson, 2009. "Bias modelling in evidence synthesis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 21-47, January.
    24. Michael P. Clements & Ana Beatriz Galvão, 2017. "Predicting Early Data Revisions to U.S. GDP and the Effects of Releases on Equity Markets," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 389-406, July.
    25. Branden B. Johnson & Paul Slovic, 1995. "Presenting Uncertainty in Health Risk Assessment: Initial Studies of Its Effects on Risk Perception and Trust," Risk Analysis, John Wiley & Sons, vol. 15(4), pages 485-494, August.
    26. Richard McKenzie, 2006. "Undertaking Revisions and Real-Time Data Analysis using the OECD Main Economic Indicators Original Release Data and Revisions Database," OECD Statistics Working Papers 2006/2, OECD Publishing.
    27. Jakob D. Jensen & Manusheela Pokharel & Courtney L. Scherr & Andy J. King & Natasha Brown & Christina Jones, 2017. "Communicating Uncertain Science to the Public: How Amount and Source of Uncertainty Impact Fatalism, Backlash, and Overload," Risk Analysis, John Wiley & Sons, vol. 37(1), pages 40-51, January.
    28. Budescu, David V. & Wallsten, Thomas S., 1985. "Consistency in interpretation of probabilistic phrases," Organizational Behavior and Human Decision Processes, Elsevier, vol. 36(3), pages 391-405, December.
    29. Naomi Oreskes & Erik M. Conway, 2010. "Defeating the merchants of doubt," Nature, Nature, vol. 465(7299), pages 686-687, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Teigen, Karl Halvor & Juanchich, Marie & Løhre, Erik, 2022. "What is a “likely” amount? Representative (modal) values are considered likely even when their probabilities are low," Organizational Behavior and Human Decision Processes, Elsevier, vol. 171(C).
    2. Galvao, Ana Beatriz & Mitchell, James, 2019. "Measuring Data Uncertainty : An Application using the Bank of England’s “Fan Charts” for Historical GDP Growth," EMF Research Papers 24, Economic Modelling and Forecasting Group.
    3. Ana Beatriz Galvão & James Mitchell & Johnny Runge, 2019. "Communicating Data Uncertainty: Experimental Evidence for U.K. GDP," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2019-20, Economic Statistics Centre of Excellence (ESCoE).
    4. Ana Beatriz Galvão & James Mitchell, 2023. "Real‐Time Perceptions of Historical GDP Data Uncertainty," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 457-481, June.
    5. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    6. Friederike Hendriks & Regina Jucks, 2020. "Does Scientific Uncertainty in News Articles Affect Readers’ Trust and Decision-Making?," Media and Communication, Cogitatio Press, vol. 8(2), pages 401-412.
    7. repec:jdm:journl:v:17:y:2022:i:4:p:849-882 is not listed on IDEAS
    8. Robin Gregory & Theresa Satterfield & David R. Boyd, 2020. "People, Pipelines, and Probabilities: Clarifying Significance and Uncertainty in Environmental Impact Assessments," Risk Analysis, John Wiley & Sons, vol. 40(2), pages 218-226, February.
    9. Carol Nash, 2021. "Challenges to Learners in Interpreting Self as Other, Post COVID-19," Challenges, MDPI, vol. 12(2), pages 1-24, November.
    10. repec:cup:judgdm:v:17:y:2022:i:4:p:849-882 is not listed on IDEAS
    11. Schils, René L.M. & van Voorn, George A.K. & Grassini, Patricio & van Ittersum, Martin K., 2022. "Uncertainty is more than a number or colour: Involving experts in uncertainty assessments of yield gaps," Agricultural Systems, Elsevier, vol. 195(C).
    12. Dominic Balog‐Way & Katherine McComas & John Besley, 2020. "The Evolving Field of Risk Communication," Risk Analysis, John Wiley & Sons, vol. 40(S1), pages 2240-2262, November.
    13. Aljoscha Minnich & Hauke Roggenkamp & Andreas Lange, 2023. "Ambiguity Attitudes and Surprises: Experimental Evidence on Communicating New Information within a Large Population Sample," CESifo Working Paper Series 10783, CESifo.
    14. Bholat, David & Broughton, Nida & Ter Meer, Janna & Walczak, Eryk, 2019. "Enhancing central bank communications using simple and relatable information," Journal of Monetary Economics, Elsevier, vol. 108(C), pages 1-15.
    15. Liliana Cori & Olivia Curzio & Gabriele Donzelli & Elisa Bustaffa & Fabrizio Bianchi, 2022. "A Systematic Review of Radon Risk Perception, Awareness, and Knowledge: Risk Communication Options," Sustainability, MDPI, vol. 14(17), pages 1-27, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:cup:judgdm:v:16:y:2021:i:2:p:363-393 is not listed on IDEAS
    2. David R. Mandel & Daniel Irwin, 2021. "Facilitating sender-receiver agreement in communicated probabilities: Is it best to use words, numbers or both?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 16(2), pages 363-393, March.
    3. Galvao, Ana Beatriz & Mitchell, James & Runge, Johnny, 2019. "Communicating Data Uncertainty: Experimental Evidence for U.K. GDP," EMF Research Papers 30, Economic Modelling and Forecasting Group.
    4. Toshio Fujimi & Masahide Watanabe & Hirokazu Tatano, 2021. "Public trust, perceived accuracy, perceived likelihood, and concern on multi-model climate projections communicated with different formats," Mitigation and Adaptation Strategies for Global Change, Springer, vol. 26(5), pages 1-20, June.
    5. Ana Beatriz Galvão & James Mitchell, 2023. "Real‐Time Perceptions of Historical GDP Data Uncertainty," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 457-481, June.
    6. Galvao, Ana Beatriz & Mitchell, James, 2019. "Measuring Data Uncertainty : An Application using the Bank of England’s “Fan Charts” for Historical GDP Growth," EMF Research Papers 24, Economic Modelling and Forecasting Group.
    7. Mazzi Gian Luigi & Mitchell James & Carausu Florabela, 2021. "Measuring and Communicating the Uncertainty in Official Economic Statistics," Journal of Official Statistics, Sciendo, vol. 37(2), pages 289-316, June.
    8. Aljoscha Minnich & Hauke Roggenkamp & Andreas Lange, 2023. "Ambiguity Attitudes and Surprises: Experimental Evidence on Communicating New Information within a Large Population Sample," CESifo Working Paper Series 10783, CESifo.
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Marie Juanchich & Theodore G. Shepherd & Miroslav Sirota, 2020. "Negations in uncertainty lexicon affect attention, decision-making and trust," Climatic Change, Springer, vol. 162(3), pages 1677-1698, October.
    11. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    12. Knut Are Aastveit & Karsten R. Gerdrup & Anne Sofie Jore & Leif Anders Thorsrud, 2014. "Nowcasting GDP in Real Time: A Density Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 48-68, January.
    13. Michael P. Clements, 2014. "Anticipating Early Data Revisions to US GDP and the Effects of Releases on Equity Markets," ICMA Centre Discussion Papers in Finance icma-dp2014-06, Henley Business School, University of Reading.
    14. repec:cup:judgdm:v:14:y:2019:i:6:p:683-695 is not listed on IDEAS
    15. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    16. Ana Beatriz Galvão & James Mitchell, 2024. "Communicating Data Uncertainty: Multiwave Experimental Evidence for UK GDP," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 56(1), pages 81-114, February.
    17. Francisco Castro & Javier J. P√Ârez & Marta Rodr√Çguez-Vives, 2013. "Fiscal Data Revisions in Europe," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45(6), pages 1187-1209, September.
    18. Garratt, Anthony & Mitchell, James & Vahey, Shaun P., 2014. "Measuring output gap nowcast uncertainty," International Journal of Forecasting, Elsevier, vol. 30(2), pages 268-279.
    19. Garratt, Anthony & Mitchell, James & Vahey, Shaun P. & Wakerly, Elizabeth C., 2011. "Real-time inflation forecast densities from ensemble Phillips curves," The North American Journal of Economics and Finance, Elsevier, vol. 22(1), pages 77-87, January.
    20. P. Marijn Poortvliet & Anne Marike Lokhorst, 2016. "The Key Role of Experiential Uncertainty when Dealing with Risks: Its Relationships with Demand for Regulation and Institutional Trust," Risk Analysis, John Wiley & Sons, vol. 36(8), pages 1615-1629, August.
    21. Kazuya Nakayachi & Branden B. Johnson & Kazuki Koketsu, 2018. "Effects of Acknowledging Uncertainty about Earthquake Risk Estimates on San Francisco Bay Area Residents’ Beliefs, Attitudes, and Intentions," Risk Analysis, John Wiley & Sons, vol. 38(4), pages 666-679, April.
    22. Marek RUSNAK, 2013. "Revisions to the Czech National Accounts: Properties and Predictability," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 63(3), pages 244-261, July.

    More about this item

    Keywords

    Epistemic Uncertainty; Uncertainty Communication; economic statistics uncertainty; interdisciplinary; JEL Classification Numbers: E01;
    All these keywords.

    JEL classification:

    • E01 - Macroeconomics and Monetary Economics - - General - - - Measurement and Data on National Income and Product Accounts and Wealth; Environmental Accounts

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wrk:wrkemf:22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ana Galvão (email available below). General contact details of provider: https://edirc.repec.org/data/emwaruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.