IDEAS home Printed from https://ideas.repec.org/a/nat/nathum/v9y2025i4d10.1038_s41562-024-02086-1.html
   My bibliography  Save this article

Spotting false news and doubting true news: a systematic review and meta-analysis of news judgements

Author

Listed:
  • Jan Pfänder

    (ENS, EHESS, PSL University, CNRS)

  • Sacha Altay

    (University of Zurich)

Abstract

How good are people at judging the veracity of news? We conducted a systematic literature review and pre-registered meta-analysis of 303 effect sizes from 67 experimental articles evaluating accuracy ratings of true and fact-checked false news (NParticipants = 194,438 from 40 countries across 6 continents). We found that people rated true news as more accurate than false news (Cohen’s d = 1.12 [1.01, 1.22]) and were better at rating false news as false than at rating true news as true (Cohen’s d = 0.32 [0.24, 0.39]). In other words, participants were able to discern true from false news and erred on the side of skepticism rather than credulity. We found no evidence that the political concordance of the news had an effect on discernment, but participants were more skeptical of politically discordant news (Cohen’s d = 0.78 [0.62, 0.94]). These findings lend support to crowdsourced fact-checking initiatives and suggest that, to improve discernment, there is more room to increase the acceptance of true news than to reduce the acceptance of fact-checked false news.

Suggested Citation

  • Jan Pfänder & Sacha Altay, 2025. "Spotting false news and doubting true news: a systematic review and meta-analysis of news judgements," Nature Human Behaviour, Nature, vol. 9(4), pages 688-699, April.
    • Handle: RePEc:nat:nathum:v:9:y:2025:i:4:d:10.1038_s41562-024-02086-1
    DOI: 10.1038/s41562-024-02086-1
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41562-024-02086-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1038/s41562-024-02086-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Reinald Besalú & Carles Pont-Sorribes, 2021. "Credibility of Digital Political News in Spain: Comparison between Traditional Media and Social Media," Social Sciences, MDPI, vol. 10(5), pages 1-18, May.
    2. Emma Hoes & Brian Aitken & Jingwen Zhang & Tomasz Gackowski & Magdalena Wojcieszak, 2024. "Author Correction: Prominent misinformation interventions reduce misperceptions but increase scepticism," Nature Human Behaviour, Nature, vol. 8(8), pages 1628-1628, August.
    3. Antonio A. Arechar & Jennifer Allen & Adam J. Berinsky & Rocky Cole & Ziv Epstein & Kiran Garimella & Andrew Gully & Jackson G. Lu & Robert M. Ross & Michael N. Stagnaro & Yunhao Zhang & Gordon Pennyc, 2023. "Understanding and combatting misinformation across 16 countries on six continents," Nature Human Behaviour, Nature, vol. 7(9), pages 1502-1513, September.
    4. Badrinathan, Sumitra, 2021. "Educative Interventions to Combat Misinformation: Evidence from a Field Experiment in India," American Political Science Review, Cambridge University Press, vol. 115(4), pages 1325-1341, November.
    5. Brian Guay & Adam J. Berinsky & Gordon Pennycook & David Rand, 2023. "How to think about whether misinformation interventions work," Nature Human Behaviour, Nature, vol. 7(8), pages 1231-1233, August.
    6. Gordon Pennycook & Ziv Epstein & Mohsen Mosleh & Antonio A. Arechar & Dean Eckles & David G. Rand, 2021. "Shifting attention to accuracy can reduce misinformation online," Nature, Nature, vol. 592(7855), pages 590-595, April.
    7. Bence Bago & David Rand & Gordon Pennycook, 2020. "Fake news, fast and slow: Deliberation reduces belief in false (but not true) news headlines," Post-Print hal-03477497, HAL.
    8. Antonio A. Arechar & Jennifer Allen & Adam J. Berinsky & Rocky Cole & Ziv Epstein & Kiran Garimella & Andrew Gully & Jackson G. Lu & Robert M. Ross & Michael N. Stagnaro & Yunhao Zhang & Gordon Pennyc, 2023. "Author Correction: Understanding and combatting misinformation across 16 countries on six continents," Nature Human Behaviour, Nature, vol. 7(10), pages 1797-1797, October.
    9. Steve Rathje & Jon Roozenbeek & Jay J. Bavel & Sander Linden, 2023. "Accuracy and social motivations shape judgements of (mis)information," Nature Human Behaviour, Nature, vol. 7(6), pages 892-903, June.
    10. Emmanuel Trouche & Petter Johansson & Lars Hall & Hugo Mercier, 2018. "Vigilant conservatism in evaluating communicated information," PLOS ONE, Public Library of Science, vol. 13(1), pages 1-16, January.
    11. Kevin Aslett & Zeve Sanderson & William Godel & Nathaniel Persily & Jonathan Nagler & Joshua A. Tucker, 2024. "Online searches to evaluate misinformation can increase its perceived veracity," Nature, Nature, vol. 625(7995), pages 548-556, January.
    12. Emma Hoes & Brian Aitken & Jingwen Zhang & Tomasz Gackowski & Magdalena Wojcieszak, 2024. "Prominent misinformation interventions reduce misperceptions but increase scepticism," Nature Human Behaviour, Nature, vol. 8(8), pages 1545-1553, August.
    13. Miriam J. Metzger, 2007. "Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(13), pages 2078-2091, November.
    14. Matthew J Page & Joanne E McKenzie & Patrick M Bossuyt & Isabelle Boutron & Tammy C Hoffmann & Cynthia D Mulrow & Larissa Shamseer & Jennifer M Tetzlaff & Elie A Akl & Sue E Brennan & Roger Chou & Jul, 2021. "The PRISMA 2020 statement: An updated guideline for reporting systematic reviews," PLOS Medicine, Public Library of Science, vol. 18(3), pages 1-15, March.
    15. João Pedro Baptista & Elisete Correia & Anabela Gradim & Valeriano Piñeiro-Naval, 2021. "The Influence of Political Ideology on Fake News Belief: The Portuguese Case," Publications, MDPI, vol. 9(2), pages 1-17, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tiziana Assenza & Alberto Cardaci & Stefanie Huber, 2024. "Fake News: Susceptibility, Awareness, and Solutions," ECONtribute Policy Brief Series 065, University of Bonn and University of Cologne, Germany.
    2. Sergei Guriev & Emeric Henry & Théo Marquis & Ekaterina Zhuravskaya, 2023. "Curtailing False News, Amplifying Truth," Working Papers halshs-04315924, HAL.
    3. repec:hal:journl:hal-03533356 is not listed on IDEAS
    4. Bago, Bence & Rosenzweig, Leah & Berinsky, Adam & Rand, David, 2021. "Emotion may predict susceptibility to fake news but emotion regulation does not help," IAST Working Papers 21-127, Institute for Advanced Study in Toulouse (IAST).
    5. Elizaveta Kuznetsova & Mykola Makhortykh & Victoria Vziatysheva & Martha Stolze & Ani Baghumyan & Aleksandra Urman, 2025. "In generative AI we trust: can chatbots effectively verify political information?," Journal of Computational Social Science, Springer, vol. 8(1), pages 1-31, February.
    6. Gordon Pennycook & David G. Rand, 2022. "Nudging Social Media toward Accuracy," The ANNALS of the American Academy of Political and Social Science, , vol. 700(1), pages 152-164, March.
    7. Mohamed Mostagir & James Siderius, 2022. "Learning in a Post-Truth World," Management Science, INFORMS, vol. 68(4), pages 2860-2868, April.
    8. Falkenberg, Max & Cinelli, Matteo & Galeazzi, Alessandro & Bail, Christopher A. & Benito, Rosa & Bruns, Axel & Gruzd, Anatoliy & Lazer, David & Lee, Jae K. & McCoy, Jennifer, 2025. "Towards global equity in political polarization research," OSF Preprints 3wzfq_v1, Center for Open Science.
    9. Joakim Sundh, 2024. "Human behavior in the context of low-probability high-impact events," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-10, December.
    10. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    11. Boglárka Anna Éliás & Attila Jámbor, 2021. "Food Security and COVID-19: A Systematic Review of the First-Year Experience," Sustainability, MDPI, vol. 13(9), pages 1-18, May.
    12. Omoyele, Olalekan & Hoffmann, Maximilian & Koivisto, Matti & Larrañeta, Miguel & Weinand, Jann Michael & Linßen, Jochen & Stolten, Detlef, 2024. "Increasing the resolution of solar and wind time series for energy system modeling: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    13. Cala, Anggie & Maturana-Córdoba, Aymer & Soto-Verjel, Joseph, 2023. "Exploring the pretreatments' influence on pressure reverse osmosis: PRISMA review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    14. Ming Shan & Yu-Shan Li & Bon-Gang Hwang & Jia-En Chua, 2021. "Productivity Metrics and Its Implementations in Construction Projects: A Case Study of Singapore," Sustainability, MDPI, vol. 13(21), pages 1-19, November.
    15. Susca, T. & Zanghirella, F. & Colasuonno, L. & Del Fatto, V., 2022. "Effect of green wall installation on urban heat island and building energy use: A climate-informed systematic literature review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    16. Alexander P. L. Martindale & Carrie D. Llewellyn & Richard O. Visser & Benjamin Ng & Victoria Ngai & Aditya U. Kale & Lavinia Ferrante Ruffano & Robert M. Golub & Gary S. Collins & David Moher & Melis, 2024. "Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    17. Gizéh Rangel-de Lázaro & Josep M. Duart, 2023. "You Can Handle, You Can Teach It: Systematic Review on the Use of Extended Reality and Artificial Intelligence Technologies for Online Higher Education," Sustainability, MDPI, vol. 15(4), pages 1-23, February.
    18. Kim, Hyunil & Kim, Yun Young & Song, Eun-Jee & Windsor, Liliane, 2024. "Policies to reduce child poverty and child maltreatment: A scoping review and preliminary estimates of indirect effects," Children and Youth Services Review, Elsevier, vol. 156(C).
    19. Nicolás Ajzenman & Bruno Ferman & Sant’Anna Pedro C., 2023. "Discrimination in the Formation of Academic Networks: A Field Experiment on #EconTwitter," Working Papers 235, Red Nacional de Investigadores en Economía (RedNIE).
    20. Buechel, Berno & Klößner, Stefan & Meng, Fanyuan & Nassar, Anis, 2023. "Misinformation due to asymmetric information sharing," Journal of Economic Dynamics and Control, Elsevier, vol. 150(C).
    21. Lee, Kuan-Ting & Chen, Yen-Chin & Yang, Yi-Ching & Wang, Wei-Li, 2024. "On practicing magicine, from wonder to care: A systematic review of studies that apply magic in healthcare," Social Science & Medicine, Elsevier, vol. 341(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:nathum:v:9:y:2025:i:4:d:10.1038_s41562-024-02086-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.