IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-30073-5.html
   My bibliography  Save this article

Accuracy prompts are a replicable and generalizable approach for reducing the spread of misinformation

Author

Listed:
  • Gordon Pennycook

    (University of Regina
    University of Regina)

  • David G. Rand

    (Massachusetts Institute of Technology)

Abstract

Interventions that shift users attention toward the concept of accuracy represent a promising approach for reducing misinformation sharing online. We assess the replicability and generalizability of this accuracy prompt effect by meta-analyzing 20 experiments (with a total N = 26,863) completed by our group between 2017 and 2020. This internal meta-analysis includes all relevant studies regardless of outcome and uses identical analyses across all studies. Overall, accuracy prompts increased the quality of news that people share (sharing discernment) relative to control, primarily by reducing sharing intentions for false headlines by 10% relative to control in these studies. The magnitude of the effect did not significantly differ by content of headlines (politics compared with COVID-19 related news) and did not significantly decay over successive trials. The effect was not robustly moderated by gender, race, political ideology, education, or value explicitly placed on accuracy, but was significantly larger for older, more reflective, and more attentive participants. This internal meta-analysis demonstrates the replicability and generalizability of the accuracy prompt effect on sharing discernment.

Suggested Citation

  • Gordon Pennycook & David G. Rand, 2022. "Accuracy prompts are a replicable and generalizable approach for reducing the spread of misinformation," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-30073-5
    DOI: 10.1038/s41467-022-30073-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-30073-5
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-022-30073-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. repec:cup:judgdm:v:11:y:2016:i:1:p:99-113 is not listed on IDEAS
    2. Osmundsen, Mathias & Bor, Alexander & Vahlstrup, Peter Bjerregaard & Bechmann, Anja & Petersen, Michael Bang, 2021. "Partisan Polarization Is the Primary Psychological Motivation behind Political Fake News Sharing on Twitter," American Political Science Review, Cambridge University Press, vol. 115(3), pages 999-1015, August.
    3. Manon Berriche & Sacha Altay, 2020. "Internet users engage more with phatic posts than with health misinformation on Facebook," Palgrave Communications, Palgrave Macmillan, vol. 6(1), pages 1-9, December.
    4. Adam J. Berinsky & Michele F. Margolis & Michael W. Sances, 2014. "Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self‐Administered Surveys," American Journal of Political Science, John Wiley & Sons, vol. 58(3), pages 739-753, July.
    5. Hans IJzerman & Neil A. Lewis & Andrew K. Przybylski & Netta Weinstein & Lisa DeBruine & Stuart J. Ritchie & Simine Vazire & Patrick S. Forscher & Richard D. Morey & James D. Ivory & Farid Anvari, 2020. "Use caution when applying behavioural science to policy," Nature Human Behaviour, Nature, vol. 4(11), pages 1092-1094, November.
    6. Gordon Pennycook & Ziv Epstein & Mohsen Mosleh & Antonio A. Arechar & Dean Eckles & David G. Rand, 2021. "Shifting attention to accuracy can reduce misinformation online," Nature, Nature, vol. 592(7855), pages 590-595, April.
    7. Boas, Taylor C. & Christenson, Dino P. & Glick, David M., 2020. "Recruiting large online samples in the United States and India: Facebook, Mechanical Turk, and Qualtrics," Political Science Research and Methods, Cambridge University Press, vol. 8(2), pages 232-250, April.
    8. Andrew M. Guess & Brendan Nyhan & Jason Reifler, 2020. "Exposure to untrustworthy websites in the 2016 US election," Nature Human Behaviour, Nature, vol. 4(5), pages 472-480, May.
    9. Jacob M. Montgomery & Brendan Nyhan & Michelle Torres, 2018. "How Conditioning on Posttreatment Variables Can Ruin Your Experiment and What to Do about It," American Journal of Political Science, John Wiley & Sons, vol. 62(3), pages 760-775, July.
    10. Ethan Porter & Thomas J. Wood, 2021. "The global effectiveness of fact-checking: Evidence from simultaneous experiments in Argentina, Nigeria, South Africa, and the United Kingdom," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 118(37), pages 2104235118-, September.
    11. Berinsky, Adam J. & Huber, Gregory A. & Lenz, Gabriel S., 2012. "Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk," Political Analysis, Cambridge University Press, vol. 20(3), pages 351-368, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Grimmer, Justin & Holliday, Derek & Lelkes, Yphtach & Westwood, Sean, 2023. "Who are the Election Skeptics? Evidence from the 2022 Midterm Elections," OSF Preprints pe2zg, Center for Open Science.
    2. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," CESifo Working Paper Series 10934, CESifo.
    3. Tobia Spampatti & Ulf J. J. Hahnel & Evelina Trutnevyte & Tobias Brosch, 2024. "Psychological inoculation strategies to fight climate disinformation across 12 countries," Nature Human Behaviour, Nature, vol. 8(2), pages 380-398, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jimin Pyo & Michael G. Maxfield, 2021. "Cognitive Effects of Inattentive Responding in an MTurk Sample," Social Science Quarterly, Southwestern Social Science Association, vol. 102(4), pages 2020-2039, July.
    2. Mohsen Mosleh & David G. Rand, 2022. "Measuring exposure to misinformation from political elites on Twitter," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    3. Jana Lasser & Segun T. Aroyehun & Fabio Carrella & Almog Simchon & David Garcia & Stephan Lewandowsky, 2023. "From alternative conceptions of honesty to alternative facts in communications by US politicians," Nature Human Behaviour, Nature, vol. 7(12), pages 2140-2151, December.
    4. Steve Rathje & Jon Roozenbeek & Jay J. Bavel & Sander Linden, 2023. "Accuracy and social motivations shape judgements of (mis)information," Nature Human Behaviour, Nature, vol. 7(6), pages 892-903, June.
    5. Gordon Pennycook & David G. Rand, 2022. "Nudging Social Media toward Accuracy," The ANNALS of the American Academy of Political and Social Science, , vol. 700(1), pages 152-164, March.
    6. Lude, Maximilian & Prügl, Reinhard, 2021. "Experimental studies in family business research," Journal of Family Business Strategy, Elsevier, vol. 12(1).
    7. Barton, Jared & Pan, Xiaofei, 2022. "Movin’ on up? A survey experiment on mobility enhancing policies," European Journal of Political Economy, Elsevier, vol. 74(C).
    8. John M. Carey & Andrew M. Guess & Peter J. Loewen & Eric Merkley & Brendan Nyhan & Joseph B. Phillips & Jason Reifler, 2022. "The ephemeral effects of fact-checks on COVID-19 misperceptions in the United States, Great Britain and Canada," Nature Human Behaviour, Nature, vol. 6(2), pages 236-243, February.
    9. Valerio Capraro & Hélène Barcelo, 2021. "Punishing defectors and rewarding cooperators: Do people discriminate between genders?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(1), pages 19-32, September.
    10. Kaitlynn Sandstrom‐Mistry & Frank Lupi & Hyunjung Kim & Joseph A. Herriges, 2023. "Comparing water quality valuation across probability and non‐probability samples," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(2), pages 744-761, June.
    11. Le Maux, Benoît & Necker, Sarah, 2023. "Honesty nudges: Effect varies with content but not with timing," Journal of Economic Behavior & Organization, Elsevier, vol. 207(C), pages 433-456.
    12. Nicole Wu, 2023. "“Restrict foreigners, not robots”: Partisan responses to automation threat," Economics and Politics, Wiley Blackwell, vol. 35(2), pages 505-528, July.
    13. Burdea, Valeria & Woon, Jonathan, 2022. "Online belief elicitation methods," Journal of Economic Psychology, Elsevier, vol. 90(C).
    14. Pan, Jing Yu & Liu, Dahai, 2022. "Mask-wearing intentions on airplanes during COVID-19 – Application of theory of planned behavior model," Transport Policy, Elsevier, vol. 119(C), pages 32-44.
    15. Schiff, Kaylyn Jackson & Schiff, Daniel S. & Bueno, Natalia, 2023. "The Liar's Dividend: The Impact of Deepfakes and Fake News on Trust in Political Discourse," SocArXiv x43ph, Center for Open Science.
    16. Michele Cantarella & Chiara Strozzi, 2021. "Workers in the crowd: the labor market impact of the online platform economy [An evaluation of instrumental variable strategies for estimating the effects of catholic schooling]," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 30(6), pages 1429-1458.
    17. Robbett, Andrea & Matthews, Peter Hans, 2018. "Partisan bias and expressive voting," Journal of Public Economics, Elsevier, vol. 157(C), pages 107-120.
    18. Vecchio, Riccardo & Caso, Gerarda & Cembalo, Luigi & Borrello, Massimiliano, 2020. "Is respondents’ inattention in online surveys a major issue for research?," Economia agro-alimentare / Food Economy, Italian Society of Agri-food Economics/Società Italiana di Economia Agro-Alimentare (SIEA), vol. 22(1), March.
    19. S. Brent Jackson & Kathryn T. Stevenson & Lincoln R. Larson & M. Nils Peterson & Erin Seekamp, 2021. "Outdoor Activity Participation Improves Adolescents’ Mental Health and Well-Being during the COVID-19 Pandemic," IJERPH, MDPI, vol. 18(5), pages 1-18, March.
    20. Park, JungKun & Ahn, Jiseon & Thavisay, Toulany & Ren, Tianbao, 2019. "Examining the role of anxiety and social influence in multi-benefits of mobile payment service," Journal of Retailing and Consumer Services, Elsevier, vol. 47(C), pages 140-149.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-30073-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.