IDEAS home Printed from https://ideas.repec.org/p/zbw/i4rdps/277.html

A Comment on Arechar et al.'s (2023) "Understanding and Combatting Misinformation Across 16 Countries on Six Continents"

Author

Listed:
  • Le Foll, Elen
  • Leung, Anna Yi
  • Nießen, Désirée
  • Poppa, Caroline

Abstract

In this commentary, we report the results of our computational reproduction of the main claims from Arechar et al. (2023), which examined psychological and social predictors of susceptibility to COVID-19 misinformation across 16 countries. Using the dataset and replication materials provided by the authors, we attempted to reproduce the study's findings using Stata (based on the authors' analysis script) and R (by translating and reconstructing the code). To assess computational reproducibility, we ran the original Stata code and independently reimplemented key analyses in R. While the Stata script allowed reproduction of several key statistical outputs, it lacked plotting code for most figures and required code edits for compatibility with Version 18. In contrast, our R implementation successfully reproduced Figures 2, 3, 4A-C, 5A-D, and 6 with visual and numerical results closely resembling those in the original publication. We also compared the pre-analysis plan and the article. We found inconsistencies in the specificity of the research questions, analysis scope, and terminology, making it challenging to assess fidelity to the preregistration. Overall, our results highlight that, while many of the reported statistical findings are robust to reanalysis, the study's graphical reproducibility could be improved by providing the complete code for all figures, better documentation, and ensuring greater consistency across the replication packages.

Suggested Citation

  • Le Foll, Elen & Leung, Anna Yi & Nießen, Désirée & Poppa, Caroline, 2025. "A Comment on Arechar et al.'s (2023) "Understanding and Combatting Misinformation Across 16 Countries on Six Continents"," I4R Discussion Paper Series 277, The Institute for Replication (I4R).
  • Handle: RePEc:zbw:i4rdps:277
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/334158/1/I4R-DP277.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brodeur, Abel & Mikola, Derek & Cook, Nikolai & Brailey, Thomas & Briggs, Ryan & de Gendre, Alexandra & Dupraz, Yannick & Fiala, Lenka & Gabani, Jacopo & Gauriot, Romain & Haddad, Joanne & Federice, A, 2024. "Mass Reproducibility and Replicability: A New Hope," I4R Discussion Paper Series 107, The Institute for Replication (I4R).
    2. Antonio A. Arechar & Jennifer Allen & Adam J. Berinsky & Rocky Cole & Ziv Epstein & Kiran Garimella & Andrew Gully & Jackson G. Lu & Robert M. Ross & Michael N. Stagnaro & Yunhao Zhang & Gordon Pennyc, 2023. "Understanding and combatting misinformation across 16 countries on six continents," Nature Human Behaviour, Nature, vol. 7(9), pages 1502-1513, September.
    3. Antonio A. Arechar & Jennifer Allen & Adam J. Berinsky & Rocky Cole & Ziv Epstein & Kiran Garimella & Andrew Gully & Jackson G. Lu & Robert M. Ross & Michael N. Stagnaro & Yunhao Zhang & Gordon Pennyc, 2023. "Author Correction: Understanding and combatting misinformation across 16 countries on six continents," Nature Human Behaviour, Nature, vol. 7(10), pages 1797-1797, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Molly Offer-Westort & Leah R. Rosenzweig & Susan Athey, 2024. "Battling the coronavirus ‘infodemic’ among social media users in Kenya and Nigeria," Nature Human Behaviour, Nature, vol. 8(5), pages 823-834, May.
    2. Sergei Guriev & Emeric Henry & Théo Marquis & Ekaterina Zhuravskaya, 2023. "Curtailing False News, Amplifying Truth," Working Papers halshs-04315924, HAL.
    3. Zhiming Liu, 2025. "Can shifting attention to accuracy reduce misinformation on social media? A replication and extension in China," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-11, December.
    4. Zhang, Si-Qi & Li, Ming-Hui & Li, Yu-Chu & Rao, Li-Lin, 2025. "Effects of childhood environments on the discernment of health misinformation," Social Science & Medicine, Elsevier, vol. 380(C).
    5. Falkenberg, Max & Cinelli, Matteo & Galeazzi, Alessandro & Bail, Christopher A. & Benito, Rosa & Bruns, Axel & Gruzd, Anatoliy & Lazer, David & Lee, Jae K. & McCoy, Jennifer, 2025. "Towards global equity in political polarization research," OSF Preprints 3wzfq_v1, Center for Open Science.
    6. Joakim Sundh, 2024. "Human behavior in the context of low-probability high-impact events," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-10, December.
    7. Jan Pfänder & Sacha Altay, 2025. "Spotting false news and doubting true news: a systematic review and meta-analysis of news judgements," Nature Human Behaviour, Nature, vol. 9(4), pages 688-699, April.
    8. Elizaveta Kuznetsova & Mykola Makhortykh & Victoria Vziatysheva & Martha Stolze & Ani Baghumyan & Aleksandra Urman, 2025. "In generative AI we trust: can chatbots effectively verify political information?," Journal of Computational Social Science, Springer, vol. 8(1), pages 1-31, February.
    9. Inaiya Armeen & Ross Niswanger & Chuan (Annie) Tian, 2025. "Combating Fake News Using Implementation Intentions," Information Systems Frontiers, Springer, vol. 27(3), pages 1107-1120, June.
    10. Ferman, Bruno & Finamor, Lucas, 2025. "There must be an error here! Experimental evidence on coding errors' biases," I4R Discussion Paper Series 266, The Institute for Replication (I4R).
    11. Deer, Lachlan & Adler, Susanne J. & Datta, Hannes & Mizik, Natalie & Sarstedt, Marko, 2025. "Toward open science in marketing research," International Journal of Research in Marketing, Elsevier, vol. 42(1), pages 212-233.
    12. Chuang, Shih-Hsien & Holian, Matthew & Pattison, Nathaniel & Ramakrishnan, Prasanthi, 2024. "A Comment on "Populist Leaders and the Economy"," I4R Discussion Paper Series 157, The Institute for Replication (I4R).
    13. Bonander, Carl & Hammar, Olle & Jakobsson, Niklas & Bensch, Gunther & Holzmeister, Felix & Brodeur, Abel, 2025. "“Try to Balance the Baseline”: A comment on “Parent–teacher meetings and student outcomes: Evidence from a developing country” by Islam (2019)," European Economic Review, Elsevier, vol. 175(C).
    14. Marcus, Jan, 2025. "Replication code as a cornerstone of the credibility revolution 2.0," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 117(C).
    15. McWay, Ryan & Braaksma, Matthew, 2025. "The political consequences of resource scarcity: Targeted spending in a water-stressed democracy. A replication study of Mahadevan and Shenoy (Journal of Public Economics, 2023)," World Development Perspectives, Elsevier, vol. 39(C).
    16. Tiziana Assenza & Alberto Cardaci & Stefanie Huber, 2024. "Fake News: Susceptibility, Awareness, and Solutions," ECONtribute Policy Brief Series 065, University of Bonn and University of Cologne, Germany.
    17. Clerc, Melchior & Gosselin-Pali, Adrien & Wendling, Eliot, 2024. "A Replication of Macchi (2023): "Worth Your Weight: Experimental Evidence on the Benefits of Obesity in Low-Income Countries"," I4R Discussion Paper Series 145, The Institute for Replication (I4R).
    18. Bogler, Lisa & Cullinan, John & Jockers, Dominik & Pechar, Stefanie, 2025. "A Comment on "Age Set versus Kin: Culture and Financial Ties in East Africa"," I4R Discussion Paper Series 259, The Institute for Replication (I4R).
    19. Jakub Sowula & Lyle Scruggs, 2025. "Diminishing Returns? Revisiting the Welfare State-Poverty Association," LIS Working papers 910, LIS Cross-National Data Center in Luxembourg.
    20. Kim, Do Won & Yang, Xilin & Kim, Do-Hoon, 2024. "A comment on "The Effects of Racial Diversity in Citizen Decision-Making Bodies"," I4R Discussion Paper Series 189, The Institute for Replication (I4R).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:277. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.