IDEAS home Printed from https://ideas.repec.org/p/zbw/i4rdps/276.html

Replication of Chan and Albarracín (2023) "A meta-analysis of correction effects in sciencerelevant misinformation"

Author

Listed:
  • Hu, Bo
  • Lu, Chang
  • Yang, Jianxun

Abstract

Chan M.-P.S. and Albarracín D. (2023) examined the impact of correction strategies on mitigating science-relevant misinformation, and found debunking effect was not significant. We replicated their study using the provided replication package, including raw data and analysis code. Our computational reproducibility confirmed the main results. However, our RoBMA analysis showed BF10 values of 1.422 with outliers and 1.437 without outliers, differing from the original study, suggesting lower publication bias. In our robustness reproducibility checks, we found discrepancies. While the misinformation correction effect became significant with different meta-analytic methods, cumulative meta-analysis showed no significant changes over time or with increasing sample sizes. Additionally, the WAAP-WLS analysis indicated no publication bias. These results suggest that while some findings align, the robustness of the debunking effect varies with analytical methods.

Suggested Citation

  • Hu, Bo & Lu, Chang & Yang, Jianxun, 2025. "Replication of Chan and Albarracín (2023) "A meta-analysis of correction effects in sciencerelevant misinformation"," I4R Discussion Paper Series 276, The Institute for Replication (I4R).
  • Handle: RePEc:zbw:i4rdps:276
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/333871/1/I4R-DP276.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Man-pui Sally Chan & Dolores Albarracín, 2023. "A meta-analysis of correction effects in science-relevant misinformation," Nature Human Behaviour, Nature, vol. 7(9), pages 1514-1525, September.
    2. Sander Linden & Matthew H. Goldberg, 2020. "Alternative meta-analysis of behavioral interventions to promote action on climate change yields different conclusions," Nature Communications, Nature, vol. 11(1), pages 1-2, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kelly M Amaddio & Jacob T Goebel & Jason K Clark & Duane T Wegener & R Kelly Garrett & Mark W Susmann & Srinivasan Parthasarathy, 2026. "Prior beliefs & automated fact checking: Limits on the effectiveness of AI-based corrections," PLOS ONE, Public Library of Science, vol. 21(2), pages 1-21, February.
    2. Hardaker, Adam & Asanov, Igor & Bartoš, František & Bruns, Stephan B., 2025. "No evidence for effectiveness of behavioral interventions to mitigate climate change after adjusting for publication bias," I4R Discussion Paper Series 263, The Institute for Replication (I4R).
    3. Perino, Grischa & Schwirplies, Claudia, 2022. "Meaty arguments and fishy effects: Field experimental evidence on the impact of reasons to reduce meat consumption," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
    4. Paul J. Ferraro & J. Dustin Tracy, 2022. "A reassessment of the potential for loss-framed incentive contracts to increase productivity: a meta-analysis and a real-effort experiment," Experimental Economics, Springer;Economic Science Association, vol. 25(5), pages 1441-1466, November.
    5. Louise Eriksson & John Armbrecht & Erik Lundberg, 2025. "Events and environmental sustainability: investigating the impact of environmental messaging and spillover mechanisms at a major sporting event in Sweden," Environment Systems and Decisions, Springer, vol. 45(3), pages 1-12, September.
    6. Tobia Spampatti & Ulf J. J. Hahnel & Evelina Trutnevyte & Tobias Brosch, 2024. "Psychological inoculation strategies to fight climate disinformation across 12 countries," Nature Human Behaviour, Nature, vol. 8(2), pages 380-398, February.
    7. Korosi, Stanley A PhD, 2026. "Beyond “More Parental Alienation Science”: Evidentiary Governance, Social Welfare Risk, and Credibility-Cue Laundering in Contested Family-Law Domains," SocArXiv n2ghr_v1, Center for Open Science.
    8. Myunghoon Kang & Chunho Park & Jisung Yoon & Greg Chih-Hsin Sheen, 2025. "Partisan attitudes and the motivation behind the spread of misleading information," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-12, December.
    9. Börjesson, Maria & Eliasson, Jonas, 2026. "Reducing traffic with “carrots”: A review of the evidence," Transportation Research Part A: Policy and Practice, Elsevier, vol. 203(C).
    10. Caballero, Mariah D. & Vandenbergh, Michael P. & Gilligan, Jonathan M. & Currier, Elodie O., 2024. "Incentivizing household action: Exploring the behavioral wedge in the 2021 Infrastructure Investment and Jobs Act and the 2022 Inflation Reduction Act," Energy Policy, Elsevier, vol. 186(C).
    11. Picard, Julien & Banerjee, Sanchayan, 2026. "Unpacking the side effects of social norm nudges," Ecological Economics, Elsevier, vol. 241(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:276. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.