IDEAS home Printed from https://ideas.repec.org/p/zbw/i4rdps/263.html
   My bibliography  Save this paper

No evidence for effectiveness of behavioral interventions to mitigate climate change after adjusting for publication bias

Author

Listed:
  • Hardaker, Adam
  • Asanov, Igor
  • Bartoš, František
  • Bruns, Stephan B.

Abstract

Behavioral interventions on citizens are often promoted as a low-cost route to induce environmen-tally friendly behavior, yet published estimates of their effectiveness are highly variable and prone to selective reporting. We reanalyzed the evidence of behavioral interventions on citizens. We con-ducted Robust Bayesian Meta-Analysis (RoBMA), averaging across a full set of publication-bias adjusted models, to the 144 effect estimates (91 studies) compiled by Nisa et al. (2019). The bias-adjusted model-averaged posterior mean standardized effect of behavioral interventions on citizens is shrunk to 0.00 (95 % credible interval 0.00; 0.00), with a Bayes factor of 66 favoring the null. Accordingly, the previously reported noteworthy mean benefit of -0.093 (95% confidence interval -0.123; -0.063) of behavioral interventions, including promising light-touch interventions (nudges or social comparison), on households and individuals is an artefact of publication bias. There is, how-ever, evidence for small between-study heterogeneity, indicating that some specific interventions might have an effect. Exploratory subgroup tests offered only weak, inconsistent hints of context-specific gains. These results imply that, on average, behavioral interventions on households and individuals are unlikely to deliver material climate benefits.

Suggested Citation

  • Hardaker, Adam & Asanov, Igor & Bartoš, František & Bruns, Stephan B., 2025. "No evidence for effectiveness of behavioral interventions to mitigate climate change after adjusting for publication bias," I4R Discussion Paper Series 263, The Institute for Replication (I4R).
  • Handle: RePEc:zbw:i4rdps:263
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/326982/1/I4R-DP263.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Niklas Döbbeling-Hildebrandt & Klaas Miersch & Tarun M. Khanna & Marion Bachelet & Stephan B. Bruns & Max Callaghan & Ottmar Edenhofer & Christian Flachsland & Piers M. Forster & Matthias Kalkuhl & Ni, 2024. "Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    2. Jack Vevea & Larry Hedges, 1995. "A general linear model for estimating effect size in the presence of publication bias," Psychometrika, Springer;The Psychometric Society, vol. 60(3), pages 419-435, September.
    3. Wilhelm Hofmann & Cornelia Betsch & Robert Böhm & Denise Ridder & Stefan Drews & Benjamin Ewert & Ralph Hertwig & Falko F. Sniehotta & Jutta Mata, 2025. "Rethinking behaviour change interventions in policymaking," Nature Human Behaviour, Nature, vol. 9(9), pages 1765-1767, September.
    4. Sander Linden & Matthew H. Goldberg, 2020. "Alternative meta-analysis of behavioral interventions to promote action on climate change yields different conclusions," Nature Communications, Nature, vol. 11(1), pages 1-2, December.
    5. Claudia F. Nisa & Jocelyn J. Bélanger & Birga M. Schumpe & Daiane G. Faller, 2019. "Meta-analysis of randomised controlled trials testing behavioural interventions to promote household action on climate change," Nature Communications, Nature, vol. 10(1), pages 1-13, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perino, Grischa & Schwirplies, Claudia, 2022. "Meaty arguments and fishy effects: Field experimental evidence on the impact of reasons to reduce meat consumption," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
    2. Louise Eriksson & John Armbrecht & Erik Lundberg, 2025. "Events and environmental sustainability: investigating the impact of environmental messaging and spillover mechanisms at a major sporting event in Sweden," Environment Systems and Decisions, Springer, vol. 45(3), pages 1-12, September.
    3. Caballero, Mariah D. & Vandenbergh, Michael P. & Gilligan, Jonathan M. & Currier, Elodie O., 2024. "Incentivizing household action: Exploring the behavioral wedge in the 2021 Infrastructure Investment and Jobs Act and the 2022 Inflation Reduction Act," Energy Policy, Elsevier, vol. 186(C).
    4. Phu Nguyen-Van & Anne Stenger & Tuyen Tiet, 2021. "Social incentive factors in interventions promoting sustainable behaviors: A meta-analysis," PLOS ONE, Public Library of Science, vol. 16(12), pages 1-27, December.
    5. Heidi E Brown & Erika Austhof & Paula M Luz & Daniel B Ferguson, 2023. "Economics, health, or environment: What motivates individual climate action?," PLOS Climate, Public Library of Science, vol. 2(8), pages 1-16, August.
    6. Jonas Moss & Riccardo De Bin, 2023. "Modelling publication bias and p‐hacking," Biometrics, The International Biometric Society, vol. 79(1), pages 319-331, March.
    7. Wang, Chao & Zhan, Jinyan & Wang, Huihui & Yang, Zheng & Chu, Xi & Liu, Wei & Teng, Yanmin & Liu, Huizi & Wang, Yifan, 2022. "Multi-group analysis on the mechanism of residents' low-carbon behaviors in Beijing, China," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    8. Zuzana Irsova & Hristos Doucouliagos & Tomas Havranek & T. D. Stanley, 2024. "Meta‐analysis of social science research: A practitioner's guide," Journal of Economic Surveys, Wiley Blackwell, vol. 38(5), pages 1547-1566, December.
    9. Mišák, Vojtěch, 2024. "Does heat cause homicides? A meta-analysis," International Review of Law and Economics, Elsevier, vol. 78(C).
    10. Pritchett, Lant & Filmer, Deon, 1999. "What education production functions really show: a positive theory of education expenditures," Economics of Education Review, Elsevier, vol. 18(2), pages 223-239, April.
    11. Wändi Bruine de Bruin & Laurel Kruke & Gale M. Sinatra & Norbert Schwarz, 2024. "Should we change the term we use for “climate change”? Evidence from a national U.S. terminology experiment," Climatic Change, Springer, vol. 177(8), pages 1-21, August.
    12. Anthony Biglan & Andrew C. Bonner & Magnus Johansson & Jessica L. Ghai & Mark J. Van Ryzin & Tiffany L. Dubuc & Holly A. Seniuk & Julia H. Fiebig & Lisa W. Coyne, 2020. "The State of Experimental Research on Community Interventions to Reduce Greenhouse Gas Emissions—A Systematic Review," Sustainability, MDPI, vol. 12(18), pages 1-19, September.
    13. Xiaofeng Xu & Miaomiao Li & Ho Kwong Kwan & Xiaomeng Zhang, 2024. "The antecedents of moral identity: A meta-analytic review," Asia Pacific Journal of Management, Springer, vol. 41(3), pages 1697-1728, September.
    14. Élise Labonté-LeMoyne & Shang-Lin Chen & Constantinos K. Coursaris & Sylvain Sénécal & Pierre-Majorique Léger, 2020. "The Unintended Consequences of COVID-19 Mitigation Measures on Mass Transit and Car Use," Sustainability, MDPI, vol. 12(23), pages 1-13, November.
    15. repec:osf:metaar:3qp2w_v1 is not listed on IDEAS
    16. Lopez-Rivas, Jose D., 2024. "Spreading the word! Effects of a randomized normative informational campaign on residential water conservation," Resource and Energy Economics, Elsevier, vol. 79.
    17. Miaomiao Li & Xiaofeng Xu & Ho Kwong Kwan, 2023. "The antecedents and consequences of workplace envy: A meta-analytic review," Asia Pacific Journal of Management, Springer, vol. 40(1), pages 1-35, March.
    18. Thole H. Hoppen & Rieke M. Cuno & Janna Nelson & Frederike Lemmel & Pascal Schlechter & Nexhmedin Morina, 2025. "Meta-analysis of randomized controlled trials examining social comparison as a behaviour change technique across the behavioural sciences," Nature Human Behaviour, Nature, vol. 9(8), pages 1595-1612, August.
    19. Maya B. Mathur & Tyler J. VanderWeele, 2020. "Sensitivity analysis for publication bias in meta‐analyses," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(5), pages 1091-1119, November.
    20. Khanna, Tarun M. & Danilenko, Diana & Tomberg, Lukas & Hansteen, Sven & Andor, Mark Andreas & Lohmann, Paul & Minx, Jan C., 2025. "Meta-analysis on the efficacy of behavioral, information and economic interventions in increasing energy-efficiency adoption among households," Ruhr Economic Papers 1141, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    21. Cort W. Rudolph & Jack C. Friedrich & Ryszard J. Koziel & Hannes Zacher, 2025. "Character Strengths Use at Work: a Meta-Analysis of Relations with Work Performance and Employee Wellbeing," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 20(2), pages 753-788, April.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:263. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.