IDEAS home Printed from https://ideas.repec.org/a/nat/nathum/v5y2021i8d10.1038_s41562-021-01143-3.html
   My bibliography  Save this article

Behavioural science is unlikely to change the world without a heterogeneity revolution

Author

Listed:
  • Christopher J. Bryan

    (University of Texas at Austin)

  • Elizabeth Tipton

    (Northwestern University)

  • David S. Yeager

    (University of Texas at Austin)

Abstract

In the past decade, behavioural science has gained influence in policymaking but suffered a crisis of confidence in the replicability of its findings. Here, we describe a nascent heterogeneity revolution that we believe these twin historical trends have triggered. This revolution will be defined by the recognition that most treatment effects are heterogeneous, so the variation in effect estimates across studies that defines the replication crisis is to be expected as long as heterogeneous effects are studied without a systematic approach to sampling and moderation. When studied systematically, heterogeneity can be leveraged to build more complete theories of causal mechanism that could inform nuanced and dependable guidance to policymakers. We recommend investment in shared research infrastructure to make it feasible to study behavioural interventions in heterogeneous and generalizable samples, and suggest low-cost steps researchers can take immediately to avoid being misled by heterogeneity and begin to learn from it instead.

Suggested Citation

  • Christopher J. Bryan & Elizabeth Tipton & David S. Yeager, 2021. "Behavioural science is unlikely to change the world without a heterogeneity revolution," Nature Human Behaviour, Nature, vol. 5(8), pages 980-989, August.
  • Handle: RePEc:nat:nathum:v:5:y:2021:i:8:d:10.1038_s41562-021-01143-3
    DOI: 10.1038/s41562-021-01143-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41562-021-01143-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1038/s41562-021-01143-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bauer, Jan M. & Aarestrup, Simon C. & Hansen, Pelle G. & Reisch, Lucia A., 2022. "Nudging more sustainable grocery purchases: Behavioural innovations in a supermarket setting," Technological Forecasting and Social Change, Elsevier, vol. 179(C).
    2. Brade, Raphael, 2022. "Social Information and Educational Investment - Nudging Remedial Math Course Participation," MPRA Paper 113076, University Library of Munich, Germany.
    3. Paulius Yamin & Luis Artavia-Mora & Benita Martunaite & Shaon Lahiri, 2023. "Installations for Civic Culture: Behavioral Policy Interventions to Promote Social Sustainability," Sustainability, MDPI, vol. 15(4), pages 1-21, February.
    4. Lars Behlen & Oliver Himmler & Robert Jäckle, 2023. "Defaults and effortful tasks," Experimental Economics, Springer;Economic Science Association, vol. 26(5), pages 1022-1059, November.
    5. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
    6. Christoph Huber & Anna Dreber & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Utz Weitzel & Miguel Abellán & Xeniya Adayeva & Fehime Ceren Ay & Kai Barron & Zachariah Berry & Werner Bönte , 2023. "Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 120(23), pages 2215572120-, June.
    7. Felix Holzmeister & Magnus Johannesson & Robert Böhm & Anna Dreber & Jürgen Huber & Michael Kirchler, 2023. "Heterogeneity in effect size estimates: Empirical evidence and practical implications," Working Papers 2023-17, Faculty of Economics and Statistics, Universität Innsbruck.
    8. Picard, Julien & Banerjee, Sanchayan, 2023. "Behavioural spillovers unpacked: estimating the side effects of social norm nudges," LSE Research Online Documents on Economics 120566, London School of Economics and Political Science, LSE Library.
    9. Susan Hanisch & Dustin Eirdosh, 2023. "Behavioral Science and Education for Sustainable Development: Towards Metacognitive Competency," Sustainability, MDPI, vol. 15(9), pages 1-30, April.
    10. Tomas Folke & Giulia Bertoldo & Darlene D’Souza & Sonia Alì & Federica Stablum & Kai Ruggeri, 2021. "Boosting promotes advantageous risk-taking," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-10, December.
    11. Behlen, Lars & Himmler, Oliver & Jaeckle, Robert, 2022. "Can defaults change behavior when post-intervention effort is required? Evidence from education," MPRA Paper 112962, University Library of Munich, Germany.
    12. Piasenti, Stefano & Valente, Marica & Van Veldhuizen, Roel & Pfeifer, Gregor, 2023. "Does Unfairness Hurt Women? The Effects of Losing Unfair Competitions," Working Papers 2023:7, Lund University, Department of Economics.
    13. Zenker, Frank & Witte, Erich H., 2021. "The case for default point-H1-hypotheses: a theory-construction perspective," OSF Preprints zue4h, Center for Open Science.
    14. Tobia Spampatti & Ulf J. J. Hahnel & Evelina Trutnevyte & Tobias Brosch, 2024. "Psychological inoculation strategies to fight climate disinformation across 12 countries," Nature Human Behaviour, Nature, vol. 8(2), pages 380-398, February.
    15. Giuseppe Attanasi & Barbara Buljat Raymond & Agnès Festré & Andrea Guido, 2023. "Augmented Reality Technology as a Tool for Promoting Pro-environmental Behavior and Attitudes," GREDEG Working Papers 2023-15, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    16. Hahnel, Ulf J.J. & Fell, Michael J., 2022. "Pricing decisions in peer-to-peer and prosumer-centred electricity markets: Experimental analysis in Germany and the United Kingdom," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    17. Rafael Quintana, 2023. "Embracing complexity in social science research," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 15-38, February.
    18. S. Mills & S. Costa & C. R. Sunstein, 2023. "AI, Behavioural Science, and Consumer Welfare," Journal of Consumer Policy, Springer, vol. 46(3), pages 387-400, September.
    19. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    20. Bauer, Jan M. & Nielsen, Kristian S. & Hofmann, Wilhelm & Reisch, Lucia A., 2022. "Healthy eating in the wild: An experience-sampling study of how food environments and situational factors shape out-of-home dietary success," Social Science & Medicine, Elsevier, vol. 299(C).
    21. Kim, Jennifer Y. & Brockner, Joel & Block, Caryn J., 2022. "Tailoring the intervention to the self: Congruence between self-affirmation and self-construal mitigates the gender gap in quantitative performance," Organizational Behavior and Human Decision Processes, Elsevier, vol. 169(C).
    22. Randall, Jason G. & Dalal, Dev K. & Dowden, Aileen, 2023. "Factors associated with contact tracing compliance among communities of color in the first year of the COVID-19 pandemic," Social Science & Medicine, Elsevier, vol. 322(C).
    23. Heyard, Rachel & Held, Leonhard, 2024. "Meta-regression to explain shrinkage and heterogeneity in large-scale replication projects," MetaArXiv e9nw2, Center for Open Science.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:nathum:v:5:y:2021:i:8:d:10.1038_s41562-021-01143-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.