IDEAS home Printed from https://ideas.repec.org/p/dpr/wpaper/1283.html
   My bibliography  Save this paper

Pre-Registration and Pre-Analysis Plans in Experimental Economics

Author

Listed:
  • Taisuke Imai
  • Séverine Toussaert
  • Aurélien Baillon
  • Anna Dreber
  • Seda Ertaç
  • Magnus Johannesson
  • Levent Neyse
  • Marie Claire Villeval

Abstract

The open science movement has gained significant momentum over the past decade, with pre-registration and the use of pre-analysis plans being central to ongoing debates. Combining observational evidence on trends in adoption with survey data from 519 researchers, this study examines the adoption of pre-registration (potentially but not necessarily including pre-analysis plans) in experimental economics. Pooling statistics from 19 leading journals published between 2017 and 2023, we observe that the number of papers containing a pre-registration grew from seven per year to 190 per year. Our findings indicate that pre-registration has now become mainstream in experimental economics, with two-thirds of respondents expressing favorable views and 86% having pre-registered at least one study. However, opinions are divided on the scope and comprehensiveness of pre-registration, highlighting the need for clearer guidelines. Researchers assign a credibility premium to pre-registered tests, although the exact channels remain to be understood. Our results suggest growing support for open science practices among experimental economists, with demand for professional associations to guide researchers and reviewers on best practices for pre-registration and other open science initiatives.

Suggested Citation

  • Taisuke Imai & Séverine Toussaert & Aurélien Baillon & Anna Dreber & Seda Ertaç & Magnus Johannesson & Levent Neyse & Marie Claire Villeval, 2025. "Pre-Registration and Pre-Analysis Plans in Experimental Economics," ISER Discussion Paper 1283, Institute of Social and Economic Research, The University of Osaka.
    • Handle: RePEc:dpr:wpaper:1283
    as

    Download full text from publisher

    File URL: https://www.iser.osaka-u.ac.jp/static/resources/docs/dp/DP1283.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Abhijit Banerjee & Esther Duflo & Amy Finkelstein & Lawrence F. Katz & Benjamin A. Olken & Anja Sautmann, 2020. "In Praise of Moderation: Suggestions for the Scope and Use of Pre-Analysis Plans for RCTs in Economics," NBER Working Papers 26993, National Bureau of Economic Research, Inc.
    2. Sylvain Mathieu & An-Wen Chan & Philippe Ravaud, 2013. "Use of Trial Register Information during the Peer Review Process," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-4, April.
    3. Marjan Bakker & Coosje L S Veldkamp & Marcel A L M van Assen & Elise A V Crompvoets & How Hwee Ong & Brian A Nosek & Courtney K Soderberg & David Mellor & Jelte M Wicherts, 2020. "Ensuring the quality and specificity of preregistrations," PLOS Biology, Public Library of Science, vol. 18(12), pages 1-18, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Imai, Taisuke & Toussaert, Séverine & Baillon, Aurélien & Dreber, Anna & Ertaç, Seda & Johannesson, Magnus & Neyse, Levent & Villeval, Marie Claire, 2025. "Pre-Registration and Pre-Analysis Plans in Experimental Economics," I4R Discussion Paper Series 220, The Institute for Replication (I4R).
    2. Taisuke Imai & Séverine Toussaert & Aurélien Baillon & Anna Drever & Seda Ertaç & Magnus Johannesson & Levent Neyse & Marie Claire Villeval, 2025. "Pre-Registration and Pre-Analysis Plans in Experimental Economics," Rationality and Competition Discussion Paper Series 530, CRC TRR 190 Rationality and Competition.
    3. Imai, Taisuke & Toussaert, Séverine & Baillon, Aurélien & Dreber, Anna & Ertaç, Seda & Johannesson, Magnus & Neyse, Levent & Villeval, Marie Claire, 2025. "Pre-Registration and Pre-Analysis Plans in Experimental Economics," I4R Discussion Paper Series 220, The Institute for Replication (I4R).
    4. Heckelei, Thomas & Huettel, Silke & Odening, Martin & Rommel, Jens, 2021. "The replicability crisis and the p-value debate – what are the consequences for the agricultural and food economics community?," Discussion Papers 316369, University of Bonn, Institute for Food and Resource Economics.
    5. Button, Patrick & Walker, Brigham, 2020. "Employment discrimination against Indigenous Peoples in the United States: Evidence from a field experiment," Labour Economics, Elsevier, vol. 65(C).
    6. Lars Behlen & Oliver Himmler & Robert Jäckle, 2023. "Defaults and effortful tasks," Experimental Economics, Springer;Economic Science Association, vol. 26(5), pages 1022-1059, November.
    7. Jeffrey D. Michler & Dewan Abdullah Al Rafi & Jonathan Giezendanner & Anna Josephson & Valerien O. Pede & Elizabeth Tellman, 2024. "Impact Evaluations in Data Poor Settings: The Case of Stress-Tolerant Rice Varieties in Bangladesh," Papers 2409.02201, arXiv.org.
    8. Maximilian Kasy & Jann Spiess, 2022. "Rationalizing Pre-Analysis Plans:Statistical Decisions Subject to Implementability," Economics Series Working Papers 975, University of Oxford, Department of Economics.
    9. Abhijit Banerjee & Rema Hanna & Benjamin A Olken & Elan Satriawan & Sudarno Sumarto, "undated". "Pangan versus Kupon Makanan: Bukti dari Eksperimen Berskala Besar di Indonesia," Working Papers 3537, Communications Section.
    10. Thibaut Arpinon & Romain Espinosa, 2023. "A practical guide to Registered Reports for economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 9(1), pages 90-122, June.
    11. Kai Barron & Tilman Fries, 2023. "Narrative Persuasion," Rationality and Competition Discussion Paper Series 469, CRC TRR 190 Rationality and Competition.
    12. Dalton, Patricio & Rüschenpöhler, Julius & Uras, Burak & Zia, Bilal, 2020. "Curating Local Knowledge : Experimental Evidence from Small Retailers in Indonesia (Revision of DP 2019-015)," Other publications TiSEM 5c5fc2c6-7cfe-4fa9-b1d1-4, Tilburg University, School of Economics and Management.
    13. Eliot Abrams & Jonathan Libgober & John A. List, 2020. "Research Registries: Facts, Myths, and Possible Improvements," NBER Working Papers 27250, National Bureau of Economic Research, Inc.
    14. Diarmaid Ó Ceallaigh & Kirsten I.M. Rohde & Hans van Kippersluis, 2024. "Skipping your workout, again? Measuring and understanding time inconsistency in physical activity," Tinbergen Institute Discussion Papers 24-028/V, Tinbergen Institute.
    15. Abel Brodeur & Nikolai M. Cook & Jonathan S. Hartley & Anthony Heyes, 2024. "Do Preregistration and Preanalysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement," Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(3), pages 527-561.
    16. Nathan Fiala & Ana Garcia-Hernandez & Kritika Narula & Nishith Prakash, 2022. "Wheels of Change: Transforming Girls’ Lives with Bicycles," Working papers 2022-04, University of Connecticut, Department of Economics.
    17. Gleue, Marvin & Harrs, Sören & Feldhaus, Christoph & Löschel, Andreas, 2024. "Identity and voluntary efforts for climate protection," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 436-476.
    18. Andrea Mattozzi & Samuel Nocito & Francesco Sobbrio, 2022. "Fact-Checking Politicians," CESifo Working Paper Series 10122, CESifo.
    19. Michler, Jeffrey D. & Josephson, Anna & Kilic, Talip & Murray, Siobhan, 2022. "Privacy protection, measurement error, and the integration of remote sensing and socioeconomic survey data," Journal of Development Economics, Elsevier, vol. 158(C).
    20. Goetz, Alexander & Mayr, Harald & Schubert, Renate, 2024. "One thing leads to another: Evidence on the scope and persistence of behavioral spillovers," Journal of Public Economics, Elsevier, vol. 236(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dpr:wpaper:1283. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Librarian (email available below). General contact details of provider: https://edirc.repec.org/data/isosujp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.