IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/svzyc.html

Will knowledge about more efficient study designs increase the willingness to pre-register?

Author

Listed:
  • Lakens, Daniel

    (Eindhoven University of Technology)

Abstract

Pre-registration is a straightforward way to make science more transparant, and control Type 1 error rates. Pre-registration is often presented as beneficial for science in general, but rarely as a practice that leads to immediate individual benefits for researchers. One benefit of pre-registered studies is that they allow for non-conventional research designs that are more efficient than conventional designs. For example, by performing one-tailed tests and sequential analyses researchers can perform well-powered studies much more efficiently. Here, I examine whether such non-conventional but more efficient designs are considered appropriate by editors under the pre-condition that the analysis plans are pre-registered, and if so, whether researchers are more willing to pre-register their analysis plan to take advantage of the efficiency benefits of non-conventional designs. Study 1 shows the large majority of editors judged one-tailed tests and sequential analyses to be appropriate in psychology, but only when such analyses are pre-registered. In Study 2 I asked experimental psychologists to indicate their attitude towards pre-registration. Half of these researchers first read about the acceptence of one-tailed tests and sequential analyses by editors, and the efficiency gains of using these procedures. However, learning about the efficiency benefits associated with one-tailed tests and sequential analyses did not substantially influence researchers' attitudes about benefits and costs of pre-registration, or their willingness to pre-register studies. The self-reported likelihood of pre-registering studies in the next two years, as well as the percentage of studies researchers planned to pre-register in the future, was surprisingly high. 47% of respondents already had experience pre-registering, and 94% of respondents indicating that they would consider pre-registering at least some of their research in the future. Given this already strong self-reported willingness to pre-register studies, pointing out immediate individual benefits seems unlikely to be a useful way to increase researchers' willingness to pre-register any further.

Suggested Citation

  • Lakens, Daniel, 2017. "Will knowledge about more efficient study designs increase the willingness to pre-register?," MetaArXiv svzyc, Center for Open Science.
  • Handle: RePEc:osf:metaar:svzyc
    DOI: 10.31219/osf.io/svzyc
    as

    Download full text from publisher

    File URL: https://osf.io/download/58c7d9b6594d9001f71d85c1/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/svzyc?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Shane Frederick & George Loewenstein & Ted O'Donoghue, 2002. "Time Discounting and Time Preference: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 351-401, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Teklewold, Hailemariam, 2011. "Farming or burning? shadow prices and farmer’s impatience on the allocation of multi-purpose resource in the mixed farming system of Ethiopia," 2011 International Congress, August 30-September 2, 2011, Zurich, Switzerland 116080, European Association of Agricultural Economists.
    2. van den Bergh, J.C.J.M. & Botzen, W.J.W., 2015. "Monetary valuation of the social cost of CO2 emissions: A critical survey," Ecological Economics, Elsevier, vol. 114(C), pages 33-46.
    3. Leonhard K. Lades & Liam Delaney, 2024. "Self-control failures, as judged by themselves," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-14, December.
    4. Hinnosaar, Marit, 2016. "Time inconsistency and alcohol sales restrictions," European Economic Review, Elsevier, vol. 87(C), pages 108-131.
    5. Dong-Xuan, Bach & Qu, Xiangyu, 2025. "Restricted dominant unanimity and social discounting," Journal of Mathematical Economics, Elsevier, vol. 117(C).
    6. Caroline Flammer & Michael W. Toffel & Kala Viswanathan, 2021. "Shareholder activism and firms' voluntary disclosure of climate change risks," Strategic Management Journal, Wiley Blackwell, vol. 42(10), pages 1850-1879, October.
    7. Min Gong & David Krantz & Elke Weber, 2014. "Why Chinese discount future financial and environmental gains but not losses more than Americans," Journal of Risk and Uncertainty, Springer, vol. 49(2), pages 103-124, October.
    8. Cosmo, Valeria Di & O’Hora, Denis, 2017. "Nudging electricity consumption using TOU pricing and feedback: evidence from Irish households," Journal of Economic Psychology, Elsevier, vol. 61(C), pages 1-14.
    9. Mitchell, O.S. & Piggott, J., 2016. "Workplace-Linked Pensions for an Aging Demographic," Handbook of the Economics of Population Aging, in: Piggott, John & Woodland, Alan (ed.), Handbook of the Economics of Population Aging, edition 1, volume 1, chapter 0, pages 865-904, Elsevier.
    10. Aman, Hiroyuki & Motonishi, Taizo & Ogawa, Kazuhito & Omori, Kozo, 2024. "The effect of financial literacy on long-term recognition and short-term trade in mutual funds: Evidence from Japan," International Review of Economics & Finance, Elsevier, vol. 89(PB), pages 762-783.
    11. Kimmich, Christian & Fischbacher, Urs, 2016. "Behavioral determinants of supply chain integration and coexistence," Journal of Forest Economics, Elsevier, vol. 25(C), pages 55-77.
    12. Stephen L. Cheung & Agnieszka Tymula & Xueting Wang, 2022. "Present bias for monetary and dietary rewards," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1202-1233, September.
    13. Luc Arrondel & André Masson, 2013. "Measuring savers' preferences how and why?," PSE Working Papers halshs-00834203, HAL.
    14. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    15. Yue Wang & Xiaoyu Wang & Xiao Yang & Fangyuan Yuan & Ying Li, 2023. "View of Times and Temporal Focus under the Pace of Life on the Impact of Intertemporal Decision Making," IJERPH, MDPI, vol. 20(5), pages 1-13, February.
    16. Atahan Afsar; José Elías Gallegos; Richard Jaimes; Edgar Silgado Gómez & Jos� El�as Gallegos & Richard Jaimes & Edgar Silgado G�mez, 2020. "Reconciling Empirics and Theory: The Behavioral Hybrid New Keynesian Model," Vniversitas Económica, Universidad Javeriana - Bogotá, vol. 0(0), pages 1-41.
    17. Marieka M. Klawitter & C. Leigh Anderson & Mary Kay Gugerty, 2013. "Savings And Personal Discount Rates In A Matched Savings Program For Low-Income Families," Contemporary Economic Policy, Western Economic Association International, vol. 31(3), pages 468-485, July.
    18. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    19. Belzil, Christian & Sidibé, Modibo, 2016. "Internal and External Validity of Experimental Risk and Time Preferences," IZA Discussion Papers 10348, Institute of Labor Economics (IZA).
    20. Fischbacher, Urs & Schudy, Simeon & Teyssier, Sabrina, 2021. "Heterogeneous preferences and investments in energy saving measures," Resource and Energy Economics, Elsevier, vol. 63(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:svzyc. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.