IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/svzyc.html
   My bibliography  Save this paper

Will knowledge about more efficient study designs increase the willingness to pre-register?

Author

Listed:
  • Lakens, Daniel

    (Eindhoven University of Technology)

Abstract

Pre-registration is a straightforward way to make science more transparant, and control Type 1 error rates. Pre-registration is often presented as beneficial for science in general, but rarely as a practice that leads to immediate individual benefits for researchers. One benefit of pre-registered studies is that they allow for non-conventional research designs that are more efficient than conventional designs. For example, by performing one-tailed tests and sequential analyses researchers can perform well-powered studies much more efficiently. Here, I examine whether such non-conventional but more efficient designs are considered appropriate by editors under the pre-condition that the analysis plans are pre-registered, and if so, whether researchers are more willing to pre-register their analysis plan to take advantage of the efficiency benefits of non-conventional designs. Study 1 shows the large majority of editors judged one-tailed tests and sequential analyses to be appropriate in psychology, but only when such analyses are pre-registered. In Study 2 I asked experimental psychologists to indicate their attitude towards pre-registration. Half of these researchers first read about the acceptence of one-tailed tests and sequential analyses by editors, and the efficiency gains of using these procedures. However, learning about the efficiency benefits associated with one-tailed tests and sequential analyses did not substantially influence researchers' attitudes about benefits and costs of pre-registration, or their willingness to pre-register studies. The self-reported likelihood of pre-registering studies in the next two years, as well as the percentage of studies researchers planned to pre-register in the future, was surprisingly high. 47% of respondents already had experience pre-registering, and 94% of respondents indicating that they would consider pre-registering at least some of their research in the future. Given this already strong self-reported willingness to pre-register studies, pointing out immediate individual benefits seems unlikely to be a useful way to increase researchers' willingness to pre-register any further.

Suggested Citation

  • Lakens, Daniel, 2017. "Will knowledge about more efficient study designs increase the willingness to pre-register?," MetaArXiv svzyc, Center for Open Science.
  • Handle: RePEc:osf:metaar:svzyc
    DOI: 10.31219/osf.io/svzyc
    as

    Download full text from publisher

    File URL: https://osf.io/download/58c7d9b6594d9001f71d85c1/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/svzyc?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Shane Frederick & George Loewenstein & Ted O'Donoghue, 2002. "Time Discounting and Time Preference: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 351-401, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hinnosaar, Marit, 2016. "Time inconsistency and alcohol sales restrictions," European Economic Review, Elsevier, vol. 87(C), pages 108-131.
    2. Caroline Flammer & Michael W. Toffel & Kala Viswanathan, 2021. "Shareholder activism and firms' voluntary disclosure of climate change risks," Strategic Management Journal, Wiley Blackwell, vol. 42(10), pages 1850-1879, October.
    3. Matteo Iacoviello, 2008. "Household Debt and Income Inequality, 1963–2003," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(5), pages 929-965, August.
    4. repec:cup:judgdm:v:16:y:2021:i:3:p:709-728 is not listed on IDEAS
    5. Richard M. H. Suen, 2014. "Time Preference And The Distributions Of Wealth And Income," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 364-381, January.
    6. Mitchell, O.S. & Piggott, J., 2016. "Workplace-Linked Pensions for an Aging Demographic," Handbook of the Economics of Population Aging, in: Piggott, John & Woodland, Alan (ed.), Handbook of the Economics of Population Aging, edition 1, volume 1, chapter 0, pages 865-904, Elsevier.
    7. Filiz-Ozbay, Emel & Guryan, Jonathan & Hyndman, Kyle & Kearney, Melissa & Ozbay, Erkut Y., 2015. "Do lottery payments induce savings behavior? Evidence from the lab," Journal of Public Economics, Elsevier, vol. 126(C), pages 1-24.
    8. Stephen L. Cheung & Agnieszka Tymula & Xueting Wang, 2022. "Present bias for monetary and dietary rewards," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1202-1233, September.
    9. Luc Arrondel & André Masson, 2013. "Measuring savers' preferences how and why?," PSE Working Papers halshs-00834203, HAL.
    10. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    11. Andreoni, James & Serra-Garcia, Marta, 2021. "Time inconsistent charitable giving," Journal of Public Economics, Elsevier, vol. 198(C).
    12. Atahan Afsar; José Elías Gallegos; Richard Jaimes; Edgar Silgado Gómez & José Elías Gallegos & Richard Jaimes & Edgar Silgado Gómez, 2020. "Reconciling Empirics and Theory: The Behavioral Hybrid New Keynesian Model," Vniversitas Económica 18560, Universidad Javeriana - Bogotá.
    13. Marieka M. Klawitter & C. Leigh Anderson & Mary Kay Gugerty, 2013. "Savings And Personal Discount Rates In A Matched Savings Program For Low-Income Families," Contemporary Economic Policy, Western Economic Association International, vol. 31(3), pages 468-485, July.
    14. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    15. Kapteyn, Arie & Kleinjans, Kristin J. & van Soest, Arthur, 2009. "Intertemporal consumption with directly measured welfare functions and subjective expectations," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 425-437, October.
    16. Jawwad Noor, 2005. "Choice and Normative Preference," Boston University - Department of Economics - Working Papers Series WP2005-039, Boston University - Department of Economics.
    17. De Paola, Maria & Scoppa, Vincenzo, 2015. "Procrastination, academic success and the effectiveness of a remedial program," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 217-236.
    18. Ehmke, Mariah & Lusk, Jayson & Tyner, Wallace, 2010. "Multidimensional tests for economic behavior differences across cultures," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(1), pages 37-45, January.
    19. Stefania Albanesi & Claudia Olivetti, 2006. "Gender roles and technological progress," 2006 Meeting Papers 411, Society for Economic Dynamics.
    20. Abhijit Banerjee & Emily Breza & Esther Duflo & Cynthia Kinnan, 2019. "Can Microfinance Unlock a Poverty Trap for Some Entrepreneurs?," NBER Working Papers 26346, National Bureau of Economic Research, Inc.
    21. Tiago Sequeira, 2012. "Facts and distortions in an endogenous growth model with physical capital, human capital and varieties," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 11(3), pages 171-188, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:svzyc. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.