Ten simple rules for good research practice
Author
Abstract
Suggested Citation
DOI: 10.1371/journal.pcbi.1010139
Download full text from publisher
References listed on IDEAS
- Anton Bespalov & Adrian G. Barnett & C. Glenn Begley, 2018. "Industry is more alarmed about reproducibility than academia," Nature, Nature, vol. 563(7733), pages 626-626, November.
- Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
- Rotem Botvinik-Nezer & Felix Holzmeister & Colin F. Camerer & Anna Dreber & Juergen Huber & Magnus Johannesson & Michael Kirchler & Roni Iwanir & Jeanette A. Mumford & R. Alison Adcock & Paolo Avesani, 2020. "Variability in the analysis of a single neuroimaging dataset by many teams," Nature, Nature, vol. 582(7810), pages 84-88, June.
- Monya Baker, 2016. "1,500 scientists lift the lid on reproducibility," Nature, Nature, vol. 533(7604), pages 452-454, May.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021.
"The influence of hidden researcher decisions in applied microeconomics,"
Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
- Huntington-Klein, Nick & Arenas, Andreu & Beam, Emily A. & Bertoni, Marco & Bloem, Jeffrey R. & Burli, Pralhad & Chen, Naibin & Greico, Paul & Ekpe, Godwin & Pugatch, Todd & Saavedra, Martin & Stopnit, 2020. "The Influence of Hidden Researcher Decisions in Applied Microeconomics," IZA Discussion Papers 13233, Institute of Labor Economics (IZA).
- Huntington-Klein, Nick & Arenas, Andreu & Beam, Emily & Bertoni, Marco & Bloem, Jeffrey R. & Burli, Pralhad & Chen, Naibin & Greico, Paul & Ekpe, Godwin & Pugatch, Todd & Saavedra, Martin & Stopnitzky, 2020. "The Influence of Hidden Researcher Decisions in Applied Microeconomics," GLO Discussion Paper Series 537, Global Labor Organization (GLO).
- Dennis Bontempi & Leonard Nuernberg & Suraj Pai & Deepa Krishnaswamy & Vamsi Thiriveedhi & Ahmed Hosny & Raymond H. Mak & Keyvan Farahani & Ron Kikinis & Andrey Fedorov & Hugo J. W. L. Aerts, 2024. "End-to-end reproducible AI pipelines in radiology using the cloud," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
- Anna Dreber & Magnus Johannesson, 2025.
"A framework for evaluating reproducibility and replicability in economics,"
Economic Inquiry, Western Economic Association International, vol. 63(2), pages 338-356, April.
- Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," Ruhr Economic Papers 1055, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," I4R Discussion Paper Series 38, The Institute for Replication (I4R).
- Fernando Hoces de la Guardia & Sean Grant & Edward Miguel, 2021.
"A framework for open policy analysis,"
Science and Public Policy, Oxford University Press, vol. 48(2), pages 154-163.
- Hoces de la Guardia, Fernando & Grant, Sean & Miguel, Edward, 2018. "A Framework for Open Policy Analysis," MetaArXiv jnyqh, Center for Open Science.
- de la Guardia, Fernando Hoces & Grant, Sean & Miguel, Edward, 2021. "A framework for open policy analysis," Department of Economics, Working Paper Series qt05r470xk, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Felix Holzmeister & Magnus Johannesson & Colin F. Camerer & Yiling Chen & Teck-Hua Ho & Suzanne Hoogeveen & Juergen Huber & Noriko Imai & Taisuke Imai & Lawrence Jin & Michael Kirchler & Alexander Ly , 2025. "Examining the replicability of online experiments selected by a decision market," Nature Human Behaviour, Nature, vol. 9(2), pages 316-330, February.
- Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johanneson & Michael Kirchler & Albert Menkveld & Michael Razen & Utz Weitzel, 2022. "Reproducibility of Empirical Results: Evidence from 1,000 Tests in Finance," Working Papers hal-03810013, HAL.
- Huntington-Klein, Nick & Pörtner, Claus C. & Acharya, Yubraj & Adamkovic, Matus & Adema, Joop & Agasa, Lameck Ondieki & Ahmad, Imtiaz & Akbulut-Yuksel, Mevlude & Andresen, Martin Eckhoff & Angenendt, , 2025.
"The Sources of Researcher Variation in Economics,"
I4R Discussion Paper Series
209, The Institute for Replication (I4R).
- Huntington-Klein, Nick & Portner, Claus C. & Gallegos, Sebastian & et al.,, 2025. "The Sources of Researcher Variation in Economics," IZA Discussion Papers 17744, Institute of Labor Economics (IZA).
- Nick Huntington-Klein & Claus C. Portner & Ian McCarthy & The Many Economists Collaborative on Researcher Variation, 2025. "The Sources of Researcher Variation in Economics," NBER Working Papers 33729, National Bureau of Economic Research, Inc.
- Schweinsberg, Martin & Feldman, Michael & Staub, Nicola & van den Akker, Olmo R. & van Aert, Robbie C.M. & van Assen, Marcel A.L.M. & Liu, Yang & Althoff, Tim & Heer, Jeffrey & Kale, Alex & Mohamed, Z, 2021. "Same data, different conclusions: Radical dispersion in empirical results when independent analysts operationalize and test the same hypothesis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 165(C), pages 228-249.
- Felix Holzmeister & Magnus Johannesson & Robert Böhm & Anna Dreber & Jürgen Huber & Michael Kirchler, 2023.
"Heterogeneity in effect size estimates: Empirical evidence and practical implications,"
Working Papers
2023-17, Faculty of Economics and Statistics, Universität Innsbruck.
- Holzmeister, Felix & Johannesson, Magnus & Böhm, Robert & Dreber, Anna & Huber, Jürgen & Kirchler, Michael, 2024. "Heterogeneity in Effect Size Estimates: Empirical Evidence and Practical Implications," I4R Discussion Paper Series 102, The Institute for Replication (I4R).
- Campbell, Douglas & Brodeur, Abel & Dreber, Anna & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "The Robustness Reproducibility of the American Economic Review," I4R Discussion Paper Series 124, The Institute for Replication (I4R).
- Chin, Jason & Zeiler, Kathryn, 2021.
"Replicability in Empirical Legal Research,"
LawArchive
2b5k4_v1, Center for Open Science.
- Chin, Jason & Zeiler, Kathryn, 2021. "Replicability in Empirical Legal Research," LawRxiv 2b5k4, Center for Open Science.
- Vu, Patrick, 2024. "Why are replication rates so low?," Journal of Econometrics, Elsevier, vol. 245(1).
- Cantone, Giulio Giacomo, 2023. "The multiversal methodology as a remedy of the replication crisis," MetaArXiv kuhmz, Center for Open Science.
- Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
- repec:osf:metaar:kuhmz_v1 is not listed on IDEAS
- Silvia Saccardo & Hengchen Dai & Maria A. Han & Sitaram Vangala & Juyea Hoo & Jeffrey Fujimoto, 2024. "Field testing the transferability of behavioural science knowledge on promoting vaccinations," Nature Human Behaviour, Nature, vol. 8(5), pages 878-890, May.
- Alexander Frankel & Maximilian Kasy, 2022.
"Which Findings Should Be Published?,"
American Economic Journal: Microeconomics, American Economic Association, vol. 14(1), pages 1-38, February.
- Kasy, Maximilian & Frankel, Alexander, 2018. "Which findings should be published?," MetaArXiv mbvz3, Center for Open Science.
- Alexandru Marcoci & David P. Wilkinson & Ans Vercammen & Bonnie C. Wintle & Anna Lou Abatayo & Ernest Baskin & Henk Berkman & Erin M. Buchanan & Sara Capitán & Tabaré Capitán & Ginny Chan & Kent Jason, 2025. "Predicting the replicability of social and behavioural science claims in COVID-19 preprints," Nature Human Behaviour, Nature, vol. 9(2), pages 287-304, February.
- Kleber Neves & Pedro B Tan & Olavo B Amaral, 2022. "Are most published research findings false in a continuous universe?," PLOS ONE, Public Library of Science, vol. 17(12), pages 1-18, December.
- Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
- Tom Coupé & W. Robert Reed, 2021.
"Do Negative Replications Affect Citations?,"
Working Papers in Economics
21/14, University of Canterbury, Department of Economics and Finance.
- Tom Coupé & W. Robert Reed, 2022. "Do Negative Replications Affect Citations?," Working Papers in Economics 22/02, University of Canterbury, Department of Economics and Finance.
- Tom Coupé & W. Robert Reed, 2022. "Do Negative Replications Affect Citations?," Working Papers in Economics 22/16, University of Canterbury, Department of Economics and Finance.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1010139. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.