IDEAS home Printed from https://ideas.repec.org/r/aea/jecper/v29y2015i3p81-98.html

Pre-analysis Plans Have Limited Upside, Especially Where Replications Are Feasible

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as


Cited by:

  1. Coupé, Tom & Reed, W. Robert & Zimmermann, Christian, 2023. "Getting seen: Results from an online experiment to draw more attention to replications," Research Policy, Elsevier, vol. 52(8).
  2. Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
  3. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
  4. Alpino, Matteo & Hauge, Karen Evelyn & Kotsadam, Andreas & Markussen, Simen, 2022. "Effects of dialogue meetings on sickness absence—Evidence from a large field experiment," Journal of Health Economics, Elsevier, vol. 83(C).
  5. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
  6. Charness, Gary & Le Bihan, Yves & Villeval, Marie Claire, 2024. "Mindfulness training, cognitive performance and stress reduction," Journal of Economic Behavior & Organization, Elsevier, vol. 217(C), pages 207-226.
  7. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 48(1), pages 62-83.
  8. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Working Papers halshs-01651080, HAL.
  9. Sevim, Dilek & Baranov, Victoria & Bhalotra, Sonia R. & Maselko, Joanna & Biroli, Pietro, 2023. "Socioemotional Skills in Early Childhood: Evidence from a Maternal Psychosocial Intervention," IZA Discussion Papers 15925, IZA Network @ LISER.
  10. Lucas C. Coffman & Muriel Niederle & Alistair J. Wilson, 2017. "A Proposal to Organize and Promote Replications," American Economic Review, American Economic Association, vol. 107(5), pages 41-45, May.
  11. Owen Ozier, 2021. "Replication Redux: The Reproducibility Crisis and the Case of Deworming [Economics of Mass Deworming Programs]," The World Bank Research Observer, World Bank, vol. 36(1), pages 101-130.
  12. Luigi Butera & Philip Grossman & Daniel Houser & John List & Marie-Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science - With an Application to the Public Goods Game," Artefactual Field Experiments 00684, The Field Experiments Website.
  13. Weili Ding, 2020. "Laboratory experiments can pre-design to address power and selection issues," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(2), pages 125-138, December.
  14. Brodeur, Abel & Cook, Nikolai & Hartley, Jonathan & Heyes, Anthony, 2022. "Do Pre-Registration and Pre-analysis Plans Reduce p-Hacking and Publication Bias?," MetaArXiv uxf39, Center for Open Science.
  15. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
  16. Maximilian Kasy & Jann Spiess, 2022. "Optimal Pre-Analysis Plans: Statistical Decisions Subject to Implementability," Papers 2208.09638, arXiv.org, revised Jul 2024.
  17. So, Tony, 2020. "Classroom experiments as a replication device," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 86(C).
  18. Leonardo Iacovone & David McKenzie & Rachael Meager, 2025. "Bayesian Impact Evaluation With Informative Priors: An Application to a Colombian Management and Export Improvement Program," Econometrica, Econometric Society, vol. 93(5), pages 1915-1935, September.
  19. Sarah A. Janzen & Jeffrey D. Michler, 2021. "Ulysses' pact or Ulysses' raft: Using pre‐analysis plans in experimental and nonexperimental research," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1286-1304, December.
  20. Jan Jozwik, 2024. "Eliciting risk preferences in an artefactual field experiment via replication and an alternative approach," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 10(2), pages 442-456, December.
  21. Burlig, Fiona, 2018. "Improving transparency in observational social science research: A pre-analysis plan approach," Economics Letters, Elsevier, vol. 168(C), pages 56-60.
  22. Roy Chen & Yan Chen & Yohanes E. Riyanto, 2021. "Best practices in replication: a case study of common information in coordination games," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 2-30, March.
  23. W. Robert Reed, 2018. "A Primer on the ‘Reproducibility Crisis’ and Ways to Fix It," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 51(2), pages 286-300, June.
  24. Brinkerink, Jasper & De Massis, Alfredo & Kellermanns, Franz, 2022. "One finding is no finding: Toward a replication culture in family business research," Journal of Family Business Strategy, Elsevier, vol. 13(4).
  25. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
  26. Bogdanoski, Aleksandar & Ofosu, George & Posner, Daniel N, 2019. "Pre-analysis Plans: A Stocktaking," MetaArXiv e4pum, Center for Open Science.
  27. Lars Ivar Oppedal Berge & Kjetil Bjorvatn & Simon Galle & Edward Miguel & Daniel N. Posner & Bertil Tungodden & Kelly Zhang, 2015. "How Strong are Ethnic Preferences?," NBER Working Papers 21715, National Bureau of Economic Research, Inc.
  28. Bauhoff, Sebastian & Busch, Jonah, 2020. "Does deforestation increase malaria prevalence? Evidence from satellite data and health surveys," World Development, Elsevier, vol. 127(C).
  29. Lergetporer, P & Woessmann, L, 2022. "Income Contingency and the Electorates Support for Tuition," CAGE Online Working Paper Series 606, Competitive Advantage in the Global Economy (CAGE).
  30. Josephson, Anna & Michler, Jeffrey D., 2018. "Viewpoint: Beasts of the field? Ethics in agricultural and applied economics," Food Policy, Elsevier, vol. 79(C), pages 1-11.
  31. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
  32. Michael L. Anderson & Jeremy Magruder, 2017. "Split-Sample Strategies for Avoiding False Discoveries," NBER Working Papers 23544, National Bureau of Economic Research, Inc.
  33. Tom Coupé & Thomas Logchies & W. Robert Reed, 2025. "Do replications receive fewer citations? A counterfactual approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(4), pages 2403-2423, April.
  34. Charness, Gary & Dao, Lien & Shurchkov, Olga, 2022. "Competing now and then: The effects of delay on competitiveness across gender," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 612-630.
  35. Abel Brodeur & Nikolai M. Cook & Jonathan S. Hartley & Anthony Heyes, 2024. "Do Preregistration and Preanalysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement," Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(3), pages 527-561.
  36. Collins, Hanne K. & Whillans, Ashley V. & John, Leslie K., 2021. "Joy and rigor in behavioral science," Organizational Behavior and Human Decision Processes, Elsevier, vol. 164(C), pages 179-191.
  37. Kathryn N. Vasilaky & J. Michelle Brock, 2020. "Power(ful) guidelines for experimental economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(2), pages 189-212, December.
  38. Lionel Page & Charles N. Noussair & Robert Slonim, 2021. "The replication crisis, the rise of new research practices and what it means for experimental economics," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 210-225, December.
  39. Canavari, Maurizio & Drichoutis, Andreas C. & Lusk, Jayson L. & Nayga, Rodolfo, 2018. "How to run an experimental auction: A review of recent advances," MPRA Paper 89715, University Library of Munich, Germany.
  40. Muriel Niederle, 2017. "A Gender Agenda: A Progress Report on Competitiveness," American Economic Review, American Economic Association, vol. 107(5), pages 115-119, May.
  41. Joel Ferguson & Rebecca Littman & Garret Christensen & Elizabeth Levy Paluck & Nicholas Swanson & Zenan Wang & Edward Miguel & David Birke & John-Henry Pezzuto, 2023. "Survey of open science practices and attitudes in the social sciences," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
  42. Tom Coupé & Thomas Logchies & W. Robert Reed, 2024. "Do Replications Really Receive Fewer Citations?," Working Papers in Economics 24/15, University of Canterbury, Department of Economics and Finance.
  43. Strømland, Eirik, 2019. "Preregistration and reproducibility," Journal of Economic Psychology, Elsevier, vol. 75(PA).
  44. repec:osf:metaar:wkmht_v1 is not listed on IDEAS
  45. repec:osf:metaar:e4pum_v1 is not listed on IDEAS
  46. Ferman, Bruno & Ponczek, Vladimir, 2017. "Should we drop covariate cells with attrition problems?," MPRA Paper 80686, University Library of Munich, Germany.
  47. Sevim, Dilek & Baranov, Victoria & Bhalotra, Sonia & Maselko, Joanna & Biroli, Pietro, 2023. "Trajectories of Early Childhood Skill Development and Maternal Mental Health," The Warwick Economics Research Paper Series (TWERPS) 1469, University of Warwick, Department of Economics.
  48. Anna Dreber & Magnus Johannesson & Yifan Yang, 2024. "Selective reporting of placebo tests in top economics journals," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 921-932, July.
  49. Maximilian Kasy & Jann Spiess, 2022. "Rationalizing Pre-Analysis Plans:Statistical Decisions Subject to Implementability," Economics Series Working Papers 975, University of Oxford, Department of Economics.
  50. repec:osf:osfxxx:8abyu_v1 is not listed on IDEAS
  51. Robert Kirkby, 2016. "Value Function Iteration Toolkit: In Matlab, on the GPU," EcoMod2016 9122, EcoMod.
  52. Opoku-Agyemang, Kweku A., 2017. "A Human-Computer Interaction Approach for Integrity in Economics," SocArXiv ra3cs, Center for Open Science.
  53. Jordan C. Stanley & Evan S. Totty, 2026. "Synthetic Data and Social Science Research: Accuracy Assessments and Practical Considerations from the SIPP Synthetic Beta," NBER Chapters, in: Data Privacy Protection and the Conduct of Applied Research: Methods, Approaches and New Findings, National Bureau of Economic Research, Inc.
  54. Brown, Martin & Hentschel, Nicole & Mettler, Hannes & Stix, Helmut, 2022. "The convenience of electronic payments and consumer cash demand," Journal of Monetary Economics, Elsevier, vol. 130(C), pages 86-102.
  55. Luigi Butera & Philip J Grossman & Daniel Houser & John A List & Marie Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science With An Application to the Public Goods GameA Review," Working Papers halshs-02512932, HAL.
  56. Reca Sarfati & Vod Vilfort, 2025. ""Post" Pre-Analysis Plans: Valid Inference for Non-Preregistered Specifications," Papers 2510.02507, arXiv.org.
  57. Robert Kirkby, 2017. "A Toolkit for Value Function Iteration," Computational Economics, Springer;Society for Computational Economics, vol. 49(1), pages 1-15, January.
  58. Anya Samek, 2019. "Gender Differences in Job Entry Decisions: A University-Wide Field Experiment," Management Science, INFORMS, vol. 65(7), pages 3272-3281, July.
  59. repec:osf:metaar:9a3rw_v1 is not listed on IDEAS
  60. Chang, Andrew C., 2017. "A replication recipe: List your ingredients before you start cooking," Economics Discussion Papers 2017-74, Kiel Institute for the World Economy.
  61. Sevim, Dilek & Baranov, Victoria & Bhalotra, Sonia & Maselko, Joanna & Biroli, Pietro, 2023. "Trajectories of Early Childhood Skill Development and Maternal Mental Health," CAGE Online Working Paper Series 674, Competitive Advantage in the Global Economy (CAGE).
  62. Felgenhauer, Mike, 2021. "Experimentation and manipulation with preregistration," Games and Economic Behavior, Elsevier, vol. 130(C), pages 400-408.
  63. Dilek Sevim & Victoria Baranov & Sonia Bhalotra & Joanna Maselko & Pietro Biroli, 2024. "Trajectories of Early Childhood Skill Development and Maternal Mental Health," Journal of Human Resources, University of Wisconsin Press, vol. 59(S), pages 365-401.
  64. Chang, Andrew C., 2018. "A replication recipe: List your ingredients before you start cooking," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy, vol. 12, pages 1-8.
  65. McCloskey, Adam & Michaillat, Pascal, 2020. "Critical Values Robust to P-hacking," Santa Cruz Department of Economics, Working Paper Series qt8x77q26c, Department of Economics, UC Santa Cruz.
  66. Drazen, Allan & Dreber, Anna & Ozbay, Erkut Y. & Snowberg, Erik, 2021. "Journal-based replication of experiments: An application to “Being Chosen to Lead”," Journal of Public Economics, Elsevier, vol. 202(C).
IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.