IDEAS home Printed from https://ideas.repec.org/r/aea/jecper/v29y2015i3p61-80.html

Promises and Perils of Pre-analysis Plans

Citations

Blog mentions

As found by EconAcademics.org, the blog aggregator for Economics research:
  1. ‘Metrics Monday: Robustness Check or Data Mining?
    by Marc F. Bellemare in Marc F. Bellemare on 2016-04-11 15:00:22

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as


Cited by:

  1. Castaing, Pauline & Gazeaud, Jules, 2025. "Do index insurance programs live up to their promises? Aggregating evidence from multiple experiments," Journal of Development Economics, Elsevier, vol. 175(C).
  2. Alex Eble & Peter Boone & Diana Elbourne, 2017. "On Minimizing the Risk of Bias in Randomized Controlled Trials in Economics," The World Bank Economic Review, World Bank, vol. 31(3), pages 687-707.
  3. Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
  4. Gong, Erick & de Walque, Damien & Dow, William H., 2019. "Coping with risk: Negative shocks, transactional sex, and the limitations of conditional cash transfers," Journal of Health Economics, Elsevier, vol. 67(C).
  5. Alpino, Matteo & Hauge, Karen Evelyn & Kotsadam, Andreas & Markussen, Simen, 2022. "Effects of dialogue meetings on sickness absence—Evidence from a large field experiment," Journal of Health Economics, Elsevier, vol. 83(C).
  6. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
  7. Dufwenberg, Martin & Dufwenberg, Martin A., 2018. "Lies in disguise – A theoretical analysis of cheating," Journal of Economic Theory, Elsevier, vol. 175(C), pages 248-264.
  8. Furukawa, Chishio, 2019. "Publication Bias under Aggregation Frictions: Theory, Evidence, and a New Correction Method," EconStor Preprints 194798, ZBW - Leibniz Information Centre for Economics.
  9. Lucas C. Coffman & Muriel Niederle & Alistair J. Wilson, 2017. "A Proposal to Organize and Promote Replications," American Economic Review, American Economic Association, vol. 107(5), pages 41-45, May.
  10. Irsova, Zuzana & Bom, Pedro R. D. & Havranek, Tomas & Rachinger, Heiko, 2023. "Spurious Precision in Meta-Analysis," EconStor Preprints 268683, ZBW - Leibniz Information Centre for Economics.
  11. Button, Patrick & Walker, Brigham, 2020. "Employment discrimination against Indigenous Peoples in the United States: Evidence from a field experiment," Labour Economics, Elsevier, vol. 65(C).
  12. Owen Ozier, 2021. "Replication Redux: The Reproducibility Crisis and the Case of Deworming [Economics of Mass Deworming Programs]," The World Bank Research Observer, World Bank, vol. 36(1), pages 101-130.
  13. Marianne Bertrand & Bruno Crépon & Alicia Marguerie & Patrick Premand, 2021. "Do Workfare Programs Live Up to Their Promises? Experimental Evidence from Cote D’Ivoire," NBER Working Papers 28664, National Bureau of Economic Research, Inc.
  14. Girum Abebe & A Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn, 2021. "Anonymity or Distance? Job Search and Labour Market Exclusion in a Growing African City [Endogenous Stratification in Randomized Experiments]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1279-1310.
  15. Brodeur, Abel & Cook, Nikolai & Hartley, Jonathan & Heyes, Anthony, 2022. "Do Pre-Registration and Pre-analysis Plans Reduce p-Hacking and Publication Bias?," MetaArXiv uxf39, Center for Open Science.
  16. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
  17. Abel Brodeur & Nikolai M. Cook & Jonathan S. Hartley & Anthony Heyes, 2024. "Do Preregistration and Preanalysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement," Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(3), pages 527-561.
  18. Maximilian Kasy & Jann Spiess, 2022. "Optimal Pre-Analysis Plans: Statistical Decisions Subject to Implementability," Papers 2208.09638, arXiv.org, revised Jul 2024.
  19. Vilhuber, Lars, 2023. "Reproducibility and transparency versus privacy and confidentiality: Reflections from a data editor," Journal of Econometrics, Elsevier, vol. 235(2), pages 2285-2294.
  20. Muhammad Haseeb & Kate Vyborny, 2016. "Imposing institutions: Evidence from cash transfer reform in Pakistan," CSAE Working Paper Series 2016-36, Centre for the Study of African Economies, University of Oxford.
  21. Elisa Matthewes & Anis Nassar & Christian Zihlmann, 2022. "Fostering innovation: Experimental evidence on the effectiveness of behavioral interventions," PLOS ONE, Public Library of Science, vol. 17(10), pages 1-17, October.
  22. Sarah A. Janzen & Jeffrey D. Michler, 2021. "Ulysses' pact or Ulysses' raft: Using pre‐analysis plans in experimental and nonexperimental research," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1286-1304, December.
  23. Avdeenko, Alexandra & Frölich, Markus, 2020. "Research standards in empirical development economics: What’s well begun, is half done," World Development, Elsevier, vol. 127(C).
  24. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
  25. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
  26. Espinosa, Romain & Treich, Nicolas, 2020. "Moderate vs. Radical NGOs," TSE Working Papers 20-1159, Toulouse School of Economics (TSE).
  27. Ali Elminejad & Tomas Havranek & Roman Horvath & Zuzana Irsova, 2023. "Intertemporal Substitution in Labor Supply: A Meta-Analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 1095-1113, December.
  28. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
  29. Roman Horvath & Ali Elminejad & Tomas Havranek, 2020. "Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply," Working Papers IES 2020/32, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
  30. Burlig, Fiona, 2018. "Improving transparency in observational social science research: A pre-analysis plan approach," Economics Letters, Elsevier, vol. 168(C), pages 56-60.
  31. Wiig, Arne & Kolstad, Ivar & Kandilige, Leander & Talleraas, Cathrine, 2025. "Effects of information about irregular migration on transit community attitudes towards migrants," World Development, Elsevier, vol. 193(C).
  32. Susan Athey & Guido Imbens, 2016. "The Econometrics of Randomized Experiments," Papers 1607.00698, arXiv.org.
  33. Bogdanoski, Aleksandar & Ofosu, George & Posner, Daniel N, 2019. "Pre-analysis Plans: A Stocktaking," MetaArXiv e4pum, Center for Open Science.
  34. repec:osf:metaar:3qp2w_v1 is not listed on IDEAS
  35. Ravi Jagadeesan & Davide Viviano, 2025. "Publication Design with Incentives in Mind," Papers 2504.21156, arXiv.org, revised Sep 2025.
  36. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
  37. Thibaut Arpinon & Romain Espinosa, 2023. "A practical guide to Registered Reports for economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 9(1), pages 90-122, June.
  38. Cristina Blanco-Perez & Abel Brodeur, 2020. "Publication Bias and Editorial Statement on Negative Findings," The Economic Journal, Royal Economic Society, vol. 130(629), pages 1226-1247.
  39. James R. Stevenson & Karen Macours & Douglas Gollin, 2023. "The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research," Annual Review of Resource Economics, Annual Reviews, vol. 15(1), pages 495-515, October.
  40. Ivar Kolstad & Arne Wiig, 2016. "How do voters respond to information on self-serving elite behaviour? Evidence from a randomized survey experiment in Tanzania," CMI Working Papers 9, CMI (Chr. Michelsen Institute), Bergen, Norway.
  41. Bauhoff, Sebastian & Busch, Jonah, 2020. "Does deforestation increase malaria prevalence? Evidence from satellite data and health surveys," World Development, Elsevier, vol. 127(C).
  42. Josephson, Anna & Michler, Jeffrey D., 2018. "Viewpoint: Beasts of the field? Ethics in agricultural and applied economics," Food Policy, Elsevier, vol. 79(C), pages 1-11.
  43. Haseeb, Muhammad & Vyborny, Kate, 2022. "Data, discretion and institutional capacity: Evidence from cash transfers in Pakistan," Journal of Public Economics, Elsevier, vol. 206(C).
  44. Abhijit Banerjee & Sylvain Chassang & Erik Snowberg, 2016. "Decision Theoretic Approaches to Experiment Design and External Validity," NBER Working Papers 22167, National Bureau of Economic Research, Inc.
  45. Michael L. Anderson & Jeremy Magruder, 2017. "Split-Sample Strategies for Avoiding False Discoveries," NBER Working Papers 23544, National Bureau of Economic Research, Inc.
  46. Roggenkamp, Hauke C., 2024. "Revisiting ‘Growth and Inequality in Public Good Provision’—Reproducing and Generalizing Through Inconvenient Online Experimentation," OSF Preprints 6rn97, Center for Open Science.
  47. Ali Elminejad & Tomas Havranek & Zuzana Irsova, 2025. "Relative Risk Aversion: A Meta‐Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 39(5), pages 2315-2333, December.
  48. Martin Brown & Nicole Hentschel & Hannes Mettler & Helmut Stix, 2020. "Financial Innovation, Payment Choice and Cash Demand – Causal Evidence from the Staggered Introduction of Contactless Debit Cards (Martin Brown,Nicole Hentschel, Hannes Mettler, Helmut Stix)," Working Papers 230, Oesterreichische Nationalbank (Austrian Central Bank).
  49. Abhijit Banerjee & Sylvain Chassang & Sergio Montero & Erik Snowberg, 2017. "A Theory of Experimenters," NBER Working Papers 23867, National Bureau of Economic Research, Inc.
  50. Heckelei, Thomas & Hüttel, Silke & Odening, Martin & Rommel, Jens, 2023. "The p-Value Debate and Statistical (Mal)practice – Implications for the Agricultural and Food Economics Community," German Journal of Agricultural Economics, Humboldt-Universitaet zu Berlin, Department for Agricultural Economics, vol. 72(01), January.
  51. Haaga, Tapio & Böckerman, Petri & Kortelainen, Mika & Tukiainen, Janne, 2024. "Effects of nurse visit copayment on primary care use: Do low-income households pay the price?," Journal of Health Economics, Elsevier, vol. 94(C).
  52. Lionel Page & Charles N. Noussair & Robert Slonim, 2021. "The replication crisis, the rise of new research practices and what it means for experimental economics," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 210-225, December.
  53. Nicole Hentschel, 2025. "Risk Attitudes do not explain Cash Holdings," Working Papers 25.04, Swiss National Bank, Study Center Gerzensee.
  54. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
  55. Saad Gulzar & Muhammad Yasir Khan, 2025. "Good Politicians: Experimental Evidence on Motivations for Political Candidacy and Government Performance," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 92(1), pages 339-364.
  56. Sedlmayr, Richard & Shah, Anuj & Sulaiman, Munshi, 2020. "Cash-plus: Poverty impacts of alternative transfer-based approaches," Journal of Development Economics, Elsevier, vol. 144(C).
  57. Furbush, Ann M. & Josephson, Anna & Kilic, Talip & Michler, Jeffrey D., 2025. "Coping or hoping? Livelihood diversification and food insecurity in the COVID-19 pandemic," Food Policy, Elsevier, vol. 131(C).
  58. David Neumark & Maysen Yen, 2022. "Effects of recent minimum wage policies in California and nationwide: Results from a pre‐specified analysis plan," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 61(2), pages 228-255, April.
  59. Michael Callen & Miguel Fajardo-Steinhäuser & Michael G. Findley & Tarek Ghani, 2025. "Can Digital Aid Deliver During Humanitarian Crises?," Management Science, INFORMS, vol. 71(11), pages 9730-9748, November.
  60. repec:osf:metaar:wkmht_v1 is not listed on IDEAS
  61. repec:osf:metaar:xq9nt_v1 is not listed on IDEAS
  62. repec:osf:metaar:e4pum_v1 is not listed on IDEAS
  63. Ferman, Bruno & Ponczek, Vladimir, 2017. "Should we drop covariate cells with attrition problems?," MPRA Paper 80686, University Library of Munich, Germany.
  64. Leah H. Palm-Forster & Paul J. Ferraro & Nicholas Janusch & Christian A. Vossler & Kent D. Messer, 2019. "Behavioral and Experimental Agri-Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 719-742, July.
  65. Anna Dreber & Magnus Johannesson & Yifan Yang, 2024. "Selective reporting of placebo tests in top economics journals," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 921-932, July.
  66. Jasper Brinkerink, 2023. "When Shooting for the Stars Becomes Aiming for Asterisks: P-Hacking in Family Business Research," Entrepreneurship Theory and Practice, , vol. 47(2), pages 304-343, March.
  67. Thibaut Arpinon & Marianne Lefebvre, 2024. "Registered Reports and Associated Benefits for Agricultural Economics," Post-Print hal-04635986, HAL.
  68. Maximilian Kasy & Jann Spiess, 2022. "Rationalizing Pre-Analysis Plans:Statistical Decisions Subject to Implementability," Economics Series Working Papers 975, University of Oxford, Department of Economics.
  69. repec:osf:osfxxx:8abyu_v1 is not listed on IDEAS
  70. Martin Brown & Nicole Hentschel & Hannes Mettler & Helmut Stix, 2020. "Financial Innovation, Payment Choice and Cash Demand - Causal Evidence from the Staggered Introduction of Contactless Debit Cards," Working Papers on Finance 2002, University of St. Gallen, School of Finance.
  71. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
  72. Heckelei, Thomas & Huettel, Silke & Odening, Martin & Rommel, Jens, "undated". "The replicability crisis and the p-value debate – what are the consequences for the agricultural and food economics community?," Discussion Papers 316369, University of Bonn, Institute for Food and Resource Economics.
  73. Brown, Martin & Hentschel, Nicole & Mettler, Hannes & Stix, Helmut, 2022. "The convenience of electronic payments and consumer cash demand," Journal of Monetary Economics, Elsevier, vol. 130(C), pages 86-102.
  74. J. Nicolas Hernandez-Aguilera & Max Mauerman & Alexandra Herrera & Kathryn Vasilaky & Walter Baethgen & Ana Maria Loboguerrero & Rahel Diro & Yohana Tesfamariam Tekeste & Daniel Osgood, 2020. "Games and Fieldwork in Agriculture: A Systematic Review of the 21st Century in Economics and Social Science," Games, MDPI, vol. 11(4), pages 1-22, October.
  75. repec:osf:metaar:nshqx_v1 is not listed on IDEAS
  76. repec:osf:metaar:b8uhe_v1 is not listed on IDEAS
  77. Alexander Hanbo Li & Jelena Bradic, 2019. "Censored Quantile Regression Forests," Papers 1902.03327, arXiv.org.
  78. repec:osf:metaar:3qp2w_v2 is not listed on IDEAS
  79. Reca Sarfati & Vod Vilfort, 2025. ""Post" Pre-Analysis Plans: Valid Inference for Non-Preregistered Specifications," Papers 2510.02507, arXiv.org.
  80. Thibaut Arpinon & Romain Espinosa, 2023. "A Practical Guide to Registered Reports for Economists," Post-Print halshs-03897719, HAL.
  81. Klaus M. Schmidt & Levent Neyse & Marianne Saam & Doreen Siegfried & Lars Vilhuber & Joachim Winter, 2026. "Open Science in den Wirtschaftswissenschaften: Transparenz, Reproduzierbarkeit und Zugang," Rationality and Competition Discussion Paper Series 570, CRC TRR 190 Rationality and Competition.
  82. Bobtcheff, Catherine & Levy, Raphaël & Mariotti, Thomas, 2021. "Negative results in science: Blessing or (winner's) curse ?," CEPR Discussion Papers 16024, C.E.P.R. Discussion Papers.
  83. repec:osf:metaar:9a3rw_v1 is not listed on IDEAS
  84. Bruns, Stephan B. & Asanov, Igor & Bode, Rasmus & Dunger, Melanie & Funk, Christoph & Hassan, Sherif M. & Hauschildt, Julia & Heinisch, Dominik & Kempa, Karol & König, Johannes & Lips, Johannes & Verb, 2019. "Reporting errors and biases in published empirical findings: Evidence from innovation research," Research Policy, Elsevier, vol. 48(9), pages 1-1.
  85. Felgenhauer, Mike, 2021. "Experimentation and manipulation with preregistration," Games and Economic Behavior, Elsevier, vol. 130(C), pages 400-408.
  86. Cristina Blanco-Perez & Abel Brodeur, 2019. "Transparency in empirical economic research," World of Labour, LISER, pages 467-467, November.
  87. repec:osf:osfxxx:6rn97_v1 is not listed on IDEAS
  88. Ivar Kolstad & Arne Wiig, 2016. "How do voters respond to information on self-serving elite behaviour? Evidence from a randomized survey experiment in Tanzania," CMI Working Papers 9, CMI (Chr. Michelsen Institute), Bergen, Norway.
IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.