IDEAS home Printed from https://ideas.repec.org/r/aea/aecrev/v110y2020i11p3634-60.html
   My bibliography  Save this item

Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as


Cited by:

  1. Hüttel, Silke & Hess, Sebastian, 2023. "Lessons from the p-value debate and the replication crisis for "open Q science" – the editor's perspective or: will the revolution devour its children?," DARE Discussion Papers 2302, Georg-August University of Göttingen, Department of Agricultural Economics and Rural Development (DARE).
  2. Aubry, Amandine & Héricourt, Jérôme & Marchal, Léa & Nedoncelle, Clément, 2022. "Does Immigration AffectWages? A Meta-Analysis," CEPREMAP Working Papers (Docweb) 2202, CEPREMAP.
  3. Bensch, Gunther & Ankel-Peters, Jörg & Vance, Colin, 2023. "Spotlight on Researcher Decisions – Infrastructure Evaluation, Instrumental Variables, and Specification Screening," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277703, Verein für Socialpolitik / German Economic Association.
  4. Abel Brodeur, Nikolai M. Cook, Anthony Heyes, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," LCERPA Working Papers am0133, Laurier Centre for Economic Research and Policy Analysis.
  5. Mark Treurniet, 2021. "The Potency of Quality Incentives: Evidence from the Indonesian Dairy Value Chain," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(5), pages 1661-1678, October.
  6. Havranek, Tomas & Cala, Petr & Irsova, Zuzana & Matousek, Jindrich & Novak, Jiri, 2022. "Financial Incentives and Performance: A Meta-Analysis of Economics Evidence," CEPR Discussion Papers 17680, C.E.P.R. Discussion Papers.
  7. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
  8. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments," GLO Discussion Paper Series 1157, Global Labor Organization (GLO).
  9. Abel Brodeur, Nikolai M. Cook, Jonathan S. Hartley, Anthony Heyes, 2022. "Do Pre-Registration and Pre-analysis Plans Reduce p-Hacking and Publication Bias?," LCERPA Working Papers am0132, Laurier Centre for Economic Research and Policy Analysis.
  10. Matteo Picchio & Michele Ubaldi, 2022. "Unemployment And Health: A Meta-Analysis," Working Papers 467, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
  11. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
  12. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
  13. David Wuepper & Robert Finger, 2023. "Regression discontinuity designs in agricultural and environmental economics," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 50(1), pages 1-28.
  14. Kaiser, Tim & Lusardi, Annamaria & Menkhoff, Lukas & Urban, Carly, 2022. "Financial education affects financial knowledge and downstream behaviors," Journal of Financial Economics, Elsevier, vol. 145(2), pages 255-272.
  15. Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022. "Detecting p‐Hacking," Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
  16. Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," Ruhr Economic Papers 1055, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
  17. Joel Bank & Hamish Fitchett & Adam Gorajek & Benjamin A. Malin & Andrew Staib, 2021. "Star Wars at Central Banks," Staff Report 620, Federal Reserve Bank of Minneapolis.
  18. Burro, Giovanni & Castagnetti, Alessandro, 2022. "Will I tell you that you are smart (dumb)? Deceiving Others about their IQ or about a Random Draw," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
  19. Bialek, Michal & Misiak, Michał & Dziekan, Martyna, 2021. "Why is the statistical revolution not progressing? Vicious cycle of the scientific reform," OSF Preprints gmfs9, Center for Open Science.
  20. Jordan Adamson & Lucas Rentschler, 2023. "Criminal justice from a public choice perspective: an introduction to the special issue," Public Choice, Springer, vol. 196(3), pages 223-227, September.
  21. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
  22. Stefano DellaVigna & Elizabeth Linos, 2022. "RCTs to Scale: Comprehensive Evidence From Two Nudge Units," Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
  23. Leonardo Baccini & Abel Brodeur & Stephen Weymouth, 2021. "The COVID-19 pandemic and the 2020 US presidential election," Journal of Population Economics, Springer;European Society for Population Economics, vol. 34(2), pages 739-767, April.
  24. Brodeur, Abel & Baccini, Leonardo & Weymouth, Stephen, 2020. "The COVID-19 Pandemic and US Presidential Elections," MetaArXiv sxajv, Center for Open Science.
  25. Cantone, Giulio Giacomo, 2023. "The multiversal methodology as a remedy of the replication crisis," MetaArXiv kuhmz, Center for Open Science.
  26. Bruns, Stephan & Herwartz, Helmut & Ioannidis, John P.A. & Islam, Chris-Gabriel & Raters, Fabian H. C., 2023. "Statistical reporting errors in economics," MetaArXiv mbx62, Center for Open Science.
  27. Anna Sokolova, 2023. "Marginal Propensity to Consume and Unemployment: a Meta-analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 813-846, December.
  28. Stommes, Drew & Aronow, P. M. & Sävje, Fredrik, 2023. "On the Reliability of Published Findings Using the Regression Discontinuity Design in Political Science," I4R Discussion Paper Series 22, The Institute for Replication (I4R).
  29. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
  30. Edward Miguel, 2021. "Evidence on Research Transparency in Economics," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 193-214, Summer.
  31. Abel Brodeur & Nikolai Cook & Carina Neisser, 2022. "P-Hacking, Data Type and Data-Sharing Policy," ECONtribute Discussion Papers Series 200, University of Bonn and University of Cologne, Germany.
  32. Brodeur, Abel & Esterling, Kevin & Ankel-Peters, Jörg & Bueno, Natália S. & Desposato, Scott & Dreber, Anna & Genovese, Federica & Green, Donald P. & Hepplewhite, Matthew & Hoces de la Guardia, Fernan, 2024. "Promoting Reproducibility and Replicability in Political Science," I4R Discussion Paper Series 100, The Institute for Replication (I4R).
  33. Bagilet, Vincent & Zabrocki-Hallak, Léo, 2022. "Why Some Acute Health Effects of Air Pollution Could Be Inflated," I4R Discussion Paper Series 11, The Institute for Replication (I4R).
  34. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2022. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics: Reply," American Economic Review, American Economic Association, vol. 112(9), pages 3137-3139, September.
  35. Sarah A. Janzen & Jeffrey D. Michler, 2021. "Ulysses' pact or Ulysses' raft: Using pre‐analysis plans in experimental and nonexperimental research," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1286-1304, December.
  36. Christoph Huber & Christian König-Kersting, 2022. "Experimenting with Financial Professionals," Working Papers 2022-07, Faculty of Economics and Statistics, Universität Innsbruck.
  37. Adam Gorajek & Benjamin A. Malin, 2021. "Comment on "Star Wars: The Empirics Strike Back"," Staff Report 629, Federal Reserve Bank of Minneapolis.
  38. Engsted, Tom & Schneider, Jesper W., 2023. "Non-Experimental Data, Hypothesis Testing, and the Likelihood Principle: A Social Science Perspective," SocArXiv nztk8, Center for Open Science.
  39. Ron Berman & Christophe Van den Bulte, 2022. "False Discovery in A/B Testing," Management Science, INFORMS, vol. 68(9), pages 6762-6782, September.
  40. Wang, Wenjie, 2021. "Wild Bootstrap for Instrumental Variables Regression with Weak Instruments and Few Clusters," MPRA Paper 106227, University Library of Munich, Germany.
  41. Paldam Martin, 2021. "Methods Used in Economic Research: An Empirical Study of Trends and Levels," Economics - The Open-Access, Open-Assessment Journal, De Gruyter, vol. 15(1), pages 28-42, January.
  42. Travis J. Lybbert & Steven T. Buccola, 2021. "The evolving ethics of analysis, publication, and transparency in applied economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1330-1351, December.
  43. Felix Chopra & Ingar Haaland & Christopher Roth & Andreas Stegmann, 2023. "The Null Result Penalty," The Economic Journal, Royal Economic Society, vol. 134(657), pages 193-219.
  44. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
  45. Chowdhury, Shyamal & Hasan, Syed & Sharma, Uttam, 2024. "The Role of Trainee Selection in the Effectiveness of Vocational Training: Evidence from a Randomized Controlled Trial in Nepal," IZA Discussion Papers 16705, Institute of Labor Economics (IZA).
  46. Uwe Hassler & Marc‐Oliver Pohle, 2022. "Unlucky Number 13? Manipulating Evidence Subject to Snooping," International Statistical Review, International Statistical Institute, vol. 90(2), pages 397-410, August.
  47. Roggenkamp, Hauke C., 2024. "Revisiting ‘Growth and Inequality in Public Good Provision’—Reproducing and Generalizing Through Inconvenient Online Experimentation," OSF Preprints 6rn97, Center for Open Science.
  48. Moritz A. Drupp & Menusch Khadjavi & Rudi Voss, 2024. "The Truth-Telling of Truth-Seekers: Evidence from Online Experiments with Scientists," CESifo Working Paper Series 10897, CESifo.
  49. Li, Yong & Wang, Nianling & Yu, Jun, 2023. "Improved marginal likelihood estimation via power posteriors and importance sampling," Journal of Econometrics, Elsevier, vol. 234(1), pages 28-52.
  50. Lang, Megan & Qiu, Wenfeng, 2021. "Cherry Picking," MetaArXiv as9zd, Center for Open Science.
  51. Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johanneson & Michael Kirchler & Albert Menkveld & Michael Razen & Utz Weitzel, 2022. "Reproducibility of Empirical Results: Evidence from 1,000 Tests in Finance," Working Papers hal-03810013, HAL.
  52. Wenjie Wang & Yichong Zhang, 2021. "Wild Bootstrap for Instrumental Variables Regressions with Weak and Few Clusters," Papers 2108.13707, arXiv.org, revised Jan 2024.
  53. Jasper Brinkerink, 2023. "When Shooting for the Stars Becomes Aiming for Asterisks: P-Hacking in Family Business Research," Entrepreneurship Theory and Practice, , vol. 47(2), pages 304-343, March.
  54. Robert Kirkby, 2023. "Quantitative Macroeconomics: Lessons Learned from Fourteen Replications," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 875-896, February.
  55. Ankel-Peters, Jörg & Vance, Colin & Bensch, Gunther, 2022. "Spotlight on researcher decisions – Infrastructure evaluation, instrumental variables, and first-stage specification screening," OSF Preprints sw6kd, Center for Open Science.
  56. Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2022. "The Power of Tests for Detecting $p$-Hacking," Papers 2205.07950, arXiv.org, revised Jun 2023.
  57. Sebastian Gechert & Bianka Mey & Matej Opatrny & Tomas Havranek & T. D. Stanley & Pedro R. D. Bom & Hristos Doucouliagos & Philipp Heimberger & Zuzana Irsova & Heiko J. Rachinger, 2023. "Conventional Wisdom, Meta-Analysis, and Research Revision in Economics," Chemnitz Economic Papers 061, Department of Economics, Chemnitz University of Technology.
  58. Armstrong, Christopher & Kepler, John D. & Samuels, Delphine & Taylor, Daniel, 2022. "Causality redux: The evolution of empirical methods in accounting research and the growth of quasi-experiments," Journal of Accounting and Economics, Elsevier, vol. 74(2).
  59. Pettersson-Lidbom, Per, 2022. "Exit, Voice and Political Change: Evidence from Swedish Mass Migration to the United States. A Comment on Karadja and Prawitz (Journal of Political Economy, 2019)," Journal of Comments and Replications in Economics (JCRE), ZBW - Leibniz Information Centre for Economics, vol. 1(2022-3), pages 1-13.
  60. Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
  61. Dutt, Satyajit & Radermacher, Jan W., 2023. "Age, wealth, and the MPC in Europe: A supervised machine learning approach," SAFE Working Paper Series 383, Leibniz Institute for Financial Research SAFE.
  62. Adam Gorajek & Joel Bank & Andrew Staib & Benjamin Malin & Hamish Fitchett, 2021. "Star Wars at Central Banks," RBA Research Discussion Papers rdp2021-02, Reserve Bank of Australia.
  63. Danielle V. Handel & Eric A. Hanushek, 2023. "Contexts of Convenience: Generalizing from Published Evaluations of School Finance Policies," NBER Working Papers 31653, National Bureau of Economic Research, Inc.
  64. Michael Lechner, 2023. "Causal Machine Learning and its use for public policy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-15, December.
  65. Slichter, David & Tran, Nhan, 2023. "Do better journals publish better estimates?," MPRA Paper 118433, University Library of Munich, Germany.
  66. Ankel-Peters, Jörg & Schmidt, Christoph M., 2023. "Rural electrification, the credibility revolution, and the limits of evidence-based policy," Ruhr Economic Papers 1051, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
  67. H. D. Vinod, 2022. "Bootstrap Version of Rao–Blackwellization to Two-Step and Instrumental Variable Estimators," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 20(1), pages 49-69, September.
  68. Martina Cioni & Giovani Federico & Michelangelo Vasta, 2021. "Persistence studies: a new kind of economic history?," Department of Economics University of Siena 859, Department of Economics, University of Siena.
  69. Rigdon, Edward E., 2023. "How improper dichotomization and the misrepresentation of uncertainty undermine social science research," Journal of Business Research, Elsevier, vol. 165(C).
  70. Anna Solms & Bernd Süssmuth, 2022. "Business cycle characteristics of Mediterranean economies: a secular trend and cycle dynamics perspective," International Economics and Economic Policy, Springer, vol. 19(4), pages 825-862, October.
  71. Vu, Patrick, 2022. "Can the Replication Rate Tell Us About Selective Publication?," I4R Discussion Paper Series 3, The Institute for Replication (I4R).
  72. Abbate Nicolás & Cabral Juan Andrés, 2023. "Reassessing a cocaine shock: a contrary narrative from Rabo de Peixe," Asociación Argentina de Economía Política: Working Papers 4628, Asociación Argentina de Economía Política.
IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.