Detecting p-hacking
Author
Abstract
Suggested Citation
Download full text from publisher
Other versions of this item:
- Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022. "Detecting p‐Hacking," Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
References listed on IDEAS
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016.
"Star Wars: The Empirics Strike Back,"
American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," PSE Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," PSE-Ecole d'économie de Paris (Postprint) hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," AMSE Working Papers 1523, Aix-Marseille School of Economics, France, revised May 2015.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," PSE Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers 1505E, University of Ottawa, Department of Economics.
- Brodeur, Abel & Lé, Mathias & Sangnier, Marc & Zylberberg, Yanos, 2013. "Star Wars: The Empirics Strike Back," IZA Discussion Papers 7268, Institute of Labor Economics (IZA).
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," Post-Print hal-01447851, HAL.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2018.
"Methods Matter: P-Hacking and Causal Inference in Economics,"
IZA Discussion Papers
11796, Institute of Labor Economics (IZA).
- Abel Brodeur & Nikolai Cook & Anthony Heyes, 2018. "Methods Matter: P-Hacking and Causal Inference in Economics," Working Papers 1809E, University of Ottawa, Department of Economics.
- Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020.
"Simple Local Polynomial Density Estimators,"
Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
- Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2018. "Simple Local Polynomial Density Estimators," Papers 1811.11512, arXiv.org, revised Jun 2019.
- Cattaneo, MD & Jansson, M & Ma, X, 2020. "Simple Local Polynomial Density Estimators," Department of Economics, Working Paper Series qt9vt997qn, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Cattaneo, MD & Jansson, M & Ma, X, 2020. "Simple Local Polynomial Density Estimators," University of California at San Diego, Economics Working Paper Series qt9vt997qn, Department of Economics, UC San Diego.
- McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
- Eva Vivalt, 2019. "Specification Searching and Significance Inflation Across Time, Methods and Disciplines," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(4), pages 797-816, August.
- Garret Christensen & Edward Miguel, 2018.
"Transparency, Reproducibility, and the Credibility of Economics Research,"
Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
- Garret S. Christensen & Edward Miguel, 2016. "Transparency, Reproducibility, and the Credibility of Economics Research," NBER Working Papers 22989, National Bureau of Economic Research, Inc.
- Christensen, Garret & Miguel, Edward, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," Department of Economics, Working Paper Series qt52h6x1cq, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Isaiah Andrews & Maximilian Kasy, 2019.
"Identification of and Correction for Publication Bias,"
American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and correction for publication bias," Papers 1711.10527, arXiv.org.
- Kasy, Maximilian & Andrews, Isaiah, 2018. "Identification of and correction for publication bias," MetaArXiv 49yst, Center for Open Science.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and Correction for Publication Bias," NBER Working Papers 23298, National Bureau of Economic Research, Inc.
- Gerber, Alan & Malhotra, Neil, 2008. "Do Statistical Reporting Standards Affect What Is Published? Publication Bias in Two Leading Political Science Journals," Quarterly Journal of Political Science, now publishers, vol. 3(3), pages 313-326, October.
- Joseph P. Romano & Michael Wolf, 2011. "Testing for monotonicity in expected asset returns," ECON - Working Papers 017, Department of Economics - University of Zurich, revised Jan 2013.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016.
"Star Wars: The Empirics Strike Back,"
American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," PSE Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," Post-Print hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," PSE-Ecole d'économie de Paris (Postprint) hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," PSE Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," AMSE Working Papers 1523, Aix-Marseille School of Economics, France, revised May 2015.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers 1505E, University of Ottawa, Department of Economics.
- Brodeur, Abel & Lé, Mathias & Sangnier, Marc & Zylberberg, Yanos, 2013. "Star Wars: The Empirics Strike Back," IZA Discussion Papers 7268, Institute of Labor Economics (IZA).
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," Working Papers halshs-00710122, HAL.
- Bruns, Stephan B. & Asanov, Igor & Bode, Rasmus & Dunger, Melanie & Funk, Christoph & Hassan, Sherif M. & Hauschildt, Julia & Heinisch, Dominik & Kempa, Karol & König, Johannes & Lips, Johannes & Verb, 2019. "Reporting errors and biases in published empirical findings: Evidence from innovation research," Research Policy, Elsevier, vol. 48(9), pages 1-1.
- Christopher A. Carolan & Joshua M. Tebbs, 2005. "Nonparametric tests for and against likelihood ratio ordering in the two-sample problem," Biometrika, Biometrika Trust, vol. 92(1), pages 159-171, March.
- Beare, Brendan K. & Moon, Jong-Myun, 2015. "Nonparametric Tests Of Density Ratio Ordering," Econometric Theory, Cambridge University Press, vol. 31(3), pages 471-492, June.
- Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
- Snyder, Christopher & Zhuo, Ran, 2018. "Sniff Tests in Economics: Aggregate Distribution of Their Probability Values and Implications for Publication Bias," MetaArXiv 8vdrh, Center for Open Science.
- P. M. Hartigan, 1985. "Computation of the Dip Statistic to Test for Unimodality," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 34(3), pages 320-325, November.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Guido W. Imbens, 2021. "Statistical Significance, p-Values, and the Reporting of Uncertainty," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 157-174, Summer.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
- Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020.
"Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought,"
Working Papers IES
2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
- Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2021. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," CEPR Discussion Papers 15724, C.E.P.R. Discussion Papers.
- Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," EconStor Preprints 223060, ZBW - Leibniz Information Centre for Economics.
- Cristina Blanco-Perez & Abel Brodeur, 2019. "Transparency in empirical economic research," IZA World of Labor, Institute of Labor Economics (IZA), pages 467-467, November.
- Zigraiova, Diana & Havranek, Tomas & Irsova, Zuzana & Novak, Jiri, 2021.
"How puzzling is the forward premium puzzle? A meta-analysis,"
European Economic Review, Elsevier, vol. 134(C).
- Havranek, Tomas & Novak, Jiri & Zigraiova, Diana, 2020. "How puzzling is the forward premium puzzle? A meta-analysis," MetaArXiv 348kc, Center for Open Science.
- Diana Zigraiova & Tomas Havranek & Jiri Novak, 2020. "How Puzzling Is the Forward Premium Puzzle? A Meta-Analysis," Working Papers IES 2020/6, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Feb 2020.
- Zigraiova, Diana & Havranek, Tomas & Novak, Jiri, 2020. "How Puzzling Is the Forward Premium Puzzle? A Meta-Analysis," EconStor Preprints 213578, ZBW - Leibniz Information Centre for Economics.
- Diana Zigraiova & Tomas Havranek & Jiri Novak, 2020. "How puzzling is the forward premium puzzle? A meta-analysis," Working Papers 46, European Stability Mechanism.
- Havranek, Tomas & Irsova, Zuzana & Novak, Jiri & Zigraiova, Diana, 2021. "How Puzzling Is the Forward Premium Puzzle? A Meta-Analysis," CEPR Discussion Papers 15817, C.E.P.R. Discussion Papers.
- Roman Horvath & Ali Elminejad & Tomas Havranek, 2020.
"Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply,"
Working Papers IES
2020/32, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
- Elminejad, Ali & Havranek, Tomas & Horvath, Roman, 2021. "Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply," EconStor Preprints 232534, ZBW - Leibniz Information Centre for Economics.
- Havranek, Tomas & Horvath, Roman & Elminejad, Ali, 2021. "Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply," MetaArXiv nshqx, Center for Open Science.
- Elminejad, M. Ali & Havranek, Tomas & Horvath, Roman, 2021. "Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply," CEPR Discussion Papers 16032, C.E.P.R. Discussion Papers.
- Isaiah Andrews & Maximilian Kasy, 2019.
"Identification of and Correction for Publication Bias,"
American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and correction for publication bias," Papers 1711.10527, arXiv.org.
- Kasy, Maximilian & Andrews, Isaiah, 2018. "Identification of and correction for publication bias," MetaArXiv 49yst, Center for Open Science.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and Correction for Publication Bias," NBER Working Papers 23298, National Bureau of Economic Research, Inc.
- Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018.
"How to run an experimental auction: A review of recent advances,"
Working Papers
2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
- Canavari, Maurizio & Drichoutis, Andreas C. & Lusk, Jayson L. & Nayga, Rodolfo, 2018. "How to run an experimental auction: A review of recent advances," MPRA Paper 89715, University Library of Munich, Germany.
- Igor Asanov & Christoph Buehren & Panagiota Zacharodimou, 2020. "The power of experiments: How big is your n?," MAGKS Papers on Economics 202032, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
- Bajzik, Josef & Havranek, Tomas & Irsova, Zuzana & Schwarz, Jiri, 2020. "Estimating the Armington elasticity: The importance of study design and publication bias," Journal of International Economics, Elsevier, vol. 127(C).
- Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2019.
"Remittances and Economic Growth: A Quantitative Survey,"
EconStor Preprints
205812, ZBW - Leibniz Information Centre for Economics.
- Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2019. "Remittances and Economic Growth: A Quantitative Survey," MPRA Paper 96823, University Library of Munich, Germany.
- Bruns, Stephan B. & Asanov, Igor & Bode, Rasmus & Dunger, Melanie & Funk, Christoph & Hassan, Sherif M. & Hauschildt, Julia & Heinisch, Dominik & Kempa, Karol & König, Johannes & Lips, Johannes & Verb, 2019. "Reporting errors and biases in published empirical findings: Evidence from innovation research," Research Policy, Elsevier, vol. 48(9), pages 1-1.
- Tomáš Havránek & T. D. Stanley & Hristos Doucouliagos & Pedro Bom & Jerome Geyer‐Klingeberg & Ichiro Iwasaki & W. Robert Reed & Katja Rost & R. C. M. van Aert, 2020. "Reporting Guidelines For Meta‐Analysis In Economics," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 469-475, July.
- Furukawa, Chishio, 2019. "Publication Bias under Aggregation Frictions: Theory, Evidence, and a New Correction Method," EconStor Preprints 194798, ZBW - Leibniz Information Centre for Economics.
- Bagues, Manuel & Campa, Pamela, 2021.
"Can gender quotas in candidate lists empower women? Evidence from a regression discontinuity design,"
Journal of Public Economics, Elsevier, vol. 194(C).
- Pamela Campa & Manuel Bagues, "undated". "Can Gender Quotas in Candidate Lists Empower Women? Evidence from a Regression Discontinuity Design," Working Papers 2017-06, Department of Economics, University of Calgary.
- Bagues, Manuel & Campa, Pamela, 2017. "Can Gender Quotas in Candidate Lists Empower Women? Evidence from a Regression Discontinuity Design," CEPR Discussion Papers 12149, C.E.P.R. Discussion Papers.
- Bagues, Manuel & Campa, Pamela, 2017. "Can Gender Quotas in Candidate Lists Empower Women? Evidence from a Regression Discontinuity Design," IZA Discussion Papers 10888, Institute of Labor Economics (IZA).
- Stefano DellaVigna & Elizabeth Linos, 2022.
"RCTs to Scale: Comprehensive Evidence From Two Nudge Units,"
Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
- Stefano DellaVigna & Elizabeth Linos, 2020. "RCTs to Scale: Comprehensive Evidence from Two Nudge Units," NBER Working Papers 27594, National Bureau of Economic Research, Inc.
- Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
- Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022.
"Individual discount rates: a meta-analysis of experimental evidence,"
Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.
- Jindrich Matousek, 2018. "Individual Discount Rates: A Meta-Analysis of the Experimental Evidence," Working Papers IES 2018/40, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Dec 2018.
- Havranek, Tomas & Irsova, Zuzana & Matousek, Jindrich, 2021. "Individual Discount Rates: A Meta-Analysis of Experimental Evidence," CEPR Discussion Papers 15688, C.E.P.R. Discussion Papers.
- Matousek, Jindrich & Havranek, Tomas & Irsova, Zuzana, 2019. "Individual Discount Rates: A Meta-Analysis of Experimental Evidence," EconStor Preprints 194617, ZBW - Leibniz Information Centre for Economics.
- Christopher Snyder & Ran Zhuo, 2018. "Sniff Tests as a Screen in the Publication Process: Throwing out the Wheat with the Chaff," NBER Working Papers 25058, National Bureau of Economic Research, Inc.
- Geyer-Klingeberg, Jerome & Hang, Markus & Rathgeber, Andreas, 2020. "Meta-analysis in finance research: Opportunities, challenges, and contemporary applications," International Review of Financial Analysis, Elsevier, vol. 71(C).
- Cristina Blanco-Perez & Abel Brodeur, 2020.
"Publication Bias and Editorial Statement on Negative Findings,"
Economic Journal, Royal Economic Society, vol. 130(629), pages 1226-1247.
- Brodeur, Abel & Blanco-Perez, Cristina, 2017. "Publication Bias and Editorial Statement on Negative Findings," MetaArXiv xq9nt, Center for Open Science.
- Cristina Blanco-Perez & Abel Brodeur, 2019. "Publication Bias and Editorial Statement on Negative Findings," Working Papers 1907E, University of Ottawa, Department of Economics.
- Blanco-Perez, Cristina & Brodeur, Abel, 2019. "Publication Bias and Editorial Statement on Negative Findings," IZA Discussion Papers 12493, Institute of Labor Economics (IZA).
- Cristina Blanco-Perez & Abel Brodeur, 2019. "Publication Bias and Editorial Statement on Negative Findings," Working Papers 190001, Canadian Centre for Health Economics.
More about this item
NEP fields
This paper has been announced in the following NEP Reports:- NEP-ECM-2019-06-24 (Econometrics)
Lists
This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1906.06711. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://arxiv.org/ .
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.