Identification of and Correction for Publication Bias
Some empirical results are more likely to be published than others. Such selective publication leads to biased estimators and distorted inference. This paper proposes two approaches for identifying the conditional probability of publication as a function of a study's results, the first based on systematic replication studies and the second based on meta-studies. For known conditional publication probabilities, we propose median-unbiased estimators and associated confidence sets that correct for selective publication. We apply our methods to recent large-scale replication studies in experimental economics and psychology, and to meta-studies of the effects of minimum wages and de-worming programs.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
|Date of creation:||Mar 2017|
|Contact details of provider:|| Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.|
Web page: http://www.nber.org
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Card, David & Krueger, Alan B, 1995. "Time-Series Minimum-Wage Studies: A Meta-analysis," American Economic Review, American Economic Association, vol. 85(2), pages 238-243, May.
- Kevin Croke & Joan Hamory Hicks & Eric Hsu & Michael Kremer & Edward Miguel, 2016. "Does Mass Deworming Affect Child Nutrition? Meta-analysis, Cost-Effectiveness, and Statistical Power," NBER Working Papers 22382, National Bureau of Economic Research, Inc.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016.
"Star Wars: The Empirics Strike Back,"
American Economic Journal: Applied Economics,
American Economic Association, vol. 8(1), pages 1-32, January.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," PSE Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers 1505E, University of Ottawa, Department of Economics.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," PSE Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," Post-Print hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," AMSE Working Papers 1523, Aix-Marseille School of Economics, Marseille, France, revised May 2015.
- Brodeur, Abel & Lé, Mathias & Sangnier, Marc & Zylberberg, Yanos, 2013. "Star Wars: The Empirics Strike Back," IZA Discussion Papers 7268, Institute for the Study of Labor (IZA).
- Clemens, Michael A., 2015. "The Meaning of Failed Replications: A Review and Proposal," IZA Discussion Papers 9000, Institute for the Study of Labor (IZA).
- De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1257-1272, December.
- J. Bradford De Long & Kevin Lang, "undated". "Are All Economic Hypotheses False?," J. Bradford De Long's Working Papers _117, University of California at Berkeley, Economics Department.
- Croke, Kevin & Hicks, Joan Hamory & Hsu, Eric & Kremer, Michael & Miguel, Edward, 2016. "Does Mass Deworming Affect Child Nutrition? Meta-analysis, Cost-Effectiveness, and Statistical Power," CEPR Discussion Papers 11458, C.E.P.R. Discussion Papers.
- Michael Clemens, 2015. "The Meaning of Failed Replications: A Review and Proposal - Working Paper 399," Working Papers 399, Center for Global Development.
- Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
- Daniel Yekutieli, 2012. "Adjusted Bayesian inference for selected parameters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 515-541, 06.
- Croke,Kevin & Hicks,Joan Hamory & Hsu,Eric & Kremer,Michael Robert & Miguel,Edward A., 2016. "Does mass deworming affect child nutrition ? meta-analysis, cost-effectiveness, and statistical power," Policy Research Working Paper Series 7921, The World Bank.
- Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum-Wage Research? A Meta-Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, 06.
- Hristos Doucouliagos & T.D. Stanley, 2008. "Publication Selection Bias in Minimum-Wage Research? A Meta-Regression Analysis," Economics Series 2008_14, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
- Garret S. Christensen & Edward Miguel, 2016. "Transparency, Reproducibility, and the Credibility of Economics Research," NBER Working Papers 22989, National Bureau of Economic Research, Inc.
- Andrews, Donald W K, 1993. "Exactly Median-Unbiased Estimation of First Order Autoregressive/Unit Root Models," Econometrica, Econometric Society, vol. 61(1), pages 139-165, January. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:23298. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ()
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.