A Monte Carlo analysis of alternative meta-analysis estimators in the presence of publication bias
A meta-analysis (MA) aggregates estimated effects from many studies to calculate a single, overall effect. There is no one, generally accepted procedure for how to do this. Several estimators are commonly used, though little is known about their relative performance. A complication arises when the sample of published studies is subject to sample selection due to "publication bias." This study uses Monte Carlo simulations to investigate the performance of five different MA estimators in the presence of publication bias. The author considers two kinds of publication bias: publication bias directed against statistically insignificant estimates, and publication bias directed against wrong-signed estimates. The experiments simulate two data environments. In the Random Effects environment, each study produces only one estimate and the true effect differs across studies. In the Panel Random Effects environment, each study produces multiple estimates, and the true effect differs both within and across studies. The simulations produce a number of findings that challenge results from previous research.
Volume (Year): 9 (2015)
Issue (Month): ()
|Contact details of provider:|| Postal: Kiellinie 66, D-24105 Kiel|
Phone: +49 431 8814-1
Fax: +49 431 8814528
Web page: http://www.economics-ejournal.org/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- T.D. Stanley, 2006.
"Meta-Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection,"
2006_20, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
- T. D. Stanley, 2008. "Meta-Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(1), pages 103-127, 02.
- Jasper M. Dalhuisen & Raymond J. G. M. Florax & JHenri L. F. de Groot & Peter Nijkamp, 2003. "Price and Income Elasticities of Residential Water Demand: A Meta-Analysis," Land Economics, University of Wisconsin Press, vol. 79(2), pages 292-308.
- Hristos Doucouliagos & T.D. Stanley & Margaret Giles, 2011.
"Are Estimates of the Value of a Statistical Life Exaggerated?,"
2011_2, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
- Doucouliagos, Chris & Stanley, T.D. & Giles, Margaret, 2012. "Are estimates of the value of a statistical life exaggerated?," Journal of Health Economics, Elsevier, vol. 31(1), pages 197-206.
- Tseday Jemaneh Mekasha & Finn Tarp, 2011.
"Aid and Growth What Meta-Analysis Reveals,"
WIDER Working Paper Series
022, World Institute for Development Economic Research (UNU-WIDER).
- Hristos Doucouliagos & T.D. Stanley, 2008.
"Publication Selection Bias in Minimum-Wage Research? A Meta-Regression Analysis,"
2008_14, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
- Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum-Wage Research? A Meta-Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, 06.
- Bellavance, Franois & Dionne, Georges & Lebeau, Martin, 2009.
"The value of a statistical life: A meta-analysis with a mixed effects regression model,"
Journal of Health Economics,
Elsevier, vol. 28(2), pages 444-464, March.
- François Bellavance & Georges Dionne & Martin Lebeau, 2006. "The Value of a Statistical Life: a Meta-Analysis with a Mixed Effects Regression Model," Cahiers de recherche 0646, CIRPEE.
- Mark Koetse & Raymond Florax & Henri Groot, 2010. "Consequences of effect size heterogeneity for meta-analysis: a Monte Carlo study," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 19(2), pages 217-236, June.
- Hristos Doucouliagos & Martin Paldam, 2012.
"The robust result in meta-analysis of aid effectiveness: A response to Mekasha and Tarp,"
2012_4, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
- Hristos Doucouliagos & Martin Paldam, 2013. "The Robust Result in Meta-analysis of Aid Effectiveness: A Response to Mekasha and Tarp," Journal of Development Studies, Taylor & Francis Journals, vol. 49(4), pages 584-587, April.
- Hristos Doucouliagos & Martin Paldam, 2011. "The robust result in meta-analysis of aid effectiveness: A response to Mekasha and Tarp," Economics Working Papers 2011-15, Department of Economics and Business Economics, Aarhus University.
When requesting a correction, please mention this item's handle: RePEc:zbw:ifweej:201530. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (ZBW - German National Library of Economics)
If references are entirely missing, you can add them using this form.