IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

A Monte Carlo Analysis of Alternative Meta-Analysis Estimators in the Presence of Publication Bias

Listed author(s):

This study uses Monte Carlo analysis to investigate the performances of five different meta-analysis (MA) estimators: the Fixed Effects (FE) estimator, the Weighted Least Squares (WLS) estimator, the Random Effects (RE) estimator, the Precision Effect Test (PET) estimator, and the Precision Effect Estimate with Standard Errors (PEESE) estimator. We consider two types of publication bias: publication bias directed against statistically insignificant estimates, and publication bias directed against wrong-signed estimates. Finally, we consider three cases concerning the distribution of the “true effect”: the Fixed Effects case, where there is only estimate per study, and all studies have the same true effect; the Random Effects case, where there is only one estimate per study, and there is heterogeneity in true effects across studies; and the Panel Random Effects case, where studies have multiple estimates, and true effects are random both across and within studies. Our simulations produce a number of findings that challenge results from previous research.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.econ.canterbury.ac.nz/RePEc/cbt/econwp/1422.pdf
Download Restriction: no

Paper provided by University of Canterbury, Department of Economics and Finance in its series Working Papers in Economics with number 14/22.

as
in new window

Length: 86 pages
Date of creation: 13 Aug 2014
Handle: RePEc:cbt:econwp:14/22
Contact details of provider: Postal:
Private Bag 4800, Christchurch, New Zealand

Phone: 64 3 369 3123 (Administrator)
Fax: 64 3 364 2635
Web page: http://www.econ.canterbury.ac.nz

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as
in new window


  1. Stanley, T. D. & Jarrell, Stephen B. & Doucouliagos, Hristos, 2010. "Could It Be Better to Discard 90% of the Data? A Statistical Paradox," The American Statistician, American Statistical Association, vol. 64(1), pages 70-77.
  2. Hristos Doucouliagos & Martin Paldam, 2009. "The Aid Effectiveness Literature: The Sad Results Of 40 Years Of Research," Journal of Economic Surveys, Wiley Blackwell, vol. 23(3), pages 433-461, 07.
  3. Mark Koetse & Raymond Florax & Henri Groot, 2010. "Consequences of effect size heterogeneity for meta-analysis: a Monte Carlo study," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 19(2), pages 217-236, June.
  4. T. D. Stanley, 2008. "Meta-Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(1), pages 103-127, 02.
  5. Jasper M. Dalhuisen & Raymond J. G. M. Florax & JHenri L. F. de Groot & Peter Nijkamp, 2003. "Price and Income Elasticities of Residential Water Demand: A Meta-Analysis," Land Economics, University of Wisconsin Press, vol. 79(2), pages 292-308.
  6. Hristos Doucouliagos & Janto Haman & T.D. Stanley, 2012. "Pay for Performance and Corporate Governance Reform," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 51(3), pages 670-703, 07.
  7. Nelson, Jon P., 2014. "Estimating the price elasticity of beer: Meta-analysis of data with heterogeneity, dependence, and publication bias," Journal of Health Economics, Elsevier, vol. 33(C), pages 180-187.
  8. Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum-Wage Research? A Meta-Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, 06.
  9. Bellavance, Franois & Dionne, Georges & Lebeau, Martin, 2009. "The value of a statistical life: A meta-analysis with a mixed effects regression model," Journal of Health Economics, Elsevier, vol. 28(2), pages 444-464, March.
  10. Doucouliagos, Chris & Stanley, T.D. & Giles, Margaret, 2012. "Are estimates of the value of a statistical life exaggerated?," Journal of Health Economics, Elsevier, vol. 31(1), pages 197-206.
  11. Hristos Doucouliagos & Martin Paldam, 2013. "The Robust Result in Meta-analysis of Aid Effectiveness: A Response to Mekasha and Tarp," Journal of Development Studies, Taylor & Francis Journals, vol. 49(4), pages 584-587, April.
  12. Tomas Havranek & Zuzana Irsova, 2017. "Do Borders Really Slash Trade? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 65(2), pages 365-396, June.
  13. Tomáš Havránek, 2015. "Measuring Intertemporal Substitution: The Importance Of Method Choices And Selective Reporting," Journal of the European Economic Association, European Economic Association, vol. 13(6), pages 1180-1204, December.
  14. Tseday Jemaneh Mekasha & Finn Tarp, 2013. "Aid and Growth: What Meta-Analysis Reveals," Journal of Development Studies, Taylor & Francis Journals, vol. 49(4), pages 564-583, April.
Full references (including those not matched with items on IDEAS)

This item is featured on the following reading lists or Wikipedia pages:

  1. Meta-Analysis in Economics

When requesting a correction, please mention this item's handle: RePEc:cbt:econwp:14/22. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Albert Yee)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.