This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Meta-Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
T.D. Stanley ()

Additional information is available for the following registered author(s):

Abstract

This study investigates the small-sample performance of meta-regression methods for detecting and estimating genuine empirical effects in research literatures tainted by publication selection. Publication selection exists when editors, reviewers or researchers have a preference for statistically significant results. Meta-regression methods are found to be robust against publication selection. Even if a literature is dominated by large and unknown misspecification biases, precision-effect testing and joint precision-effect/meta-significance testing can provide viable strategies for detecting genuine empirical effects. Publication biases are greatly reduced by combining two biased estimates, the estimated meta-regression coefficient on precision (1/Se) and the unadjusted average effect.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.deakin.edu.au/buslaw/aef/workingpapers/papers/2006_20eco.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance in its series Economics Series with number 2006_20.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: 29 Oct 2006
Date of revision:
Handle: RePEc:dkn:econwp:eco_2006_20

Contact details of provider:
Postal: 221 Burwood Highway, Burwood 3125
Phone: 61 3 9244 3815
Web page: http://www.deakin.edu.au/buslaw/aef/index.php

For technical questions regarding this item, or to correct its listing, contact: (Dr Xueli Tang).

Related research
Keywords: Meta-analysis; Publication selection bias; Meta-regression analysis; Precision; Funnel graphs;

Other versions of this item:

Find related papers by JEL classification:
C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Hypothesis Testing
C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Estimation
B40 - Schools of Economic Thought and Methodology - - Economic Methodology - - - General

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

  1. Orley Ashenfelter & Colm Harmon & Hessel Oosterbeek, 1999. "A Review of Estimates of the Schooling/Earnings Relationship, with Tests for Publication Bias," Working Papers 804, Princeton University, Department of Economics, Industrial Relations Section.. [Downloadable!]
    Other versions:
  2. T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 131-150, Summer. [Downloadable!] (restricted)
  3. T. D. Stanley, 2005. "Integrating the Empirical Tests of the Natural Rate Hypothesis: A Meta-Regression Analysis," Kyklos, Blackwell Publishing, vol. 58(4), pages 611-634, November. [Downloadable!] (restricted)
  4. T. D. Stanley & Stephen B. Jarrell, 2005. "Meta-Regression Analysis: A Quantitative Method of Literature Surveys," Journal of Economic Surveys, Blackwell Publishing, vol. 19(3), pages 299-308, 07. [Downloadable!] (restricted)
    Other versions:
  5. Jasper M. Dalhuisen & Raymond J. G. M. Florax & JHenri L. F. de Groot & Peter Nijkamp, 2003. "Price and Income Elasticities of Residential Water Demand: A Meta-Analysis," Land Economics, University of Wisconsin Press, vol. 79(2), pages 292-308. [Downloadable!] (restricted)
  6. repec:fth:prinin:425 is not listed on IDEAS
  7. Chris Doucouliagos, 2005. "Publication Bias in the Economic Freedom and Economic Growth Literature," Journal of Economic Surveys, Blackwell Publishing, vol. 19(3), pages 367-387, 07. [Downloadable!] (restricted)
  8. De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1257-72, December. [Downloadable!] (restricted)
    Other versions:
  9. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Blackwell Publishing, vol. 19(3), pages 309-345, 07. [Downloadable!] (restricted)
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. T.D. Stanley & Chris Doucouliagous, 2006. "Publication Bias in Minimum-Wage Research? Card and Krueger Redux," Economics Series 2006_16, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
  2. Chris Doucouliagos & Patrice Laroche, 2007. "Unions and Profitability: A Meta-Analysis," Economics Series 2007_01, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
  3. T.D. Stanley, 2006. "Two-Stage Precision-Effect Estimation and Heckman Meta-Regression for Publication Selection Bias," Economics Series 2006_25, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
  4. Costa-Font, J & Gemmill, M & Rubert, G, 2009. "Re-visiting the Health Care Luxury Good Hypothesis: Aggregation, Precision, and Publication Biases?," Health, Econometrics and Data Group (HEDG) Working Papers 09/02, HEDG, c/o Department of Economics, University of York. [Downloadable!]
    Other versions:
  5. T.D Stanley & Hristos Doucouliagos, 2007. "Identifying and Correcting Publication Selection Bias in the Efficiency-Wage Literature: Heckman Meta-Regression," Economics Series 2007_11, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
  6. Su Wu, 2006. "The Wallis Report and Implications of Bank Mergers for Efficiencies," Economics Series 2006_12, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
  7. T.D. Stanley & Chris Doucouliagous & Stephen B. Jarrell, 2006. "Meta-Regression Analysis as the Socio-Economics of Economic Research," Economics Series 2006_21, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
    Other versions:
  8. Hristos Doucouliagos & T.D. Stanley, 2008. "Publication Selection Bias in Minimum-Wage Research? A Meta-Regression Analysis," Economics Series 2008_14, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
    Other versions:
  9. T.D. Stanley & Stephen B. Jarrell & Hristos Doucouliagos, 2009. "Could It Be Better to Discard 90% of the Data? A Statistical Paradox," Economics Series 2009_13, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
  10. Tomáš Havránek, 2009. "Rose Effect and the Euro: The Magic is Gone," Working Papers IES 2009/20, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Aug 2009. [Downloadable!]
  11. Hristos Doucouliagos & T.D. Stanley, 2008. "Theory Competition and Selectivity: Are All Economic Facts Greatly Exaggerated?," Economics Series 2008_06, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance. [Downloadable!]
Statistics
Access and download statistics

Did you know? Authors can create their own profile with links to their works on the RePEc Author Service.

This page was last updated on 2009-11-12.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.