Meta-Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection
This study investigates the small-sample performance of meta-regression methods for detecting and estimating genuine empirical effects in research literatures tainted by publication selection. Publication selection exists when editors, reviewers or researchers have a preference for statistically significant results. Meta-regression methods are found to be robust against publication selection. Even if a literature is dominated by large and unknown misspecification biases, precision-effect testing and joint precision-effect/meta-significance testing can provide viable strategies for detecting genuine empirical effects. Publication biases are greatly reduced by combining two biased estimates, the estimated meta-regression coefficient on precision (1/Se) and the unadjusted average effect.
|Date of creation:||29 Oct 2006|
|Date of revision:|
|Contact details of provider:|| Postal: |
Phone: 61 3 9244 3815
Web page: http://www.deakin.edu.au/buslaw/aef/index.php
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Rose, Andrew K, 2003.
"A Meta-Analysis of the Effect of Common Currencies on International Trade,"
CEPR Discussion Papers
4341, C.E.P.R. Discussion Papers.
- Andrew K. Rose & T. D. Stanley, 2005. "A Meta-Analysis of the Effect of Common Currencies on International Trade ," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 347-365, 07.
- Andrew Rose, 2004. "A Meta-Analysis of the Effect of Common Currencies on International Trade," NBER Working Papers 10373, National Bureau of Economic Research, Inc.
- De Long, J Bradford & Lang, Kevin, 1992.
"Are All Economic Hypotheses False?,"
Journal of Political Economy,
University of Chicago Press, vol. 100(6), pages 1257-72, December.
- Chris Doucouliagos, 2005. "Publication Bias in the Economic Freedom and Economic Growth Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 367-387, 07.
- T. D. Stanley, 2005. "Integrating the Empirical Tests of the Natural Rate Hypothesis: A Meta-Regression Analysis," Kyklos, Wiley Blackwell, vol. 58(4), pages 611-634, November.
- T. D. Stanley, 2004. "Does unemployment hysteresis falsify the natural rate hypothesis? a meta-regression analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 18(4), pages 589-612, 09.
- Orley Ashenfelter & Colm Harmon & Hessel Oosterbeek, 1999.
"A Review of Estimates of the Schooling/Earnings Relationship, with Tests for Publication Bias,"
804, Princeton University, Department of Economics, Industrial Relations Section..
- Ashenfelter, Orley & Harmon, Colm & Oosterbeek, Hessel, 1999. "A review of estimates of the schooling/earnings relationship, with tests for publication bias," Labour Economics, Elsevier, vol. 6(4), pages 453-470, November.
- Orley Ashenfelter & Colm Harmon & Hessel Oosterbeek, 2000. "A Review of Estimates of the Schooling/Earnings Relationship, with Tests for Publication Bias," NBER Working Papers 7457, National Bureau of Economic Research, Inc.
- Ashenfelter, O. & Harmon, C. & Oosterbeek, H., 1999. "A Review of Estimates of the Schooling/ Earnings Relationship, with tests for Publication Bias," Papers 99/20, College Dublin, Department of Political Economy-.
- Laroche, P., 2000. "What do Unions do to Productivity? A Meta-Analysis," Papers 2000-5, Groupe de recherche en économie financière et en gestion des entreprises, Universite Nancy 2.
- Peter Nijkamp & Jacques Poot, 2002.
"The Last Word on the Wage Curve?,"
Tinbergen Institute Discussion Papers
02-029/3, Tinbergen Institute, revised 13 Mar 2003.
- Chris Doucouliagos & Patrice Laroche, 2007. "Unions and Profitability: A Meta-Analysis," Economics Series 2007_01, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
- T. D. Stanley & Stephen B. Jarrell, 2005.
"Meta-Regression Analysis: A Quantitative Method of Literature Surveys,"
Journal of Economic Surveys,
Wiley Blackwell, vol. 19(3), pages 299-308, 07.
- Stanley, T D & Jarrell, Stephen B, 1989. " Meta-Regression Analysis: A Quantitative Method of Literature Survey s," Journal of Economic Surveys, Wiley Blackwell, vol. 3(2), pages 161-70.
- T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 131-150, Summer.
- Jasper M. Dalhuisen & Raymond J. G. M. Florax & JHenri L. F. de Groot & Peter Nijkamp, 2003. "Price and Income Elasticities of Residential Water Demand: A Meta-Analysis," Land Economics, University of Wisconsin Press, vol. 79(2), pages 292-308.
- T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, 07.
- Gorg, Holger & Strobl, Eric, 2001. "Multinational Companies and Productivity Spillovers: A Meta-analysis," Economic Journal, Royal Economic Society, vol. 111(475), pages F723-39, November.
When requesting a correction, please mention this item's handle: RePEc:dkn:econwp:eco_2006_20. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dr Xueli Tang)
If references are entirely missing, you can add them using this form.