Theory Competition and Selectivity: Are All Economic Facts Greatly Exaggerated?
There is growing concern and mounting evidence of selectivity in empirical economics. Most empirical economic literatures have a skewed (or truncated) distribution of results. The aim of this paper is to explore the links between publication selectivity and theory competition. In research areas where theory supports a wide range of outcomes, empirical evidence is less likely to be affected by selectivity. However, in those areas where theory is consistent with only one qualitative effect (e.g, a negative effect of price on quantity demanded), selectivity is more likely and its bias, more severe. This hypothesis is supported through the analysis of 65 distinct empirical economics literatures, involving approximately two thousand separate empirical studies, which in turn collectively contain many more thousands of estimates. Our meta-meta-analysis shows that publication selection is widespread, but not universal. It distorts scientific inference with potentially adverse effects on policy making, but competition and debate between rival theories reduces this selectivity and thereby improves economic inference. All literature reviews, whether traditional or quantitative (meta-analysis), need to adopt explicit selection correction methods.
|Date of creation:||15 Oct 2008|
|Date of revision:|
|Contact details of provider:|| Postal: 221 Burwood Highway, Burwood 3125|
Phone: 61 3 9244 3815
Fax: +61 3 5227 2655
Web page: http://www.deakin.edu.au/buslaw/aef/index.php
More information through EDIRC
When requesting a correction, please mention this item's handle: RePEc:dkn:econwp:eco_2008_06. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dr Xueli Tang)
If references are entirely missing, you can add them using this form.