Advanced Search
MyIDEAS: Login to save this paper or follow this series

Theory Competition and Selectivity: Are All Economic Facts Greatly Exaggerated?

Contents:

Author Info

Abstract

There is growing concern and mounting evidence of selectivity in empirical economics. Most empirical economic literatures have a skewed (or truncated) distribution of results. The aim of this paper is to explore the links between publication selectivity and theory competition. In research areas where theory supports a wide range of outcomes, empirical evidence is less likely to be affected by selectivity. However, in those areas where theory is consistent with only one qualitative effect (e.g, a negative effect of price on quantity demanded), selectivity is more likely and its bias, more severe. This hypothesis is supported through the analysis of 65 distinct empirical economics literatures, involving approximately two thousand separate empirical studies, which in turn collectively contain many more thousands of estimates. Our meta-meta-analysis shows that publication selection is widespread, but not universal. It distorts scientific inference with potentially adverse effects on policy making, but competition and debate between rival theories reduces this selectivity and thereby improves economic inference. All literature reviews, whether traditional or quantitative (meta-analysis), need to adopt explicit selection correction methods.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.deakin.edu.au/buslaw/aef/workingpapers/papers/2008_06eco.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance in its series Economics Series with number 2008_06.

as in new window
Length: 47 pages
Date of creation: 15 Oct 2008
Date of revision:
Handle: RePEc:dkn:econwp:eco_2008_06

Contact details of provider:
Postal: 221 Burwood Highway, Burwood 3125
Phone: 61 3 9244 3815
Web page: http://www.deakin.edu.au/buslaw/aef/index.php

Related research

Keywords: publication selectivity; theory competition; meta-meta-analysis; empirical economics;

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Peter Nijkamp & Jacques Poot, 2002. "The Last Word on the Wage Curve?," Tinbergen Institute Discussion Papers, Tinbergen Institute 02-029/3, Tinbergen Institute, revised 13 Mar 2003.
  2. Orley Ashenfelter & Michael Greenstone, 2004. "Estimating the Value of a Statistical Life: The Importance of Omitted Variables and Publication Bias," NBER Working Papers 10401, National Bureau of Economic Research, Inc.
  3. Simonetta Longhi & Peter Nijkamp & Jacques Poot, 2004. "A Meta-Analytic Assessment of the Effect of Immigration on Wages," Population Studies Centre Discussion Papers, University of Waikato, Population Studies Centre dp-47, University of Waikato, Population Studies Centre.
  4. B. Douglas Bernheim, 1987. "Ricardian Equivalence: An Evaluation of Theory and Evidence," NBER Chapters, National Bureau of Economic Research, Inc, in: NBER Macroeconomics Annual 1987, Volume 2, pages 263-316 National Bureau of Economic Research, Inc.
  5. Thompson, Bruce, 2004. "The "significance" crisis in psychology and education," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, Elsevier, vol. 33(5), pages 607-613, November.
  6. Robert J. Barro, 1988. "The Ricardian Approach to Budget Deficits," Working Papers, Queen's University, Department of Economics 728, Queen's University, Department of Economics.
  7. Barro, Robert J, 1974. "Are Government Bonds Net Wealth?," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 82(6), pages 1095-1117, Nov.-Dec..
  8. Phillips, Joseph M, 1994. "Farmer Education and Farmer Efficiency: A Meta-Analysis," Economic Development and Cultural Change, University of Chicago Press, University of Chicago Press, vol. 43(1), pages 149-65, October.
  9. Thomas J. Steichen, 1998. "Tests for publication bias in meta-analysis," Stata Technical Bulletin, StataCorp LP, StataCorp LP, vol. 7(41).
  10. T.D Stanley & Hristos Doucouliagos, 2007. "Identifying and Correcting Publication Selection Bias in the Efficiency-Wage Literature: Heckman Meta-Regression," Economics Series 2007_11, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
  11. Chris Doucouliagos, 2005. "Publication Bias in the Economic Freedom and Economic Growth Literature," Journal of Economic Surveys, Wiley Blackwell, Wiley Blackwell, vol. 19(3), pages 367-387, 07.
  12. Maria Abreu & Henri L.F. de Groot & Raymond J.G.M. Florax, 2005. "A Meta-Analysis of Beta-Convergence: The Legendary Two-Percent," Tinbergen Institute Discussion Papers, Tinbergen Institute 05-001/3, Tinbergen Institute.
  13. De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 100(6), pages 1257-72, December.
  14. Markus Knell & Helmut Stix, 2005. "The Income Elasticity of Money Demand: A Meta-Analysis of Empirical Results ," Journal of Economic Surveys, Wiley Blackwell, Wiley Blackwell, vol. 19(3), pages 513-533, 07.
  15. T.D. Stanley, 2006. "Meta-Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection," Economics Series 2006_20, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
  16. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, Wiley Blackwell, vol. 19(3), pages 309-345, 07.
  17. Laroche, P., 2000. "What do Unions do to Productivity? A Meta-Analysis," Papers, Groupe de recherche en économie financière et en gestion des entreprises, Universite Nancy 2 2000-5, Groupe de recherche en économie financière et en gestion des entreprises, Universite Nancy 2.
  18. Ashenfelter, O. & Harmon, C. & Oosterbeek, H., 1999. "A Review of Estimates of the Schooling/ Earnings Relationship, with tests for Publication Bias," Papers, College Dublin, Department of Political Economy- 99/20, College Dublin, Department of Political Economy-.
  19. repec:fth:prinin:425 is not listed on IDEAS
  20. Rose, Andrew K, 2003. "A Meta-Analysis of the Effect of Common Currencies on International Trade," CEPR Discussion Papers, C.E.P.R. Discussion Papers 4341, C.E.P.R. Discussion Papers.
  21. T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, American Economic Association, vol. 15(3), pages 131-150, Summer.
  22. Dan Fuller & Doris Geide-stevenson, 2003. "Consensus Among Economists: Revisited," The Journal of Economic Education, Taylor & Francis Journals, Taylor & Francis Journals, vol. 34(4), pages 369-387, December.
  23. Feige, Edgar L, 1975. "The Consequences of Journal Editorial Policies and a Suggestion for Revision," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 83(6), pages 1291-95, December.
  24. Maria Cipollina & Luca Salvatici, 2010. "Reciprocal Trade Agreements in Gravity Models: A Meta-Analysis," Review of International Economics, Wiley Blackwell, Wiley Blackwell, vol. 18(1), pages 63-80, 02.
  25. Chris Doucouliagos & Patrice Laroche, 2007. "Unions and Profitability: A Meta-Analysis," Economics Series 2007_01, Deakin University, Faculty of Business and Law, School of Accounting, Economics and Finance.
  26. T. D. Stanley & Stephen B. Jarrell, 2005. "Meta-Regression Analysis: A Quantitative Method of Literature Surveys," Journal of Economic Surveys, Wiley Blackwell, Wiley Blackwell, vol. 19(3), pages 299-308, 07.
  27. Barry T. Hirsch, 2004. "What Do Unions Do for Economic Performance?," Journal of Labor Research, Transaction Publishers, Transaction Publishers, vol. 25(3), pages 415-456, July.
  28. Nelson, Jon P., 2006. "Cigarette advertising regulation: A meta-analysis," International Review of Law and Economics, Elsevier, Elsevier, vol. 26(2), pages 195-226, June.
  29. Peter Jensen & Martin Paldam, 2006. "Can the two new aid-growth models be replicated?," Public Choice, Springer, Springer, vol. 127(1), pages 147-175, April.
  30. McCloskey, Donald N, 1985. "The Loss Function Has Been Mislaid: The Rhetoric of Significance Tests," American Economic Review, American Economic Association, American Economic Association, vol. 75(2), pages 201-05, May.
  31. T. D. Stanley, 2005. "Integrating the Empirical Tests of the Natural Rate Hypothesis: A Meta-Regression Analysis," Kyklos, Wiley Blackwell, Wiley Blackwell, vol. 58(4), pages 611-634, November.
  32. José Allouche & Patrice Laroche, 2005. "A Meta-analytical investigation of the relationship between corporate social and financial performance," Post-Print, HAL hal-00923906, HAL.
  33. Victor R. Fuchs & Alan B. Krueger & James M. Poterba, 1998. "Economists' Views about Parameters, Values, and Policies: Survey Results in Labor and Public Economics," Journal of Economic Literature, American Economic Association, American Economic Association, vol. 36(3), pages 1387-1425, September.
  34. Marin C. Gemmill & Joan Costa-Font & Alistair McGuire, 2007. "In search of a corrected prescription drug Elasticity estimate: a meta-regression approach," Health Economics, John Wiley & Sons, Ltd., John Wiley & Sons, Ltd., vol. 16(6), pages 627-643.
  35. Bryan Caplan, 2002. "Systematically Biased Beliefs About Economics: Robust Evidence of Judgemental Anomalies from the Survey of Americans and Economists on the Economy," Economic Journal, Royal Economic Society, Royal Economic Society, vol. 112(479), pages 433-458, April.
  36. David Dollar & Craig Burnside, 2000. "Aid, Policies, and Growth," American Economic Review, American Economic Association, American Economic Association, vol. 90(4), pages 847-868, September.
  37. Hristos Doucouliagos & Martin Paldam, 2007. "Explaining development aid allocation by growth: A meta study," Economics Working Papers, School of Economics and Management, University of Aarhus 2007-13, School of Economics and Management, University of Aarhus.
  38. Brigitte Waldorf & Pillsung Byun, 2005. "Meta-analysis of the impact of age structure on fertility," Journal of Population Economics, Springer, Springer, vol. 18(1), pages 15-40, December.
  39. Mookerjee, Rajen, 2006. "A meta-analysis of the export growth hypothesis," Economics Letters, Elsevier, Elsevier, vol. 91(3), pages 395-401, June.
  40. Frey, Bruno S & Eichenberger, Reiner, 1992. "Economics and Economists: A European Perspective," American Economic Review, American Economic Association, American Economic Association, vol. 82(2), pages 216-20, May.
  41. Barry T. Hirsch, 1991. "Labor Unions and the Economic Performance of Unions," Books from Upjohn Press, W.E. Upjohn Institute for Employment Research, W.E. Upjohn Institute for Employment Research, number luepf.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:dkn:econwp:eco_2008_06. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dr Xueli Tang).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.