Uncertainty Measures for Economics Journal Impact Factors
Academic economists appear to be intensely interested in rankings of journals, institutions, and individuals. Yet there is little discussion of the uncertainty associated with these rankings. To illustrate the uncertainty associated with citations-based rankings, I compute the standard error of the impact factor for all economics journals with a five-year impact factor in the 2011 Journal Citations Report. I use these to derive confidence intervals for the impact factors as well as ranges of possible rank for a subset of thirty journals. I find that the impact factors of the top two journals are well defined and set these journals apart in a clearly defined group. An elite group of 9-11 mainstream journals can also be fairly reliably distinguished. The four bottom ranked journals are also fairly clearly set apart. For the remainder of the distribution, confidence intervals overlap and rankings are quite uncertain.
|Date of creation:||Jan 2013|
|Contact details of provider:|| Postal: Crawford Building, Lennox Crossing, Building #132, Canberra ACT 2601|
Phone: +61 2 6125 4705
Fax: +61 2 6125 5448
Web page: https://crawford.anu.edu.au/research/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Christian Zimmermann, 2013.
"Academic Rankings with RePEc,"
MDPI, Open Access Journal, vol. 1(3), pages 1-32, December.
- Christian Zimmermann, 2007. "Academic Rankings with RePEc," Working papers 2007-36, University of Connecticut, Department of Economics, revised Mar 2009.
- Christian Zimmermann, 2012. "Academic rankings with RePEc," Working Papers 2012-023, Federal Reserve Bank of St. Louis.
- repec:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0679-8 is not listed on IDEAS
- George Emm Halkos & Nickolaos G. Tzeremes, 2011. "Measuring economic journals’ citation efficiency: a data envelopment analysis approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 979-1001, September.
- George Emm. Halkos & Nickolaos G. Tzeremes, 2011. "Measuring Economic Journals' Citation Efficiency: A Data Envelopment Analysis Approach," EERI Research Paper Series EERI_RP_2011_13, Economics and Econometrics Research Institute (EERI), Brussels.
- Halkos, George & Tzeremes, Nickolaos, 2011. "Measuring economic journals’ citation efficiency: A data envelopment analysis approach," MPRA Paper 29893, University Library of Munich, Germany.
- David N. Laband & Robert D. Tollison, 2003. "Dry Holes in Economic Research," Kyklos, Wiley Blackwell, vol. 56(2), pages 161-173, 05.
- Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
- S. Redner, 1998. "How popular is your paper? An empirical study of the citation distribution," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 4(2), pages 131-134, July.
- repec:spr:scient:v:78:y:2009:i:2:d:10.1007_s11192-008-2166-9 is not listed on IDEAS
- Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
- repec:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0634-8 is not listed on IDEAS
- Ma, Chunbo & Stern, David I., 2006. "Environmental and ecological economics: A citation analysis," Ecological Economics, Elsevier, vol. 58(3), pages 491-506, June.
- Chunbo Ma & David I. Stern, 2004. "Environmental and Ecological Economics: A Citation Analysis," Rensselaer Working Papers in Economics 0418, Rensselaer Polytechnic Institute, Department of Economics.
- repec:spr:scient:v:51:y:2001:i:2:d:10.1023_a:1012705818635 is not listed on IDEAS
- Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, 02.
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," IZA Discussion Papers 2070, Institute for the Study of Labor (IZA).
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," The Warwick Economics Research Paper Series (TWERPS) 744, University of Warwick, Department of Economics.
- Burton, M P & Phimister, Euan, 1995. "Core Journals: A Reappraisal of the Diamond List," Economic Journal, Royal Economic Society, vol. 105(429), pages 361-373, March.
- Laband, David N & Piette, Michael J, 1994. "The Relative Impacts of Economics Journals: 1970-1990," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 640-666, June.
- Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
- repec:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0747-0 is not listed on IDEAS
- Tom Coupé, 2003. "Revealed Performances: Worldwide Rankings of Economists and Economics Departments, 1990-2000," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1309-1345, December.
- Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June. Full references (including those not matched with items on IDEAS)