Journal rankings in economics: handle with care
AbstractNearly all journal rankings in economics use some weighted average of citations to calculate a journal's impact. These rankings are often used, formally or informally, to help assess the publication success of individual economists or institutions. Although ranking methods and opinions are legion, scant attention has been paid to the usefulness of any ranking as representative of the many articles published in a journal. First, because the distributions of citations across articles within a journal are seriously skewed, and the skewness differs across journals, the appropriate measure of central tendency is the median rather than the mean. Second, large shares of articles in the highest-ranked journals are cited less frequently than typical articles in much-lower-ranked journals. Finally, a ranking that uses the h-index is very similar to one that uses total citations, making it less than ideal for assessing the typical impact of articles within a journal.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Federal Reserve Bank of St. Louis in its series Working Papers with number 2009-014.
Date of creation: 2009
Date of revision:
This paper has been announced in the following NEP Reports:
- NEP-ALL-2009-08-02 (All new papers)
- NEP-HIS-2009-08-02 (Business, Economic & Financial History)
- NEP-HPE-2009-08-02 (History & Philosophy of Economics)
- NEP-SOG-2009-08-02 (Sociology of Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Pantelis Kalaitzidakis & Theofanis P Mamuneas & Thanasis Stengos, 2001.
"Rankings of Academic Journals and Institutions in Economics,"
Discussion Papers in Economics
01/8, Department of Economics, University of Leicester.
- Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
- Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
- Kristie M. Engemann & Howard J. Wall, 2009. "A journal ranking for the ambitious economist," Review, Federal Reserve Bank of St. Louis, issue May, pages 127-140.
- Oswald, Andrew J., 2006.
"An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers,"
IZA Discussion Papers
2070, Institute for the Study of Labor (IZA).
- Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, 02.
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," The Warwick Economics Research Paper Series (TWERPS) 744, University of Warwick, Department of Economics.
- Yolanda K. Kodrzycki & Pingkang David Yu, 2005. "New approaches to ranking economics journals," Working Papers 05-12, Federal Reserve Bank of Boston.
- Ignacio Palacios-Huerta & Oscar Volij, 2004.
"The Measurement of Intellectual Influence,"
Econometric Society, vol. 72(3), pages 963-977, 05.
- Volij, Oscar & Palacios-Huerta, Ignacio, 2004. "The Measurment of Intellectual Influence," Staff General Research Papers 10797, Iowa State University, Department of Economics.
- Ignacio Palacios-Huerta & Oscar Volij, 2002. "The Measurement of Intellectual Influence," Economic theory and game theory 015, Oscar Volij.
- Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
RePEc Biblio mentionsAs found on the RePEc Biblio, the curated bibliography for Economics:CitEc Project, subscribe to its RSS feed for this item.
- Miguel sarmiento, 2009.
"Central Bank Economic Research: Output, Demand, Productivity, and Relevance,"
BORRADORES DE ECONOMIA
005935, BANCO DE LA REPÚBLICA.
- Miguel Sarmiento, . "Central Bank Economic Research: Output, Demand, Productivity, and Relevance," Borradores de Economia 576, Banco de la Republica de Colombia.
- Winkler, Anne E. & Levin, Sharon & Stephan, Paula & Glänzel, Wolfgang, 2011. "Publishing Trends in Economics across Colleges and Universities, 1991-2007," IZA Discussion Papers 6082, Institute for the Study of Labor (IZA).
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Anna Xiao).
If references are entirely missing, you can add them using this form.