Journal rankings in economics: handle with care
Nearly all journal rankings in economics use some weighted average of citations to calculate a journal's impact. These rankings are often used, formally or informally, to help assess the publication success of individual economists or institutions. Although ranking methods and opinions are legion, scant attention has been paid to the usefulness of any ranking as representative of the many articles published in a journal. First, because the distributions of citations across articles within a journal are seriously skewed, and the skewness differs across journals, the appropriate measure of central tendency is the median rather than the mean. Second, large shares of articles in the highest-ranked journals are cited less frequently than typical articles in much-lower-ranked journals. Finally, a ranking that uses the h-index is very similar to one that uses total citations, making it less than ideal for assessing the typical impact of articles within a journal.
|Date of creation:||2009|
|Contact details of provider:|| Postal: P.O. Box 442, St. Louis, MO 63166|
Web page: http://www.stlouisfed.org/
More information through EDIRC
|Order Information:|| Email: |
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
- Ignacio Palacios-Huerta & Oscar Volij, 2004.
"The Measurement of Intellectual Influence,"
Econometric Society, vol. 72(3), pages 963-977, 05.
- Ignacio Palacios-Huerta & Oscar Volij, 2002. "The Measurement of Intellectual Influence," Economic theory and game theory 015, Oscar Volij.
- Volij, Oscar & Palacios-Huerta, Ignacio, 2004. "The Measurment of Intellectual Influence," Staff General Research Papers Archive 10797, Iowa State University, Department of Economics.
- Kristie M. Engemann & Howard J. Wall, 2009. "A journal ranking for the ambitious economist," Review, Federal Reserve Bank of St. Louis, issue May, pages 127-140.
- Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, 02.
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," IZA Discussion Papers 2070, Institute for the Study of Labor (IZA).
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," The Warwick Economics Research Paper Series (TWERPS) 744, University of Warwick, Department of Economics.
- repec:spr:scient:v:69:y:2006:i:1:d:10.1007_s11192-006-0147-4 is not listed on IDEAS
- Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
- Pantelis Kalaitzidakis & Theofanis P Mamuneas & Thanasis Stengos, 2001. "Rankings of Academic Journals and Institutions in Economics," Discussion Papers in Economics 01/8, Department of Economics, University of Leicester.
- Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
- Yolanda Kodrzycki & Pingkang David Yu, 2005. "New approaches to ranking economics journals," Working Papers 05-12, Federal Reserve Bank of Boston. Full references (including those not matched with items on IDEAS)