This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Do Rankings Reflect Research Quality?

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Bruno S. Frey
Katja Rost

Additional information is available for the following registered author(s):

Abstract

Publication and citation rankings have become major indicators of the scientific worth of universities and countries, and determine to a large extent the career of individual scholars. We argue that such rankings do not effectively measure research quality, which should be the essence of evaluation. For that reason, an alternative ranking is developed as a quality indicator, based on membership on academic editorial boards of professional journals. It turns out that especially the ranking of individual scholars is far from objective. The results differ markedly, depending on whether research quantity or research quality is considered. Even quantity rankings are not objective; two citation rankings, based on different samples, produce entirely different results. It follows that any career decisions based on rankings are dominated by chance and do not reflect research quality. Instead of propagating a ranking based on board membership as the gold standard, we suggest that committees make use of this quality indicator to find members who, in turn, evaluate the research quality of individual scholars.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.iew.unizh.ch/wp/iewwp390.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by Institute for Empirical Research in Economics - IEW in its series IEW - Working Papers with number iewwp390.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: Oct 2008
Date of revision:
Handle: RePEc:zur:iewwpx:390

Contact details of provider:

For technical questions regarding this item, or to correct its listing, contact: (Hanna Britt).

Related research
Keywords: Rankings; Universities; Scholars; Publications; Citations;

Other versions of this item:

Find related papers by JEL classification:
H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
L15 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Information and Product Quality
O38 - Economic Development, Technological Change, and Growth - - Technological Change - - - Government Policy

This paper has been announced in the following NEP Reports:

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)
  1. Albers, Sönke, 2008. "Three Failed Attempts of Joint Rankings of Research in Economics and Business," MPRA Paper 12868, University Library of Munich, Germany, revised 16 Jan 2009. [Downloadable!]
  2. Bruno S. Frey & Susanne Neckermann, 2009. "Academics Appreciate Awards - A New Aspect of Incentives in Research," CESifo Working Paper Series CESifo Working Paper No. , CESifo Group Munich. [Downloadable!]
    Other versions:
Statistics
Access and download statistics

Did you know? Over five million full texts a year are downloaded through IDEAS.

This page was last updated on 2009-11-19.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.