How Should Research Performance Be Measured? A Study of Swedish Economists
Billions of euros are allocated every year to university research. Increased specialisation and international integration of research and researchers has sharply raised the need for comparisons of performance across fields, institutions and individual researchers. However, there is still no consensus regarding how such rankings should be conducted and what output measures are appropriate to use. We rank all full professors in a particular discipline, economics, in one European nation using seven established, and some of them commonly used, measures of research performance. Our examination shows both that the rank order can vary greatly across measures, and that depending on the measure used the distribution of total research out-put is valued very differently. The renowned KMS measure in economics stands out among the measures analysed here. It exhibits the weakest correlation with the others used in our study. We conclude by giving advice to funding councils and others assessing research quality on how to think about the use of both quantitative and qualitative measures of performance.
|Date of creation:||04 Mar 2008|
|Publication status:||Published as Henrekson, Magnus and Daniel Waldenström, 'How Should Research Performance Be Measured? A Study of Swedish Economists' in The Manchester School, 2011, pages 1139-1156.|
|Contact details of provider:|| Postal: The Economic Research Institute, Stockholm School of Economics, P.O. Box 6501, 113 83 Stockholm, Sweden|
Phone: +46-(0)8-736 90 00
Fax: +46-(0)8-31 01 57
Web page: http://www.hhs.se/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Michel Lubrano & Luc Bauwens & Alan Kirman & Camelia Protopopescu, 2003.
"Ranking Economics Departments in Europe: A Statistical Approach,"
Journal of the European Economic Association,
MIT Press, vol. 1(6), pages 1367-1401, December.
- BAUWENS, Luc & KIRMAN, Alan & LUBRANO, Michel & PROTOPOPESCU, Camelia, "undated". "Ranking economics departments in Europe: a statistical approach," CORE Discussion Papers RP 1694, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- BAUWENS, Luc & KIRMAN, Alan & LUBRANO, Michel & PROTOPOPESCU, Camelia, 2003. "Ranking economics departments in Europe: a statistical approach," CORE Discussion Papers 2003050, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- David N. Laband & Robert D. Tollison, 2003. "Dry Holes in Economic Research," Kyklos, Wiley Blackwell, vol. 56(2), pages 161-173, 05.
- Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
- Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
- Pantelis Kalaitzidakis & Theofanis P Mamuneas & Thanasis Stengos, 2001. "Rankings of Academic Journals and Institutions in Economics," Discussion Papers in Economics 01/8, Department of Economics, University of Leicester.