Intellectual Influence: Quality versus Quantity
AbstractTo take development and budgeting decisions for research activi- ties the officials in charge need to constantly evaluate and assess the quality of research. Over the years a handful of scoring methods for academic journals have been proposed. Discussing the most prominent methods (de facto standards) we show that they cannot distinguish quality from quantity at article level and that they are inherently biased against journals publishing more articles. If we consider the length of a journal by the number of pages or characters, then all methods are biased against lengthier journals. The systematic bias we find is analytically tractable and implies that the methods are manipulable. We show that the strategies for successful manipulation are relatively easy to infer and implement. The implications of our findings extend beyond the evaluation of academic research, to related settings like the ranking of web domains. Non-manipulable methods for measuring intellectual influence exist.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Maastricht : METEOR, Maastricht Research School of Economics of Technology and Organization in its series Research Memoranda with number 029.
Date of creation: 2010
Date of revision:
Contact details of provider:
Web page: http://www.maastrichtuniversity.nl/web/UMPublications.htm
computer science applications;
Other versions of this item:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Volij, Oscar & Palacios-Huerta, Ignacio, 2004.
"The Measurment of Intellectual Influence,"
Staff General Research Papers
10797, Iowa State University, Department of Economics.
- Laszlo A. Koczy & Martin Strobel, 2010.
"The World Cup of Economics Journals: A Ranking by a Tournament Method,"
IEHAS Discussion Papers
1018, Institute of Economics, Centre for Economic and Regional Studies, Hungarian Academy of Sciences.
- László Á. Kóczy & Martin Strobel, 2010. "The World Cup of Economics Journals: A Ranking by a Tournament Method," Working Paper Series 1011, Óbuda University, Keleti Faculty of Business and Management.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Charles Bollen).
If references are entirely missing, you can add them using this form.