How much do journal titles tell us about the academic interest and relevance of economic research? An empirical analysis
AbstractUnlike in other disciplines, research output in economics is commonly measured based on the journal titles in which an author has published. Here, I examine how much output measures based on journal titles tell us about the academic interest and relevance of economic papers as measured by citation frequency. Using data from the 2008 Handelsblatt ranking of economists in German speaking countries and interdisciplinary citation data from the Web of Science, I find that researcher scores based on journal titles explain only about one fourth of the variation (variance) in article citations. When the top 10 (20) percent of the researchers according to journal title scores are excluded, the percentage of explained variation in citation frequency drops to 5 (3) percent. These findings empirically confirm the hypothesis that the measures of research output in economics promote narrow and complacent work that is of interest to few, even among an academic audience. They suggest that responsible hiring committees and funding institutions should re-examine existing standards in evaluation and abandon the heavy reliance on journal titles as a measure of individual research output.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University of Zurich, Socioeconomic Institute in its series Working Papers with number 0917.
Length: 14 pages
Date of creation: Dec 2009
Date of revision:
citation index; incentives; publication; research evaluation; scientometrics;
Find related papers by JEL classification:
- A10 - General Economics and Teaching - - General Economics - - - General
This paper has been announced in the following NEP Reports:
- NEP-ALL-2010-01-10 (All new papers)
- NEP-HPE-2010-01-10 (History & Philosophy of Economics)
- NEP-SOG-2010-01-10 (Sociology of Economics)
You can help add them by filling out this form.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Marita Kieser).
If references are entirely missing, you can add them using this form.