The Use of Bibliometrics to Measure Research Performance in Education Sciences
AbstractThis paper investigates the fitness-for-purpose and soundness of bibliometric parameters for measuring and elucidating the research performance of individual researchers in the field of education sciences in Switzerland. In order to take into account the specificities of publication practices of researchers in education sciences, the analyses are based on two separate databases: Web of Science and Google Scholar. Both databases show a very unequal distribution of the individual research output, and the indicators used to measure research performance (quantity of publications and citation impact) from the two data sources are highly positively correlated. However, individual characteristics of the researchers, such as age, gender and academic position, that serve to explain the great variance in research performance, can only be identified if the Web of Science is used as a benchmark of research performance. The results indicate that Google Scholar is so inclusive that it impedes a meaningful interpretation of the data. However, the Web of Science inclusion policy for journals is also associated with certain shortcomings that put some researchers at an unjustified disadvantage. Therefore, problems currently exist in regard to both citation databases when used to benchmark individual research performance.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University of Zurich, Institute for Strategy and Business Economics (ISU) in its series Economics of Education Working Paper Series with number 0066.
Length: 39 pages
Date of creation: Sep 2011
Date of revision: May 2013
Publication status: published
bibliometrics; education sciences; research performance; scientometric methods; science research;
Find related papers by JEL classification:
- I23 - Health, Education, and Welfare - - Education - - - Higher Education and Research Institutions
- I29 - Health, Education, and Welfare - - Education - - - Other
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-10-09 (All new papers)
- NEP-EDU-2011-10-09 (Education)
- NEP-LAB-2011-10-09 (Labour Economics)
- NEP-SOG-2011-10-09 (Sociology of Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- De Witte, K. & Rogge, N., 2010.
"To publish or not to publish? On the aggregation and drivers of research performance,"
33, Top Institute for Evidence Based Education Research.
- Rogge, Nicky & De Witte, Kristof, 2009. "To publish or not to publish? On the aggregation and drivers of research performance," Working Papers 2009/42, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- Günther G. Schulze & Susanne Warning & Christian Wiermann, 2008.
"Zeitschriftenrankings für die Wirtschaftswissenschaften - Konstruktion eines umfassenden Metaindexes,"
Perspektiven der Wirtschaftspolitik,
Verein für Socialpolitik, vol. 9(3), pages 286-305, 08.
- Susanne Warning & Christian Wiermann & Günther G. Schulze, 2008. "Zeitschriftenrankings für die Wirtschaftswissenschaften Konstruktion eines umfassenden Metaindexes," Discussion Paper Series 3, Department of International Economic Policy, University of Freiburg, revised Mar 2008.
- Carayol, Nicolas & Matt, Mireille, 2006. "Individual and collective determinants of academic scientists' productivity," Information Economics and Policy, Elsevier, vol. 18(1), pages 55-72, March.
- Michael Rauber & Heinrich W. Ursprung, 2008.
"Life Cycle and Cohort Productivity in Economic Research: The Case of Germany,"
German Economic Review,
Verein für Socialpolitik, vol. 9, pages 431-456, November.
- Michael Rauber & Heinrich Ursprung, 2007. "Life Cycle and Cohort Productivity in Economic Research: The Case of Germany," CESifo Working Paper Series 2093, CESifo Group Munich.
- Panaretos, John & Malesios, Chrisovaladis, 2008. "Assessing scientific research performance and impact with single indices," MPRA Paper 12842, University Library of Munich, Germany.
- Klaus Ritzberger, 2008. "Eine invariante Bewertung wirtschaftswissenschaftlicher Fachzeitschriften," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 267-285, 08.
- Karol Paludkiewicz & Klaus Wohlrabe, 2010. "Qualitätsanalyse von Zeitschriften in den Wirtschaftswissenschaften – über Zitationsdatenbanken und Impaktfaktoren im Online-Zeitalter," Ifo Schnelldienst, Ifo Institute for Economic Research at the University of Munich, vol. 63(21), pages 18-28, November.
- Robert Hofmeister & Heinrich W. Ursprung, 2008. "Das Handelsblatt Ökonomen-Ranking 2007: Eine kritische Beurteilung," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 254-266, 08.
- Gonzalez-Brambila, Claudia & Veloso, Francisco M., 2007. "The determinants of research output and impact: A study of Mexican researchers," Research Policy, Elsevier, vol. 36(7), pages 1035-1051, September.
- Michael Graber & Andrey Launov & Klaus Wälde, 2008. "Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9, pages 457-472, November.
- Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-32, March.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christian Rupietta).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.