IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v74y2008i1d10.1007_s11192-008-0109-0.html
   My bibliography  Save this article

Policy impact of bibliometric rankings of research performance of departments and individuals in economics

Author

Listed:
  • Anton J. Nederhof

    (University of Leiden)

Abstract

This paper examines policy-relevant effects of a yearly public ranking of individual researchers and their institutes in economics by means of their publication output in international top journals. In 1980, a grassroots ranking (‘Top 40’) of researchers in the Netherlands by means of their publications in international top journals started a competition among economists. The objective was to improve economics research in the Netherlands to an internationally competitive level. The ranking lists did stimulate output in prestigious international journals. Netherlands universities tended to perform well compared to universities elsewhere in the EU concerning volume of output in ISI source journals, but their citation impact was average. Limitations of ranking studies and of bibliometric monitoring in the field of economics are discussed.

Suggested Citation

  • Anton J. Nederhof, 2008. "Policy impact of bibliometric rankings of research performance of departments and individuals in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(1), pages 163-174, January.
    • Handle: RePEc:spr:scient:v:74:y:2008:i:1:d:10.1007_s11192-008-0109-0
    DOI: 10.1007/s11192-008-0109-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-008-0109-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-008-0109-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joe Davis & John Huston & Debra Patterson, 2001. "The scholarly output of economists: A description of publishing patterns," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 29(3), pages 341-349, September.
    2. Anton J. Nederhof, 2006. "Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(1), pages 81-100, January.
    3. Tombazos, Christis G., 2005. "A revisionist perspective of European research in economics," European Economic Review, Elsevier, vol. 49(2), pages 251-277, February.
    4. Rolf Sternberg & Timo Litzenberger, 2005. "The publication and citation output of German Faculties of Economics and Social Sciences - a comparison of faculties and disciplines based upon SSCI data," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(1), pages 29-53, October.
    5. Peter Nijkamp, 1992. "Towards performance measurement of economics research in the Netherlands," Research Evaluation, Oxford University Press, vol. 2(2), pages 66-72, August.
    6. Johnes, Geraint, 1988. "Determinants of research output in economics departments in British universities," Research Policy, Elsevier, vol. 17(3), pages 171-178, June.
    7. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    8. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anton J. Nederhof & Thed N. Leeuwen & Anthony F. J. Raan, 2010. "Highly cited non-journal publications in political science, economics and psychology: a first exploration," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(2), pages 363-374, May.
    2. Ho Fai Chan & Bruno S. Frey & Jana Gallus & Markus Schaffner & Benno Torgler & Stephen Whyte, 2014. "Do the best scholars attract the highest speaking fees? An exploration of internal and external influence," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 793-817, October.
    3. Aistleitner, Matthias & Kapeller, Jakob & Kronberger, Dominik, 2022. "The authors of economics journals revisited: Evidence from a large-scale replication of Hodgson & Rothman (1999)," ifso working paper series 20, University of Duisburg-Essen, Institute for Socioeconomics (ifso).
    4. Aistleitner, Matthias & Kapeller, Jakob & Kronberger, Dominik, 2023. "The authors of economics journals revisited: evidence from a large-scale replication of Hodgson and Rothman (1999)," Journal of Institutional Economics, Cambridge University Press, vol. 19(1), pages 86-101, February.
    5. Roula Inglesi-Lotz & Anastassios Pouris, 2011. "Scientometric impact assessment of a research policy instrument: the case of rating researchers on scientific outputs in South Africa," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 747-760, September.
    6. Anne-Wil Harzing & Wilfred Mijnhardt, 2015. "Proof over promise: towards a more inclusive ranking of Dutch academics in Economics & Business," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 727-749, January.
    7. Frederic S. Lee & Therese C. Grijalva & Clifford Nowell, 2010. "Ranking Economics Departments in a Contested Discipline: A Bibliometric Approach to Quality Equality Between Theoretically Distinct Subdisciplines," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1345-1375, November.
    8. Richard S. J. Tol, 2012. "Shapley values for assessing research production and impact of schools and scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 763-780, March.
    9. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).
    10. João Claro & Carlos A. V. Costa, 2011. "A made-to-measure indicator for cross-disciplinary bibliometric ranking of researchers performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 113-123, January.
    11. Frederic S. Lee & Bruce C. Cronin & Scott McConnell & Erik Dean, 2010. "Research Quality Rankings of Heterodox Economic Journals in a Contested Discipline," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1409-1452, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raúl Ramos & Vicente Royuela & Jordi Suriñach, 2007. "An analysis of the determinants in Economics and Business publications by Spanish universities between 1994 and 2004," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 117-144, April.
    2. Frederic S. Lee & Therese C. Grijalva & Clifford Nowell, 2010. "Ranking Economics Departments in a Contested Discipline: A Bibliometric Approach to Quality Equality Between Theoretically Distinct Subdisciplines," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1345-1375, November.
    3. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    4. Ruiz-Castillo, Javier, 2006. "La investigación en economía en España durante los años 90 : una revisión de la literatura," DE - Documentos de Trabajo. Economía. DE de060201, Universidad Carlos III de Madrid. Departamento de Economía.
    5. Javier Ruiz-Castillo, 2008. "Economics research in Spain during the 1990s: a literature review," Spanish Economic Review, Springer;Spanish Economic Association, vol. 10(3), pages 221-249, September.
    6. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    7. Jordi Pons-Novell & Daniel Tirado-Fabregat, 2010. "Is there life beyond the ISI Journal lists? The international impact of Spanish, Italian, French and German economics journals," Applied Economics, Taylor & Francis Journals, vol. 42(6), pages 689-699.
    8. Richard V. Adkisson, 2010. "Reptilian Economists of the World Unite: A Tolerance Manifesto," The American Economist, Sage Publications, vol. 55(2), pages 14-23, November.
    9. Tombazos, Christis G. & Dobra, Matthew, 2014. "Formulating research policy on expert advice," European Economic Review, Elsevier, vol. 72(C), pages 166-181.
    10. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    11. Melody Lo & M. C. Sunny Wong & Franklin G. Mixon, 2008. "Ranking Economics Journals, Economics Departments, and Economists Using Teaching‐Focused Research Productivity," Southern Economic Journal, John Wiley & Sons, vol. 74(3), pages 894-906, January.
    12. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    13. Chen, Jihui Susan & Liu, Qihong & Billger, Sherrilyn M., 2012. "Where Do New Ph.D. Economists Go? Evidence from Recent Initial Job Placements," IZA Discussion Papers 6990, Institute of Labor Economics (IZA).
    14. Justus Haucap & Michael Mödl, 2013. "Zum Verhältnis von Spitzenforschung und Politikberatung: Eine empirische Analyse vor dem Hintergrund des Ökonomenstreits," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 14(3-4), pages 346-378, August.
    15. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    16. Jishnu Das & Quy-Toan Do, 2020. "US and them - The geography of academic research," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 111-114, Centre for Economic Policy Research.
    17. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & J. Martinez-Baena, 2012. "On first quartile journals which are not of highest impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 925-943, March.
    18. David L. Anderson & John Tresler, 2008. "An Analysis of New Zealand Economists' Research Output 2000-2006," Working Papers in Economics 08/20, University of Waikato, revised 31 Dec 2008.
    19. Dolado, Juan J & Felgueroso, Florentino & Almunia, Miguel, 2005. "Do Men and Women Economists Choose the Same Research Fields?: Evidence From Top 50 Departments," CEPR Discussion Papers 5421, C.E.P.R. Discussion Papers.
    20. Matthias Weber, 2016. "The Effects of Listing Authors in Alphabetical Order: A survey of the Empirical Evidence," Bank of Lithuania Occasional Paper Series 12, Bank of Lithuania.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:74:y:2008:i:1:d:10.1007_s11192-008-0109-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.