IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_3691.html
   My bibliography  Save this paper

Ranking Economists on the Basis of Many Indicators: An Alternative Approach Using RePEc Data

Author

Listed:
  • Christian Seiler
  • Klaus Wohlrabe

    ()

Abstract

In socio-economic sciences the RePEc network (Research Papers in Economics) has become an essential source for the gathering and the spread of both existing and new economic research. Furthermore, it is currently the largest bibliometric database in economic sciences containing 33 different indicators for more than 30,000 economists. Based on this bibliographic information RePEc calculates well-known rankings for authors and academic institutions. We provide some cautionary remarks concerning the interpretation of some provided bibliometric measures in RePEc. Moreover, we show how individual and aggregated rankings can be biased due to the employed ranking methodology. In order to select key in-dicators describing and assessing research performance of scientist, we propose to apply principal component analysis in this data-rich environment. This approach allows us to assign weights to each indicator prior to aggregation. We illustrate the approach by providing a new overall ranking of economists based on RePEc data.

Suggested Citation

  • Christian Seiler & Klaus Wohlrabe, 2011. "Ranking Economists on the Basis of Many Indicators: An Alternative Approach Using RePEc Data," CESifo Working Paper Series 3691, CESifo.
  • Handle: RePEc:ces:ceswps:_3691
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp3691.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, Open Access Journal, vol. 1(3), pages 1-32, December.
    2. repec:ebl:ecbull:v:1:y:2004:i:4:p:1-19 is not listed on IDEAS
    3. Frances P. Ruane & Richard S. J. Tol, 2009. "A Hirsch measure for the quality of research supervision, and an illustration with trade economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(3), pages 613-624, September.
    4. Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
    5. Magnus Henrekson & Daniel Waldenström, 2011. "How Should Research Performance Be Measured? A Study Of Swedish Economists," Manchester School, University of Manchester, vol. 79(6), pages 1139-1156, December.
    6. Robert Hofmeister & Heinrich W. Ursprung, 2008. "Das Handelsblatt Ökonomen‐Ranking 2007: Eine kritische Beurteilung," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 254-266, August.
    7. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    8. Norris, Michael & Oppenheim, Charles, 2007. "Comparing alternatives to the Web of Science for coverage of the social sciences’ literature," Journal of Informetrics, Elsevier, vol. 1(2), pages 161-169.
    9. Gonzalez-Navarro, Marco & Quintana-Domeque, Climent, 2010. "Urban Infrastructure and Economic Development: Experimental Evidence from Street Pavement," IZA Discussion Papers 5346, Institute of Labor Economics (IZA).
    10. Baltagi, Badi H., 2003. "Worldwide Institutional And Individual Rankings In Econometrics Over The Period 1989–1999: An Update," Econometric Theory, Cambridge University Press, vol. 19(1), pages 165-224, February.
    11. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    12. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    13. Ortega, José Luis & López-Romero, Elena & Fernández, Inés, 2011. "Multivariate approach to classify research institutes according to their outputs: The case of the CSIC's institutes," Journal of Informetrics, Elsevier, vol. 5(3), pages 323-332.
    14. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    15. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    16. Hirsch, Barry T, et al, 1984. "Economics Departmental Rankings: Comment [Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency]," American Economic Review, American Economic Association, vol. 74(4), pages 822-826, September.
    17. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    18. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    19. Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    20. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    21. Frances Ruane & Richard S.J. Tol, 2007. "Refined (Successive) H-Indices: An Application To Economics In The Republic Of Ireland," Working Papers FNU-130, Research unit Sustainability and Global Change, Hamburg University, revised Mar 2007.
    22. Tom Coupé, 2003. "Revealed Performances: Worldwide Rankings of Economists and Economics Departments, 1990-2000," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1309-1345, December.
    23. Baltagi, Badi H, 1999. "Applied Econometrics Rankings: 1989-1995," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(4), pages 423-441, July-Aug..
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, Open Access Journal, vol. 1(3), pages 1-32, December.
    2. Krapf, Matthias & Ursprung, Heinrich W. & Zimmermann, Christian, 2017. "Parenthood and productivity of highly skilled labor: Evidence from the groves of academe," Journal of Economic Behavior & Organization, Elsevier, vol. 140(C), pages 147-175.
    3. Martin Braml & Klaus Wohlrabe, 2014. "New Ranking, Old Mistakes – The “Global Go-To Think Tanks†Ranking 2013," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 12(1), pages 46-49, 04.
    4. Klaus Wohlrabe, 2013. "Einige Anmerkungen zum Handelsblatt-Ranking 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 66(23), pages 79-83, December.
    5. Balatsky, E. & Yurevich, M., 2016. "The Misalignment of Russian Economists' Scientometric Indicators in RISC," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 176-180.
    6. Tol, Richard S.J., 2013. "The Matthew effect for cohorts of economists," Journal of Informetrics, Elsevier, vol. 7(2), pages 522-527.
    7. Christian Seiler & Klaus Wohlrabe, 2012. "Archetypal Analysis: Ein neuer Ansatz zur Klassifizierung von Wissenschaftlern," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 65(22), pages 07-12, November.
    8. Schupp, Claudia & Wache, Benjamin, 2014. "Wie groß ist der Einfluss von deutschen Wirtschaftsforschungsinstituten? Ein Ranking anhand von RePEc-Daten
      [How large is the influence of German economic research institutes? A ranking analysis us
      ," MPRA Paper 55519, University Library of Munich, Germany.
    9. Richard S.J. Tol, 2013. "Measuring catch-up growth in malnourished populations," Working Paper Series 6013, Department of Economics, University of Sussex Business School.
    10. Matthias Krapf & Heinrich Ursprung & Christian Zimmermann, 2014. "Parenthood and Productivity of Highly Skilled Labor: Evidence from the Groves of Academe," CESifo Working Paper Series 4641, CESifo.
    11. Christian Seiler & Klaus Wohlrabe, 2012. "Archetypal Scientists," CESifo Working Paper Series 3990, CESifo.

    More about this item

    Keywords

    RePEc; ranking aggregation; principal components analysis; economics profession;

    JEL classification:

    • A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    Lists

    This item is featured on the following reading lists or Wikipedia pages:
    1. Papers using RePEc data

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_3691. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Klaus Wohlrabe). General contact details of provider: http://edirc.repec.org/data/cesifde.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.