IDEAS home Printed from https://ideas.repec.org/p/ces/ifowps/_96.html
   My bibliography  Save this paper

Ranking Economists and Economic Institutions Using RePEc: Some Remarks

Author

Listed:
  • Christian Seiler
  • Klaus Wohlrabe

    ()

Abstract

In socio-economic sciences the RePEc network (Research Papers in Economics) has become an essential source both for the spread of existing and new economic research. Furthermore the calculation of rankings for authors and academic institutions play a central role. We provide some cautionary remarks on the ranking methodology employed by RePEc and show how the aggregated rankings maybe biased. Furthermore we offer a new ranking approach, based on standardization of scores, which allows interpersonal comparisons and is less sensitive to outliers. We illustrate our new approach with a large data set provided by RePEc based on 24,500 authors.

Suggested Citation

  • Christian Seiler & Klaus Wohlrabe, 2011. "Ranking Economists and Economic Institutions Using RePEc: Some Remarks," ifo Working Paper Series 96, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
  • Handle: RePEc:ces:ifowps:_96
    as

    Download full text from publisher

    File URL: http://www.cesifo-group.de/DocDL/IfoWorkingPaper-96.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Norris, Michael & Oppenheim, Charles, 2007. "Comparing alternatives to the Web of Science for coverage of the social sciences’ literature," Journal of Informetrics, Elsevier, vol. 1(2), pages 161-169.
    2. Magnus Henrekson & Daniel Waldenström, 2011. "How Should Research Performance Be Measured? A Study Of Swedish Economists," Manchester School, University of Manchester, vol. 79(6), pages 1139-1156, December.
    3. Ortega, José Luis & López-Romero, Elena & Fernández, Inés, 2011. "Multivariate approach to classify research institutes according to their outputs: The case of the CSIC's institutes," Journal of Informetrics, Elsevier, vol. 5(3), pages 323-332.
    4. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    5. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, Open Access Journal, vol. 1(3), pages 1-32, December.
    6. Hirsch, Barry T, et al, 1984. "Economics Departmental Rankings: Comment [Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency]," American Economic Review, American Economic Association, vol. 74(4), pages 822-826, September.
    7. Angelina Keil & Peter Huber, 2004. ""Wo die Luft dünn wird H "- Zur Publikationstätigkeit der Wirtschaftsforschungsinstitute Österreichs und Deutschlands," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 5(3), pages 363-375, August.
    8. Bruno S. Frey & Reiner Eichenberger, 1993. "American and European Economics and Economists," Journal of Economic Perspectives, American Economic Association, vol. 7(4), pages 185-193, Fall.
    9. Courtault, Jean-Michel & Hayek, Naïla & Rimbaux, Eric & Zhu, Tong, 2010. "Research in economics and management in France: A bibliometric study using the h-index," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(2), pages 329-337, April.
    10. Frances P. Ruane & Richard S. J. Tol, 2009. "A Hirsch measure for the quality of research supervision, and an illustration with trade economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(3), pages 613-624, September.
    11. Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
    12. Kalaitzidakis, Pantelis & Mamuneas, Theofanis P. & Stengos, Thanasis, 1999. "European economics: An analysis based on publications in the core journals," European Economic Review, Elsevier, vol. 43(4-6), pages 1150-1168, April.
    13. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    14. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    15. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    16. Christian Seiler & Klaus Wohlrabe, 2010. "RePEc – An Independent Platform for Measuring Output in Economics," CESifo Forum, Ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 11(4), pages 72-77, December.
    17. Joseph Macri & Dipendra Sinha, 2004. "Rankings of Economists in Teaching Economics Departments in Australia, 1988-2000," Economics Bulletin, AccessEcon, vol. 1(4), pages 1-19.
    18. Frances Ruane & Richard S.J. Tol, 2007. "Refined (Successive) H-Indices: An Application To Economics In The Republic Of Ireland," Working Papers FNU-130, Research unit Sustainability and Global Change, Hamburg University, revised Mar 2007.
    19. Tom Coupé, 2003. "Revealed Performances: Worldwide Rankings of Economists and Economics Departments, 1990-2000," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1309-1345, December.
    20. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    21. Gonzalez-Navarro, Marco & Quintana-Domeque, Climent, 2010. "Urban Infrastructure and Economic Development: Experimental Evidence from Street Pavement," IZA Discussion Papers 5346, Institute for the Study of Labor (IZA).
    22. Graves, Philip E & Marchand, James R & Thompson, Randal, 1982. "Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency," American Economic Review, American Economic Association, vol. 72(5), pages 1131-1141, December.
    23. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    24. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    25. Baltagi, Badi H, 1999. "Applied Econometrics Rankings: 1989-1995," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(4), pages 423-441, July-Aug..
    26. repec:ebl:ecbull:v:1:y:2004:i:4:p:1-19 is not listed on IDEAS
    27. Juan Dolado & Antonio García-Romero & Gema Zamarro, 2003. "Publishing performance in economics: Spanish rankings (1990-1999)," Spanish Economic Review, Springer;Spanish Economic Association, vol. 5(4), pages 317-317, November.
    28. Martin Steininger & Bernd Süssmuth, 2005. "Elfenbeinligen und ihre Erfassung: Ein Kommentar und eine neuerliche Messung der Publikationstätigkeit der Wirtschaftsforschungsinstitute im deutschsprachigen Raum: 1989-2003," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 6(3), pages 409-420, August.
    29. Robert Hofmeister & Heinrich W. Ursprung, 2008. "Das Handelsblatt Ökonomen-Ranking 2007: Eine kritische Beurteilung," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 254-266, August.
    30. Kirman, Alan & Dahl, Mogens, 1994. "Economic research in Europe," European Economic Review, Elsevier, vol. 38(3-4), pages 505-522, April.
    31. Baltagi, Badi H., 2003. "Worldwide Institutional And Individual Rankings In Econometrics Over The Period 1989 1999: An Update," Econometric Theory, Cambridge University Press, vol. 19(01), pages 165-224, February.
    32. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    33. David L. Anderson & John Tressler, 2008. "Research Output in New Zealand Economics Department 2000-2006," Working Papers in Economics 08/05, University of Waikato.
    34. Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    35. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    Rankings; RePEc; ranking aggregation; standardization;

    JEL classification:

    • A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    Lists

    This item is featured on the following reading lists or Wikipedia pages:
    1. Papers using RePEc data

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ifowps:_96. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Klaus Wohlrabe). General contact details of provider: http://edirc.repec.org/data/ifooode.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.