IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-00606931.html
   My bibliography  Save this paper

Ranking scientists and departments in a consistent manner

Author

Listed:
  • Denis Bouyssou

    () (LAMSADE - Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision - Université Paris-Dauphine - CNRS - Centre National de la Recherche Scientifique)

  • Thierry Marchant

    () (Department of Data Analysis - UGENT - Ghent University [Belgium])

Abstract

The standard data that we use when computing bibliometric rankings of scientists are just their publication/citation records, i.e., so many papers with 0 citation, so many with 1 citation, so many with 2 citations, etc. The standard data for bibliometric rankings of departments have the same structure. It is therefore tempting (and many authors gave in to temptation) to use the same method for computing rankings of scientists and rankings of departments. Depending on the method, this can yield quite surprising and unpleasant results. Indeed, with some methods, it may happen that the "best" department contains the "worst" scientists, and only them. This problem will not occur if the rankings satisfy a property called consistency, recently introduced in the literature. In this paper, we explore the consequences of consistency and we characterize two families of consistent rankings.

Suggested Citation

  • Denis Bouyssou & Thierry Marchant, 2011. "Ranking scientists and departments in a consistent manner," Post-Print hal-00606931, HAL.
  • Handle: RePEc:hal:journl:hal-00606931
    DOI: 10.1002/asi.21544
    Note: View the original document on HAL open archive server: https://hal.archives-ouvertes.fr/hal-00606931
    as

    Download full text from publisher

    File URL: https://hal.archives-ouvertes.fr/hal-00606931/document
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. van Eck, Nees Jan & Waltman, Ludo, 2008. "Generalizing the h- and g-indices," Journal of Informetrics, Elsevier, vol. 2(4), pages 263-271.
    2. Kinnucan, Henry W. & Traxler, Greg, 1994. "Ranking Agricultural Economics Departments By Ajae Page Counts: A Reappraisal," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 23(2), October.
    3. Bouyssou, Denis & Marchant, Thierry, 2011. "Bibliometric rankings of journals based on Impact Factors: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 5(1), pages 75-86.
    4. Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
    5. van Eck, N.J.P. & Waltman, L., 2008. "Generalizing the h- and g-indices," ERIM Report Series Research in Management ERS-2008-049-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    6. Waltman, L. & van Eck, N.J.P., 2009. "A Taxonomy of Bibliometric Performance Indicators Based on the Property of Consistency," ERIM Report Series Research in Management ERS-2009-014-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    7. Bouyssou, D. & Marchant, T., 2010. "Consistent bibliometric rankings of authors and of journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 365-378.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:spr:scient:v:96:y:2013:i:3:d:10.1007_s11192-012-0934-z is not listed on IDEAS
    2. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    3. repec:spr:scient:v:96:y:2013:i:3:d:10.1007_s11192-013-0961-4 is not listed on IDEAS
    4. Crespo, Juan A. & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2012. "The citation merit of scientific publications," UC3M Working papers. Economics we1136, Universidad Carlos III de Madrid. Departamento de Economía.
    5. Rousseau, Ronald & Yang, Liying, 2012. "Reflections on the activity index and related indicators," Journal of Informetrics, Elsevier, vol. 6(3), pages 413-421.
    6. Marta Cardin & Marco Corazza & Stefania Funari & Silvio Giove, 2011. "A fuzzy-based scoring rule for author ranking," Working Papers 2011_11, Department of Economics, University of Venice "Ca' Foscari".
    7. Muhammad Imtiaz Subhani & Amber Osman & Syed Akif Hasan & Muhammad Saad & Sabeen Mir, 2013. "Formulation of Advanced H-Index: The S-Index," South Asian Journal of Management Sciences (SAJMS), Iqra University, Iqra University, vol. 7(2), pages 63-70, Fall.
    8. repec:spr:scient:v:97:y:2013:i:3:d:10.1007_s11192-013-1026-4 is not listed on IDEAS
    9. repec:gam:jsusta:v:9:y:2017:i:6:p:1011-:d:101238 is not listed on IDEAS
    10. Rousseau, Ronald & García-Zorita, Carlos & Sanz-Casado, Elias, 2013. "The h-bubble," Journal of Informetrics, Elsevier, vol. 7(2), pages 294-300.
    11. repec:spr:scient:v:102:y:2015:i:2:d:10.1007_s11192-014-1464-7 is not listed on IDEAS
    12. repec:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0649-1 is not listed on IDEAS
    13. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    14. Albort-Morant, Gema & Ribeiro-Soriano, Domingo, 2016. "A bibliometric analysis of international impact of business incubators," Journal of Business Research, Elsevier, vol. 69(5), pages 1775-1779.
    15. repec:spr:scient:v:94:y:2013:i:1:d:10.1007_s11192-012-0758-x is not listed on IDEAS
    16. Bouyssou, Denis & Marchant, Thierry, 2016. "Ranking authors using fractional counting of citations: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 10(1), pages 183-199.

    More about this item

    Keywords

    ranking scientists; ranking departments; consistence; Bibliometrics; ranking of scientists; ranking of departments;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-00606931. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (CCSD). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.