IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v109y2016i3d10.1007_s11192-016-2056-5.html
   My bibliography  Save this article

How can differences in international university rankings be explained?

Author

Listed:
  • Fredrik Niclas Piro

    (Nordic Institute for Studies in Innovation, Research and Education (NIFU))

  • Gunnar Sivertsen

    (Nordic Institute for Studies in Innovation, Research and Education (NIFU))

Abstract

University rankings are typically presenting their results as league tables with more emphasis on final scores and positions, than on the clarification of why the universities are ranked as they are. Finding out the latter is often not possible, because final scores are based on weighted indicators where raw data and the processing of these are not publically available. In this study we use a sample of Scandinavian universities, explaining what is causing differences between them in the two most influential university rankings: Times Higher Education and the Shanghai-ranking. The results show that differences may be attributed to both small variations on what we believe are not important indicators, as well as substantial variations on what we believe are important indicators. The overall aim of this paper is to provide a methodology that can be used in understanding universities’ different ranks in global university rankings.

Suggested Citation

  • Fredrik Niclas Piro & Gunnar Sivertsen, 2016. "How can differences in international university rankings be explained?," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2263-2278, December.
    • Handle: RePEc:spr:scient:v:109:y:2016:i:3:d:10.1007_s11192-016-2056-5
    DOI: 10.1007/s11192-016-2056-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2056-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2056-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Domingo Docampo & Lawrence Cram, 2015. "On the effects of institutional size in university classifications: the case of the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1325-1346, February.
    2. Fred L. Bookstein & Horst Seidler & Martin Fieder & Georg Winckler, 2010. "Too much noise in the Times Higher Education rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 295-299, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lutz Bornmann & Werner Marx, 2020. "Thomas theorem in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 553-555, April.
    2. Wu, Jiang & Ou, Guiyan & Liu, Xiaohui & Dong, Ke, 2022. "How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence," Journal of Informetrics, Elsevier, vol. 16(2).
    3. Ernesto Galbán-Rodríguez & Deborah Torres-Ponjuán & Ricardo Arencibia-Jorge, 2021. "Multidimensional quantitative analysis of the Cuban scientific output and its regional context," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2643-2665, March.
    4. Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
    5. McAleer, M.J. & Nakamura, T. & Watkins, C., 2018. "Size, Internationalization and University Rankings: Evaluating Times Higher Education (THE) Data for Japan," Econometric Institute Research Papers EI2018-43, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Gauffriau, Marianne, 2017. "A categorization of arguments for counting methods for publication and citation indicators," Journal of Informetrics, Elsevier, vol. 11(3), pages 672-684.
    7. Frenken, Koen & Heimeriks, Gaston J. & Hoekman, Jarno, 2017. "What drives university research performance? An analysis using the CWTS Leiden Ranking data," Journal of Informetrics, Elsevier, vol. 11(3), pages 859-872.
    8. Michael McAleer & Tamotsu Nakamura & Clinton Watkins, 2019. "Size, Internationalization, and University Rankings: Evaluating and Predicting Times Higher Education (THE) Data for Japan," Sustainability, MDPI, vol. 11(5), pages 1-12, March.
    9. Gerhard Reichmann & Christian Schlögl, 2022. "On the possibilities of presenting the research performance of an institute over a long period of time: the case of the Institute of Information Science at the University of Graz in Austria," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3193-3223, June.
    10. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    11. Vicente Safón & Domingo Docampo, 2020. "Analyzing the impact of reputational bias on global university rankings based on objective research performance data: the case of the Shanghai Ranking (ARWU)," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2199-2227, December.
    12. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    13. Cinzia Daraio, 2017. "A framework for the Assessment of Research and its impacts," DIAG Technical Reports 2017-04, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    14. Vicente Safón, 2019. "Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 897-915, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Johannes Sorz & Wolfgang Glänzel & Ursula Ulrych & Christian Gumpenberger & Juan Gorraiz, 2020. "Research strengths identified by esteem and bibliometric indicators: a case study at the University of Vienna," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1095-1116, November.
    2. D. Docampo & D. Egret & L. Cram, 2015. "The effect of university mergers on the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 175-191, July.
    3. Varshavsky, Alexander & Komkina, Tatiana, 2011. "Analysis of two main university rankings," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 23(3), pages 57-78.
    4. Hernández-Escobedo, Quetzalcoatl & Perea-Moreno, Alberto-Jesús & Manzano-Agugliaro, Francisco, 2018. "Wind energy research in Mexico," Renewable Energy, Elsevier, vol. 123(C), pages 719-729.
    5. Massucci, Francesco Alessandro & Docampo, Domingo, 2019. "Measuring the academic reputation through citation networks via PageRank," Journal of Informetrics, Elsevier, vol. 13(1), pages 185-201.
    6. Kuang-hua Chen & Pei-yu Liao, 2012. "A comparative study on world university rankings: a bibliometric survey," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 89-103, July.
    7. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    8. Alan Peter Matthews, 2012. "South African universities in world rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 675-695, September.
    9. Vicente Safón & Domingo Docampo, 2020. "Analyzing the impact of reputational bias on global university rankings based on objective research performance data: the case of the Shanghai Ranking (ARWU)," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2199-2227, December.
    10. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    11. Domingo Docampo & Lawrence Cram, 2017. "Academic performance and institutional resources: a cross-country analysis of research universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 739-764, February.
    12. Johan Lyhagen & Per Ahlgren, 2020. "Uncertainty and the ranking of economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2545-2560, December.
    13. Vicente Safón, 2019. "Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 897-915, November.
    14. Jacek Pietrucha, 2018. "Country-specific determinants of world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1129-1139, March.

    More about this item

    Keywords

    University rankings; Performance;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:109:y:2016:i:3:d:10.1007_s11192-016-2056-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.