IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v103y2015i3d10.1007_s11192-015-1586-6.html
   My bibliography  Save this article

A comparative analysis of global and national university ranking systems

Author

Listed:
  • Murat Perit Çakır

    (Middle East Technical University)

  • Cengiz Acartürk

    (Middle East Technical University)

  • Oğuzhan Alaşehir

    (Middle East Technical University)

  • Canan Çilingir

    (Middle East Technical University
    Middle East Technical University)

Abstract

Recent interest towards university rankings has led to the development of several ranking systems at national and global levels. Global ranking systems tend to rely on internationally accessible bibliometric databases and reputation surveys to develop league tables at a global level. Given their access and in-depth knowledge about local institutions, national ranking systems tend to include a more comprehensive set of indicators. The purpose of this study is to conduct a systematic comparison of national and global university ranking systems in terms of their indicators, coverage and ranking results. Our findings indicate that national rankings tend to include a larger number of indicators that primarily focus on educational and institutional parameters, whereas global ranking systems tend to have fewer indicators mainly focusing on research performance. Rank similarity analysis between national rankings and global rankings filtered for each country suggest that with the exception of a few instances global rankings do not strongly predict the national rankings.

Suggested Citation

  • Murat Perit Çakır & Cengiz Acartürk & Oğuzhan Alaşehir & Canan Çilingir, 2015. "A comparative analysis of global and national university ranking systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 813-848, June.
    • Handle: RePEc:spr:scient:v:103:y:2015:i:3:d:10.1007_s11192-015-1586-6
    DOI: 10.1007/s11192-015-1586-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-015-1586-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-015-1586-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jamil Salmi & Alenoush Saroyan, 2007. "League Tables as Policy Instruments: Uses and Misuses," Higher Education Management and Policy, OECD Publishing, vol. 19(2), pages 1-38.
    2. Saisana, Michaela & d'Hombres, Béatrice & Saltelli, Andrea, 2011. "Rickety numbers: Volatility of university rankings and policy implications," Research Policy, Elsevier, vol. 40(1), pages 165-177, February.
    3. Isidro F. Aguillo & Judit Bar-Ilan & Mark Levene & José Luis Ortega, 2010. "Comparing university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 243-256, October.
    4. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    5. Bar-Ilan, Judit & Levene, Mark & Lin, Ayelet, 2007. "Some measures for comparing citation databases," Journal of Informetrics, Elsevier, vol. 1(1), pages 26-34.
    6. Griffith, Amanda & Rask, Kevin, 2007. "The influence of the US News and World Report collegiate rankings on the matriculation decision of high-ability students: 1995-2004," Economics of Education Review, Elsevier, vol. 26(2), pages 244-255, April.
    7. Thed N. Van Leeuwen & Henk F. Moed & Robert J. W. Tijssen & Martijn S. Visser & Anthony F. J. Van Raan, 2001. "Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 335-346, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shahryar Rahnamayan & Sedigheh Mahdavi & Kalyanmoy Deb & Azam Asilian Bidgoli, 2020. "Ranking Multi-Metric Scientific Achievements Using a Concept of Pareto Optimality," Mathematics, MDPI, vol. 8(6), pages 1-46, June.
    2. A. Ferrer-Sapena & E. Erdogan & E Jiménez-Fernández & E. A. Sánchez-Pérez & F. Peset, 2020. "Self-defined information indices: application to the case of university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2443-2456, September.
    3. Yang Zhang & Yu Xiao & Jun Wu & Xin Lu, 2021. "Comprehensive world university ranking based on ranking aggregation," Computational Statistics, Springer, vol. 36(2), pages 1139-1152, June.
    4. Ibrahim Shehatta & Khalid Mahmood, 2016. "Correlation among top 100 universities in the major six global rankings: policy implications," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1231-1254, November.
    5. Yan, Weiwei & Zhang, Yin, 2018. "Research universities on the ResearchGate social networking site: An examination of institutional differences, research activity level, and social networks formed," Journal of Informetrics, Elsevier, vol. 12(1), pages 385-400.
    6. Dmitry Kochetkov, 2023. "Review of the Russian-language academic literature on university rankings and a global perspective," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-11, December.
    7. Zsolt Tibor Kosztyán & Beáta Fehérvölgyi & Tibor Csizmadia & Kinga Kerekes, 2021. "Investigating collaborative and mobility networks: reflections on the core missions of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3551-3564, April.
    8. Csóka, Imola & Sebestyén, Géza & Neszveda, Gábor, 2019. "Tudományos teljesítmény mérése a magyar felsőoktatás gazdasági képzéseiben [Measuring scientific performance of business and economics faculties in Hungarian higher education]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(7), pages 751-770.
    9. Zsolt Kohus & Márton Demeter & László Kun & Eszter Lukács & Katalin Czakó & Gyula Péter Szigeti, 2022. "A Study of the Relation between Byline Positions of Affiliated/Non-Affiliated Authors and the Scientific Impact of European Universities in Times Higher Education World University Rankings," Sustainability, MDPI, vol. 14(20), pages 1-14, October.
    10. Zhimin Liu & Goodluck Jacob Moshi & Cynthia Mwonya Awuor, 2019. "Sustainability and Indicators of Newly Formed World-Class Universities (NFWCUs) between 2010 and 2018: Empirical Analysis from the Rankings of ARWU, QSWUR and THEWUR," Sustainability, MDPI, vol. 11(10), pages 1-29, May.
    11. Manuel Muñoz-Suárez & Natividad Guadalajara & José M. Osca, 2020. "A Comparative Analysis between Global University Rankings and Environmental Sustainability of Universities," Sustainability, MDPI, vol. 12(14), pages 1-19, July.
    12. Zorica Lazić & Aleksandar Đorđević & Albina Gazizulina, 2021. "Improvement of Quality of Higher Education Institutions as a Basis for Improvement of Quality of Life," Sustainability, MDPI, vol. 13(8), pages 1-27, April.
    13. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    14. Ertugrul Ayyildiz & Mirac Murat & Gul Imamoglu & Yildiz Kose, 2023. "A novel hybrid MCDM approach to evaluate universities based on student perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 55-86, January.
    15. Angel Meseguer-Martinez & Alejandro Ros-Galvez & Alfonso Rosa-Garcia & Jose Antonio Catalan-Alarcon, 2019. "Online video impact of world class universities," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(3), pages 519-532, September.
    16. Hong Li & Zilin Chen, 2022. "A Comprehensive Evaluation Framework to Assess the Sustainable Development of Schools within a University: Application to a Chinese University," Sustainability, MDPI, vol. 14(17), pages 1-12, August.
    17. Mohammad Reza Zare Banadkouki & Mohammad Ali Vahdatzad & Mohammad Saleh Owlia & Mohammad Mahdi Lotfi, 2018. "Ranking Iranian universities: an interpretative structural modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1493-1512, December.
    18. Vicente Safón, 2019. "Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 897-915, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    2. Andrea Bonaccorsi & Cinzia Daraio, 2014. "Beyond university rankings ? Generating new indicators on European universities by linking data in open platforms," DIAG Technical Reports 2014-12, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    3. Yang Zhang & Yu Xiao & Jun Wu & Xin Lu, 2021. "Comprehensive world university ranking based on ranking aggregation," Computational Statistics, Springer, vol. 36(2), pages 1139-1152, June.
    4. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    5. Christopher Claassen, 2015. "Measuring university quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 793-807, September.
    6. Vicente Safón, 2013. "What do global university rankings really measure? The search for the X factor and the X entity," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 223-244, November.
    7. Vicente Safón, 2019. "Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 897-915, November.
    8. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    9. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    10. Mike Thelwall, 2017. "Judit Bar-Ilan: information scientist, computer scientist, scientometrician," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1235-1244, December.
    11. Gennaro Guida, 2018. "Italian Economics Departments’ Scientific Research Performance: Comparison between VQR and ASN Methodologies," International Journal of Business and Management, Canadian Center of Science and Education, vol. 13(9), pages 182-182, August.
    12. Marlo M Vernon & E Andrew Balas & Shaher Momani, 2018. "Are university rankings useful to improve research? A systematic review," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.
    13. Javier Ruiz-Castillo, 2012. "The evaluation of citation distributions," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(1), pages 291-310, March.
    14. Ibrahim Shehatta & Khalid Mahmood, 2016. "Correlation among top 100 universities in the major six global rankings: policy implications," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1231-1254, November.
    15. Frank J. Rijnsoever & Laurens K. Hessels, 2021. "How academic researchers select collaborative research projects: a choice experiment," The Journal of Technology Transfer, Springer, vol. 46(6), pages 1917-1948, December.
    16. Esteban Fernández Tuesta & Máxima Bolaños-Pizarro & Daniel Pimentel Neves & Geziel Fernández & Justin Axel-Berg, 2020. "Complex networks for benchmarking in global universities rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 405-425, October.
    17. Shibayama, Sotaro & Baba, Yasunori, 2015. "Impact-oriented science policies and scientific publication practices: The case of life sciences in Japan," Research Policy, Elsevier, vol. 44(4), pages 936-950.
    18. Rafols, Ismael & Stirling, Andy, 2020. "Designing indicators for opening up evaluation. Insights from research assessment," SocArXiv h2fxp, Center for Open Science.
    19. Antonio Perianes-Rodriguez & Javier Ruiz-Castillo, 2016. "University citation distributions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(11), pages 2790-2804, November.
    20. Osmo Kivinen & Juha Hedman & Kalle Artukka, 2017. "Scientific publishing and global university rankings. How well are top publishing universities recognized?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 679-695, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:103:y:2015:i:3:d:10.1007_s11192-015-1586-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.