IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v101y2014i2d10.1007_s11192-014-1263-1.html
   My bibliography  Save this article

An insight into the importance of national university rankings in an international context: the case of the I-UGR rankings of Spanish universities

Author

Listed:
  • Nicolás Robinson-García

    (Universidad de Granada)

  • Daniel Torres-Salinas

    (Universidad de Navarra)

  • Emilio Delgado López-Cózar

    (Universidad de Granada)

  • Francisco Herrera

    (Universidad de Granada)

Abstract

The great importance international rankings have achieved in the research policy arena warns against many threats consequence of the flaws and shortcomings these tools present. One of them has to do with the inability to accurately represent national university systems as their original purpose is only to rank world-class universities. Another one has to do with the lack of representativeness of universities’ disciplinary profiles as they usually provide a unique table. Although some rankings offer a great coverage and others offer league tables by fields, no international ranking does both. In order to surpass such limitation from a research policy viewpoint, this paper analyzes the possibility of using national rankings in order to complement international rankings. For this, we analyze the Spanish university system as a study case presenting the I-UGR Rankings for Spanish universities by fields and subfields. Then, we compare their results with those obtained by the Shanghai Ranking, the QS Ranking, the Leiden Ranking and the NTU Ranking, as they all have basic common grounds which allow such comparison. We conclude that it is advisable to use national rankings in order to complement international rankings, however we observe that this must be done with certain caution as they differ on the methodology employed as well as on the construction of the fields.

Suggested Citation

  • Nicolás Robinson-García & Daniel Torres-Salinas & Emilio Delgado López-Cózar & Francisco Herrera, 2014. "An insight into the importance of national university rankings in an international context: the case of the I-UGR rankings of Spanish universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1309-1324, November.
  • Handle: RePEc:spr:scient:v:101:y:2014:i:2:d:10.1007_s11192-014-1263-1
    DOI: 10.1007/s11192-014-1263-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-014-1263-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-014-1263-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Domingo Docampo, 2011. "On using the Shanghai ranking to assess the research performance of university systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 77-92, January.
    2. Daniel Torres-Salinas & Jose G. Moreno-Torres & Emilio Delgado-López-Cózar & Francisco Herrera, 2011. "A methodology for Institution-Field ranking based on a bidimensional analysis: the IFQ 2 A index," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 771-786, September.
    3. Lutz Bornmann & Rüdiger Mutz & Hans‐Dieter Daniel, 2013. "Multilevel‐statistical reformulation of citation‐based university rankings: The Leiden ranking 2011/2012," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(8), pages 1649-1658, August.
    4. Isidro F. Aguillo & Judit Bar-Ilan & Mark Levene & José Luis Ortega, 2010. "Comparing university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 243-256, October.
    5. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    6. Moed, Henk F. & de Moya-Anegón, Félix & López-Illescas, Carmen & Visser, Martijn, 2011. "Is concentration of university research associated with better research performance?," Journal of Informetrics, Elsevier, vol. 5(4), pages 649-658.
    7. Giovanni Abramo & Tindaro Cicero & Ciriaco Andrea D’Angelo, 2011. "The dangers of performance-based research funding in non-competitive higher education systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 641-654, June.
    8. Loet Leydesdorff & Ismael Rafols, 2009. "A global map of science based on the ISI subject categories," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(2), pages 348-362, February.
    9. Domingo Docampo, 2011. "Erratum to: On using the Shanghai ranking to assess the research performance of university systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 237-237, January.
    10. J.A. García & Rosa Rodríguez-Sánchez & J. Fdez-Valdivia & N. Robinson-García & D. Torres-Salinas, 2012. "Mapping academic institutions according to their journal publication profile: Spanish universities as a case study," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2328-2340, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Massucci, Francesco Alessandro & Docampo, Domingo, 2019. "Measuring the academic reputation through citation networks via PageRank," Journal of Informetrics, Elsevier, vol. 13(1), pages 185-201.
    2. Teodoro Luque-Martínez & Salvador Barrio-García, 2016. "Constructing a synthetic indicator of research activity," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1049-1064, September.
    3. Milica Jovanovic & Veljko Jeremic & Gordana Savic & Milica Bulajic & Milan Martic, 2012. "How does the normalization of data affect the ARWU ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 319-327, November.
    4. Domingo Docampo & Lawrence Cram, 2017. "Academic performance and institutional resources: a cross-country analysis of research universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 739-764, February.
    5. Nicolás Robinson-García & Clara Calero-Medina, 2014. "What do university rankings by fields rank? Exploring discrepancies between the organizational structure of universities and bibliometric classifications," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1955-1970, March.
    6. Veljko Jeremic & Milica Bulajic & Milan Martic & Zoran Radojicic, 2011. "A fresh approach to evaluating the academic ranking of world universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 587-596, June.
    7. Esteban Fernández Tuesta & Máxima Bolaños-Pizarro & Daniel Pimentel Neves & Geziel Fernández & Justin Axel-Berg, 2020. "Complex networks for benchmarking in global universities rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 405-425, October.
    8. Christopher Claassen, 2015. "Measuring university quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 793-807, September.
    9. Guo Chen & Lu Xiao & Chang-ping Hu & Xue-qin Zhao, 2015. "Identifying the research focus of Library and Information Science institutions in China with institution-specific keywords," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 707-724, May.
    10. Pin-Hua Lin & Jong-Rong Chen & Chih-Hai Yang, 2014. "Academic research resources and academic quality: a cross-country analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 109-123, October.
    11. Domingo Docampo & Lawrence Cram, 2014. "On the internal dynamics of the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1347-1366, February.
    12. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    13. El Gibari, Samira & Gómez, Trinidad & Ruiz, Francisco, 2018. "Evaluating university performance using reference point based composite indicators," Journal of Informetrics, Elsevier, vol. 12(4), pages 1235-1250.
    14. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    15. Shahryar Rahnamayan & Sedigheh Mahdavi & Kalyanmoy Deb & Azam Asilian Bidgoli, 2020. "Ranking Multi-Metric Scientific Achievements Using a Concept of Pareto Optimality," Mathematics, MDPI, vol. 8(6), pages 1-46, June.
    16. Gnewuch, Matthias & Wohlrabe, Klaus, 2018. "Super-efficiency of education institutions: an application to economics departments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 26, pages 610-623.
    17. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & Nicolas Robinson-García & Daniel Torres-Salinas, 2013. "Benchmarking research performance at the university level with information theoretic measures," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 435-452, April.
    18. Gul, Muhammet & Yucesan, Melih, 2022. "Performance evaluation of Turkish Universities by an integrated Bayesian BWM-TOPSIS model," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    19. Seiler, Christian & Wohlrabe, Klaus, 2013. "Archetypal scientists," Journal of Informetrics, Elsevier, vol. 7(2), pages 345-356.
    20. Zaida Chinchilla-Rodríguez & Grisel Zacca-González & Benjamín Vargas-Quesada & Félix Moya-Anegón, 2016. "Benchmarking scientific performance by decomposing leadership of Cuban and Latin American institutions in Public Health," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1239-1264, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:101:y:2014:i:2:d:10.1007_s11192-014-1263-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.