IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v125y2020i1d10.1007_s11192-020-03637-9.html
   My bibliography  Save this article

Complex networks for benchmarking in global universities rankings

Author

Listed:
  • Esteban Fernández Tuesta

    (University of São Paulo: EACH-USP)

  • Máxima Bolaños-Pizarro

    (University of Valencia)

  • Daniel Pimentel Neves

    (University of São Paulo: EACH-USP)

  • Geziel Fernández

    (Federal University of Santa Catarina: PPGEco-UFSC)

  • Justin Axel-Berg

    (University of São Paulo, FEA-USP)

Abstract

Finding a set of units that can serve as a reference for growth or improvement in positions within a ranking is not a simple task, since each ranking method can place the same unit in different positions and may even differ in relative position within the ranking. This study proposes a method that applies a combination of network analysis and efficiency methods to global university rankings. Complex networks allow the creation of a graph structure that selects a set of units that change positions in consecutive rankings and also the selection of the set of nodes that are linked with a selected node. For this new set, it is possible to calculate the efficiency level using Data Envelopment Analysis (DEA), from which the benchmarks of the indicators for each of the selected universities can be computed. The purpose of this paper is to develop a methodology to find a set of universities that compete with any university selected from those in the global university rankings, in particular ARWU, THE and QS. Moreover, this work also proposes to estimate the efficiency level of each university that competes with the selected university using the Data Envelopment Analysis methodology in order to establish benchmarks for each of the target Universities. This methodology is replicable for any university in any ranking or set of rankings. Given the high volatility of rankings, this process can serve university policy makers in selecting indicators to focus on for improved results in the short term.

Suggested Citation

  • Esteban Fernández Tuesta & Máxima Bolaños-Pizarro & Daniel Pimentel Neves & Geziel Fernández & Justin Axel-Berg, 2020. "Complex networks for benchmarking in global universities rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 405-425, October.
    • Handle: RePEc:spr:scient:v:125:y:2020:i:1:d:10.1007_s11192-020-03637-9
    DOI: 10.1007/s11192-020-03637-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-020-03637-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-020-03637-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ludo Waltman & Clara Calero‐Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan van Eck & Thed N. van Leeuwen & Anthony F.J. van Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    2. Valentina Raponi & Francesca Martella & Antonello Maruotti, 2016. "A biclustering approach to university performances: an Italian case study," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(1), pages 31-45, January.
    3. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    4. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    5. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    6. Jesús T. Pastor & JosÉ L. Ruiz & Inmaculada Sirvent, 2002. "A Statistical Test for Nested Radial Dea Models," Operations Research, INFORMS, vol. 50(4), pages 728-735, August.
    7. Garcia-Zorita, Carlos & Rousseau, Ronald & Marugan-Lazaro, Sergio & Sanz-Casado, Elias, 2018. "Ranking dynamics and volatility," Journal of Informetrics, Elsevier, vol. 12(3), pages 567-578.
    8. Lutz Bornmann & Rüdiger Mutz & Hans‐Dieter Daniel, 2013. "Multilevel‐statistical reformulation of citation‐based university rankings: The Leiden ranking 2011/2012," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(8), pages 1649-1658, August.
    9. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    10. Dyson, R. G. & Allen, R. & Camanho, A. S. & Podinovski, V. V. & Sarrico, C. S. & Shale, E. A., 2001. "Pitfalls and protocols in DEA," European Journal of Operational Research, Elsevier, vol. 132(2), pages 245-259, July.
    11. Isidro F. Aguillo & Judit Bar-Ilan & Mark Levene & José Luis Ortega, 2010. "Comparing university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 243-256, October.
    12. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    13. Guironnet, Jean-Pascal & Peypoch, Nicolas, 2018. "The geographical efficiency of education and research: The ranking of U.S. universities," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 44-55.
    14. Gerhard Kempkes & Carsten Pohl, 2010. "The efficiency of German universities-some evidence from nonparametric and parametric methods," Applied Economics, Taylor & Francis Journals, vol. 42(16), pages 2063-2079.
    15. Gualberto Buela-Casal & Olga Gutiérrez-Martínez & María Paz Bermúdez-Sánchez & Oscar Vadillo-Muñoz, 2007. "Comparative study of international academic rankings of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(3), pages 349-365, June.
    16. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    17. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    18. H. David Sherman & Joe Zhu, 2006. "Service Productivity Management," Springer Books, Springer, number 978-0-387-33231-4, September.
    19. Nian Cai Liu & Ying Cheng & Li Liu, 2005. "Academic ranking of world universities using scientometrics - A comment to the “Fatal Attraction”," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 101-109, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    2. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    3. Klaus Wohlrabe & Sabine Gralka & Lutz Bornmann, 2019. "Zur Effizienz deutscher Universitäten und deren Entwicklung zwischen 2004 und 2015," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 72(21), pages 15-21, November.
    4. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    5. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    6. Wang, Derek D., 2019. "Performance-based resource allocation for higher education institutions in China," Socio-Economic Planning Sciences, Elsevier, vol. 65(C), pages 66-75.
    7. Gralka, Sabine, 2018. "Stochastic frontier analysis in higher education: A systematic review," CEPIE Working Papers 05/18, Technische Universität Dresden, Center of Public and International Economics (CEPIE).
    8. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    9. Calogero Guccio & Marco Ferdinando Martorana & Isidoro Mazza, 2016. "Efficiency assessment and convergence in teaching and research in Italian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1063-1094, June.
    10. Tzeremes, Nickolaos & Halkos, George, 2010. "A DEA approach for measuring university departments’ efficiency," MPRA Paper 24029, University Library of Munich, Germany.
    11. Alexander Eck & Sabine Gralka & Julia Sonnenburg & Wolfgang Nagl & Joachim Ragnitz, 2015. "Hochschulfinanzierung in Mecklenburg-Vorpommern," ifo Dresden Studien, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 75.
    12. Alan Peter Matthews, 2012. "South African universities in world rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 675-695, September.
    13. Klaus Wohlrabe & Lutz Bornmann & Sabine Gralka & Felix de Moya Anegon, 2018. "Wie effizient forschen Universitäten in Deutschland, deren Zukunftskonzepte im Rahmen der Exzellenzinitiative ausgezeichnet wurden?," ifo Working Paper Series 253, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    14. Calogero Guccio & Marco Ferdinando Martorana & Luisa Monaco, 2016. "Evaluating the impact of the Bologna Process on the efficiency convergence of Italian universities: a non-parametric frontier approach," Journal of Productivity Analysis, Springer, vol. 45(3), pages 275-298, June.
    15. Abankina, Irina & Aleskerov, Fuad & Belousova, Veronika & Gokhberg, Leonid & Kiselgof, Sofya & Petrushchenko, Vsevolod & Shvydun, Sergey & Zinkovsky, Kirill, 2016. "From equality to diversity: Classifying Russian universities in a performance oriented system," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 228-239.
    16. Daraio, Cinzia & Simar, Léopold & Wilson, Paul W., 2021. "Quality as a latent heterogeneity factor in the efficiency of universities," Economic Modelling, Elsevier, vol. 99(C).
    17. Vicente Safón, 2019. "Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 897-915, November.
    18. Yaisawarng, Suthathip & Ng, Ying Chu, 2014. "The impact of higher education reform on research performance of Chinese universities," China Economic Review, Elsevier, vol. 31(C), pages 94-105.
    19. Lars Herberholz & Berthold U. Wigger, 2020. "Efficiency of European Universities: A Comparison of Peers," CESifo Working Paper Series 8044, CESifo.
    20. Irina V. Abankina & Fuad T. Aleskerov & Veronika Yu. Belousova & Leonid M. Gokhberg & Kirill V. Zinkovsky & Sofya G. Kiselgof & Vsevolod Petrushchenko & Sergey V. Shvydun, 2015. "Performance-Based Typology Of Universities: Evidence From Russia," HSE Working papers WP BRP 33/STI/2015, National Research University Higher School of Economics.

    More about this item

    Keywords

    Global universities rankings; Research evaluation; Benchmarking; ARWU; THE; QS;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • C67 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Input-Output Models
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:125:y:2020:i:1:d:10.1007_s11192-020-03637-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.