IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i3d10.1007_s11192-023-04920-1.html
   My bibliography  Save this article

Ranking resilience: assessing the impact of scientific performance and the expansion of the Times Higher Education Word University Rankings on the position of Czech, Hungarian, Polish, and Slovak universities

Author

Listed:
  • Barbara Tóth

    (Óbuda University)

  • Hossein Motahari-Nezhad

    (Óbuda University)

  • Nicki Horseman

    (Horseman Bruce Associates Ltd)

  • László Berek

    (Óbuda University
    Óbuda University)

  • Levente Kovács

    (Óbuda University)

  • Áron Hölgyesi

    (Óbuda University
    Óbuda University)

  • Márta Péntek

    (Óbuda University)

  • Seyedali Mirjalili

    (Óbuda University
    Torrens University)

  • László Gulácsi

    (Óbuda University)

  • Zsombor Zrubka

    (Óbuda University)

Abstract

University rankings are gaining importance worldwide. While the top-ranked universities are the subject of numerous academic publications, very little literature is available on universities in the lower two-thirds of the ranking list. In this study, we analysed the sensitivity of year to year changes in position in the Times Higher Education World University Rankings (THE) of universities from the Czech Republic, Hungary, Poland, and Slovakia using hypothetical scenarios of potential changes in their research outputs. A regression model was developed that quantifies the effect of the inclusion of institutions that are new to ranking as well as dropouts on the ranking list. We also developed a method to allow customized sensitivity analysis of the subsequent year's rank from an institution's projected research output, given its current rank and research output, assuming that other ranking indicators remain unchanged over 1–2 years. It should be noted that most universities in the region have ranked below 800, and while research output has been increasing, it was observed that ranks worsened for most universities from these four countries. The Field-Weighted Citation Impact and the total volume of publications had the highest effect on rankings, while the proportion of Scimago Q1 publications did not have a consistent effect on the projected next year's ranks. In most universities, the growth in research performance indicators were below the level that would be required to offset the rank changes due to the inclusion of new entrants in ranking. The findings of this research suggest that universities have to consider complex strategies to improve their ranking focusing on other activities than research such as reputation, internationalization, or industry income. With due caution, our results might be generalized to most of the universities below 800 in the THE. The rank prediction tool presented in this article is available online at https://hecon.uni-obuda.hu/en/rank-calculator/ .

Suggested Citation

  • Barbara Tóth & Hossein Motahari-Nezhad & Nicki Horseman & László Berek & Levente Kovács & Áron Hölgyesi & Márta Péntek & Seyedali Mirjalili & László Gulácsi & Zsombor Zrubka, 2024. "Ranking resilience: assessing the impact of scientific performance and the expansion of the Times Higher Education Word University Rankings on the position of Czech, Hungarian, Polish, and Slovak univ," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(3), pages 1739-1770, March.
    • Handle: RePEc:spr:scient:v:129:y:2024:i:3:d:10.1007_s11192-023-04920-1
    DOI: 10.1007/s11192-023-04920-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04920-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-023-04920-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michael McAleer & Tamotsu Nakamura & Clinton Watkins, 2019. "Size, Internationalization, and University Rankings: Evaluating and Predicting Times Higher Education (THE) Data for Japan," Sustainability, MDPI, vol. 11(5), pages 1-12, March.
    2. Mónica Benito & Pilar Gil & Rosario Romera, 2019. "Funding, is it key for standing out in the university rankings?," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 771-792, November.
    3. Murat Perit Çakır & Cengiz Acartürk & Oğuzhan Alaşehir & Canan Çilingir, 2015. "A comparative analysis of global and national university ranking systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 813-848, June.
    4. Jacek Pietrucha, 2018. "Country-specific determinants of world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1129-1139, March.
    5. Marlo M Vernon & E Andrew Balas & Shaher Momani, 2018. "Are university rankings useful to improve research? A systematic review," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.
    6. Gabriele Marconi & Jo Ritzen, 2015. "Determinants of international university rankings scores," Applied Economics, Taylor & Francis Journals, vol. 47(57), pages 6211-6227, December.
    7. Zsuzsanna Banász & Zsolt T. Kosztyán & Vivien V. Csányi & András Telcs, 2023. "University leagues alongside rankings," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 721-736, February.
    8. Charles J. Gomez & Andrew C. Herman & Paolo Parigi, 2022. "Leading countries in global science increasingly receive more citations than other countries doing similar research," Nature Human Behaviour, Nature, vol. 6(7), pages 919-929, July.
    9. Anna Kowalska & Jaroslav Kovarnik & Eva Hamplova & Pavel Prazak, 2018. "The Selected Topics for Comparison in Visegrad Four Countries," Economies, MDPI, vol. 6(3), pages 1-15, September.
    10. Anthony F. J. Raan & Thed N. Leeuwen & Martijn S. Visser, 2011. "Severe language effect in university rankings: particularly Germany and France are wronged in citation-based rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 495-498, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Neszveda, Gábor & Horváth, Zsófia, 2024. "Új szempont a magyar felsőoktatási intézmények teljesítményének mérésében - az egyetemek online láthatósága [Online visibility - A new aspect of measuring the performance of Hungarian higher educat," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(7), pages 755-790.
    2. Benito, M. & Gil, P. & Romera, R., 2020. "Evaluating the influence of country characteristics on the Higher Education System Rankings’ progress," Journal of Informetrics, Elsevier, vol. 14(3).
    3. Meng-Chen Zhang & Bo-Wei Zhu & Chao-Meng Huang & Gwo-Hshiung Tzeng, 2021. "Systematic Evaluation Model for Developing Sustainable World-Class Universities: An East Asian Perspective," Mathematics, MDPI, vol. 9(8), pages 1-20, April.
    4. Zorica Lazić & Aleksandar Đorđević & Albina Gazizulina, 2021. "Improvement of Quality of Higher Education Institutions as a Basis for Improvement of Quality of Life," Sustainability, MDPI, vol. 13(8), pages 1-27, April.
    5. Mónica Benito & Pilar Gil & Rosario Romera, 2019. "Funding, is it key for standing out in the university rankings?," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 771-792, November.
    6. Jacek Pietrucha, 2018. "Country-specific determinants of world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1129-1139, March.
    7. Fernando García & Francisco Guijarro & Javier Oliver, 2021. "A Multicriteria Goal Programming Model for Ranking Universities," Mathematics, MDPI, vol. 9(5), pages 1-17, February.
    8. Hong Li & Zilin Chen, 2022. "A Comprehensive Evaluation Framework to Assess the Sustainable Development of Schools within a University: Application to a Chinese University," Sustainability, MDPI, vol. 14(17), pages 1-12, August.
    9. Congbin Guo & Xiaowei Hao & Jiaqi Wu & Tizhen Hu, 2023. "The effect of national higher education initiatives on university rankings," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-9, December.
    10. A. Ferrer-Sapena & E. Erdogan & E Jiménez-Fernández & E. A. Sánchez-Pérez & F. Peset, 2020. "Self-defined information indices: application to the case of university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2443-2456, September.
    11. Jung Cheol Shin & Soo Jeung Lee, 2022. "Different measures of international faculty and their impacts on global rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6125-6145, November.
    12. Cinzia Daraio & Simone Di Leo & Loet Leydesdorff, 2022. "Using the Leiden Rankings as a Heuristics: Evidence from Italian universities in the European landscape," LEM Papers Series 2022/08, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    13. Zsolt Kohus & Márton Demeter & László Kun & Eszter Lukács & Katalin Czakó & Gyula Péter Szigeti, 2022. "A Study of the Relation between Byline Positions of Affiliated/Non-Affiliated Authors and the Scientific Impact of European Universities in Times Higher Education World University Rankings," Sustainability, MDPI, vol. 14(20), pages 1-14, October.
    14. Markus Daniel Meier, 2021. "Ars docendi," Books, Universidad Externado de Colombia, Facultad de Derecho, number 1325.
    15. Yan, Weiwei & Zhang, Yin, 2018. "Research universities on the ResearchGate social networking site: An examination of institutional differences, research activity level, and social networks formed," Journal of Informetrics, Elsevier, vol. 12(1), pages 385-400.
    16. Dmitry Kochetkov, 2023. "Review of the Russian-language academic literature on university rankings and a global perspective," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-11, December.
    17. Avenali, Alessandro & Daraio, Cinzia & Di Leo, Simone & Wolszczak-Derlacz, Joanna, 2024. "Heterogeneity of national accounting systems, world-class universities and financial resources: What are the links?," Journal of Informetrics, Elsevier, vol. 18(2).
    18. Ertugrul Ayyildiz & Mirac Murat & Gul Imamoglu & Yildiz Kose, 2023. "A novel hybrid MCDM approach to evaluate universities based on student perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 55-86, January.
    19. Ali Sina Önder & Sascha Schweitzer & Hakan Yilmazkuday, 2021. "Field Distance and Quality in Economists’ Collaborations," Working Papers in Economics & Finance 2021-04, University of Portsmouth, Portsmouth Business School, Economics and Finance Subject Group.
    20. Hans P. W. Bauer & Gabriel Schui & Alexander Eye & Günter Krampen, 2013. "How does scientific success relate to individual and organizational characteristics? A scientometric study of psychology researchers in the German-speaking countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 523-539, February.

    More about this item

    Keywords

    University rankings; Bibliometric indicators; Higher education; Ranking prediction model; predictive factors;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:3:d:10.1007_s11192-023-04920-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.