IDEAS home Printed from https://ideas.repec.org/a/nos/voprob/2019i3p130-151.html

The Method of League Analysis and Its Application in Comparing Global University Rankings and Russia's University Performance Monitoring

Author

Listed:
  • Vladimir Navodnov
  • Galina Motova
  • Olga Ryzhakova

Abstract

Vladimir Navodnov - Doctor of Sciences in Engineering, Professor, Director of the National Centre for Public Accreditation. Address: 206a Volkova Str., 424000 Yoshkar-Ola, Mari-El Republic, Russian Federation. E-mail: director@ncpa.ruGalina Motova - Doctor of Sciences in Pedagogy, Deputy Director of the National Centre for Public Accreditation. Address: 206a Volkova Str., 424000 Yoshkar-Ola, Mari-El Republic, Russian Federation. E-mail: g.motova@ncpa.ruOlga Ryzhakova - Graduate Student, Department of Applied Mathematics and Information Technology, the Volga State University of Technology. Address: 3 Lenina Sq., 424000 Yoshkar-Ola, Mari-El Republic, Russian Federation. E-mail: olgaryzh@yandex.ruA new technique called Method of Analysis of Leagues (MethALeague) is proposed for comparing performance of higher education institutions measured by different assessment methods. The MethALeague uses the convolution operations from the theory of small-group decision making to create aggregate charts of university leagues based on the performance indicators obtained with different assessment techniques. Specifically, researchers are given the opportunity to bring widely divergent university performance indicators into unified assessment charts and carry out comparative analysis of different assessment approaches. The MethALeague was applied successfully to compare the performance indicators of the Project 5-100 universities reflected in three major global rankings, Academic Ranking of World Universities, QS World University Rankings, and Times Higher Education World University Rankings. A formalized concept of world ranking proposed in the article makes it possible to visualize the performance dynamics of Russia's top universities and compare it to that of the top universities in other countries (United States, Great Britain, Australia, Germany, and China). Suggestions are made on using a modified version of the MethALeague at the national level to analyze the results of university performance monitoring and compare them to the universities' global ranking positions. The method described in the article could be applied by educational authorities, researchers and higher education institutions to determine the frameworks of strategic development, both for specific universities and for Russia's higher education system as a whole.

Suggested Citation

  • Vladimir Navodnov & Galina Motova & Olga Ryzhakova, 2019. "The Method of League Analysis and Its Application in Comparing Global University Rankings and Russia's University Performance Monitoring," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 130-151.
    • Handle: RePEc:nos:voprob:2019:i:3:p:130-151
    as

    Download full text from publisher

    File URL: https://vo.hse.ru/data/2019/09/16/1541237741/05%20Navodnov.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ibrahim Shehatta & Khalid Mahmood, 2016. "Correlation among top 100 universities in the major six global rankings: policy implications," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1231-1254, November.
    2. Jamil Salmi & Isak Froumin, 2013. "Excellence Initiatives to Establish World-Class Universities: Evaluation of Recent Experiences," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 25-68.
    3. repec:wbk:wbpubs:2600 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Наводнов В. Г. & Мотова Г. Н. & Рыжакова О. Е., 2019. "Сравнение Международных Рейтингов И Результатов Российского Мониторинга Эффективности Деятельности Вузов По Методике Анализа Лиг," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 130-151.
    2. Julian D. Cortes & Liliana Rivera & Katerina Bohle Carbonell, 2021. "Mission Statements in Universities: Readability and performance," Papers 2104.07438, arXiv.org.
    3. Manuel Muñoz-Suárez & Natividad Guadalajara & José M. Osca, 2020. "A Comparative Analysis between Global University Rankings and Environmental Sustainability of Universities," Sustainability, MDPI, vol. 12(14), pages 1-19, July.
    4. Чернова Е. Г. & Ахобадзе Т. Д. & Малова А. С. & Салтан А. А., 2017. "Модели Финансирования Высшего Образования И Эффективность Деятельности Университетов Эмпирическое Исследование Европейского Опыта И Отечественная Практика," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 37-82.
    5. Meng-Chen Zhang & Bo-Wei Zhu & Chao-Meng Huang & Gwo-Hshiung Tzeng, 2021. "Systematic Evaluation Model for Developing Sustainable World-Class Universities: An East Asian Perspective," Mathematics, MDPI, vol. 9(8), pages 1-20, April.
    6. Marko Marhl & Rene Markovič & Vladimir Grubelnik & Matjaž Perc, 2025. "The changing world dynamics of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(1), pages 469-488, January.
    7. Frank J. Rijnsoever & Laurens K. Hessels, 2021. "How academic researchers select collaborative research projects: a choice experiment," The Journal of Technology Transfer, Springer, vol. 46(6), pages 1917-1948, December.
    8. McAleer, M.J. & Nakamura, T. & Watkins, C., 2018. "Size, Internationalization and University Rankings: Evaluating Times Higher Education (THE) Data for Japan," Econometric Institute Research Papers EI2018-43, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    9. Maryam Moshtagh & Tahereh Jowkar & Maryam Yaghtin & Hajar Sotudeh, 2023. "The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: the case of THE and QS vs. Nature Index and Leiden," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 761-781, January.
    10. Enis Siniksaran & M. Hakan Satman, 2020. "WURS: a simulation software for university rankings—software review," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 701-717, January.
    11. Mónica Benito & Pilar Gil & Rosario Romera, 2019. "Funding, is it key for standing out in the university rankings?," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 771-792, November.
    12. Osmo Kivinen & Juha Hedman & Kalle Artukka, 2017. "Scientific publishing and global university rankings. How well are top publishing universities recognized?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 679-695, July.
    13. Guangyuan Hu & Hongxu Liu & Li Tang, 2025. "Flexible recruitment of overseas talent," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(8), pages 4397-4422, August.
    14. Iñigo Martin-Melero & Maria Luisa Medrano-Garcia & Felipe Hernandez-Perlines & Raul Gomez-Martinez, 2026. "ESG and reputation in Ibero–America: Evidence from corporate rankings," International Entrepreneurship and Management Journal, Springer, vol. 22(1), pages 1-63, March.
    15. Kübra Akyol Özcan, 2023. "Sustainability Ranking of Turkish Universities with Different Weighting Approaches and the TOPSIS Method," Sustainability, MDPI, vol. 15(16), pages 1-24, August.
    16. Juan Antonio Dip, 2021. "What does U-multirank tell us about knowledge transfer and research?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3011-3039, April.
    17. Michael McAleer & Tamotsu Nakamura & Clinton Watkins, 2019. "Size, Internationalization, and University Rankings: Evaluating and Predicting Times Higher Education (THE) Data for Japan," Sustainability, MDPI, vol. 11(5), pages 1-12, March.
    18. Vicente Safón, 2019. "Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 897-915, November.
    19. Xin Guo & Zhuolin Feng, 2024. "Identifying university opinion leaders during the global crisis: information communication on official websites," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-11, December.
    20. Ksenia Romanenko, 2018. "University Mergers: The Implications for Students," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 154-173.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nos:voprob:2019:i:3:p:130-151. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marta Morozova (email available below). General contact details of provider: http://vo.hse.ru/en/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.