IDEAS home Printed from https://ideas.repec.org/a/nos/voprob/2019i3p130-151.html
   My bibliography  Save this article

The Method of League Analysis and Its Application in Comparing Global University Rankings and Russia's University Performance Monitoring

Author

Listed:
  • Vladimir Navodnov
  • Galina Motova
  • Olga Ryzhakova

Abstract

Vladimir Navodnov - Doctor of Sciences in Engineering, Professor, Director of the National Centre for Public Accreditation. Address: 206a Volkova Str., 424000 Yoshkar-Ola, Mari-El Republic, Russian Federation. E-mail: director@ncpa.ruGalina Motova - Doctor of Sciences in Pedagogy, Deputy Director of the National Centre for Public Accreditation. Address: 206a Volkova Str., 424000 Yoshkar-Ola, Mari-El Republic, Russian Federation. E-mail: g.motova@ncpa.ruOlga Ryzhakova - Graduate Student, Department of Applied Mathematics and Information Technology, the Volga State University of Technology. Address: 3 Lenina Sq., 424000 Yoshkar-Ola, Mari-El Republic, Russian Federation. E-mail: olgaryzh@yandex.ruA new technique called Method of Analysis of Leagues (MethALeague) is proposed for comparing performance of higher education institutions measured by different assessment methods. The MethALeague uses the convolution operations from the theory of small-group decision making to create aggregate charts of university leagues based on the performance indicators obtained with different assessment techniques. Specifically, researchers are given the opportunity to bring widely divergent university performance indicators into unified assessment charts and carry out comparative analysis of different assessment approaches. The MethALeague was applied successfully to compare the performance indicators of the Project 5-100 universities reflected in three major global rankings, Academic Ranking of World Universities, QS World University Rankings, and Times Higher Education World University Rankings. A formalized concept of world ranking proposed in the article makes it possible to visualize the performance dynamics of Russia's top universities and compare it to that of the top universities in other countries (United States, Great Britain, Australia, Germany, and China). Suggestions are made on using a modified version of the MethALeague at the national level to analyze the results of university performance monitoring and compare them to the universities' global ranking positions. The method described in the article could be applied by educational authorities, researchers and higher education institutions to determine the frameworks of strategic development, both for specific universities and for Russia's higher education system as a whole.

Suggested Citation

  • Vladimir Navodnov & Galina Motova & Olga Ryzhakova, 2019. "The Method of League Analysis and Its Application in Comparing Global University Rankings and Russia's University Performance Monitoring," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 130-151.
    • Handle: RePEc:nos:voprob:2019:i:3:p:130-151
    as

    Download full text from publisher

    File URL: https://vo.hse.ru/data/2019/09/16/1541237741/05%20Navodnov.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ibrahim Shehatta & Khalid Mahmood, 2016. "Correlation among top 100 universities in the major six global rankings: policy implications," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1231-1254, November.
    2. Jamil Salmi & Isak Froumin, 2013. "Excellence Initiatives to Establish World-Class Universities: Evaluation of Recent Experiences," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 25-68.
    3. Jamil Salmi, 2009. "The Challenge of Establishing World-Class Universities," World Bank Publications - Books, The World Bank Group, number 2600, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Наводнов В. Г. & Мотова Г. Н. & Рыжакова О. Е., 2019. "Сравнение Международных Рейтингов И Результатов Российского Мониторинга Эффективности Деятельности Вузов По Методике Анализа Лиг," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 130-151.
    2. Чернова Е. Г. & Ахобадзе Т. Д. & Малова А. С. & Салтан А. А., 2017. "Модели Финансирования Высшего Образования И Эффективность Деятельности Университетов Эмпирическое Исследование Европейского Опыта И Отечественная Практика," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 37-82.
    3. Bjørn Stensaker, 2018. "University Alliances: Enhancing Control, Capacity, and Creativity in Dynamic Environments," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 132-153.
    4. Julian D. Cortes & Liliana Rivera & Katerina Bohle Carbonell, 2021. "Mission Statements in Universities: Readability and performance," Papers 2104.07438, arXiv.org.
    5. Arega Yirdaw, 2016. "Quality of Education in Private Higher Institutions in Ethiopia," SAGE Open, , vol. 6(1), pages 21582440156, January.
    6. Adam, Edmund, 2020. "‘Governments base performance-based funding on global rankings indicators’: A global trend in higher education finance or a global rankings literature fiction? A comparative analysis of four performan," International Journal of Educational Development, Elsevier, vol. 76(C).
    7. Bonaccorsi, Andrea & Haddawy, Peter & Cicero, Tindaro & Hassan, Saeed-Ul, 2017. "The solitude of stars. An analysis of the distributed excellence model of European universities," Journal of Informetrics, Elsevier, vol. 11(2), pages 435-454.
    8. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    9. M. V. Puchkov, 2022. "University Campus: Interrelations of Educational Technologies and Models of Architectural Space Formation," University Management: Practice and Analysis, Federal State Autonomous Educational Institution of Higher Education «Ural Federal University named after the first President of Russia B.N.Yeltsin»; Non-Commercial Partnership “University Management: Practice and, vol. 25(4).
    10. Saisana, Michaela & d'Hombres, Béatrice & Saltelli, Andrea, 2011. "Rickety numbers: Volatility of university rankings and policy implications," Research Policy, Elsevier, vol. 40(1), pages 165-177, February.
    11. Manuel Muñoz-Suárez & Natividad Guadalajara & José M. Osca, 2020. "A Comparative Analysis between Global University Rankings and Environmental Sustainability of Universities," Sustainability, MDPI, vol. 12(14), pages 1-19, July.
    12. D. Docampo & D. Egret & L. Cram, 2015. "The effect of university mergers on the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 175-191, July.
    13. Chirikov, Igor, 2016. "HOW GLOBAL COMPETITION IS CHANGING UNIVERSITIES: Three Theoretical Perspectives," University of California at Berkeley, Center for Studies in Higher Education qt50g3t797, Center for Studies in Higher Education, UC Berkeley.
    14. Shahid Yusuf & Kaoru Nabeshima, 2009. "Growth through Innovation : An Industrial Strategy for Shanghai," World Bank Publications - Reports 18613, The World Bank Group.
    15. Sacha Lussier & Jean-François Chanlat, 2015. "L’évaluation des établissements d’enseignement et le rôle des enseignants-chercheurs en gestion : l’intériorisation institutionnelle de l’internationalisation," Post-Print hal-01655876, HAL.
    16. Brigida Blasi & Sandra Romagnosi & Andrea Bonaccorsi, 2018. "Universities as celebrities? How the media select information from a large research assessment exercise," Science and Public Policy, Oxford University Press, vol. 45(4), pages 503-514.
    17. Bennell, Paul, 2021. "The political economy of attaining Universal Primary Education in sub-Saharan Africa: The politics of UPE implementation," International Journal of Educational Development, Elsevier, vol. 80(C).
    18. Bradley Beecher & Bernhard Streitwieser, 2019. "A Risk Management Approach for the Internationalization of Higher Education," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 10(4), pages 1404-1426, December.
    19. CASANI, Fernando & De FILIPPO, Daniela & PÉREZ-ESPARRELLS, Carmen & SANZ-CASADO, Elías, 2012. "La Posición Investigadora De Los Sistemas Universitarios Regionales A Través De Su Producción Científica," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 12(3).
    20. Ivan Pavlyutkin, 2014. "University Merger And Sensemaking At The Threshold: Understanding Radical Organizational Change In Higher Education," HSE Working papers WP BRP 16/EDU/2014, National Research University Higher School of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nos:voprob:2019:i:3:p:130-151. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marta Morozova (email available below). General contact details of provider: http://vo.hse.ru/en/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.