IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v13y2021i24p13873-d703235.html
   My bibliography  Save this article

Novel World University Rankings Combining Academic, Environmental and Resource Indicators

Author

Listed:
  • Wei-Chao Lin

    (Department of Information Management, Chang Gung University, Taoyuan 33302, Taiwan
    Center for Institutional Research, Chang Gung University, Taoyuan 33302, Taiwan
    Department of Thoracic Surgery, Chang Gung Memorial Hospital at Linkou, Taoyuan 333423, Taiwan)

  • Ching Chen

    (Department of Information Management, Chang Gung University, Taoyuan 33302, Taiwan)

Abstract

World university rankings are regarded as an important tool to assess higher education quality. There are several media sources that publish world university rankings every year. These ranking results are mainly based on academic indicators, including research and teaching, with different weightings. However, some of these academic indicators are questionable, which affects the objectivity of the ranking results. In addition, conducting more medical-related studies could enhance the research impact scores. Some universities that devote themselves to enhancing these academic indicators lose sight of their original development goals and directions. To make the rankings more comprehensive, it is necessary to consider different viewpoints in the assessment. In other words, the research question of this paper is: whether considering different kinds of indicators can provide better ranking results? Therefore, in this paper, we introduce a novel ranking approach that combines academic, environmental, and resource indicators based on the Borda count method. The top 100 world universities from the Academic Ranking of World Universities, QS World University Rankings, Times Higher Education World Universities, and U.S. News & World Report are chosen for the analysis. The comparisons between the original and new rankings show that many universities improve in the rankings, while some universities from particular countries drop in the rankings due to the scores obtained from the environmental and resource indicators.

Suggested Citation

  • Wei-Chao Lin & Ching Chen, 2021. "Novel World University Rankings Combining Academic, Environmental and Resource Indicators," Sustainability, MDPI, vol. 13(24), pages 1-15, December.
  • Handle: RePEc:gam:jsusta:v:13:y:2021:i:24:p:13873-:d:703235
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/13/24/13873/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/13/24/13873/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Valero, Anna & Van Reenen, John, 2019. "The economic impact of universities: Evidence from across the globe," Economics of Education Review, Elsevier, vol. 68(C), pages 53-67.
    2. Nikola Zornic & Aleksandar Markovic & Veljko Jeremic, 2014. "How the top 500 ARWU can provide a misleading rank," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(6), pages 1303-1304, June.
    3. Oscar N. Ventura & Alvaro W. Mombrú, 2006. "Use of bibliometric information to assist research policy making. A comparison of publication and citation profiles of Full and Associate Professors at a School of Chemistry in Uruguay," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(2), pages 287-313, November.
    4. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    5. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    6. Andrew Gelman & Christian Hennig, 2017. "Beyond subjective and objective in statistics," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 967-1033, October.
    7. Philip G. Altbach & Jamil Salmi, 2011. "The Road to Academic Excellence : The Making of World-Class Research Universities [El camino hacia la excelencia académica : la constitución de universidades de investigación de rango mundial]," World Bank Publications - Books, The World Bank Group, number 2357.
    8. Milan Dobrota & Marina Dobrota, 2016. "ARWU ranking uncertainty and sensitivity: What if the award factor was Excluded?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(2), pages 480-482, February.
    9. Bouyssou, D. & Marchant, T., 2010. "Consistent bibliometric rankings of authors and of journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 365-378.
    10. Bouyssou, D. & Marchant, T., 2010. "Consistent bibliometric rankings of authors and of journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 365-378.
    11. Domingo Docampo & Lawrence Cram, 2014. "On the internal dynamics of the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1347-1366, February.
    12. Mike Thelwall & Kayvan Kousha, 2015. "ResearchGate: Disseminating, communicating, and measuring Scholarship?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(5), pages 876-889, May.
    13. Peter Emerson, 2013. "The original Borda count and partial voting," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 40(2), pages 353-358, February.
    14. Marina Dobrota & Milica Bulajic & Lutz Bornmann & Veljko Jeremic, 2016. "A new approach to the QS university ranking using the composite I-distance indicator: Uncertainty and sensitivity analyses," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(1), pages 200-211, January.
    15. Mu-Hsuan Huang, 2012. "Opening the black box of QS World University Rankings," Research Evaluation, Oxford University Press, vol. 21(1), pages 71-78, February.
    16. Philip Cooke & Loet Leydesdorff, 2006. "Regional Development in the Knowledge-Based Economy: The Construction of Advantage," The Journal of Technology Transfer, Springer, vol. 31(1), pages 5-15, January.
    17. Vicente Safón, 2013. "What do global university rankings really measure? The search for the X factor and the X entity," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 223-244, November.
    18. Brown, William O., 2001. "Sources of funds and quality effects in higher education," Economics of Education Review, Elsevier, vol. 20(3), pages 289-295, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olga A. Myzrova & Tatyana V. Goryacheva & Olga V. Sysoeva & Victor V. Sysoev, 2023. "The Effect of the Entrepreneurial Ecosystem of Universities on the Innovative Activity in Russian Regions," Economies, MDPI, vol. 11(7), pages 1-19, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    2. Carla Martínez-Climent & Ana Zorio-Grima & Domingo Ribeiro-Soriano, 2018. "Financial return crowdfunding: literature review and bibliometric analysis," International Entrepreneurship and Management Journal, Springer, vol. 14(3), pages 527-553, September.
    3. Yunrong Li & Javier Ruiz-Castillo, 2014. "The impact of extreme observations in citation distributions," Research Evaluation, Oxford University Press, vol. 23(2), pages 174-182.
    4. Marta Cardin & Marco Corazza & Stefania Funari & Silvio Giove, 2011. "A fuzzy-based scoring rule for author ranking," Working Papers 2011_11, Department of Economics, University of Venice "Ca' Foscari".
    5. Massucci, Francesco Alessandro & Docampo, Domingo, 2019. "Measuring the academic reputation through citation networks via PageRank," Journal of Informetrics, Elsevier, vol. 13(1), pages 185-201.
    6. Saulo Mendes, 2025. "Assessment of subject-normalized comprehensiveness of research-intensive universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(1), pages 109-131, January.
    7. Bouyssou, Denis & Marchant, Thierry, 2011. "Bibliometric rankings of journals based on Impact Factors: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 5(1), pages 75-86.
    8. László Csató & Dóra Gréta Petróczy, 2024. "Bibliometric indices as a measure of performance and competitive balance in the knockout stage of the UEFA Champions League," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 32(4), pages 961-988, December.
    9. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    10. Mohsen Fazeli-Varzaneh & Pete Bettinger & Erfan Ghaderi-Azad & Marcin Kozak & Davood Mafi-Gholami & Abolfazl Jaafari, 2021. "Forestry Research in the Middle East: A Bibliometric Analysis," Sustainability, MDPI, vol. 13(15), pages 1-19, July.
    11. Ronald Rousseau, 2012. "Updating the journal impact factor or total overhaul?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 413-417, August.
    12. Osório, António (António Miguel), 2019. "The value and credits of n-authors publications," Working Papers 2072/376026, Universitat Rovira i Virgili, Department of Economics.
    13. Melike Çağlayan & Ece Çağlayan & Cengiz Acartürk, 2025. "Stakeholder Perspectives on Rankings of Higher Education Institutions: A Structural Equation Modeling Analysis," Research in Higher Education, Springer;Association for Institutional Research, vol. 66(3), pages 1-38, May.
    14. Dilruba Mahbuba & Ronald Rousseau, 2013. "Year-based h-type indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 785-797, September.
    15. Xiaojun Hu & Ronald Rousseau, 2015. "A simple approach to describe a company’s innovative activities and their technological breadth," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1401-1411, February.
    16. Bouyssou, Denis & Marchant, Thierry, 2016. "Ranking authors using fractional counting of citations: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 10(1), pages 183-199.
    17. Dima Alina Mihaela & Argatu Ruxandra & Rădoi Mireille, 2024. "Performance Evaluation in Higher Education – A Comparative Approach," Proceedings of the International Conference on Business Excellence, Sciendo, vol. 18(1), pages 2453-2471.
    18. Rousseau, Ronald & García-Zorita, Carlos & Sanz-Casado, Elias, 2013. "The h-bubble," Journal of Informetrics, Elsevier, vol. 7(2), pages 294-300.
    19. Teodoro Luque-Martínez & Ignacio Luque-Raya, 2024. "Spanish scientific research by field and subject. Strategic analysis with ARWU indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5265-5285, September.
    20. Andrea Bonaccorsi & Cinzia Daraio, 2014. "Beyond university rankings ? Generating new indicators on European universities by linking data in open platforms," DIAG Technical Reports 2014-12, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:13:y:2021:i:24:p:13873-:d:703235. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.