IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v130y2025i1d10.1007_s11192-024-05214-w.html
   My bibliography  Save this article

Global or regional: the hidden truth behind ShanghaiRanking’s global university ranking by the subject of Law

Author

Listed:
  • Hui Li

    (Zhejiang University)

Abstract

University rankings released by famous ranking agencies provide valuable information for non-professionals seeking to select universities for study, employment, and research collaboration. Compared to the overall ranking of universities such as the Academic Ranking of World Universities by ShanghaiRanking, the flaws of the subject ranking of universities such as the Global Ranking of Academic Subjects by the same agency have not been sufficiently addressed. In this paper, we present evidence of the over-representation of US universities among the top 50 universities in the field of Law, as published by ShanghaiRanking. Moreover, we identify the anomalies and flaws of the top journal paper indicator used by ShanghaiRanking's Global Ranking of Academic Subjects for the field of Law, which is characterized by some distinctive research and publication practices. Through an in-depth analysis of these anomalies, flaws, and potential impacts, we put forward suggestions for improvement.

Suggested Citation

  • Hui Li, 2025. "Global or regional: the hidden truth behind ShanghaiRanking’s global university ranking by the subject of Law," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(1), pages 515-530, January.
    • Handle: RePEc:spr:scient:v:130:y:2025:i:1:d:10.1007_s11192-024-05214-w
    DOI: 10.1007/s11192-024-05214-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-05214-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-024-05214-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Grewal, Rajdeep & Dearden, James A. & Lilien, Gary L., 2008. "The University Rankings Game: Modeling the Competition Among Universities for Ranking," The American Statistician, American Statistical Association, vol. 62, pages 232-237, August.
    2. Osmo Kivinen & Juha Hedman & Kalle Artukka, 2017. "Scientific publishing and global university rankings. How well are top publishing universities recognized?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 679-695, July.
    3. Toluwase Asubiaro & Sodiq Onaolapo & David Mills, 2024. "Regional disparities in Web of Science and Scopus journal coverage," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(3), pages 1469-1491, March.
    4. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    5. Jill Johnes, 2018. "University rankings: What do they really show?," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 585-606, April.
    6. Domingo Docampo, 2013. "Reproducibility of the Shanghai academic ranking of world universities results," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 567-587, February.
    7. repec:dau:papers:123456789/2947 is not listed on IDEAS
    8. Weishu Liu & Rong Ni & Guangyuan Hu, 2024. "Web of Science Core Collection’s coverage expansion: the forgotten Arts & Humanities Citation Index?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(2), pages 933-955, February.
    9. Igor Savchenko & Denis Kosyakov, 2022. "Lost in affiliation: apatride publications in international databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3471-3487, June.
    10. Saisana, Michaela & d'Hombres, Béatrice & Saltelli, Andrea, 2011. "Rickety numbers: Volatility of university rankings and policy implications," Research Policy, Elsevier, vol. 40(1), pages 165-177, February.
    11. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Correction to: Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 907-908, January.
    12. Weishu Liu & Meiting Huang & Haifeng Wang, 2021. "Same journal but different numbers of published records indexed in Scopus and Web of Science Core Collection: causes, consequences, and solutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4541-4550, May.
    13. Elizabeth Gadd, 2020. "University rankings need a rethink," Nature, Nature, vol. 587(7835), pages 523-523, November.
    14. Hui Li & Xingmei Zhang, 2024. "Dr. Anonymous is still there: a revisit of legal scholarly publishing," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 681-692, January.
    15. Nian Cai Liu & Ying Cheng & Li Liu, 2005. "Academic ranking of world universities using scientometrics - A comment to the “Fatal Attraction”," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 101-109, July.
    16. Henk F. Moed, 2017. "A critical comparative analysis of five world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 967-990, February.
    17. Liu, Weishu & Hu, Guangyuan & Tang, Li, 2018. "Missing author address information in Web of Science—An explorative study," Journal of Informetrics, Elsevier, vol. 12(3), pages 985-997.
    18. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 871-906, January.
    19. Mu-Hsuan Huang, 2012. "Opening the black box of QS World University Rankings," Research Evaluation, Oxford University Press, vol. 21(1), pages 71-78, February.
    20. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Massucci, Francesco Alessandro & Docampo, Domingo, 2019. "Measuring the academic reputation through citation networks via PageRank," Journal of Informetrics, Elsevier, vol. 13(1), pages 185-201.
    2. Michael McAleer & Tamotsu Nakamura & Clinton Watkins, 2019. "Size, Internationalization, and University Rankings: Evaluating and Predicting Times Higher Education (THE) Data for Japan," Sustainability, MDPI, vol. 11(5), pages 1-12, March.
    3. Vicente Safón, 2013. "What do global university rankings really measure? The search for the X factor and the X entity," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 223-244, November.
    4. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    5. Pei Chen & Shan Gao & Fan Jiang & Yifang Ma, 2024. "Measuring the labor market outcomes of universities: evidence from China’s listed company executives," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5715-5730, September.
    6. Yang Zhang & Yu Xiao & Jun Wu & Xin Lu, 2021. "Comprehensive world university ranking based on ranking aggregation," Computational Statistics, Springer, vol. 36(2), pages 1139-1152, June.
    7. McAleer, M.J. & Nakamura, T. & Watkins, C., 2018. "Size, Internationalization and University Rankings: Evaluating Times Higher Education (THE) Data for Japan," Econometric Institute Research Papers EI2018-43, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    8. Osmo Kivinen & Juha Hedman & Kalle Artukka, 2017. "Scientific publishing and global university rankings. How well are top publishing universities recognized?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 679-695, July.
    9. Berlemann, Michael & Haucap, Justus, 2015. "Which factors drive the decision to opt out of individual research rankings? An empirical study of academic resistance to change," Research Policy, Elsevier, vol. 44(5), pages 1108-1115.
    10. Jacek Pietrucha, 2018. "Country-specific determinants of world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1129-1139, March.
    11. Hui Li & Xingmei Zhang, 2024. "Dr. Anonymous is still there: a revisit of legal scholarly publishing," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 681-692, January.
    12. Weishu Liu & Meiting Huang & Haifeng Wang, 2021. "Same journal but different numbers of published records indexed in Scopus and Web of Science Core Collection: causes, consequences, and solutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4541-4550, May.
    13. Csató, László & Tóth, Csaba, 2020. "University rankings from the revealed preferences of the applicants," European Journal of Operational Research, Elsevier, vol. 286(1), pages 309-320.
    14. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    15. Yating Wen & Xiaodong Zhao & Xingguo Li & Yuqi Zang, 2023. "Explaining the Paradox of World University Rankings in China: Higher Education Sustainability Analysis with Sentiment Analysis and LDA Topic Modeling," Sustainability, MDPI, vol. 15(6), pages 1-18, March.
    16. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    17. Adrian Domenteanu & Georgiana-Alina Crișan & Corina Frăsineanu & Camelia Delcea, 2025. "Exploring Grey Systems in Uncertain Environments: A Bibliometric Analysis of Global Contributions and Research Themes," Sustainability, MDPI, vol. 17(6), pages 1-43, March.
    18. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    19. Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
    20. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:130:y:2025:i:1:d:10.1007_s11192-024-05214-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.