IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v19y2025i2s1751157725000070.html

A measure and the related models for characterizing the usage of academic journal

Author

Listed:
  • Qiao, Lili
  • Zhao, Star X.
  • Ji, Yutong
  • Li, Wu

Abstract

Based on the underlying usage data given by the Web of Science, we establish a novel metric, termed Uh-index for multi-dimensional assessment of academic journals. Our research objectively examines the empirical and theoretical dimensions of the Uh-index, assessing its validity and potential use in scientific evaluation. For this study, we conducted a quantitative analysis of the Uh-index for 1,603 journals across the fields of physics, chemistry, economics, and management, and explored potential theory models. It reveals that the Uh-index, as a literature metric based on usage data, is more sensitive and discriminatory compared to the h-index, which relies solely on citation data. Additionally, the Uh-index and paper usage data were consistent with both the Glänzel–Schubert and the power-law model. It indicates that the Uh index, as an impact observatory index, aligns with the fundamental principles of scientific knowledge dissemination, thereby holding significant scientific value. It facilitates the quantification of dissemination characteristics of core articles in journals, laying the foundation for a novel approach to categorizing and evaluating journals based on both theoretical orientation and practical application. Finally, from a multidimensional research evaluation perspective, the Uh index offers a transitional dimension for observation, bridging the gap between academic citations and the broader dissemination of research through on social media.

Suggested Citation

  • Qiao, Lili & Zhao, Star X. & Ji, Yutong & Li, Wu, 2025. "A measure and the related models for characterizing the usage of academic journal," Journal of Informetrics, Elsevier, vol. 19(2).
    • Handle: RePEc:eee:infome:v:19:y:2025:i:2:s1751157725000070
    DOI: 10.1016/j.joi.2025.101643
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157725000070
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2025.101643?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jeppe Nicolaisen & Tove Faber Frandsen, 2019. "Zero impact: a large-scale study of uncitedness," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1227-1254, May.
    2. Brady D. Lund & Ting Wang & Nishith Reddy Mannuru & Bing Nie & Somipam Shimray & Ziang Wang, 2023. "ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(5), pages 570-581, May.
    3. Valentina Markusova & Valentin Bogorov & Alexander Libkind, 2018. "Usage metrics vs classical metrics: analysis of Russia’s research output," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 593-603, February.
    4. Zhao, Star X. & Rousseau, Ronald & Ye, Fred Y., 2011. "h-Degree as a basic measure in weighted networks," Journal of Informetrics, Elsevier, vol. 5(4), pages 668-677.
    5. Mike Thelwall & Kevan Buckley & Georgios Paltoglou, 2011. "Sentiment in Twitter events," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(2), pages 406-418, February.
    6. Mike Thelwall & Kevan Buckley & Georgios Paltoglou, 2011. "Sentiment in Twitter events," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(2), pages 406-418, February.
    7. Yezhu Wang & Yundong Xie & Dong Wang & Lu Guo & Rongting Zhou, 2022. "Do cover papers get better citations and usage counts? An analysis of 42 journals in cell biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3793-3813, July.
    8. Bikun Chen, 2018. "Usage pattern comparison of the same scholarly articles between Web of Science (WoS) and Springer," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 519-537, April.
    9. Pei-Shan Chi & Wolfgang Glänzel, 2017. "An empirical investigation of the associations among usage, scientific collaboration and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 403-412, July.
    10. Henk F. Moed & Gali Halevi, 2015. "Multidimensional assessment of scholarly research impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(10), pages 1988-2002, October.
    11. Star X. Zhao & Paul L. Zhang & Jiang Li & Alice M. Tan & Fred Y. Ye, 2014. "Abstracting the core subnet of weighted networks based on link strengths," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(5), pages 984-994, May.
    12. Miranda Lee Pao, 1986. "An empirical examination of Lotka's law," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 37(1), pages 26-33, January.
    13. Wang, Zhiqi & Chen, Yue & Glänzel, Wolfgang, 2020. "Preprints as accelerator of scholarly communication: An empirical analysis in Mathematics," Journal of Informetrics, Elsevier, vol. 14(4).
    14. Pardeep Sud & Mike Thelwall, 2014. "Evaluating altmetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1131-1143, February.
    15. Zhiqi Wang & Wolfgang Glänzel & Yue Chen, 2020. "The impact of preprints in Library and Information Science: an analysis of citations, usage and social attention indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1403-1423, November.
    16. Star X. Zhao & Wen Lou & Alice M. Tan & Shuang Yu, 2018. "Do funded papers attract more usage?," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 153-168, April.
    17. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    18. Fred Y. Ye, 2009. "An investigation on mathematical models of the h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 493-498, November.
    19. John D. McDonald, 2007. "Understanding journal usage: A statistical analysis of citation and use," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(1), pages 39-50, January.
    20. Chun-Kai Huang & Cameron Neylon & Lucy Montgomery & Richard Hosking & James P. Diprose & Rebecca N. Handcock & Katie Wilson, 2024. "Open access research outputs receive more diverse citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(2), pages 825-845, February.
    21. Viswanath Venkatesh & Fred D. Davis, 2000. "A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies," Management Science, INFORMS, vol. 46(2), pages 186-204, February.
    22. Marleine Azar & Francois Lagacé & Anastasiya Muntyanu & Elena Netchiporouk & Youwen Zhou & Charles Lynde & Linda Moreau & Steve Mathieu & Denis Sasseville & Rachel Asiniwasis & Neil H. Shear & Robert , 2023. "Measuring h-index and scholarly productivity in academic dermatology in Canada," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1071-1090, February.
    23. Haustein, Stefanie & Siebenlist, Tobias, 2011. "Applying social bookmarking data to evaluate journal usage," Journal of Informetrics, Elsevier, vol. 5(3), pages 446-457.
    24. Wolfgang Glänzel & Juan Gorraiz, 2015. "Usage metrics versus altmetrics: confusing terminology?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2161-2164, March.
    25. Fassin, Yves, 2024. "The internal dynamics of journals’ h-cores over time," Journal of Informetrics, Elsevier, vol. 18(2).
    26. repec:bla:jamest:v:37:y:1986:i:1:p:26-33 is not listed on IDEAS
    27. Wencan Tian & Zhichao Fang & Xianwen Wang & Rodrigo Costas, 2024. "A multi-dimensional analysis of usage counts, Mendeley readership, and citations for journal and conference papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(2), pages 985-1013, February.
    28. Tibor Braun & Wolfgang Glänzel & András Schubert, 2006. "A Hirsch-type index for journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 169-173, October.
    29. Johan Bollen & Herbert Van de Sompel, 2008. "Usage impact factor: The effects of sample characteristics on usage‐based impact metrics," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(1), pages 136-149, January.
    30. Miranda Lee Pao, 1986. "An empirical examination of Lotka's Law," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 37(1), pages 26-33, January.
    31. ↓Xia Peng & Zequan Xiong & Li Yang, 2024. "Can document characteristics affect motivations for literature usage?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3543-3563, June.
    32. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    33. repec:osf:socarx:9n347_v1 is not listed on IDEAS
    34. Zhang, Lin & Sivertsen, Gunnar & Du, Huiying & HUANG, Ying & Glänzel, Wolfgang, 2021. "Gender differences in the aims and impacts of research," SocArXiv 9n347, Center for Open Science.
    35. Schubert, András & Glänzel, Wolfgang, 2007. "A systematic analysis of Hirsch-type indices for journals," Journal of Informetrics, Elsevier, vol. 1(3), pages 179-184.
    36. Cheng, Xi & Wang, Haoran & Tang, Li & Jiang, Weiyan & Zhou, Maotian & Wang, Guoyan, 2024. "Open peer review correlates with altmetrics but not with citations: Evidence from Nature Communications and PLoS One," Journal of Informetrics, Elsevier, vol. 18(3).
    37. Lutz Bornmann & Hans‐Dieter Daniel, 2007. "What do we know about the h index?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(9), pages 1381-1385, July.
    38. Wencan Tian & Yongzhen Wang & Zhigang Hu & Ruonan Cai & Guangyao Zhang & Xianwen Wang, 2024. "Does Granger causality exist between article usage and publication counts? A topic-level time-series evidence from IEEE Xplore," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3285-3302, June.
    39. Chunli Wei & Jingyi Zhao & Jue Ni & Jiang Li, 2023. "What does open peer review bring to scientific articles? Evidence from PLoS journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2763-2776, May.
    40. Xianwen Wang & Zhichao Fang & Xiaoling Sun, 2016. "Usage patterns of scholarly articles on Web of Science: a study on Web of Science usage count," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 917-926, November.
    41. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yezhu Wang & Yundong Xie & Dong Wang & Lu Guo & Rongting Zhou, 2022. "Do cover papers get better citations and usage counts? An analysis of 42 journals in cell biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3793-3813, July.
    2. Wencan Tian & Zhichao Fang & Xianwen Wang & Rodrigo Costas, 2024. "A multi-dimensional analysis of usage counts, Mendeley readership, and citations for journal and conference papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(2), pages 985-1013, February.
    3. Wencan Tian & Yongzhen Wang & Zhigang Hu & Ruonan Cai & Guangyao Zhang & Xianwen Wang, 2024. "Does Granger causality exist between article usage and publication counts? A topic-level time-series evidence from IEEE Xplore," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3285-3302, June.
    4. Anna Tietze & Philip Hofmann, 2019. "The h-index and multi-author hm-index for individual researchers in condensed matter physics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 171-185, April.
    5. Wei, Shelia X. & Tong, Tong & Rousseau, Ronald & Wang, Wanru & Ye, Fred Y., 2022. "Relations among the h-, g-, ψ-, and p-index and offset-ability," Journal of Informetrics, Elsevier, vol. 16(4).
    6. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2019. "A new parameter for (normalized) evaluation of H-index: countries as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1065-1078, March.
    7. Yang, Alex Jie & Wu, Linwei & Zhang, Qi & Wang, Hao & Deng, Sanhong, 2023. "The k-step h-index in citation networks at the paper, author, and institution levels," Journal of Informetrics, Elsevier, vol. 17(4).
    8. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    9. Wang, Zhiqi & Chen, Yue & Glänzel, Wolfgang, 2020. "Preprints as accelerator of scholarly communication: An empirical analysis in Mathematics," Journal of Informetrics, Elsevier, vol. 14(4).
    10. Bikun Chen & Dannan Deng & Zhouyan Zhong & Chengzhi Zhang, 2020. "Exploring linguistic characteristics of highly browsed and downloaded academic articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1769-1790, March.
    11. Zhiqi Wang & Wolfgang Glänzel & Yue Chen, 2020. "The impact of preprints in Library and Information Science: an analysis of citations, usage and social attention indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1403-1423, November.
    12. Bikun Chen, 2018. "Usage pattern comparison of the same scholarly articles between Web of Science (WoS) and Springer," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 519-537, April.
    13. Luis Javier Cabeza Ramírez & Sandra M. Sánchez-Cañizares & Fernando J. Fuentes-García, 2019. "Past Themes and Tracking Research Trends in Entrepreneurship: A Co-Word, Cites and Usage Count Analysis," Sustainability, MDPI, vol. 11(11), pages 1-32, June.
    14. Lucio Bertoli-Barsotti & Tommaso Lando, 2017. "A theoretical model of the relationship between the h-index and other simple citation indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1415-1448, June.
    15. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    16. M. Ausloos, 2013. "A scientometrics law about co-authors and their ranking: the co-author core," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 895-909, June.
    17. Pascal Bador & Thierry Lafouge, 2010. "Comparative analysis between impact factor and h-index for pharmacology and psychiatry journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 65-79, July.
    18. Soo Jeung Lee & Christian Schneijderberg & Yangson Kim & Isabel Steinhardt, 2021. "Have Academics’ Citation Patterns Changed in Response to the Rise of World University Rankings? A Test Using First-Citation Speeds," Sustainability, MDPI, vol. 13(17), pages 1-19, August.
    19. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.
    20. Xia Gao & Jiancheng Guan, 2012. "Network model of knowledge diffusion," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 749-762, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:19:y:2025:i:2:s1751157725000070. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.