IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v14y2020i1s1751157719302652.html
   My bibliography  Save this article

Measurement and analysis of Chinese journal discriminative capacity

Author

Listed:
  • Zhang, Baolong
  • Wang, Hao
  • Deng, Sanhong
  • Su, Xinning

Abstract

This study proposes a method for measuring the discriminative capacity of journals to evaluate and analyze differences in research content among academic journals. A total of 100 Chinese academic journals from five disciplines are selected as research objects. The discriminative capacities of journals in the library, information, and archival science in 2017 and 2013–2017 are calculated and analyzed using bibliographic data (titles, abstracts, and keywords). The characteristics of the discriminative capacities of journals within different time spans are compared based on changes in the spatial distribution and discriminative capacity of the journals. The discriminative capacity of journals published from 2013 to 2017 is determined and ranked to explore their annual change rules over time. The discriminative capacity of journals in five disciplines is calculated and discussed, and the differences among disciplines are measured and analyzed using the mean discriminative capacity. The experimental results reveal that the discriminative capacity of journals in library, information, and archival science evidently vary, with journals in archival science having the highest discriminative capacity, closely followed by journals in information and library science. In addition, the journals show distinct characteristics in different time spans. The discriminative capacity of journals shows obvious change rules over time and varies in characteristics among different disciplines.

Suggested Citation

  • Zhang, Baolong & Wang, Hao & Deng, Sanhong & Su, Xinning, 2020. "Measurement and analysis of Chinese journal discriminative capacity," Journal of Informetrics, Elsevier, vol. 14(1).
    • Handle: RePEc:eee:infome:v:14:y:2020:i:1:s1751157719302652
    DOI: 10.1016/j.joi.2019.101000
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157719302652
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2019.101000?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2011. "Evaluating research: from informed peer review to bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 499-514, June.
    2. Tingcan Ma & Gui-Fang Wang & Ke Dong & Mukun Cao, 2012. "The Journal’s Integrated Impact Index: a new indicator for journal evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 649-658, February.
    3. Bihui Jin & Bing Wang, 1999. "Chinese science citation database: Its construction and application," Scientometrics, Springer;Akadémiai Kiadó, vol. 45(2), pages 325-332, June.
    4. Loet Leydesdorff & Lutz Bornmann & Caroline S. Wagner, 2017. "Generating clustered journal maps: an automated system for hierarchical classification," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1601-1614, March.
    5. Feifei Wang & Dietmar Wolfram, 2015. "Assessment of journal similarity based on citing discipline analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(6), pages 1189-1198, June.
    6. Su, Cheng & Pan, YunTao & Zhen, YanNing & Ma, Zheng & Yuan, JunPeng & Guo, Hong & Yu, ZhengLu & Ma, CaiFeng & Wu, YiShan, 2011. "PrestigeRank: A new evaluation method for papers and journals," Journal of Informetrics, Elsevier, vol. 5(1), pages 1-13.
    7. Yundong Xie & Qiang Wu & Xingchen Li, 2019. "Editorial team scholarly index (ETSI): an alternative indicator for evaluating academic journal reputation," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1333-1349, September.
    8. William M. Cockriel & James B. McDonald, 2018. "The influence of dispersion on journal impact measures," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 609-622, July.
    9. Brenda Cheang & Samuel Kai Wah Chu & Chongshou Li & Andrew Lim, 2014. "OR/MS journals evaluation based on a refined PageRank method: an updated and more comprehensive review," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 339-361, August.
    10. R. G. Raj & A. N. Zainab, 2012. "Relative measure index: a metric to measure the quality of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 305-317, November.
    11. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    12. Fuli Zhang, 2017. "Evaluating journal impact based on weighted citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1155-1169, November.
    13. Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2012. "A further step forward in measuring journals’ scientific prestige: The SJR2 indicator," Journal of Informetrics, Elsevier, vol. 6(4), pages 674-688.
    14. Cheng Zhang & Xu Liu & Yunjie (Calvin) Xu & Youwei Wang, 2011. "Quality‐structure index: A new metric to measure scientific journal influence," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(4), pages 643-653, April.
    15. Antonio J. Gómez-Núñez & Benjamín Vargas-Quesada & Félix Moya-Anegón, 2016. "Updating the SCImago journal and country rank classification: A new approach using Ward's clustering and alternative combination of citation measures," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(1), pages 178-190, January.
    16. Otto Tuomaala & Kalervo Järvelin & Pertti Vakkari, 2014. "Evolution of library and information science, 1965–2005: Content analysis of journal articles," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(7), pages 1446-1462, July.
    17. Christian Weismayer & Ilona Pezenka, 2017. "Identifying emerging research fields: a longitudinal latent semantic keyword analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1757-1785, December.
    18. Yuen-Hsien Tseng & Ming-Yueh Tsay, 2013. "Journal clustering of library and information science for subfield delineation using the bibliometric analysis toolkit: CATAR," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 503-528, May.
    19. Lutz Bornmann & Hans-Dieter Daniel, 2009. "Reviewer and editor biases in journal peer review: an investigation of manuscript refereeing at Angewandte Chemie International Edition," Research Evaluation, Oxford University Press, vol. 18(4), pages 262-272, October.
    20. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    21. Wolfram, Dietmar & Zhao, Yuehua, 2014. "A comparison of journal similarity across six disciplines using citing discipline analysis," Journal of Informetrics, Elsevier, vol. 8(4), pages 840-853.
    22. Primož Južnič & Stojan Pečlin & Matjaž Žaucer & Tilen Mandelj & Miro Pušnik & Franci Demšar, 2010. "Scientometric indicators: peer-review, bibliometric methods and conflict of interests," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 429-441, November.
    23. Xinning Su & Sanhong Deng & Si Shen, 2014. "The design and application value of the Chinese Social Science Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1567-1582, March.
    24. Jin Zhang & Robert R. Korfhage, 1999. "A distance and angle similarity measure method," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 50(9), pages 772-778.
    25. Cheng Zhang & Xu Liu & Yunjie (Calvin) Xu & Youwei Wang, 2011. "Quality-structure index: A new metric to measure scientific journal influence," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(4), pages 643-653, April.
    26. Leydesdorff, Loet & Rafols, Ismael, 2012. "Interactive overlays: A new method for generating global journal maps from Web-of-Science data," Journal of Informetrics, Elsevier, vol. 6(2), pages 318-332.
    27. Srđan Bojović & Rada Matić & Zorica Popović & Miroslava Smiljanić & Milena Stefanović & Vera Vidaković, 2014. "An overview of forestry journals in the period 2006–2010 as basis for ascertaining research trends," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1331-1346, February.
    28. Moed, Henk F., 2010. "Measuring contextual citation impact of scientific journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 265-277.
    29. G. Salton & C. S. Yang & C. T. Yu, 1975. "A theory of term importance in automatic text analysis," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 26(1), pages 33-44, January.
    30. González-Pereira, Borja & Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2010. "A new approach to the metric of journals’ scientific prestige: The SJR indicator," Journal of Informetrics, Elsevier, vol. 4(3), pages 379-391.
    31. Ethan J. Allen & Roberta K. Weber & William Howerton, 2018. "Library Assessment Research: A Content Comparison from Three American Library Journals," Publications, MDPI, vol. 6(1), pages 1-22, March.
    32. Fang Xu & Wenbin Liu & Ronald Rousseau, 2015. "Introducing sub-impact factor (SIF-) sequences and an aggregated SIF-indicator for journal ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1577-1593, February.
    33. Tibor Braun & Wolfgang Glänzel & András Schubert, 2006. "A Hirsch-type index for journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 169-173, October.
    34. Leydesdorff, Loet & Bornmann, Lutz & Zhou, Ping, 2016. "Construction of a pragmatic base line for journal classifications and maps based on aggregated journal-journal citation relations," Journal of Informetrics, Elsevier, vol. 10(4), pages 902-918.
    35. Howard D. White & Katherine W. McCain, 1998. "Visualizing a discipline: An author co‐citation analysis of information science, 1972–1995," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 49(4), pages 327-355.
    36. Haddawy, Peter & Hassan, Saeed-Ul & Asghar, Awais & Amin, Sarah, 2016. "A comprehensive examination of the relation of three citation-based journal metrics to expert judgment of journal quality," Journal of Informetrics, Elsevier, vol. 10(1), pages 162-173.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    2. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    3. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    4. Zhang, Fang & Wu, Shengli, 2020. "Predicting future influence of papers, researchers, and venues in a dynamic academic network," Journal of Informetrics, Elsevier, vol. 14(2).
    5. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    6. Xie, Yundong & Wu, Qiang & Zhang, Peng & Li, Xingchen, 2020. "Information Science and Library Science (IS-LS) journal subject categorisation and comparison based on editorship information," Journal of Informetrics, Elsevier, vol. 14(4).
    7. Juan Gorraiz & Ursula Ulrych & Wolfgang Glänzel & Wenceslao Arroyo-Machado & Daniel Torres-Salinas, 2022. "Measuring the excellence contribution at the journal level: an alternative to Garfield’s impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7229-7251, December.
    8. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    9. Fang Zhang & Shengli Wu, 2021. "Measuring academic entities’ impact by content-based citation analysis in a heterogeneous academic network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(8), pages 7197-7222, August.
    10. A. Abrizah & A. N. Zainab & K. Kiran & R. G. Raj, 2013. "LIS journals scientific impact and subject categorization: a comparison between Web of Science and Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 721-740, February.
    11. Liwei Cai & Jiahao Tian & Jiaying Liu & Xiaomei Bai & Ivan Lee & Xiangjie Kong & Feng Xia, 2019. "Scholarly impact assessment: a survey of citation weighting solutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 453-478, February.
    12. Eleni Fragkiadaki & Georgios Evangelidis, 2014. "Review of the indirect citations paradigm: theory and practice of the assessment of papers, authors and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 261-288, May.
    13. Gagolewski, Marek, 2011. "Bibliometric impact assessment with R and the CITAN package," Journal of Informetrics, Elsevier, vol. 5(4), pages 678-692.
    14. Gagolewski, Marek & Mesiar, Radko, 2012. "Aggregating different paper quality measures with a generalized h-index," Journal of Informetrics, Elsevier, vol. 6(4), pages 566-579.
    15. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    16. Judit Bar-Ilan & Mark Levene, 2015. "The hw-rank: an h-index variant for ranking web pages," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2247-2253, March.
    17. Judit Bar-Ilan, 2012. "Journal report card," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 249-260, August.
    18. Olga Moskaleva & Vladimir Pislyakov & Ivan Sterligov & Mark Akoev & Svetlana Shabanova, 2018. "Russian Index of Science Citation: Overview and review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 449-462, July.
    19. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    20. Fiorenzo Franceschini & Domenico Maisano, 2011. "Bibliometric positioning of scientific manufacturing journals: a comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 463-485, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:14:y:2020:i:1:s1751157719302652. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.