IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v112y2017i1d10.1007_s11192-017-2356-4.html
   My bibliography  Save this article

An empirical investigation of the associations among usage, scientific collaboration and citation impact

Author

Listed:
  • Pei-Shan Chi

    (KU Leuven)

  • Wolfgang Glänzel

    (KU Leuven
    Library of the Hungarian Academy of Sciences)

Abstract

In this study usage counts and times cited from Web of Science Core Collection (WoS) were collected for articles published in 2013 with Belgian, Israeli and Iranian addresses. We investigated the relations among three indicators related to citation impact, usage counts and co-authorship, respectively. In addition, we applied the method of Characteristic Scores and Scales (CSS) to analyse the distributions of citations and usage counts to further test the relation between the usage and citation impact. The results show that citations and usage counts in WoS correlate significantly, especially in the social sciences. However, higher numbers of co-authors are not associated with higher usage counts or citations. Furthermore, the stability of CSS-class distributions substantiates the applicability of CSS in characterising both usage and citation distributions. Distinctly different patterns in citations and usage are observed, but the similarities within citations and usage in these fields are somewhat unexpected.

Suggested Citation

  • Pei-Shan Chi & Wolfgang Glänzel, 2017. "An empirical investigation of the associations among usage, scientific collaboration and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 403-412, July.
  • Handle: RePEc:spr:scient:v:112:y:2017:i:1:d:10.1007_s11192-017-2356-4
    DOI: 10.1007/s11192-017-2356-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2356-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-017-2356-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. H. P. F. Peters & A. F. J. van Raan, 1994. "On determinants of citation scores: A case study in chemical engineering," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 45(1), pages 39-49, January.
    2. Johan Bollen & Herbert Van de Sompel & Aric Hagberg & Ryan Chute, 2009. "A Principal Component Analysis of 39 Scientific Impact Measures," PLOS ONE, Public Library of Science, vol. 4(6), pages 1-11, June.
    3. Tim Brody & Stevan Harnad & Leslie Carr, 2006. "Earlier Web usage statistics as predictors of later citation impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(8), pages 1060-1072, June.
    4. Blaise Cronin & Debora Shaw & Kathryn La Barre, 2004. "Visible, less visible, and invisible work: Patterns of collaboration in 20th century chemistry," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 55(2), pages 160-168, January.
    5. Wolfgang Glänzel & Bart Thijs & Koenraad Debackere, 2014. "The application of citation-based performance classes to the disciplinary and multidisciplinary assessment in national comparison and institutional research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 939-952, November.
    6. Wolfgang Glänzel & András Schubert, 2003. "A new classification scheme of science fields and subfields designed for scientometric evaluation purposes," Scientometrics, Springer;Akadémiai Kiadó, vol. 56(3), pages 357-367, March.
    7. Xianwen Wang & Zhichao Fang & Xiaoling Sun, 2016. "Usage patterns of scholarly articles on Web of Science: a study on Web of Science usage count," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 917-926, November.
    8. Wolfgang Glänzel & Bart Thijs, 2004. "Does co-authorship inflate the share of self-citations?," Scientometrics, Springer;Akadémiai Kiadó, vol. 61(3), pages 395-404, November.
    9. Wolfgang Glänzel & Bart Thijs & Pei-Shan Chi, 2016. "The challenges to expand bibliometric studies from periodical literature to monographic literature with a new data source: the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2165-2179, December.
    10. Lutz Bornmann, 2015. "Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 1123-1144, June.
    11. Björn Hammarfelt, 2014. "Using altmetrics for assessing research impact in the humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1419-1430, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bikun Chen, 2018. "Usage pattern comparison of the same scholarly articles between Web of Science (WoS) and Springer," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 519-537, April.
    2. Mingyang Wang & Jiaqi Zhang & Shijia Jiao & Tianyu Zhang, 2019. "Evaluating the impact of citations of articles based on knowledge flow patterns hidden in the citations," PLOS ONE, Public Library of Science, vol. 14(11), pages 1-19, November.
    3. Wang, Zhiqi & Chen, Yue & Glänzel, Wolfgang, 2020. "Preprints as accelerator of scholarly communication: An empirical analysis in Mathematics," Journal of Informetrics, Elsevier, vol. 14(4).
    4. Yezhu Wang & Yundong Xie & Dong Wang & Lu Guo & Rongting Zhou, 2022. "Do cover papers get better citations and usage counts? An analysis of 42 journals in cell biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3793-3813, July.
    5. Barbara McGillivray & Mathias Astell, 2019. "The relationship between usage and citations in an open access mega-journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 817-838, November.
    6. Mingyang Wang & Zhenyu Wang & Guangsheng Chen, 2019. "Which can better predict the future success of articles? Bibliometric indices or alternative metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1575-1595, June.
    7. Mingyang Wang & Jiaqi Zhang & Shijia Jiao & Xiangrong Zhang & Na Zhu & Guangsheng Chen, 2020. "Important citation identification by exploiting the syntactic and contextual information of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2109-2129, December.
    8. Bikun Chen & Dannan Deng & Zhouyan Zhong & Chengzhi Zhang, 2020. "Exploring linguistic characteristics of highly browsed and downloaded academic articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1769-1790, March.
    9. Kong, Ling & Wang, Dongbo, 2020. "Comparison of citations and attention of cover and non-cover papers," Journal of Informetrics, Elsevier, vol. 14(4).
    10. Zhiqi Wang & Wolfgang Glänzel & Yue Chen, 2020. "The impact of preprints in Library and Information Science: an analysis of citations, usage and social attention indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1403-1423, November.
    11. Mohammadamin Erfanmanesh & A. Noorhidawati & A. Abrizah, 2019. "What can Bookmetrix tell us about the impact of Springer Nature’s books," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 521-536, October.
    12. Pei-Shan Chi & Juan Gorraiz & Wolfgang Glänzel, 2019. "Comparing capture, usage and citation indicators: an altmetric analysis of journal papers in chemistry disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1461-1473, September.
    13. Valentina Markusova & Valentin Bogorov & Alexander Libkind, 2018. "Usage metrics vs classical metrics: analysis of Russia’s research output," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 593-603, February.
    14. Heng Huang & Donghua Zhu & Xuefeng Wang, 2022. "Evaluating scientific impact of publications: combining citation polarity and purpose," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5257-5281, September.
    15. Hongquan Shen & Juan Xie & Jiang Li & Ying Cheng, 2021. "The correlation between scientific collaboration and citation count at the paper level: a meta-analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3443-3470, April.
    16. Andrés Fernández-Ramos & Blanca Rodríguez-Bravo & Ángela Diez-Diez, 2023. "Use of scientific journals in Spanish universities: analysis of the relationship between citations and downloads in two university library consortia," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2489-2505, April.
    17. Pei-Shan Chi & Wolfgang Glänzel, 2018. "Comparison of citation and usage indicators in research assessment in scientific disciplines and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 537-554, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhiqi Wang & Wolfgang Glänzel & Yue Chen, 2020. "The impact of preprints in Library and Information Science: an analysis of citations, usage and social attention indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1403-1423, November.
    2. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    3. Mingyang Wang & Zhenyu Wang & Guangsheng Chen, 2019. "Which can better predict the future success of articles? Bibliometric indices or alternative metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1575-1595, June.
    4. Wang, Zhiqi & Chen, Yue & Glänzel, Wolfgang, 2020. "Preprints as accelerator of scholarly communication: An empirical analysis in Mathematics," Journal of Informetrics, Elsevier, vol. 14(4).
    5. Mingkun Wei & Abdolreza Noroozi Chakoli, 2020. "Evaluating the relationship between the academic and social impact of open access books based on citation behaviors and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2401-2420, December.
    6. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    7. Zhichao Fang & Rodrigo Costas & Wencan Tian & Xianwen Wang & Paul Wouters, 2020. "An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2519-2549, September.
    8. Pei-Shan Chi & Juan Gorraiz & Wolfgang Glänzel, 2019. "Comparing capture, usage and citation indicators: an altmetric analysis of journal papers in chemistry disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1461-1473, September.
    9. Lin Zhang & Wenjing Zhao & Beibei Sun & Ying Huang & Wolfgang Glänzel, 2020. "How scientific research reacts to international public health emergencies: a global analysis of response patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 747-773, July.
    10. Barbara McGillivray & Mathias Astell, 2019. "The relationship between usage and citations in an open access mega-journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 817-838, November.
    11. Ying Huang & Wolfgang Glänzel & Lin Zhang, 2021. "Tracing the development of mapping knowledge domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6201-6224, July.
    12. Ortega, José Luis, 2018. "The life cycle of altmetric impact: A longitudinal study of six metrics from PlumX," Journal of Informetrics, Elsevier, vol. 12(3), pages 579-589.
    13. Wolfgang Glänzel & Lin Zhang, 2018. "Scientometric research assessment in the developing world: A tribute to Michael J. Moravcsik from the perspective of the twenty-first century," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1517-1532, June.
    14. Siluo Yang & Xin Xing & Fan Qi & Maria Cláudia Cabrini Grácio, 2021. "Comparison of academic book impact from a disciplinary perspective: an analysis of citations and altmetric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1101-1123, February.
    15. Lutz Bornmann & Robin Haunschild & Vanash M Patel, 2020. "Are papers addressing certain diseases perceived where these diseases are prevalent? The proposal to use Twitter data as social-spatial sensors," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-22, November.
    16. Bhaskar Mukherjee & Siniša Subotić & Ajay Kumar Chaubey, 2018. "And now for something completely different: the congruence of the Altmetric Attention Score’s structure between different article groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 253-275, January.
    17. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    18. Tomaz Bartol & Gordana Budimir & Primoz Juznic & Karmen Stopar, 2016. "Mapping and classification of agriculture in Web of Science: other subject categories and research fields may benefit," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 979-996, November.
    19. Pei-Shan Chi & Wolfgang Glänzel, 2018. "Comparison of citation and usage indicators in research assessment in scientific disciplines and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 537-554, July.
    20. Latefa Ali Dardas & Malik Sallam & Amanda Woodward & Nadia Sweis & Narjes Sweis & Faleh A. Sawair, 2023. "Evaluating Research Impact Based on Semantic Scholar Highly Influential Citations, Total Citations, and Altmetric Attention Scores: The Quest for Refined Measures Remains Illusive," Publications, MDPI, vol. 11(1), pages 1-16, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:112:y:2017:i:1:d:10.1007_s11192-017-2356-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.