IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v125y2020i2d10.1007_s11192-020-03473-x.html
   My bibliography  Save this article

The big challenge of Scientometrics 2.0: exploring the broader impact of scientific research in public health

Author

Listed:
  • Wolfgang Glänzel

    (KU Leuven
    Library of the Hungarian Academy of Sciences)

  • Pei-Shan Chi

    (KU Leuven)

Abstract

In the present study we discuss the challenge of “Scientometrics 2.0” as introduced by Priem and Hemminger (2010) in the light of possible applications to research evaluation. We use the Web of Science subject category public, environmental and occupational health to illustrate how indicators similar to those used in traditional scientometrics can be built, and we also discuss their opportunities and limitations. The discipline under study combines life sciences and social sciences in a unique manner and provides usable metrics reflecting both scholarly and wider impact. Nonetheless, metrics reflecting social media attention like tweets, retweets and Facebook likes, shares or comments are still subject to limitations in this research discipline as well. Furthermore, Usage metrics clearly point to the manipulation proneness of this measure. Although the counterparts of important bibliometric indicators proved to work for several altmetrics too, their interpretation and application to research assessment requires proper context analysis.

Suggested Citation

  • Wolfgang Glänzel & Pei-Shan Chi, 2020. "The big challenge of Scientometrics 2.0: exploring the broader impact of scientific research in public health," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1011-1031, November.
    • Handle: RePEc:spr:scient:v:125:y:2020:i:2:d:10.1007_s11192-020-03473-x
    DOI: 10.1007/s11192-020-03473-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-020-03473-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-020-03473-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Henk F. Moed, 2005. "Statistical relationships between downloads and citations at the level of individual documents within a single journal," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 56(10), pages 1088-1097, August.
    2. Christian Gumpenberger & Wolfgang Glänzel & Juan Gorraiz, 2016. "The ecstasy and the agony of the altmetric score," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 977-982, August.
    3. Mike Thelwall, 2017. "Are Mendeley reader counts useful impact indicators in all fields?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1721-1731, December.
    4. Zohreh Zahedi & Rodrigo Costas & Paul Wouters, 2014. "How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1491-1513, November.
    5. Mike Thelwall, 2018. "Early Mendeley readers correlate with later citation counts," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1231-1240, June.
    6. Tim Brody & Stevan Harnad & Leslie Carr, 2006. "Earlier Web usage statistics as predictors of later citation impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(8), pages 1060-1072, June.
    7. Pei-Shan Chi & Juan Gorraiz & Wolfgang Glänzel, 2019. "Comparing capture, usage and citation indicators: an altmetric analysis of journal papers in chemistry disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1461-1473, September.
    8. A. Bookstein, 1997. "Informetric distributions. III. Ambiguity and randomness," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 48(1), pages 2-10, January.
    9. Mike Thelwall, 2012. "Journal impact evaluation: a webometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 429-441, August.
    10. Pei-Shan Chi & Wolfgang Glänzel, 2018. "Comparison of citation and usage indicators in research assessment in scientific disciplines and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 537-554, July.
    11. Rodrigo Costas & Zohreh Zahedi & Paul Wouters, 2015. "Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(10), pages 2003-2019, October.
    12. Juan Gorraiz & Christian Gumpenberger & Christian Schlögl, 2014. "Usage versus citation behaviours in four subject areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1077-1095, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Lin & Sivertsen, Gunnar & Du, Huiying & HUANG, Ying & Glänzel, Wolfgang, 2021. "Gender differences in the aims and impacts of research," SocArXiv 9n347, Center for Open Science.
    2. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    3. Han Zheng & L. G. Pee & Dan Zhang, 2021. "Societal impact of research: a text mining study of impact types," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7397-7417, September.
    4. Zhiqi Wang & Wolfgang Glänzel & Yue Chen, 2020. "The impact of preprints in Library and Information Science: an analysis of citations, usage and social attention indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1403-1423, November.
    5. Steve O’Hern & Nora Estgfaeller, 2020. "A Scientometric Review of Powered Micromobility," Sustainability, MDPI, vol. 12(22), pages 1-21, November.
    6. Qianjin Zong & Zhihong Huang & Jiaru Huang, 2023. "Can open access increase LIS research’s policy impact? Using regression analysis and causal inference," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4825-4854, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    2. Maryam Moshtagh & Tahereh Jowkar & Maryam Yaghtin & Hajar Sotudeh, 2023. "The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: the case of THE and QS vs. Nature Index and Leiden," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 761-781, January.
    3. Zhiqi Wang & Wolfgang Glänzel & Yue Chen, 2020. "The impact of preprints in Library and Information Science: an analysis of citations, usage and social attention indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1403-1423, November.
    4. Mike Thelwall, 2018. "Early Mendeley readers correlate with later citation counts," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1231-1240, June.
    5. Ortega, José Luis, 2018. "The life cycle of altmetric impact: A longitudinal study of six metrics from PlumX," Journal of Informetrics, Elsevier, vol. 12(3), pages 579-589.
    6. Mohammadamin Erfanmanesh & A. Noorhidawati & A. Abrizah, 2019. "What can Bookmetrix tell us about the impact of Springer Nature’s books," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 521-536, October.
    7. Ortega, José Luis, 2020. "Proposal of composed altmetric indicators based on prevalence and impact dimensions," Journal of Informetrics, Elsevier, vol. 14(4).
    8. Thelwall, Mike & Nevill, Tamara, 2018. "Could scientists use Altmetric.com scores to predict longer term citation counts?," Journal of Informetrics, Elsevier, vol. 12(1), pages 237-248.
    9. Metwaly Ali Mohamed Eldakar, 2019. "Who reads international Egyptian academic articles? An altmetrics analysis of Mendeley readership categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 105-135, October.
    10. Barbara McGillivray & Mathias Astell, 2019. "The relationship between usage and citations in an open access mega-journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 817-838, November.
    11. Sebastian Vogl & Thomas Scherndl & Anton Kühberger, 2018. "#Psychology: a bibliometric analysis of psychological literature in the online media," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1253-1269, June.
    12. Muhammad Salman Khan & Muhammad Younas, 2017. "Analyzing readers behavior in downloading articles from IEEE digital library: a study of two selected journals in the field of education," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1523-1537, March.
    13. Xianwen Wang & Zhichao Fang & Xiaoling Sun, 2016. "Usage patterns of scholarly articles on Web of Science: a study on Web of Science usage count," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 917-926, November.
    14. Wang, Zhiqi & Chen, Yue & Glänzel, Wolfgang, 2020. "Preprints as accelerator of scholarly communication: An empirical analysis in Mathematics," Journal of Informetrics, Elsevier, vol. 14(4).
    15. Rafael Repiso & Antonio Castillo-Esparcia & Daniel Torres-Salinas, 2019. "Altmetrics, alternative indicators for Web of Science Communication studies journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 941-958, May.
    16. Kaltrina Nuredini, 2021. "Investigating Altmetric Information For The Top 1000 Journals From Handelsblatt Ranking In Economic And Business Studies," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1315-1343, December.
    17. Thelwall, Mike, 2018. "Do females create higher impact research? Scopus citations and Mendeley readers for articles from five countries," Journal of Informetrics, Elsevier, vol. 12(4), pages 1031-1041.
    18. Latefa Ali Dardas & Malik Sallam & Amanda Woodward & Nadia Sweis & Narjes Sweis & Faleh A. Sawair, 2023. "Evaluating Research Impact Based on Semantic Scholar Highly Influential Citations, Total Citations, and Altmetric Attention Scores: The Quest for Refined Measures Remains Illusive," Publications, MDPI, vol. 11(1), pages 1-16, January.
    19. Anthony Breitzman, 2021. "The relationship between web usage and citation statistics for electronics and information technology articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2085-2105, March.
    20. Saeed-Ul Hassan & Mubashir Imran & Uzair Gillani & Naif Radi Aljohani & Timothy D. Bowman & Fereshteh Didegah, 2017. "Measuring social media activity of scientific literature: an exhaustive comparison of scopus and novel altmetrics big data," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1037-1057, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:125:y:2020:i:2:d:10.1007_s11192-020-03473-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.