IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i8d10.1007_s11192-022-04456-w.html
   My bibliography  Save this article

Exploring the relationships between altmetric counts and citations of papers in different academic fields based on co-occurrence analysis

Author

Listed:
  • Chieh Liu

    (Atomic Energy Council
    National Taiwan University)

  • Mu-Hsuan Huang

    (National Taiwan University)

Abstract

Altmetrics is an emerging method for observing academic communication. Many researchers have explored the relationships between altmetric counts and citations through correlation analysis, but there is no consistent result. The varied results may come from the divergence of data sources, disciplinary differences, and the characteristics of data distribution. To reduce the influence of the interfering factors above, the Co-occurrence analysis was proposed in this study as the method to explore the relationships between citations and altmetric counts. We observe the overlap between the highly-cited papers and the high altmetric count papers, alongside with the coverage of each collection from various altmetric sources in different academic fields. The results show that Mendeley has the highest correlation with citations among all the altmetric sources in the five academic fields, and might be the only one having the opportunity to be an indicator for academic evaluation. The other altmetric counts from different sources do not show strong relationships with citations in general.

Suggested Citation

  • Chieh Liu & Mu-Hsuan Huang, 2022. "Exploring the relationships between altmetric counts and citations of papers in different academic fields based on co-occurrence analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4939-4958, August.
    • Handle: RePEc:spr:scient:v:127:y:2022:i:8:d:10.1007_s11192-022-04456-w
    DOI: 10.1007/s11192-022-04456-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-022-04456-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-022-04456-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Bornmann, Lutz & Haunschild, Robin & Adams, Jonathan, 2019. "Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)," Journal of Informetrics, Elsevier, vol. 13(1), pages 325-340.
    2. Mike Thelwall & Paul Wilson, 2016. "Mendeley readership altmetrics for medical articles: An analysis of 45 fields," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(8), pages 1962-1972, August.
    3. Fereshteh Didegah & Timothy D. Bowman & Kim Holmberg, 2018. "On the differences between citations and altmetrics: An investigation of factors driving altmetrics versus citations for finnish articles," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(6), pages 832-843, June.
    4. Cassidy R. Sugimoto & Sam Work & Vincent Larivière & Stefanie Haustein, 2017. "Scholarly use of social media and altmetrics: A review of the literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2037-2062, September.
    5. David Adam, 2002. "The counting house," Nature, Nature, vol. 415(6873), pages 726-729, February.
    6. Harley, Diane & Acord, Sophia Krzys & Earl-Novell, Sarah & Lawrence, Shannon & King, C. Judson, 2010. "Assessing the Future Landscape of Scholarly Communication: An Exploration of Faculty Values and Needs in Seven Disciplines - Executive Summary," University of California at Berkeley, Center for Studies in Higher Education qt0kr8s78v, Center for Studies in Higher Education, UC Berkeley.
    7. Stefanie Haustein & Isabella Peters & Judit Bar-Ilan & Jason Priem & Hadas Shema & Jens Terliesner, 2014. "Coverage and adoption of altmetrics sources in the bibliometric community," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1145-1163, November.
    8. Rafael Repiso & Antonio Castillo-Esparcia & Daniel Torres-Salinas, 2019. "Altmetrics, alternative indicators for Web of Science Communication studies journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 941-958, May.
    9. Zohreh Zahedi & Rodrigo Costas & Paul Wouters, 2014. "How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1491-1513, November.
    10. José Luis Ortega, 2018. "Reliability and accuracy of altmetric providers: a comparison among Altmetric.com, PlumX and Crossref Event Data," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2123-2138, September.
    11. Stefanie Haustein & Isabella Peters & Cassidy R. Sugimoto & Mike Thelwall & Vincent Larivière, 2014. "Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(4), pages 656-669, April.
    12. Kaplan, Andreas M. & Haenlein, Michael, 2010. "Users of the world, unite! The challenges and opportunities of Social Media," Business Horizons, Elsevier, vol. 53(1), pages 59-68, January.
    13. Harley, Diane & Acord, Sophia Krzys & Earl-Novell, Sarah & Lawrence, Shannon & King, C. Judson, 2010. "Assessing the Future Landscape of Scholarly Communication: An Exploration of Faculty Values and Needs in Seven Disciplines," University of California at Berkeley, Center for Studies in Higher Education qt15x7385g, Center for Studies in Higher Education, UC Berkeley.
    14. Björn Hammarfelt, 2014. "Using altmetrics for assessing research impact in the humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1419-1430, November.
    15. Kietzmann, Jan H. & Hermkens, Kristopher & McCarthy, Ian P. & Silvestre, Bruno S., 2011. "Social media? Get serious! Understanding the functional building blocks of social media," Business Horizons, Elsevier, vol. 54(3), pages 241-251, May.
    16. Henry Small, 2004. "On the shoulders of Robert Merton: Towards a normative theory of citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(1), pages 71-79, May.
    17. Bornmann, Lutz, 2014. "Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics," Journal of Informetrics, Elsevier, vol. 8(4), pages 895-903.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcus Goncalves & Esteban De La Vega Ahumada, 2025. "A Bibliometric Analysis of Women Entrepreneurship: Current Trends and Challenges," Merits, MDPI, vol. 5(2), pages 1-32, April.
    2. Hao Peng & Misha Teplitskiy & Daniel M. Romero & Emőke-Ágnes Horvát, 2025. "The gender gap in scholarly self-promotion on social media," Nature Communications, Nature, vol. 16(1), pages 1-12, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    2. Isidro F. Aguillo, 2020. "Altmetrics of the Open Access Institutional Repositories: a webometrics approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1181-1192, June.
    3. Mike Thelwall & Kayvan Kousha & Mahshid Abdoli & Emma Stuart & Meiko Makita & Paul Wilson & Jonathan Levitt, 2023. "Do altmetric scores reflect article quality? Evidence from the UK Research Excellence Framework 2021," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(5), pages 582-593, May.
    4. Lutz Bornmann & Rüdiger Mutz & Robin Haunschild & Felix Moya-Anegon & Mirko Almeida Madeira Clemente & Moritz Stefaner, 2021. "Mapping the impact of papers on various status groups in excellencemapping.net: a new release of the excellence mapping tool based on citation and reader scores," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9305-9331, November.
    5. Ni Cheng & Ke Dong, 2018. "Knowledge communication on social media: a case study of Biomedical Science on Baidu Baike," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1749-1770, September.
    6. Yu Liu & Dan Lin & Xiujuan Xu & Shimin Shan & Quan Z. Sheng, 2018. "Multi-views on Nature Index of Chinese academic institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 823-837, March.
    7. Ou, Guiyan & Zhao, Kang & Zuo, Renxian & Wu, Jiang, 2024. "Effects of research funding on the academic impact and societal visibility of scientific research," Journal of Informetrics, Elsevier, vol. 18(4).
    8. repec:plo:pone00:0242550 is not listed on IDEAS
    9. Liwei Zhang & Jue Wang, 2021. "What affects publications’ popularity on Twitter?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9185-9198, November.
    10. Bornmann, Lutz & Haunschild, Robin & Adams, Jonathan, 2019. "Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)," Journal of Informetrics, Elsevier, vol. 13(1), pages 325-340.
    11. Amalia Mas-Bleda & Mike Thelwall, 2016. "Can alternative indicators overcome language biases in citation counts? A comparison of Spanish and UK research," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2007-2030, December.
    12. Maryam Moshtagh & Tahereh Jowkar & Maryam Yaghtin & Hajar Sotudeh, 2023. "The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: the case of THE and QS vs. Nature Index and Leiden," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 761-781, January.
    13. Jianhua Hou & Jiantao Ye, 2020. "Are uncited papers necessarily all nonimpact papers? A quantitative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1631-1662, August.
    14. Solanki Gupta & Vivek Kumar Singh & Sumit Kumar Banshal, 2024. "Altmetric data quality analysis using Benford’s law," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4597-4621, July.
    15. Saeed-Ul Hassan & Timothy D. Bowman & Mudassir Shabbir & Aqsa Akhtar & Mubashir Imran & Naif Radi Aljohani, 2019. "Influential tweeters in relation to highly cited articles in altmetric big data," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 481-493, April.
    16. Li, Hao & Hou, Jianhua, 2024. "Revalidation of the applicability of Altmetrics indicators in article-level evaluation: An empirical analysis of papers of different types of citation trajectories," Journal of Informetrics, Elsevier, vol. 18(4).
    17. González-Betancor, Sara M. & Dorta-González, Pablo, 2023. "Does society show differential attention to researchers based on gender and field?," Journal of Informetrics, Elsevier, vol. 17(4).
    18. Jianhua Hou & Da Ma, 2020. "How the high-impact papers formed? A study using data from social media and citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2597-2615, December.
    19. Banshal, Sumit Kumar & Gupta, Solanki & Lathabai, Hiran H & Singh, Vivek Kumar, 2022. "Power Laws in altmetrics: An empirical analysis," Journal of Informetrics, Elsevier, vol. 16(3).
    20. Daniel Torres-Salinas & Domingo Docampo & Wenceslao Arroyo-Machado & Nicolas Robinson-Garcia, 2024. "The many publics of science: using altmetrics to identify common communication channels by scientific field," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 3705-3723, July.
    21. Lutz Bornmann, 2015. "Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 1123-1144, June.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:8:d:10.1007_s11192-022-04456-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.