IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i3d10.1007_s11192-021-04258-6.html
   My bibliography  Save this article

Academic social networks metrics: an effective indicator for university performance?

Author

Listed:
  • Łukasz Wiechetek

    (Maria Curie-Sklodowska-University)

  • Zbigniew Pastuszak

    (Maria Curie-Sklodowska-University)

Abstract

Social networks have become popular among researchers and scientists. Specialized platforms for researchers offer many metrics and indicators which are used to evaluate various scientists and assess the strength of their impact. In this article the authors perform systematic comparison between the main university level ResearchGate (RG) metrics: total RG Score, number of publications, number of affiliated profiles and ARWU. A tool for acquiring the RG metrics of research units and a framework for calculating alternative university ranks was implemented and tested. As a point of reference the ranking system of the Academic Ranking of World Universities (ARWU, 2019) was used. The authors used a web scraping technique to acquire data. Data analysis was based on Spearman's rho and multiple linear regression (MLR). Ten additional ranks were developed and compared with the benchmark ranking. The k-means clustering method was used to identify the groups of ARWU universities. The research results show that the metrics provided by specialized social networks can be used for the assessment of universities, however, an in-depth evaluation requires a more advanced procedure and indicators to measure many areas of scholarly activity like research, integration, application, teaching, and co-creation. Clustering method showed also that the distance between the ARWU universities measured in values of RG metrics are bigger for the top of the ranking. The university authorities should encourage researchers to use specialized social networks, and train them how to do it, to promote not only their own achievements, but also to increase the impact and recognition of their respective research units. At the end of the article some limitations of the method used and some practical recommendations for the university authorities were formulated.

Suggested Citation

  • Łukasz Wiechetek & Zbigniew Pastuszak, 2022. "Academic social networks metrics: an effective indicator for university performance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1381-1401, March.
  • Handle: RePEc:spr:scient:v:127:y:2022:i:3:d:10.1007_s11192-021-04258-6
    DOI: 10.1007/s11192-021-04258-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-021-04258-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-021-04258-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hamid R. Jamali, 2017. "Copyright compliance and infringement in ResearchGate full-text journal articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 241-254, July.
    2. Christian Pieter Hoffmann & Christoph Lutz & Miriam Meckel, 2016. "A relational altmetric? Network centrality on ResearchGate as an indicator of scientific impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(4), pages 765-775, April.
    3. Ellen Hazelkorn, 2009. "Rankings and the battle for world-class excellence: Institutional strategies and policy choices," Higher Education Management and Policy, OECD Publishing, vol. 21(1), pages 1-22.
    4. Christian Gumpenberger & Wolfgang Glänzel & Juan Gorraiz, 2016. "The ecstasy and the agony of the altmetric score," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 977-982, August.
    5. Cassidy R. Sugimoto & Sam Work & Vincent Larivière & Stefanie Haustein, 2017. "Scholarly use of social media and altmetrics: A review of the literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2037-2062, September.
    6. Yan, Weiwei & Zhang, Yin, 2018. "Research universities on the ResearchGate social networking site: An examination of institutional differences, research activity level, and social networks formed," Journal of Informetrics, Elsevier, vol. 12(1), pages 385-400.
    7. Ortega, José Luis, 2015. "Relationship between altmetric and bibliometric indicators across academic social sites: The case of CSIC's members," Journal of Informetrics, Elsevier, vol. 9(1), pages 39-49.
    8. Hamid R. Jamali & David Nicholas & Eti Herman, 2016. "Scholarly reputation in the digital age and the role of emerging platforms and mechanisms," Research Evaluation, Oxford University Press, vol. 25(1), pages 37-49.
    9. Shannon Mason, 2020. "Adoption and usage of Academic Social Networks: a Japan case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1751-1767, March.
    10. Mike Thelwall & Kayvan Kousha, 2017. "ResearchGate articles: Age, discipline, audience size, and impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(2), pages 468-479, February.
    11. Enrique Orduna-Malea & Alberto Martín-Martín & Mike Thelwall & Emilio Delgado López-Cózar, 2017. "Do ResearchGate Scores create ghost academic reputations?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 443-460, July.
    12. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    13. Barbara McGillivray & Mathias Astell, 2019. "The relationship between usage and citations in an open access mega-journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 817-838, November.
    14. Mike Thelwall & Kayvan Kousha, 2015. "ResearchGate: Disseminating, communicating, and measuring Scholarship?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(5), pages 876-889, May.
    15. Sergio Copiello, 2019. "Research Interest: another undisclosed (and redundant) algorithm by ResearchGate," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 351-360, July.
    16. Sergio Copiello & Pietro Bonifaci, 2019. "ResearchGate Score, full-text research items, and full-text reads: a follow-up study," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1255-1262, May.
    17. Lepori, Benedetto & Thelwall, Michael & Hoorani, Bareerah Hafeez, 2018. "Which US and European Higher Education Institutions are visible in ResearchGate and what affects their RG score?," Journal of Informetrics, Elsevier, vol. 12(3), pages 806-818.
    18. Mojisola Erdt & Aarthy Nagarajan & Sei-Ching Joanna Sin & Yin-Leng Theng, 2016. "Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1117-1166, November.
    19. Richard Van Noorden, 2014. "Online collaboration: Scientists and the social network," Nature, Nature, vol. 512(7513), pages 126-129, August.
    20. Sergio Copiello & Pietro Bonifaci, 2018. "A few remarks on ResearchGate score and academic reputation," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 301-306, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sergio Copiello, 2019. "Research Interest: another undisclosed (and redundant) algorithm by ResearchGate," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 351-360, July.
    2. Sergio Copiello & Pietro Bonifaci, 2019. "ResearchGate Score, full-text research items, and full-text reads: a follow-up study," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1255-1262, May.
    3. Sergio Copiello & Pietro Bonifaci, 2018. "A few remarks on ResearchGate score and academic reputation," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 301-306, January.
    4. Vivek Kumar Singh & Satya Swarup Srichandan & Hiran H. Lathabai, 2022. "ResearchGate and Google Scholar: how much do they differ in publications, citations and different metrics and why?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1515-1542, March.
    5. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    6. Shannon Mason & Yusuke Sakurai, 2021. "A ResearchGate-way to an international academic community?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1149-1171, February.
    7. Lepori, Benedetto & Thelwall, Michael & Hoorani, Bareerah Hafeez, 2018. "Which US and European Higher Education Institutions are visible in ResearchGate and what affects their RG score?," Journal of Informetrics, Elsevier, vol. 12(3), pages 806-818.
    8. Weiwei Yan & Xin Wen & Yin Zhang & Sonali Kudva & Qian Liu, 2023. "The dynamics of Q&A in academic social networking sites: insights from participants, interaction network, response time, and discipline differences," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1895-1922, March.
    9. Weiwei Yan & Yin Zhang & Wendy Bromfield, 2018. "Analyzing the follower–followee ratio to determine user characteristics and institutional participation differences among research universities on ResearchGate," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 299-316, April.
    10. Daniela De Filippo & Fernanda Morillo & Borja González-Albo, 2023. "Measuring the Impact and Influence of Scientific Activity in the Humanities and Social Sciences," Publications, MDPI, vol. 11(2), pages 1-17, June.
    11. Yan, Weiwei & Zhang, Yin, 2018. "Research universities on the ResearchGate social networking site: An examination of institutional differences, research activity level, and social networks formed," Journal of Informetrics, Elsevier, vol. 12(1), pages 385-400.
    12. Martín-Martín, Alberto & Orduna-Malea, Enrique & Delgado López-Cózar, Emilio, 2018. "Author-level metrics in the new academic profile platforms: The online behaviour of the Bibliometrics community," Journal of Informetrics, Elsevier, vol. 12(2), pages 494-509.
    13. Sergio Copiello, 2020. "Multi-criteria altmetric scores are likely to be redundant with respect to a subset of the underlying information," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 819-824, July.
    14. Weiwei Yan & Qian Liu & Ruoyu Chen & Shengwei Yi, 2020. "Social networks formed by follower–followee relationships on academic social networking sites: an examination of corporation users," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2083-2101, September.
    15. Juliana E. Raffaghelli & Stefania Manca, 2019. "Is There a Social Life in Open Data? The Case of Open Data Practices in Educational Technology Research," Publications, MDPI, vol. 7(1), pages 1-17, January.
    16. Maria Cláudia Cabrini Grácio & Natalia Rodrigues Delbianco & Fábio Sampaio Rosas & Antonio Perianes-Rodríguez, 2023. "Co-follower metric on academic-social media ResearchGate: similarities between Derek de Solla Price Memorial Medal winners," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5545-5569, October.
    17. Shannon Mason, 2020. "Adoption and usage of Academic Social Networks: a Japan case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1751-1767, March.
    18. Vincenzo Corvello & Maria Cristina Chimenti & Carlo Giglio & Saverino Verteramo, 2020. "An Investigation on the Use by Academic Researchers of Knowledge from Scientific Social Networking Sites," Sustainability, MDPI, vol. 12(22), pages 1-16, November.
    19. Enrique Orduna-Malea & Alberto Martín-Martín & Mike Thelwall & Emilio Delgado López-Cózar, 2017. "Do ResearchGate Scores create ghost academic reputations?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 443-460, July.
    20. Yang, Siluo & Zheng, Mengxue & Yu, Yonghao & Wolfram, Dietmar, 2021. "Are Altmetric.com scores effective for research impact evaluation in the social sciences and humanities?," Journal of Informetrics, Elsevier, vol. 15(1).

    More about this item

    Keywords

    ResearchGate; Altmetrics; Web scraping; Academic social network; University rank; University evaluation; Comparison;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:3:d:10.1007_s11192-021-04258-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.