IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v115y2018i2d10.1007_s11192-018-2678-x.html
   My bibliography  Save this article

Do traditional scientometric indicators predict social media activity on scientific knowledge? An analysis of the ecological literature

Author

Listed:
  • João Carlos Nabout

    (Universidade Estadual de Goiás, Campus de Ciências Exatas e Tecnológicas (CCET))

  • Fabrício Barreto Teresa

    (Universidade Estadual de Goiás, Campus de Ciências Exatas e Tecnológicas (CCET))

  • Karine Borges Machado

    (Universidade Federal de Goiás, Campus II UFG)

  • Vitor Hugo Mendonça Prado

    (Universidade Estadual de Goiás, Campus de Ciências Exatas e Tecnológicas (CCET))

  • Luis Mauricio Bini

    (Universidade Federal de Goiás, Campus II UFG)

  • José Alexandre Felizola Diniz-Filho

    (Universidade Federal de Goiás, Campus II UFG)

Abstract

Traditional citation-based indicators and activities on Online Social Media Platforms (OnSMP; e.g. Twitter) have been used to assess the impact of scientific research. However, the association between traditional indicators (i.e., number of citations and journal impact factor) and the new OnSMP metrics still deserve further investigations. Here, we used multivariate models to evaluate the relative influence of collaboration, time since publication and traditional indicators on the interest of 2863 papers published in five ecological journals from 2013 to 2015 as given by nine OnSMP. We found that most activities were concentrated on Twitter and Mendeley and that activities in these two OnSMP are highly correlated. Our results indicate that traditional indicators explained most of the variation in OnSMP activity. Considering that OnSMP activities are high as soon as the articles are made available online, contrasting with the slow pace in which the citations are accumulated, our results support the use of activities on OnSMP as an early signal of research impact of ecological articles.

Suggested Citation

  • João Carlos Nabout & Fabrício Barreto Teresa & Karine Borges Machado & Vitor Hugo Mendonça Prado & Luis Mauricio Bini & José Alexandre Felizola Diniz-Filho, 2018. "Do traditional scientometric indicators predict social media activity on scientific knowledge? An analysis of the ecological literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1007-1015, May.
    • Handle: RePEc:spr:scient:v:115:y:2018:i:2:d:10.1007_s11192-018-2678-x
    DOI: 10.1007/s11192-018-2678-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-018-2678-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-018-2678-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bruce G Charlton & Peter Andras, 2007. "Evaluating universities using simple scientometric research-output metrics: Total citation counts per university for a retrospective seven-year rolling sample," Science and Public Policy, Oxford University Press, vol. 34(8), pages 555-563, October.
    2. André Andrian Padial & João Carlos Nabout & Tadeu Siqueira & Luis Mauricio Bini & José Alexandre Felizola Diniz-Filho, 2010. "Weak evidence for determinants of citation frequency in ecological articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 1-12, October.
    3. Zeileis, Achim & Kleiber, Christian & Jackman, Simon, 2008. "Regression Models for Count Data in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i08).
    4. Lutz Bornmann, 2013. "What is societal impact of research and how can it be assessed? a literature survey," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 217-233, February.
    5. Diniz-Filho, José Alexandre F. & Fioravanti, Maria Clorinda S. & Bini, Luis Mauricio & Rangel, Thiago Fernando, 2016. "Drivers of academic performance in a Brazilian university under a government-restructuring program," Journal of Informetrics, Elsevier, vol. 10(1), pages 151-161.
    6. Mark William Neff & Elizabeth A. Corley, 2009. "35 years and 160,000 articles: A bibliometric exploration of the evolution of ecology," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(3), pages 657-682, September.
    7. Saeed-Ul Hassan & Mubashir Imran & Uzair Gillani & Naif Radi Aljohani & Timothy D. Bowman & Fereshteh Didegah, 2017. "Measuring social media activity of scientific literature: an exhaustive comparison of scopus and novel altmetrics big data," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1037-1057, November.
    8. Micael Rosa Parreira & Karine Borges Machado & Ramiro Logares & José Alexandre Felizola Diniz-Filho & João Carlos Nabout, 2017. "The roles of geographic distance and socioeconomic factors on international collaboration among ecologists," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1539-1550, December.
    9. Heather Piwowar, 2013. "Value all research products," Nature, Nature, vol. 493(7431), pages 159-159, January.
    10. D. Shiffman, 2012. "Twitter as a tool for conservation education and outreach: what scientific conferences can do to promote live-tweeting," Journal of Environmental Studies and Sciences, Springer;Association of Environmental Studies and Sciences, vol. 2(3), pages 257-262, September.
    11. Lutz Bornmann & Werner Marx, 2014. "How should the societal impact of research be generated and measured? A proposal for a simple and practicable approach to allow interdisciplinary comparisons," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 211-219, January.
    12. Jochen Krauss, 2007. "Journal self-citation rates in ecological sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(1), pages 79-89, October.
    13. Bornmann, Lutz, 2014. "Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime," Journal of Informetrics, Elsevier, vol. 8(4), pages 935-950.
    14. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    15. Hendrik P. Van Dalen & Kène Henkens, 2001. "What makes a scientific article influential? The case of demographers," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(3), pages 455-482, March.
    16. Kuku Joseph Aduku & Mike Thelwall & Kayvan Kousha, 2017. "Do Mendeley reader counts reflect the scholarly impact of conference papers? An investigation of computer science and engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 573-581, July.
    17. João Carlos Nabout & Micael Rosa Parreira & Fabrício Barreto Teresa & Fernanda Melo Carneiro & Hélida Ferreira Cunha & Luciana Souza Ondei & Samantha Salomão Caramori & Thannya Nascimento Soares, 2015. "Publish (in a group) or perish (alone): the trend from single- to multi-authorship in biological papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 357-364, January.
    18. Lutz Bornmann, 2015. "Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 1123-1144, June.
    19. Ehsan Mohammadi & Mike Thelwall & Stefanie Haustein & Vincent Larivière, 2015. "Who reads research articles? An altmetrics analysis of Mendeley user categories," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(9), pages 1832-1846, September.
    20. Rodrigo Costas & Zohreh Zahedi & Paul Wouters, 2015. "Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(10), pages 2003-2019, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jianhua Hou & Jiantao Ye, 2020. "Are uncited papers necessarily all nonimpact papers? A quantitative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1631-1662, August.
    2. Zhou Chunlei & Kong Xiangyi & Lin Zhipeng, 2019. "Research on Derek John de Solla Price Medal Prediction Based on Academic Credit Analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 159-175, January.
    3. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).
    4. Balázs Győrffy & Andrea Magda Nagy & Péter Herman & Ádám Török, 2018. "Factors influencing the scientific performance of Momentum grant holders: an evaluation of the first 117 research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 409-426, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hou, Jianhua & Yang, Xiucai, 2020. "Social media-based sleeping beauties: Defining, identifying and features," Journal of Informetrics, Elsevier, vol. 14(2).
    2. Jianhua Hou & Xiucai Yang & Yang Zhang, 2023. "The effect of social media knowledge cascade: an analysis of scientific papers diffusion," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 5169-5195, September.
    3. Maryam Moshtagh & Tahereh Jowkar & Maryam Yaghtin & Hajar Sotudeh, 2023. "The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: the case of THE and QS vs. Nature Index and Leiden," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 761-781, January.
    4. Mojisola Erdt & Aarthy Nagarajan & Sei-Ching Joanna Sin & Yin-Leng Theng, 2016. "Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1117-1166, November.
    5. Ying Guo & Xiantao Xiao, 2022. "Author-level altmetrics for the evaluation of Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 973-990, February.
    6. Yaxue Ma & Zhichao Ba & Yuxiang Zhao & Jin Mao & Gang Li, 2021. "Understanding and predicting the dissemination of scientific papers on social media: a two-step simultaneous equation modeling–artificial neural network approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(8), pages 7051-7085, August.
    7. Chaocheng He & Jiang Wu & Qingpeng Zhang, 2021. "Characterizing research leadership on geographically weighted collaboration network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4005-4037, May.
    8. Ortega, José Luis, 2018. "The life cycle of altmetric impact: A longitudinal study of six metrics from PlumX," Journal of Informetrics, Elsevier, vol. 12(3), pages 579-589.
    9. Liwei Zhang & Jue Wang, 2021. "What affects publications’ popularity on Twitter?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9185-9198, November.
    10. Bornmann, Lutz & Haunschild, Robin & Adams, Jonathan, 2019. "Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)," Journal of Informetrics, Elsevier, vol. 13(1), pages 325-340.
    11. Kaltrina Nuredini, 2021. "Investigating Altmetric Information For The Top 1000 Journals From Handelsblatt Ranking In Economic And Business Studies," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1315-1343, December.
    12. Xuan Zhen Liu & Hui Fang, 2017. "What we can learn from tweets linking to research papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 349-369, April.
    13. Feiheng Luo & Aixin Sun & Mojisola Erdt & Aravind Sesagiri Raamkumar & Yin-Leng Theng, 2018. "Exploring prestigious citations sourced from top universities in bibliometrics and altmetrics: a case study in the computer science discipline," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 1-17, January.
    14. D’Este, Pablo & Robinson-García, Nicolás, 2023. "Interdisciplinary research and the societal visibility of science: The advantages of spanning multiple and distant scientific fields," Research Policy, Elsevier, vol. 52(2).
    15. António Correia & Hugo Paredes & Benjamim Fonseca, 2018. "Scientometric analysis of scientific publications in CSCW," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 31-89, January.
    16. Zhichao Fang & Rodrigo Costas & Wencan Tian & Xianwen Wang & Paul Wouters, 2020. "An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2519-2549, September.
    17. Jianhua Hou & Bili Zheng & Yang Zhang & Chaomei Chen, 2021. "How do Price medalists’ scholarly impact change before and after their awards?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5945-5981, July.
    18. Liwei Zhang & Jue Wang, 2018. "Why highly cited articles are not highly tweeted? A biology case," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 495-509, October.
    19. Michael Taylor, 2020. "An altmetric attention advantage for open access books in the humanities and social sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2523-2543, December.
    20. Saeed-Ul Hassan & Sehrish Iqbal & Naif R. Aljohani & Salem Alelyani & Alesia Zuccala, 2020. "Introducing the ‘alt-index’ for measuring the social visibility of scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1407-1419, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:115:y:2018:i:2:d:10.1007_s11192-018-2678-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.