IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0134389.html
   My bibliography  Save this article

I Like, I Cite? Do Facebook Likes Predict the Impact of Scientific Work?

Author

Listed:
  • Stefanie Ringelhan
  • Jutta Wollersheim
  • Isabell M Welpe

Abstract

Due to the increasing amount of scientific work and the typical delays in publication, promptly assessing the impact of scholarly work is a huge challenge. To meet this challenge, one solution may be to create and discover innovative indicators. The goal of this paper is to investigate whether Facebook likes for unpublished manuscripts that are uploaded to the Internet could be used as an early indicator of the future impact of the scientific work. To address our research question, we compared Facebook likes for manuscripts uploaded to the Harvard Business School website (Study 1) and the bioRxiv website (Study 2) with traditional impact indicators (journal article citations, Impact Factor, Immediacy Index) for those manuscripts that have been published as a journal article. Although based on our full sample of Study 1 (N = 170), Facebook likes do not predict traditional impact indicators, for manuscripts with one or more Facebook likes (n = 95), our results indicate that the more Facebook likes a manuscript receives, the more journal article citations the manuscript receives. In additional analyses (for which we categorized the manuscripts as psychological and non-psychological manuscripts), we found that the significant prediction of citations stems from the psychological and not the non-psychological manuscripts. In Study 2, we observed that Facebook likes (N = 270) and non-zero Facebook likes (n = 84) do not predict traditional impact indicators. Taken together, our findings indicate an interdisciplinary difference in the predictive value of Facebook likes, according to which Facebook likes only predict citations in the psychological area but not in the non-psychological area of business or in the field of life sciences. Our paper contributes to understanding the possibilities and limits of the use of social media indicators as potential early indicators of the impact of scientific work.

Suggested Citation

  • Stefanie Ringelhan & Jutta Wollersheim & Isabell M Welpe, 2015. "I Like, I Cite? Do Facebook Likes Predict the Impact of Scientific Work?," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-21, August.
    • Handle: RePEc:plo:pone00:0134389
    DOI: 10.1371/journal.pone.0134389
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0134389
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0134389&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0134389?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Carlos B. Amat, 2008. "Editorial and publication delay of papers submitted to 14 selected Food Research journals. Influence of online posting," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(3), pages 379-389, March.
    2. M. H. MacRoberts & B. R. MacRoberts, 1987. "Another test of the normative theory of citing," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 38(4), pages 305-306, July.
    3. Goodall, Amanda H., 2009. "Highly cited leaders and the performance of research universities," Research Policy, Elsevier, vol. 38(7), pages 1079-1092, September.
    4. R. G. Raj & A. N. Zainab, 2012. "Relative measure index: a metric to measure the quality of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 305-317, November.
    5. Tai‐Quan Peng & Jonathan J.H. Zhu, 2012. "Where you publish matters most: A multilevel analysis of factors affecting citations of internet studies," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(9), pages 1789-1803, September.
    6. Cameron Neylon & Shirley Wu, 2009. "Article-Level Metrics and the Evolution of Scientific Impact," PLOS Biology, Public Library of Science, vol. 7(11), pages 1-6, November.
    7. Amin Mazloumian & Young-Ho Eom & Dirk Helbing & Sergi Lozano & Santo Fortunato, 2011. "How Citation Boosts Promote Scientific Paradigm Shifts and Nobel Prizes," PLOS ONE, Public Library of Science, vol. 6(5), pages 1-6, May.
    8. Dirk Helbing, 2013. "Globally networked risks and how to respond," Nature, Nature, vol. 497(7447), pages 51-59, May.
    9. Amin Mazloumian, 2012. "Predicting Scholars' Scientific Impact," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-5, November.
    10. Tai-Quan Peng & Jonathan J.H. Zhu, 2012. "Where you publish matters most: A multilevel analysis of factors affecting citations of internet studies," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(9), pages 1789-1803, September.
    11. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    12. Hadas Shema & Judit Bar-Ilan & Mike Thelwall, 2014. "Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(5), pages 1018-1027, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Akella, Akhil Pandey & Alhoori, Hamed & Kondamudi, Pavan Ravikanth & Freeman, Cole & Zhou, Haiming, 2021. "Early indicators of scientific impact: Predicting citations with altmetrics," Journal of Informetrics, Elsevier, vol. 15(2).
    2. Houqiang Yu & Yue Wang & Shah Hussain & Haoyang Song, 2023. "Towards a better understanding of Facebook Altmetrics in LIS field: assessing the characteristics of involved paper, user and post," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 3147-3170, May.
    3. Saeed-Ul Hassan & Mubashir Imran & Uzair Gillani & Naif Radi Aljohani & Timothy D. Bowman & Fereshteh Didegah, 2017. "Measuring social media activity of scientific literature: an exhaustive comparison of scopus and novel altmetrics big data," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1037-1057, November.
    4. Laura Graf & Wiebke S. Wendler & Jutta Stumpf-Wollersheim & Isabell M. Welpe, 2019. "Wanting More, Getting Less: Gaming Performance Measurement as a Form of Deviant Workplace Behavior," Journal of Business Ethics, Springer, vol. 157(3), pages 753-773, July.
    5. Mojisola Erdt & Aarthy Nagarajan & Sei-Ching Joanna Sin & Yin-Leng Theng, 2016. "Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1117-1166, November.
    6. Ortega, José Luis, 2021. "How do media mention research papers? Structural analysis of blogs and news networks using citation coupling," Journal of Informetrics, Elsevier, vol. 15(3).
    7. Josué Gutiérrez-Barroso & Alberto Javier Báez-García & Francisco Flores-Muñoz, 2019. "Emerging Practices in Facebook at National Parks," Scientific Annals of Economics and Business (continues Analele Stiintifice), Alexandru Ioan Cuza University, Faculty of Economics and Business Administration, vol. 66(4), pages 573-595, December.
    8. Min Chung Han, 2021. "Thumbs down on “likes”? The impact of Facebook reactions on online consumers’ nonprofit engagement behavior," International Review on Public and Nonprofit Marketing, Springer;International Association of Public and Non-Profit Marketing, vol. 18(2), pages 255-272, June.
    9. Mingyang Wang & Zhenyu Wang & Guangsheng Chen, 2019. "Which can better predict the future success of articles? Bibliometric indices or alternative metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1575-1595, June.
    10. Bornmann, Lutz & Haunschild, Robin & Adams, Jonathan, 2019. "Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)," Journal of Informetrics, Elsevier, vol. 13(1), pages 325-340.
    11. Thomy Tonia & Herman Van Oyen & Anke Berger & Christian Schindler & Nino Künzli, 2016. "If I tweet will you cite? The effect of social media exposure of articles on downloads and citations," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 61(4), pages 513-520, May.
    12. Xi Zhang & Xianhai Wang & Hongke Zhao & Patricia Ordóñez de Pablos & Yongqiang Sun & Hui Xiong, 2019. "An effectiveness analysis of altmetrics indices for different levels of artificial intelligence publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1311-1344, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mike Thelwall & Paul Wilson, 2016. "Does research with statistics have more impact? The citation rank advantage of structural equation modeling," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(5), pages 1233-1244, May.
    2. A. V. Chumachenko & B. G. Kreminskyi & Iu. L. Mosenkis & A. I. Yakimenko, 2020. "Dynamics of topic formation and quantitative analysis of hot trends in physical science," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 739-753, October.
    3. Daniela De Filippo & Fernanda Morillo & Borja González-Albo, 2023. "Measuring the Impact and Influence of Scientific Activity in the Humanities and Social Sciences," Publications, MDPI, vol. 11(2), pages 1-17, June.
    4. Basma Albanna & Julia Handl & Richard Heeks, 2021. "Publication outperformance among global South researchers: An analysis of individual-level and publication-level predictors of positive deviance," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8375-8431, October.
    5. Xianwen Wang & Zhichao Fang & Xiaoling Sun, 2016. "Usage patterns of scholarly articles on Web of Science: a study on Web of Science usage count," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 917-926, November.
    6. Vanclay, Jerome K., 2013. "Factors affecting citation rates in environmental science," Journal of Informetrics, Elsevier, vol. 7(2), pages 265-271.
    7. Bornmann, Lutz, 2014. "Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics," Journal of Informetrics, Elsevier, vol. 8(4), pages 895-903.
    8. Lipeng Fan & Yuefen Wang & Shengchun Ding & Binbin Qi, 2020. "Productivity trends and citation impact of different institutional collaboration patterns at the research units’ level," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1179-1196, November.
    9. Martorell Cunil, Onofre & Otero González, Luis & Durán Santomil, Pablo & Mulet Forteza, Carlos, 2023. "How to accomplish a highly cited paper in the tourism, leisure and hospitality field," Journal of Business Research, Elsevier, vol. 157(C).
    10. Ortega, José Luis, 2020. "Proposal of composed altmetric indicators based on prevalence and impact dimensions," Journal of Informetrics, Elsevier, vol. 14(4).
    11. Yezhu Wang & Yundong Xie & Dong Wang & Lu Guo & Rongting Zhou, 2022. "Do cover papers get better citations and usage counts? An analysis of 42 journals in cell biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3793-3813, July.
    12. Danielle H. Lee, 2019. "Predictive power of conference-related factors on citation rates of conference papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 281-304, January.
    13. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    14. Fan, Lingxu & Guo, Lei & Wang, Xinhua & Xu, Liancheng & Liu, Fangai, 2022. "Does the author’s collaboration mode lead to papers’ different citation impacts? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 16(4).
    15. Daniela Filippo & Pablo Sastrón-Toledo, 2023. "Influence of research on open science in the public policy sphere," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1995-2017, March.
    16. Yu-Wei Chang, 2021. "Characteristics of high research performance authors in the field of library and information science and those of their articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3373-3391, April.
    17. Liwei Zhang & Jue Wang, 2018. "Why highly cited articles are not highly tweeted? A biology case," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 495-509, October.
    18. Tai Quan Peng & Zhen-Zhen Wang, 2013. "Network closure, brokerage, and structural influence of journals: a longitudinal study of journal citation network in Internet research (2000–2010)," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 675-693, December.
    19. Ke, Qing, 2020. "The citation disadvantage of clinical research," Journal of Informetrics, Elsevier, vol. 14(1).
    20. Max Leckert, 2021. "(E-) Valuative Metrics as a Contested Field: A Comparative Analysis of the Altmetrics- and the Leiden Manifesto," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9869-9903, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0134389. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.