IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i1d10.1007_s11192-023-04871-7.html
   My bibliography  Save this article

How do tweeters feel about scientific misinformation: an infoveillance sentiment analysis of tweets on retraction notices and retracted papers

Author

Listed:
  • Mahsa Amiri

    (Shiraz University)

  • Maryam Yaghtin

    (Islamic World Science Citation Center (ISC))

  • Hajar Sotudeh

    (Shiraz University)

Abstract

The traditional retraction mechanism's failure to eradicate the retracted papers' continued effects urges for more control and monitoring systems to warn against low-quality and flawed papers. To investigate the potential of Twitter in reflecting social attitudes about retracted papers, this study analyzed the sentiments expressed in the tweets about the papers and contrasted them against two benchmarks: the retraction notes and their tweets respectively serving as authorities’ voices and their social resonance. Using a sentiment analysis method, the study examined a collection of Scopus-indexed retracted papers, their retraction notices, and their tweets. The opinions expressed in the texts were mined using the SentiStrength. The findings revealed a high rate of untweetedness for the retracted papers (91.54%) and retraction notes (90.72%). However, the paper tweets mostly contained texts and were not limited to URLs, except for a low percentage (2.78%). While the retraction notices were mostly negative, followed by neutral polarity, the note and paper tweets were dominated by neutrality followed by negativity. Nevertheless, the paper tweets were more negative either in the pre-, or post-retraction phases. Moreover, negative tweets were comparatively more retweeted than positive and neutral polarities. The research findings implied tweet potentials in increasing the visibility of and awareness about low-quality and erroneous papers, even before being disclosed by official authorities, provided that more users are actively involved in the discussions on the platform. The potential can be regarded as a kind of monitoring applied by social users who feel responsible and show sensitivity towards the quality of science, though they may be scarce in number and selectively react to some papers.

Suggested Citation

  • Mahsa Amiri & Maryam Yaghtin & Hajar Sotudeh, 2024. "How do tweeters feel about scientific misinformation: an infoveillance sentiment analysis of tweets on retraction notices and retracted papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 261-287, January.
  • Handle: RePEc:spr:scient:v:129:y:2024:i:1:d:10.1007_s11192-023-04871-7
    DOI: 10.1007/s11192-023-04871-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04871-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-023-04871-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Robin Haunschild & Lutz Bornmann, 2021. "Can tweets be used to detect problems early with scientific papers? A case study of three retracted COVID-19/SARS-CoV-2 papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5181-5199, June.
    2. Mike Thelwall & Kevan Buckley & Georgios Paltoglou, 2011. "Sentiment in Twitter events," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(2), pages 406-418, February.
    3. Robin Haunschild & Lutz Bornmann, 2018. "Field- and time-normalization of data with many zeros: an empirical analysis using citation and Twitter data," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 997-1012, August.
    4. Mike Thelwall & Kevan Buckley, 2013. "Topic-based sentiment analysis for the social web: The role of mood and issue-related words," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(8), pages 1608-1617, August.
    5. Zhichao Fang & Rodrigo Costas & Wencan Tian & Xianwen Wang & Paul Wouters, 2021. "How is science clicked on Twitter? Click metrics for Bitly short links to scientific publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(7), pages 918-932, July.
    6. Kimberley Collins & David Shiffman & Jenny Rock, 2016. "How Are Scientists Using Social Media in the Workplace?," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-10, October.
    7. Lutz Bornmann & Robin Haunschild, 2018. "Allegation of scientific misconduct increases Twitter attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1097-1100, May.
    8. Judit Bar-Ilan & Gali Halevi, 2017. "Post retraction citations in context: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 547-565, October.
    9. Carol Ann Kochan & John M. Budd, 1992. "The persistence of fraud in the literature: The Darsee case," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(7), pages 488-493, August.
    10. Mike Thelwall & Kevan Buckley & Georgios Paltoglou, 2011. "Sentiment in Twitter events," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(2), pages 406-418, February.
    11. Stephan Leitner & Bartosz Gula & Dietmar Jannach & Ulrike Krieg-Holz & Friederike Wall, 2021. "Understanding the dynamics emerging from infodemics: a call to action for interdisciplinary research," SN Business & Economics, Springer, vol. 1(1), pages 1-18, January.
    12. Simon, Tomer & Goldberg, Avishay & Adini, Bruria, 2015. "Socializing in emergencies—A review of the use of social media in emergency situations," International Journal of Information Management, Elsevier, vol. 35(5), pages 609-619.
    13. Mike Thelwall & Stefanie Haustein & Vincent Larivière & Cassidy R Sugimoto, 2013. "Do Altmetrics Work? Twitter and Ten Other Social Web Services," PLOS ONE, Public Library of Science, vol. 8(5), pages 1-7, May.
    14. Wajdi Aljedaani & Eysha Saad & Furqan Rustam & Isabel de la Torre Díez & Imran Ashraf, 2022. "Role of Artificial Intelligence for Analysis of COVID-19 Vaccination-Related Tweets: Opportunities, Challenges, and Future Trends," Mathematics, MDPI, vol. 10(17), pages 1-33, September.
    15. Hadas Shema & Judit Bar-Ilan & Mike Thelwall, 2012. "Research Blogs and the Discussion of Scholarly Information," PLOS ONE, Public Library of Science, vol. 7(5), pages 1-8, May.
    16. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    17. Juan Miguel Campanario, 2000. "Fraud: retracted articles are still being cited," Nature, Nature, vol. 408(6810), pages 288-288, November.
    18. Mike Thelwall & Kevan Buckley, 2013. "Topic‐based sentiment analysis for the social web: The role of mood and issue‐related words," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(8), pages 1608-1617, August.
    19. Bornmann, Lutz & Haunschild, Robin, 2018. "Normalization of zero-inflated data: An empirical analysis of a new indicator family and its use with altmetrics data," Journal of Informetrics, Elsevier, vol. 12(3), pages 998-1011.
    20. Kate Kahle & Aviv J Sharon & Ayelet Baram-Tsabari, 2016. "Footprints of Fascination: Digital Traces of Public Engagement with Particle Physics on CERN's Social Media Platforms," PLOS ONE, Public Library of Science, vol. 11(5), pages 1-22, May.
    21. Marina Paolanti & Adriano Mancini & Emanuele Frontoni & Andrea Felicetti & Luca Marinelli & Ernesto Marcheggiani & Roberto Pierdicca, 2021. "Tourism destination management using sentiment analysis and geo-location information: a deep learning approach," Information Technology & Tourism, Springer, vol. 23(2), pages 241-264, June.
    22. Serena Y. Kim & Koushik Ganesan & Princess Dickens & Soumya Panda, 2021. "Public Sentiment toward Solar Energy—Opinion Mining of Twitter Using a Transformer-Based Language Model," Sustainability, MDPI, vol. 13(5), pages 1-19, March.
    23. Shaoxiong (Brian) Xu & Guangwei Hu, 2018. "Retraction Notices: Who Authored Them?," Publications, MDPI, vol. 6(1), pages 1-18, January.
    24. Wang, Yuxi & McKee, Martin & Torbica, Aleksandra & Stuckler, David, 2019. "Systematic Literature Review on the Spread of Health-related Misinformation on Social Media," Social Science & Medicine, Elsevier, vol. 240(C).
    25. Adam Marcus & Ivan Oransky, 2011. "The paper is not sacred," Nature, Nature, vol. 480(7378), pages 449-450, December.
    26. Ivan Heibi & Silvio Peroni, 2021. "A qualitative and quantitative analysis of open citations to retracted articles: the Wakefield 1998 et al.'s case," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8433-8470, October.
    27. Haunschild, Robin & Leydesdorff, Loet & Bornmann, Lutz & Hellsten, Iina & Marx, Werner, 2019. "Does the public discuss other topics on climate change than researchers? A comparison of explorative networks based on author keywords and hashtags," Journal of Informetrics, Elsevier, vol. 13(2), pages 695-707.
    28. Didegah, Fereshteh & Mejlgaard, Niels & Sørensen, Mads P., 2018. "Investigating the quality of interactions and public engagement around scientific papers on Twitter," Journal of Informetrics, Elsevier, vol. 12(3), pages 960-971.
    29. Richard Van Noorden, 2014. "Online collaboration: Scientists and the social network," Nature, Nature, vol. 512(7513), pages 126-129, August.
    30. Judit Bar-Ilan & Gali Halevi, 2018. "Temporal characteristics of retracted articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1771-1783, September.
    31. Salim Moussa, 2022. "The propagation of error: retracted articles in marketing and their citations," Italian Journal of Marketing, Springer, vol. 2022(1), pages 11-36, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mahsa Amiri & Hajar Sotudeh, 2025. "Comparative opinion mining of tweets on retracted papers and their valid peers: a semi-experimental follow-up," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(2), pages 1159-1179, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mahsa Amiri & Hajar Sotudeh, 2025. "Comparative opinion mining of tweets on retracted papers and their valid peers: a semi-experimental follow-up," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(2), pages 1159-1179, February.
    2. Hajar Sotudeh & Zeinab Saber & Farzin Ghanbari Aloni & Mahdieh Mirzabeigi & Farshad Khunjush, 2022. "A longitudinal study of the evolution of opinions about open access and its main features: a twitter sentiment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5587-5611, October.
    3. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    4. Jodi Schneider & Di Ye & Alison M. Hill & Ashley S. Whitehorn, 2020. "Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2877-2913, December.
    5. Luis-Millán González & José Devís-Devís & Maite Pellicer-Chenoll & Miquel Pans & Alberto Pardo-Ibañez & Xavier García-Massó & Fernanda Peset & Fernanda Garzón-Farinós & Víctor Pérez-Samaniego, 2021. "The Impact of COVID-19 on Sport in Twitter: A Quantitative and Qualitative Content Analysis," IJERPH, MDPI, vol. 18(9), pages 1-20, April.
    6. Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
    7. Behzad Gholampour & Sajad Gholampour & Alireza Noruzi & Clément Arsenault & Thomas Haertlé & Ali Akbar Saboury, 2022. "Retracted articles in oncology in the last three decades: frequency, reasons, and themes," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1841-1865, April.
    8. Salim Moussa, 2022. "The propagation of error: retracted articles in marketing and their citations," Italian Journal of Marketing, Springer, vol. 2022(1), pages 11-36, March.
    9. Metwaly Ali Mohamed Eldakar & Ahmed Maher Khafaga Shehata, 2023. "A bibliometric study of article retractions in technology fields in developing economies countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(11), pages 6047-6083, November.
    10. Smolinsky, Lawrence & Klingenberg, Bernhard & Marx, Brian D., 2022. "Interpretation and inference for altmetric indicators arising from sparse data statistics," Journal of Informetrics, Elsevier, vol. 16(1).
    11. Zhichao Fang & Rodrigo Costas & Paul Wouters, 2022. "User engagement with scholarly tweets of scientific papers: a large-scale and cross-disciplinary analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4523-4546, August.
    12. Ma, Jie & Tse, Ying Kei & Wang, Xiaojun & Zhang, Minhao, 2019. "Examining customer perception and behaviour through social media research – An empirical study of the United Airlines overbooking crisis," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 127(C), pages 192-205.
    13. Marion Schmidt, 2024. "Why do some retracted articles continue to get cited?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(12), pages 7535-7563, December.
    14. Yaxue Ma & Zhichao Ba & Yuxiang Zhao & Jin Mao & Gang Li, 2021. "Understanding and predicting the dissemination of scientific papers on social media: a two-step simultaneous equation modeling–artificial neural network approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(8), pages 7051-7085, August.
    15. Judit Bar-Ilan & Gali Halevi, 2017. "Post retraction citations in context: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 547-565, October.
    16. Karin Sim Smith & Richard McCreadie & Craig Macdonald & Iadh Ounis, 2018. "Regional Sentiment Bias in Social Media Reporting During Crises," Information Systems Frontiers, Springer, vol. 20(5), pages 1013-1025, October.
    17. Beatriz Barros & Ana Fernández-Zubieta & Raul Fidalgo-Merino & Francisco Triguero, 2018. "Scientific knowledge percolation process and social impact: A case study on the biotechnology and microbiology perceptions on Twitter," Science and Public Policy, Oxford University Press, vol. 45(6), pages 804-814.
    18. Thomas T. Hills & Eugenio Proto & Daniel Sgroi & Chanuki Illushka Seresinhe, 2019. "Historical analysis of national subjective wellbeing using millions of digitized books," Nature Human Behaviour, Nature, vol. 3(12), pages 1271-1275, December.
    19. Ping-Yu Hsu & Hong-Tsuen Lei & Shih-Hsiang Huang & Teng Hao Liao & Yao-Chung Lo & Chin-Chun Lo, 2019. "Effects of sentiment on recommendations in social network," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(2), pages 253-262, June.
    20. Bor Luen Tang, 2023. "Some Insights into the Factors Influencing Continuous Citation of Retracted Scientific Papers," Publications, MDPI, vol. 11(4), pages 1-14, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:1:d:10.1007_s11192-023-04871-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.