IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v126y2021i10d10.1007_s11192-021-04097-5.html
   My bibliography  Save this article

A qualitative and quantitative analysis of open citations to retracted articles: the Wakefield 1998 et al.'s case

Author

Listed:
  • Ivan Heibi

    (University of Bologna
    University of Bologna)

  • Silvio Peroni

    (University of Bologna
    University of Bologna)

Abstract

In this article, we show the results of a quantitative and qualitative analysis of open citations on a popular and highly cited retracted paper: “Ileal-lymphoid-nodular hyperplasia, non-specific colitis and pervasive developmental disorder in children” by Wakefield et al., published in 1998. The main purpose of our study is to understand the behavior of the publications citing one retracted article and the characteristics of the citations the retracted article accumulated over time. Our analysis is based on a methodology which illustrates how we gathered the data, extracted the topics of the citing articles and visualized the results. The data and services used are all open and free to foster the reproducibility of the analysis. The outcomes concerned the analysis of the entities citing Wakefield et al.’s article and their related in-text citations. We observed a constant increasing number of citations in the last 20 years, accompanied with a constant increment in the percentage of those acknowledging its retraction. Citing articles have started either discussing or dealing with the retraction of Wakefield et al.’s article even before its full retraction happened in 2010. Articles in the social sciences domain citing the Wakefield et al.’s one were among those that have mostly discussed its retraction. In addition, when observing the in-text citations, we noticed that a large number of the citations received by Wakefield et al.’s article has focused on general discussions without recalling strictly medical details, especially after the full retraction. Medical studies did not hesitate in acknowledging the retraction of the Wakefield et al.’s article and often provided strong negative statements on it.

Suggested Citation

  • Ivan Heibi & Silvio Peroni, 2021. "A qualitative and quantitative analysis of open citations to retracted articles: the Wakefield 1998 et al.'s case," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8433-8470, October.
    • Handle: RePEc:spr:scient:v:126:y:2021:i:10:d:10.1007_s11192-021-04097-5
    DOI: 10.1007/s11192-021-04097-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-021-04097-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-021-04097-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xin Shuai & Jason Rollins & Isabelle Moulinier & Tonya Custis & Mathilda Edmunds & Frank Schilder, 2017. "A Multidimensional Investigation of the Effects of Publication Retraction on Scholarly Impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2225-2236, September.
    2. Judit Bar-Ilan & Gali Halevi, 2017. "Post retraction citations in context: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 547-565, October.
    3. Azoulay, Pierre & Bonatti, Alessandro & Krieger, Joshua L., 2017. "The career effects of scandal: Evidence from scientific retractions," Research Policy, Elsevier, vol. 46(9), pages 1552-1569.
    4. Philippe Mongeon & Vincent Larivière, 2016. "Costly collaborations: The impact of scientific fraud on co-authors' careers," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 535-542, March.
    5. Chaomei Chen & Loet Leydesdorff, 2014. "Patterns of connections and movements in dual-map overlays: A new method of publication portfolio analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(2), pages 334-351, February.
    6. Lutz Bornmann & K. Brad Wray & Robin Haunschild, 2020. "Citation concept analysis (CCA): a new form of citation analysis revealing the usefulness of concepts for other researchers illustrated by exemplary case studies including classic books by Thomas S. K," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1051-1074, February.
    7. Ivan Heibi & Silvio Peroni & David Shotton, 2019. "Software review: COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 1213-1228, November.
    8. Chaomei Chen & Zhigang Hu & Jared Milbank & Timothy Schultz, 2013. "A visual analytic study of retracted articles in scientific literature," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 234-253, February.
    9. Lutz Bornmann & K. Brad Wray & Robin Haunschild, 2020. "Correction to: Citation concept analysis (CCA): a new form of citation analysis revealing the usefulness of concepts for other researchers illustrated by exemplary case studies including classic books," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2737-2737, September.
    10. Jaime A. Teixeira da Silva & Judit Dobránszki, 2017. "Highly cited retracted papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1653-1661, March.
    11. Xiaozan Lyu & Rodrigo Costas, 2020. "How do academic topics shift across altmetric sources? A case study of the research area of Big Data," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 909-943, May.
    12. Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
    13. Lingzi Feng & Junpeng Yuan & Liying Yang, 2020. "An observation framework for retracted publications in multiple dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1445-1457, November.
    14. Yi Zhang & Xiaojing Cai & Caroline V. Fry & Mengjia Wu & Caroline S. Wagner, 2021. "Topic evolution, disruption and resilience in early COVID-19 research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4225-4253, May.
    15. Xiaoyao Han, 2020. "Evolution of research topics in LIS between 1996 and 2019: an analysis based on latent Dirichlet allocation topic model," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2561-2595, December.
    16. Jodi Schneider & Di Ye & Alison M. Hill & Ashley S. Whitehorn, 2020. "Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2877-2913, December.
    17. Chaomei Chen & Zhigang Hu & Jared Milbank & Timothy Schultz, 2013. "A visual analytic study of retracted articles in scientific literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 234-253, February.
    18. Judit Bar-Ilan & Gali Halevi, 2018. "Temporal characteristics of retracted articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1771-1783, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lingzi Feng & Junpeng Yuan & Liying Yang, 2020. "An observation framework for retracted publications in multiple dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1445-1457, November.
    2. Behzad Gholampour & Sajad Gholampour & Alireza Noruzi & Clément Arsenault & Thomas Haertlé & Ali Akbar Saboury, 2022. "Retracted articles in oncology in the last three decades: frequency, reasons, and themes," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1841-1865, April.
    3. Jodi Schneider & Di Ye & Alison M. Hill & Ashley S. Whitehorn, 2020. "Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2877-2913, December.
    4. Salim Moussa, 2022. "The propagation of error: retracted articles in marketing and their citations," Italian Journal of Marketing, Springer, vol. 2022(1), pages 11-36, March.
    5. Tariq Ahmad Shah & Sumeer Gul & Saimah Bashir & Suhail Ahmad & Assumpció Huertas & Andrea Oliveira & Farzana Gulzar & Ashaq Hussain Najar & Kanu Chakraborty, 2021. "Influence of accessibility (open and toll-based) of scholarly publications on retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4589-4606, June.
    6. Eleonora Alabrese, 2022. "Bad Science: Retractions and Media Coverage," CESifo Working Paper Series 10195, CESifo.
    7. Zhentao Liang & Jin Mao & Kun Lu & Gang Li, 2021. "Finding citations for PubMed: a large-scale comparison between five freely available bibliographic data sources," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9519-9542, December.
    8. Bor Luen Tang, 2023. "Some Insights into the Factors Influencing Continuous Citation of Retracted Scientific Papers," Publications, MDPI, vol. 11(4), pages 1-14, October.
    9. Qin Zhang & Juneman Abraham & Hui-Zhen Fu, 2020. "Collaboration and its influence on retraction based on retracted publications during 1978–2017," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 213-232, October.
    10. Gonzalo Marco-Cuenca & José Antonio Salvador-Oliván & Rosario Arquero-Avilés, 2021. "Fraud in scientific publications in the European Union. An analysis through their retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5143-5164, June.
    11. Judit Dobránszki & Jaime A. Teixeira da Silva, 2019. "Corrective factors for author- and journal-based metrics impacted by citations to accommodate for retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 387-398, October.
    12. K. Brad Wray, 2020. "Paradigms in Structure: finally, a count," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 823-828, October.
    13. Tom Coupé & W. Robert Reed, 2021. "Do Negative Replications Affect Citations?," Working Papers in Economics 21/14, University of Canterbury, Department of Economics and Finance.
    14. Liu, Xiaojuan & Wang, Chenlin & Chen, Dar-Zen & Huang, Mu-Hsuan, 2022. "Exploring perception of retraction based on mentioned status in post-retraction citations," Journal of Informetrics, Elsevier, vol. 16(3).
    15. Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
    16. Naif Radi Aljohani & Ayman Fayoumi & Saeed-Ul Hassan, 2021. "An in-text citation classification predictive model for a scholarly search system," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5509-5529, July.
    17. Kiran Sharma, 2021. "Team size and retracted citations reveal the patterns of retractions from 1981 to 2020," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8363-8374, October.
    18. Xu, Haifeng & Ding, Yi & Zhang, Cheng & Tan, Bernard C.Y., 2023. "Too official to be effective: An empirical examination of unofficial information channel and continued use of retracted articles," Research Policy, Elsevier, vol. 52(7).
    19. Ashley S. Fulton & Alison M. Coates & Marie T. Williams & Peter R.C. Howe & Alison M. Hill, 2015. "Persistent Citation of the Only Published Randomised Controlled Trial of Omega-3 Supplementation in Chronic Obstructive Pulmonary Disease Six Years after Its Retraction," Publications, MDPI, vol. 3(1), pages 1-10, February.
    20. Horton, Joanne & Krishna Kumar, Dhanya & Wood, Anthony, 2020. "Detecting academic fraud using Benford law: The case of Professor James Hunton," Research Policy, Elsevier, vol. 49(8).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:126:y:2021:i:10:d:10.1007_s11192-021-04097-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.