IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0270872.html
   My bibliography  Save this article

A protocol to gather, characterize and analyze incoming citations of retracted articles

Author

Listed:
  • Ivan Heibi
  • Silvio Peroni

Abstract

In this article, we present a methodology which takes as input a collection of retracted articles, gathers the entities citing them, characterizes such entities according to multiple dimensions (disciplines, year of publication, sentiment, etc.), and applies a quantitative and qualitative analysis on the collected values. The methodology is composed of four phases: (1) identifying, retrieving, and extracting basic metadata of the entities which have cited a retracted article, (2) extracting and labeling additional features based on the textual content of the citing entities, (3) building a descriptive statistical summary based on the collected data, and finally (4) running a topic modeling analysis. The goal of the methodology is to generate data and visualizations that help understanding possible behaviors related to retraction cases. We present the methodology in a structured step-by-step form following its four phases, discuss its limits and possible workarounds, and list the planned future improvements.

Suggested Citation

  • Ivan Heibi & Silvio Peroni, 2022. "A protocol to gather, characterize and analyze incoming citations of retracted articles," PLOS ONE, Public Library of Science, vol. 17(7), pages 1-24, July.
    • Handle: RePEc:plo:pone00:0270872
    DOI: 10.1371/journal.pone.0270872
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0270872
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0270872&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0270872?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Xin Shuai & Jason Rollins & Isabelle Moulinier & Tonya Custis & Mathilda Edmunds & Frank Schilder, 2017. "A Multidimensional Investigation of the Effects of Publication Retraction on Scholarly Impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2225-2236, September.
    2. Judit Bar-Ilan & Gali Halevi, 2017. "Post retraction citations in context: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 547-565, October.
    3. Azoulay, Pierre & Bonatti, Alessandro & Krieger, Joshua L., 2017. "The career effects of scandal: Evidence from scientific retractions," Research Policy, Elsevier, vol. 46(9), pages 1552-1569.
    4. Lingzi Feng & Junpeng Yuan & Liying Yang, 2020. "An observation framework for retracted publications in multiple dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1445-1457, November.
    5. Ivan Heibi & Silvio Peroni & David Shotton, 2019. "Software review: COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 1213-1228, November.
    6. Jodi Schneider & Di Ye & Alison M. Hill & Ashley S. Whitehorn, 2020. "Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2877-2913, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Martin Shepperd & Leila Yousefi, 2023. "An analysis of retracted papers in Computer Science," PLOS ONE, Public Library of Science, vol. 18(5), pages 1-17, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ivan Heibi & Silvio Peroni, 2021. "A qualitative and quantitative analysis of open citations to retracted articles: the Wakefield 1998 et al.'s case," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8433-8470, October.
    2. Marion Schmidt, 2024. "Why do some retracted articles continue to get cited?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(12), pages 7535-7563, December.
    3. Lingzi Feng & Junpeng Yuan & Liying Yang, 2020. "An observation framework for retracted publications in multiple dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1445-1457, November.
    4. N. Siva & P. Rajendran, 2023. "Retracted publications in BRICS countries: an analytical study," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(12), pages 6313-6333, December.
    5. Behzad Gholampour & Sajad Gholampour & Alireza Noruzi & Clément Arsenault & Thomas Haertlé & Ali Akbar Saboury, 2022. "Retracted articles in oncology in the last three decades: frequency, reasons, and themes," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1841-1865, April.
    6. Xu, Haifeng & Ding, Yi & Zhang, Cheng & Tan, Bernard C.Y., 2023. "Too official to be effective: An empirical examination of unofficial information channel and continued use of retracted articles," Research Policy, Elsevier, vol. 52(7).
    7. Kiran Sharma & Satyam Mukherjee, 2024. "The ripple effect of retraction on an author’s collaboration network," Journal of Computational Social Science, Springer, vol. 7(2), pages 1519-1531, October.
    8. Gonzalo Marco-Cuenca & José Antonio Salvador-Oliván & Rosario Arquero-Avilés, 2021. "Fraud in scientific publications in the European Union. An analysis through their retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5143-5164, June.
    9. Tariq Ahmad Shah & Sumeer Gul & Saimah Bashir & Suhail Ahmad & Assumpció Huertas & Andrea Oliveira & Farzana Gulzar & Ashaq Hussain Najar & Kanu Chakraborty, 2021. "Influence of accessibility (open and toll-based) of scholarly publications on retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4589-4606, June.
    10. Sida Feng & Lingzi Feng & Fang Han & Ye Zhang & Yanqing Ren & Lixue Wang & Junpeng Yuan, 2024. "Citation network analysis of retractions in molecular biology field," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4795-4817, August.
    11. Eleonora Alabrese, 2022. "Bad Science: Retractions and Media Coverage," CESifo Working Paper Series 10195, CESifo.
    12. Hussinger, Katrin & Pellens, Maikel, 2019. "Guilt by association: How scientific misconduct harms prior collaborators," Research Policy, Elsevier, vol. 48(2), pages 516-530.
    13. Tom Coupé & W. Robert Reed, 2021. "Do Negative Replications Affect Citations?," Working Papers in Economics 21/14, University of Canterbury, Department of Economics and Finance.
    14. Liu, Xiaojuan & Wang, Chenlin & Chen, Dar-Zen & Huang, Mu-Hsuan, 2022. "Exploring perception of retraction based on mentioned status in post-retraction citations," Journal of Informetrics, Elsevier, vol. 16(3).
    15. Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
    16. Bergemann, Dirk & Ottaviani, Marco, 2021. "Information Markets and Nonmarkets," CEPR Discussion Papers 16459, C.E.P.R. Discussion Papers.
    17. Zhentao Liang & Jin Mao & Kun Lu & Gang Li, 2021. "Finding citations for PubMed: a large-scale comparison between five freely available bibliographic data sources," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9519-9542, December.
    18. Judit Bar-Ilan & Gali Halevi, 2018. "Temporal characteristics of retracted articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1771-1783, September.
    19. Zunino, Diego & van Praag, Mirjam C. & Dushnitsky, Gary, 2017. "Badge of Honor or Scarlet Letter? Unpacking Investors' Judgment of Entrepreneurs' Past Failure," IZA Discussion Papers 11017, Institute of Labor Economics (IZA).
    20. Gilles Grolleau & Naoufel Mzoughi, 2022. "How research institutions can make the best of scandals – once they become unavoidable," Post-Print hal-03908837, HAL.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0270872. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.