IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0285383.html

An analysis of retracted papers in Computer Science

Author

Listed:
  • Martin Shepperd
  • Leila Yousefi

Abstract

Context: The retraction of research papers, for whatever reason, is a growing phenomenon. However, although retracted paper information is publicly available via publishers, it is somewhat distributed and inconsistent. Objective: The aim is to assess: (i) the extent and nature of retracted research in Computer Science (CS) (ii) the post-retraction citation behaviour of retracted works and (iii) the potential impact upon systematic reviews and mapping studies. Method: We analyse the Retraction Watch database and take citation information from the Web of Science and Google scholar. Results: We find that of the 33,955 entries in the Retraction watch database (16 May 2022), 2,816 are classified as CS, i.e., ≈ 8%. For CS, 56% of retracted papers provide little or no information as to the reasons. This contrasts with 26% for other disciplines. There is also some disparity between different publishers, a tendency for multiple versions of a retracted paper to be available beyond the Version of Record (VoR), and for new citations long after a paper is officially retracted (median = 3; maximum = 18). Systematic reviews are also impacted with ≈ 30% of the retracted papers having one or more citations from a review. Conclusions: Unfortunately, retraction seems to be a sufficiently common outcome for a scientific paper that we as a research community need to take it more seriously, e.g., standardising procedures and taxonomies across publishers and the provision of appropriate research tools. Finally, we recommend particular caution when undertaking secondary analyses and meta-analyses which are at risk of becoming contaminated by these problem primary studies.

Suggested Citation

  • Martin Shepperd & Leila Yousefi, 2023. "An analysis of retracted papers in Computer Science," PLOS ONE, Public Library of Science, vol. 18(5), pages 1-17, May.
    • Handle: RePEc:plo:pone00:0285383
    DOI: 10.1371/journal.pone.0285383
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0285383
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0285383&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0285383?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
    2. Ivan Heibi & Silvio Peroni, 2022. "A protocol to gather, characterize and analyze incoming citations of retracted articles," PLOS ONE, Public Library of Science, vol. 17(7), pages 1-24, July.
    3. Jodi Schneider & Di Ye & Alison M. Hill & Ashley S. Whitehorn, 2020. "Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2877-2913, December.
    4. Ivan Heibi & Silvio Peroni, 2021. "A qualitative and quantitative analysis of open citations to retracted articles: the Wakefield 1998 et al.'s case," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8433-8470, October.
    5. Daniele Fanelli, 2009. "How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data," PLOS ONE, Public Library of Science, vol. 4(5), pages 1-11, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marion Schmidt, 2024. "Why do some retracted articles continue to get cited?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(12), pages 7535-7563, December.
    2. Karen Santos-d’Amorim & Elías Sanz-Casado & Raimundo Nonato Macedo Santos, 2025. "Errors, questionable practices, or misconduct? A bibliometric and altmetric review covering two decades of retractions in Latin America," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(7), pages 3679-3706, July.
    3. Gonzalo Marco-Cuenca & José Antonio Salvador-Oliván & Rosario Arquero-Avilés, 2021. "Fraud in scientific publications in the European Union. An analysis through their retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5143-5164, June.
    4. Sida Feng & Lingzi Feng & Fang Han & Ye Zhang & Yanqing Ren & Lixue Wang & Junpeng Yuan, 2024. "Citation network analysis of retractions in molecular biology field," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4795-4817, August.
    5. Ivan Heibi & Silvio Peroni, 2021. "A qualitative and quantitative analysis of open citations to retracted articles: the Wakefield 1998 et al.'s case," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8433-8470, October.
    6. Eleonora Alabrese, 2022. "Bad Science: Retractions and Media Coverage," CESifo Working Paper Series 10195, CESifo.
    7. Love, Peter E.D. & Ika, Lavagnon A. & Ahiaga-Dagbui, Dominic D., 2019. "On de-bunking ‘fake news’ in a post truth era: Why does the Planning Fallacy explanation for cost overruns fall short?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 397-408.
    8. Jeremy Hall & Ben R. Martin, 2019. "Towards a Taxonomy of Academic Misconduct: The Case of Business School Research," SPRU Working Paper Series 2019-02, SPRU - Science Policy Research Unit, University of Sussex Business School.
    9. Robert J Warren II & Joshua R King & Charlene Tarsa & Brian Haas & Jeremy Henderson, 2017. "A systematic review of context bias in invasion biology," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-12, August.
    10. Jasper Brinkerink, 2023. "When Shooting for the Stars Becomes Aiming for Asterisks: P-Hacking in Family Business Research," Entrepreneurship Theory and Practice, , vol. 47(2), pages 304-343, March.
    11. Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
    12. Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
    13. Necker, Sarah, 2014. "Scientific misbehavior in economics," Research Policy, Elsevier, vol. 43(10), pages 1747-1759.
    14. Gary Charness & David Masclet & Marie Claire Villeval, 2014. "The Dark Side of Competition for Status," Management Science, INFORMS, vol. 60(1), pages 38-55, January.
    15. David Spiegelhalter, 2017. "Trust in numbers," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 948-965, October.
    16. Horbach, S.P.J.M.(Serge) & Halffman, W.(Willem), 2019. "The extent and causes of academic text recycling or ‘self-plagiarism’," Research Policy, Elsevier, vol. 48(2), pages 492-502.
    17. Bor Luen Tang, 2023. "Some Insights into the Factors Influencing Continuous Citation of Retracted Scientific Papers," Publications, MDPI, vol. 11(4), pages 1-14, October.
    18. Harrison, Mark, 2011. "Forging success: Soviet managers and accounting fraud, 1943-1962," Journal of Comparative Economics, Elsevier, vol. 39(1), pages 43-64, March.
    19. Kiran Sharma, 2021. "Team size and retracted citations reveal the patterns of retractions from 1981 to 2020," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8363-8374, October.
    20. Kingori, Patricia & Gerrets, René, 2016. "Morals, morale and motivations in data fabrication: Medical research fieldworkers views and practices in two Sub-Saharan African contexts," Social Science & Medicine, Elsevier, vol. 166(C), pages 150-159.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0285383. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.