IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v121y2019i1d10.1007_s11192-019-03190-0.html
   My bibliography  Save this article

Corrective factors for author- and journal-based metrics impacted by citations to accommodate for retractions

Author

Listed:
  • Judit Dobránszki

    (University of Debrecen)

  • Jaime A. Teixeira da Silva

Abstract

Citation-based metrics are frequently used to evaluate the level, or quality, of a researcher, or their work, often as a function of the ranking of the journal in which they publish, and broadly tend to be divided into journal-based metrics (JBMs) and author-based metrics (ABMs). Despite wide knowledge of the gaming of such metrics, in particular the Clarivate Analytics journal impact factor (JIF), no suitable substitute concept has yet emerged, nor has any corrective measure been developed. In a post-publication peer review world of increasing retractions, and within a framework of open science, we propose correction factors for JBMs and ABMs that take into account retractions. We describe ways to correct the JIF, CiteScore, the 5-year Impact Factor, Immediacy Index, Cited Half-Life, Raw Impact per Paper and other JBMs (Eigenfactor Score and Article Influence Score) as well as the h-index, one of the most widespread ABMs, depending on the number of retractions for that journal or individual, respectively. The existence of such corrective factors could make the use of these metrics more transparent, and might allow them to be used in a world that is adapting to an increase in retractions and corrective measures to deal with erroneous scientific literature. We caution that such correction factors should be used exclusively as such, and should not be viewed, or used, as punitive factors.

Suggested Citation

  • Judit Dobránszki & Jaime A. Teixeira da Silva, 2019. "Corrective factors for author- and journal-based metrics impacted by citations to accommodate for retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 387-398, October.
    • Handle: RePEc:spr:scient:v:121:y:2019:i:1:d:10.1007_s11192-019-03190-0
    DOI: 10.1007/s11192-019-03190-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-019-03190-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-019-03190-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John P A Ioannidis, 2005. "Why Most Published Research Findings Are False," PLOS Medicine, Public Library of Science, vol. 2(8), pages 1-1, August.
    2. Jaime A. Teixeira da Silva, 2018. "The Google Scholar h-index: useful but burdensome metric," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 631-635, October.
    3. Jaime A. Teixeira da Silva & Judit Dobránszki, 2018. "Citation inflation: the effect of not correcting the scientific literature sufficiently, a case study in the plant sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 1213-1222, August.
    4. Judit Bar-Ilan & Gali Halevi, 2017. "Post retraction citations in context: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 547-565, October.
    5. R Grant Steen & Arturo Casadevall & Ferric C Fang, 2013. "Why Has the Number of Scientific Retractions Increased?," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-9, July.
    6. B Ian Hutchins & Xin Yuan & James M Anderson & George M Santangelo, 2016. "Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level," PLOS Biology, Public Library of Science, vol. 14(9), pages 1-25, September.
    7. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    8. Jaime A. Teixeira da Silva & Aamir Raoof Memon, 2017. "CiteScore: A cite for sore eyes, or a valuable, transparent metric?," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 553-556, April.
    9. Jaime A. Teixeira da Silva & Judit Dobránszki, 2017. "Highly cited retracted papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1653-1661, March.
    10. Jaime A. Teixeira da Silva & Judit Dobránszki, 2018. "Multiple versions of the h-index: cautionary use for formal academic purposes," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1107-1113, May.
    11. Björn Hammarfelt & Alexander D. Rushforth, 2017. "Indicators as judgment devices: An empirical study of citizen bibliometrics in research evaluation," Research Evaluation, Oxford University Press, vol. 26(3), pages 169-180.
    12. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    13. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    14. Jaime A. Teixeira da Silva & Helmar Bornemann-Cimenti, 2017. "Why do some retracted papers continue to be cited?," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 365-370, January.
    15. Judit Bar-Ilan & Gali Halevi, 2018. "Temporal characteristics of retracted articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1771-1783, September.
    16. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    17. Xue-Li Liu & Shuang-Shuang Gai & Jing Zhou, 2016. "Journal Impact Factor: Do the Numerator and Denominator Need Correction?," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-15, March.
    18. Mohammadamin Erfanmanesh & Jaime A. Teixeira da Silva, 2019. "Is the soundness-only quality control policy of open access mega journals linked to a higher rate of published errors?," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 917-923, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jaime A. Teixeira da Silva & Serhii Nazarovets, 2023. "Partial citation analysis of five classes of retracted papers, and devising a new four-tier citation classification system for retracted (and other) papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4887-4894, August.
    2. Jaime A. Teixeira da Silva, 2021. "The i100-index, i1000-index and i10,000-index: expansion and fortification of the Google Scholar h-index for finer-scale citation descriptions and researcher classification," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3667-3672, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
    2. Behzad Gholampour & Sajad Gholampour & Alireza Noruzi & Clément Arsenault & Thomas Haertlé & Ali Akbar Saboury, 2022. "Retracted articles in oncology in the last three decades: frequency, reasons, and themes," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1841-1865, April.
    3. Bor Luen Tang, 2023. "Some Insights into the Factors Influencing Continuous Citation of Retracted Scientific Papers," Publications, MDPI, vol. 11(4), pages 1-14, October.
    4. Liu, Xiaojuan & Wang, Chenlin & Chen, Dar-Zen & Huang, Mu-Hsuan, 2022. "Exploring perception of retraction based on mentioned status in post-retraction citations," Journal of Informetrics, Elsevier, vol. 16(3).
    5. Pantea Kamrani & Isabelle Dorsch & Wolfgang G. Stock, 2021. "Do researchers know what the h-index is? And how do they estimate its importance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5489-5508, July.
    6. Judit Bar-Ilan & Gali Halevi, 2018. "Temporal characteristics of retracted articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1771-1783, September.
    7. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    8. Salim Moussa, 2022. "The propagation of error: retracted articles in marketing and their citations," Italian Journal of Marketing, Springer, vol. 2022(1), pages 11-36, March.
    9. Kiran Sharma, 2021. "Team size and retracted citations reveal the patterns of retractions from 1981 to 2020," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8363-8374, October.
    10. Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
    11. Jaime A. Teixeira da Silva & Judit Dobránszki, 2018. "Multiple versions of the h-index: cautionary use for formal academic purposes," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1107-1113, May.
    12. Jodi Schneider & Di Ye & Alison M. Hill & Ashley S. Whitehorn, 2020. "Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2877-2913, December.
    13. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    14. Jaime A. Teixeira da Silva & Serhii Nazarovets, 2023. "Partial citation analysis of five classes of retracted papers, and devising a new four-tier citation classification system for retracted (and other) papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4887-4894, August.
    15. Ivan Heibi & Silvio Peroni, 2021. "A qualitative and quantitative analysis of open citations to retracted articles: the Wakefield 1998 et al.'s case," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8433-8470, October.
    16. Gaviria-Marin, Magaly & Merigó, José M. & Baier-Fuentes, Hugo, 2019. "Knowledge management: A global examination based on bibliometric analysis," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 194-220.
    17. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "On the interplay between normalisation, bias, and performance of paper impact metrics," Journal of Informetrics, Elsevier, vol. 13(1), pages 270-290.
    18. A Cecile J W Janssens & Michael Goodman & Kimberly R Powell & Marta Gwinn, 2017. "A critical evaluation of the algorithm behind the Relative Citation Ratio (RCR)," PLOS Biology, Public Library of Science, vol. 15(10), pages 1-5, October.
    19. Hoyeop Lee & Jueun Kwak & Min Song & Chang Ouk Kim, 2015. "Coherence analysis of research and education using topic modeling," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1119-1137, February.
    20. Thelwall, Mike, 2018. "Dimensions: A competitor to Scopus and the Web of Science?," Journal of Informetrics, Elsevier, vol. 12(2), pages 430-435.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:121:y:2019:i:1:d:10.1007_s11192-019-03190-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.