IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0151414.html
   My bibliography  Save this article

Journal Impact Factor: Do the Numerator and Denominator Need Correction?

Author

Listed:
  • Xue-Li Liu
  • Shuang-Shuang Gai
  • Jing Zhou

Abstract

To correct the incongruence of document types between the numerator and denominator in the traditional impact factor (IF), we make a corresponding adjustment to its formula and present five corrective IFs: IFTotal/Total, IFTotal/AREL, IFAR/AR, IFAREL/AR, and IFAREL/AREL. Based on a survey of researchers in the fields of ophthalmology and mathematics, we obtained the real impact ranking of sample journals in the minds of peer experts. The correlations between various IFs and questionnaire score were analyzed to verify their journal evaluation effects. The results show that it is scientific and reasonable to use five corrective IFs for journal evaluation for both ophthalmology and mathematics. For ophthalmology, the journal evaluation effects of the five corrective IFs are superior than those of traditional IF: the corrective effect of IFAR/AR is the best, IFAREL/AR is better than IFTotal/Total, followed by IFTotal/AREL, and IFAREL/AREL. For mathematics, the journal evaluation effect of traditional IF is superior than those of the five corrective IFs: the corrective effect of IFTotal/Total is best, IFAREL/AR is better than IFTotal/AREL and IFAREL/AREL, and the corrective effect of IFAR/AR is the worst. In conclusion, not all disciplinary journal IF need correction. The results in the current paper show that to correct the IF of ophthalmologic journals may be valuable, but it seems to be meaningless for mathematic journals.

Suggested Citation

  • Xue-Li Liu & Shuang-Shuang Gai & Jing Zhou, 2016. "Journal Impact Factor: Do the Numerator and Denominator Need Correction?," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-15, March.
    • Handle: RePEc:plo:pone00:0151414
    DOI: 10.1371/journal.pone.0151414
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0151414
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0151414&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0151414?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. E. Garfield & I. H. Sher, 1963. "New factors in the evaluation of scientific literature through citation indexing," American Documentation, Wiley Blackwell, vol. 14(3), pages 195-201, July.
    2. Juan Miguel Campanario, 2011. "Large increases and decreases in journal impact factors in only one year: The effect of journal self‐citations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(2), pages 230-235, February.
    3. Juan Miguel Campanario, 2011. "Large increases and decreases in journal impact factors in only one year: The effect of journal self-citations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(2), pages 230-235, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Judit Dobránszki & Jaime A. Teixeira da Silva, 2019. "Corrective factors for author- and journal-based metrics impacted by citations to accommodate for retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 387-398, October.
    2. Yurij L. Katchanov & Yulia V. Markova, 2017. "The “space of physics journals”: topological structure and the Journal Impact Factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 313-333, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Szomszor & David A. Pendlebury & Jonathan Adams, 2020. "How much is too much? The difference between research influence and self-citation excess," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1119-1147, May.
    2. Juan Miguel Campanario, 2018. "Journals that Rise from the Fourth Quartile to the First Quartile in Six Years or Less: Mechanisms of Change and the Role of Journal Self-Citations," Publications, MDPI, vol. 6(4), pages 1-15, November.
    3. Marcelo Mendoza, 2021. "Differences in Citation Patterns across Areas, Article Types and Age Groups of Researchers," Publications, MDPI, vol. 9(4), pages 1-23, October.
    4. Salustiano Martínez-Fierro & María Paula Lechuga Sancho, 2021. "Descriptive Elements and Conceptual Structure of Glass Ceiling Research," IJERPH, MDPI, vol. 18(15), pages 1-20, July.
    5. Yu, Tian & Yu, Guang & Wang, Ming-Yang, 2014. "Classification method for detecting coercive self-citation in journals," Journal of Informetrics, Elsevier, vol. 8(1), pages 123-135.
    6. Yi-Ching Liaw & Te-Yi Chan & Chin-Yuan Fan & Cheng-Hsin Chiang, 2014. "Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 17-37, October.
    7. Pajić, Dejan, 2015. "On the stability of citation-based journal rankings," Journal of Informetrics, Elsevier, vol. 9(4), pages 990-1006.
    8. Rabishankar Giri & Sabuj Kumar Chaudhuri, 2021. "Ranking journals through the lens of active visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2189-2208, March.
    9. Jianhua Hou, 2017. "Exploration into the evolution and historical roots of citation analysis by referenced publication year spectroscopy," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1437-1452, March.
    10. Ejovi Akpojevwe Abafe & Yonas T. Bahta & Henry Jordaan, 2022. "Exploring Biblioshiny for Historical Assessment of Global Research on Sustainable Use of Water in Agriculture," Sustainability, MDPI, vol. 14(17), pages 1-34, August.
    11. Jianhua Hou & Xiucai Yang & Yang Zhang, 2023. "The effect of social media knowledge cascade: an analysis of scientific papers diffusion," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 5169-5195, September.
    12. Woocheol Kim & Gohar Feroz Khan & Jacob Wood & Muhammad Tariq Mahmood, 2016. "Employee Engagement for Sustainable Organizations: Keyword Analysis Using Social Network Analysis and Burst Detection Approach," Sustainability, MDPI, vol. 8(7), pages 1-11, July.
    13. Gangan Prathap, 2019. "The Pinski–Narin influence weight and the Ramanujacharyulu power-weakness ratio indicators revisited," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1173-1185, May.
    14. Lutz Bornmann & Robin Haunschild & Loet Leydesdorff, 2018. "Reference publication year spectroscopy (RPYS) of Eugene Garfield’s publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 439-448, February.
    15. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    16. Luciano Rossoni & Rodrigo Assunção Rosa, 2020. "Genesis, Impact, and Identity of the Journal of Contemporary Administration," RAC - Revista de Administração Contemporânea (Journal of Contemporary Administration), ANPAD - Associação Nacional de Pós-Graduação e Pesquisa em Administração, vol. 24(5), pages 448-473.
    17. Wolfgang Glänzel & Henk F. Moed, 2013. "Opinion paper: thoughts and facts on bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 381-394, July.
    18. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    19. Ernesto Mesa-Vázquez & Juan F. Velasco-Muñoz & José A. Aznar-Sánchez & Belén López-Felices, 2021. "Three Decades of Behavioural Economics in Agriculture. An Overview of Global Research," Sustainability, MDPI, vol. 13(18), pages 1-21, September.
    20. Erjia Yan & Ying Ding & Qinghua Zhu, 2010. "Mapping library and information science in China: a coauthorship network analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(1), pages 115-131, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0151414. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.