IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v92y2012i2d10.1007_s11192-011-0601-9.html
   My bibliography  Save this article

The impact factor: its place in Garfield’s thought, in science evaluation, and in library collection management

Author

Listed:
  • Stephen J. Bensman

    (LSU Libraries, Louisiana State University)

Abstract

This paper is a response to that of Vanclay, who proposes, that since the impact factor (IF) is so seriously flawed, Thomson Reuters should either correct the measure or—preferably—no longer publish it and restrict itself to journal certification. It is argued here that Vanclay’s analysis is itself seriously flawed, because he appears totally ignorant of the thought structure of Eugene Garfield, IF’s creator. As a result, Vanclay appears unaware of the importance of total cites and the close connection of IF with review journals, where the paradigms of science are defined. This paper’s author agrees that IF is a defective measure, analyzing its defects from the perspective of the frequency theory of probability, on which modern inferential statistics is based. However, he asserts that abandoning it would be counterproductive because of its demonstrated ability—even with its defects—to identify small important journals like review journals, giving it an important role in science evaluation and library collection management.

Suggested Citation

  • Stephen J. Bensman, 2012. "The impact factor: its place in Garfield’s thought, in science evaluation, and in library collection management," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 263-275, August.
    • Handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-011-0601-9
    DOI: 10.1007/s11192-011-0601-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-011-0601-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-011-0601-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stephen J. Bensman & Loet Leydesdorff, 2009. "Definition and identification of journals as bibliographic and subject entities: Librarianship versus ISI Journal Citation Reports methods and their effect on citation measures," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(6), pages 1097-1117, June.
    2. Per O Seglen, 1992. "How representative is the journal impact factor?," Research Evaluation, Oxford University Press, vol. 2(3), pages 143-149, December.
    3. Stephen J. Bensman, 2008. "Distributional differences of the impact factor in the sciences versus the social sciences: An analysis of the probabilistic structure of the 2005 journal citation reports," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(9), pages 1366-1382, July.
    4. Stephen J. Bensman & Lawrence J. Smolinsky & Alexander I. Pudovkin, 2010. "Mean citation rate per article in mathematics journals: Differences from the scientific model," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(7), pages 1440-1463, July.
    5. E. Garfield & I. H. Sher, 1963. "New factors in the evaluation of scientific literature through citation indexing," American Documentation, Wiley Blackwell, vol. 14(3), pages 195-201, July.
    6. Stephen J. Bensman & Lawrence J. Smolinsky & Alexander I. Pudovkin, 2010. "Mean citation rate per article in mathematics journals: Differences from the scientific model," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(7), pages 1440-1463, July.
    7. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David A. Pendlebury & Jonathan Adams, 2012. "Comments on a critique of the Thomson Reuters journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 395-401, August.
    2. Gualberto Buela-Casal & Izabela Zych, 2012. "What do the scientists think about the impact factor?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 281-292, August.
    3. Gustavo Dambiski Gomes de Carvalho & Luis Mauricio Martins de Resende & Joseane Pontes & Hélio Gomes de Carvalho & Leozenir Mendes Betim, 2021. "Innovation and Management in MSMEs: A Literature Review of Highly Cited Papers," SAGE Open, , vol. 11(4), pages 21582440211, October.
    4. de Carvalho, Gustavo Dambiski Gomes & Sokulski, Carla Cristiane & da Silva, Wesley Vieira & de Carvalho, Hélio Gomes & de Moura, Rafael Vignoli & de Francisco, Antonio Carlos & da Veiga, Claudimar Per, 2020. "Bibliometrics and systematic reviews: A comparison between the Proknow-C and the Methodi Ordinatio," Journal of Informetrics, Elsevier, vol. 14(3).
    5. Alfirević Nikša & Pavičić Jurica & Rendulić Darko, 2023. "A Bibliometric Analysis of Public Business School Scientific Productivity and Impact in South-East Europe (2017-2021)," South East European Journal of Economics and Business, Sciendo, vol. 18(1), pages 27-45, June.
    6. Finardi, Ugo, 2013. "Correlation between Journal Impact Factor and Citation Performance: An experimental study," Journal of Informetrics, Elsevier, vol. 7(2), pages 357-370.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    2. Lawrence Smolinsky & Aaron Lercher, 2012. "Citation rates in mathematics: a study of variation by subdiscipline," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 911-924, June.
    3. McAleer, M.J. & Oláh, J. & Popp, J., 2018. "Pros and Cons of the Impact Factor in a Rapidly Changing Digital World," Econometric Institute Research Papers EI2018-11, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    4. Stephen J. Bensman, 2011. "Anne-Wil Harzing: The publish or perish book: Your guide to effective and responsible citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 339-342, July.
    5. Martin Szomszor & David A. Pendlebury & Jonathan Adams, 2020. "How much is too much? The difference between research influence and self-citation excess," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1119-1147, May.
    6. Vanclay, Jerome K., 2013. "Factors affecting citation rates in environmental science," Journal of Informetrics, Elsevier, vol. 7(2), pages 265-271.
    7. David A. Pendlebury & Jonathan Adams, 2012. "Comments on a critique of the Thomson Reuters journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 395-401, August.
    8. Gualberto Buela-Casal & Izabela Zych, 2012. "What do the scientists think about the impact factor?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 281-292, August.
    9. Lindahl, Jonas, 2018. "Predicting research excellence at the individual level: The importance of publication rate, top journal publications, and top 10% publications in the case of early career mathematicians," Journal of Informetrics, Elsevier, vol. 12(2), pages 518-533.
    10. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    11. Huang, Ding-wei, 2017. "Impact factor distribution revisited," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 482(C), pages 173-180.
    12. Lando, Tommaso & Bertoli-Barsotti, Lucio, 2017. "Measuring the citation impact of journals with generalized Lorenz curves," Journal of Informetrics, Elsevier, vol. 11(3), pages 689-703.
    13. Kun Lu & Isola Ajiferuke & Dietmar Wolfram, 2014. "Extending citer analysis to journal impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 245-260, July.
    14. Marcelo Mendoza, 2021. "Differences in Citation Patterns across Areas, Article Types and Age Groups of Researchers," Publications, MDPI, vol. 9(4), pages 1-23, October.
    15. Fang Xu & Wenbin Liu & Ronald Rousseau, 2015. "Introducing sub-impact factor (SIF-) sequences and an aggregated SIF-indicator for journal ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1577-1593, February.
    16. Saarela, Mirka & Kärkkäinen, Tommi, 2020. "Can we automate expert-based journal rankings? Analysis of the Finnish publication indicator," Journal of Informetrics, Elsevier, vol. 14(2).
    17. Péter Vinkler, 2012. "The Garfield impact factor, one of the fundamental indicators in scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 471-483, August.
    18. Zeki Simsek & Ciaran Heavey & Justin J. P. Jansen, 2013. "Journal Impact as a Diffusion Process: A Conceptualization and the Case of the Journal of Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 50(8), pages 1374-1407, December.
    19. Kun-Yang Chuang & Ming-Huang Wang & Yuh-Shan Ho, 2011. "High-impact papers presented in the subject category of water resources in the essential science indicators database of the institute for scientific information," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 551-562, June.
    20. Lawrence Smolinsky & Daniel S. Sage & Aaron J. Lercher & Aaron Cao, 2021. "Citations versus expert opinions: citation analysis of featured reviews of the American Mathematical Society," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3853-3870, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-011-0601-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.