IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v92y2012i2d10.1007_s11192-012-0685-x.html
   My bibliography  Save this article

Impact factors, scientometrics and the history of citation-based research

Author

Listed:
  • Derek R. Smith

    (University of Newcastle)

Abstract

Few contemporary inventions have influenced academic publishing as much as journal impact factors. On the other hand, debates and discussion on the potential limitations of, and appropriate uses for, journal performance indicators are almost as long as the history of the measures themselves. Given that scientometrics is often undertaken using bibliometric techniques, the history of the former is inextricably linked to the latter. As with any controversy it is difficult to separate an invention from its history, and for these reasons, the current article provides an overview of some key historical events of relevance to the impact factor. When he first proposed the concept over half a century ago, Garfield did not realise that impact factors would one day become the subject of such widespread controversy. As the current Special Issue of Scientometrics suggests, this debate continues today.

Suggested Citation

  • Derek R. Smith, 2012. "Impact factors, scientometrics and the history of citation-based research," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 419-427, August.
  • Handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0685-x
    DOI: 10.1007/s11192-012-0685-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-012-0685-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-012-0685-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chung, Kee H & Cox, Raymond A K, 1990. "Patterns of Productivity in the Finance Literature: A Study of the Bibliometric Distributions," Journal of Finance, American Finance Association, vol. 45(1), pages 301-309, March.
    2. Ronald Rousseau, 2012. "Updating the journal impact factor or total overhaul?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 413-417, August.
    3. Wolfgang Glänzel & Henk F. Moed, 2002. "Journal impact measures in bibliometric research," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 171-193, February.
    4. Sune Lehmann & Andrew D. Jackson & Benny E. Lautrup, 2006. "Measures for measures," Nature, Nature, vol. 444(7122), pages 1003-1004, December.
    5. Louise Wiles & Timothy Olds & Marie Williams, 2010. "Evidence base, quantitation and collaboration: three novel indices for bibliometric content analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 317-328, October.
    6. Fred R. Shapiro, 1992. "Origins of bibliometrics, citation indexing, and citation analysis: The neglected legal literature," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(5), pages 337-339, June.
    7. W. C. Adair, 1955. "Citation indexes for scientific literature?," American Documentation, Wiley Blackwell, vol. 6(1), pages 31-32, January.
    8. William W. Hood & Concepción S. Wilson, 2001. "The Literature of Bibliometrics, Scientometrics, and Informetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 52(2), pages 291-314, October.
    9. Loet Leydesdorff, 2002. "Indicators of structural change in the dynamics of science: Entropy statistics of the SCI Journal Citation Reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(1), pages 131-159, January.
    10. Mark R. Elkins & Christopher G. Maher & Robert D. Herbert & Anne M. Moseley & Catherine Sherrington, 2010. "Correlation between the Journal Impact Factor and three other journal citation indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 81-93, October.
    11. A. E. Cawkell, 1978. "Evaluating scientific journals with Journal Citation Reports — a case study in acoustics," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 29(1), pages 41-46, January.
    12. Éric Archambault & Vincent Larivière, 2009. "History of the journal impact factor: Contingencies and consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 635-649, June.
    13. Bella Hass Weinberg, 1997. "The earliest Hebrew citation indexes," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 48(4), pages 318-330, April.
    14. Jerome K. Vanclay, 2009. "Bias in the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 3-12, January.
    15. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Heather Keathley-Herring & Eileen Van Aken & Fernando Gonzalez-Aleu & Fernando Deschamps & Geert Letens & Pablo Cardenas Orlandini, 2016. "Assessing the maturity of a research area: bibliometric review and proposed framework," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 927-951, November.
    2. Marcelo Mendoza, 2021. "Differences in Citation Patterns across Areas, Article Types and Age Groups of Researchers," Publications, MDPI, vol. 9(4), pages 1-23, October.
    3. Azima, Mahshad & Seyis, Senem, 2023. "Science mapping the knowledge domain of energy performance research in the AEC industry: A scientometric analysis," Energy, Elsevier, vol. 264(C).
    4. Felipe de Araújo Nascimento & Flávia Melo Rodrigues, 2015. "Growth trend of scientific literature on genetic improvement through the database Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 805-816, November.
    5. Ruth Zárate-Rueda & Yolima Ivonne Beltrán-Villamizar & Daniella Murallas-Sánchez, 2021. "Social representations of socioenvironmental dynamics in extractive ecosystems and conservation practices with sustainable development: a bibliometric analysis," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(11), pages 16428-16453, November.
    6. Magdalena Formanowicz & Marta Witkowska & Weronika Hryniszak & Zuzanna Jakubik & Aleksandra Cisłak, 2023. "Gender bias in special issues: evidence from a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2283-2299, April.
    7. Carlo Galli & Stefano Guizzardi, 2021. "The Effect of Article Characteristics on Citation Number in a Diachronic Dataset of the Biomedical Literature on Chronic Inflammation: An Analysis by Ensemble Machines," Publications, MDPI, vol. 9(2), pages 1-11, April.
    8. Hale Turhan Damar & Ozlem Bilik & Guzin Ozdagoglu & Askin Ozdagoglu & Muhammet Damar, 2018. "Evaluating the nursing academicians in Turkey in the scope of Web of Science: scientometrics of original articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 539-562, April.
    9. Judith Czellar & Jacques Lanarès, 2013. "Quality of research: which underlying values?," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1003-1021, June.
    10. Luciano Rossoni & Rodrigo Assunção Rosa, 2020. "Genesis, Impact, and Identity of the Journal of Contemporary Administration," RAC - Revista de Administração Contemporânea (Journal of Contemporary Administration), ANPAD - Associação Nacional de Pós-Graduação e Pesquisa em Administração, vol. 24(5), pages 448-473.
    11. Cortés-Sánchez, Julián David, 2019. "Bibliometric outlook of the most cited documents in business, management and accounting in Ibero-America," SocArXiv cqa3z, Center for Open Science.
    12. Chilou Zhou & Yingjie Ren & Xinrui Yan & Yiran Zheng & Baoqing Liu, 2022. "A Bibliometric and Visualized Overview of Hydrogen Embrittlement from 1997 to 2022," Energies, MDPI, vol. 15(23), pages 1-22, December.
    13. Guangchao Charles Feng, 2020. "Research Performance Evaluation in China: A Big Data Analysis," SAGE Open, , vol. 10(1), pages 21582440199, January.
    14. José María Cavero & Belén Vela & Paloma Cáceres, 2014. "Computer science research: more production, less productivity," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2103-2111, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kun Lu & Isola Ajiferuke & Dietmar Wolfram, 2014. "Extending citer analysis to journal impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 245-260, July.
    2. de Carvalho, Gustavo Dambiski Gomes & Sokulski, Carla Cristiane & da Silva, Wesley Vieira & de Carvalho, Hélio Gomes & de Moura, Rafael Vignoli & de Francisco, Antonio Carlos & da Veiga, Claudimar Per, 2020. "Bibliometrics and systematic reviews: A comparison between the Proknow-C and the Methodi Ordinatio," Journal of Informetrics, Elsevier, vol. 14(3).
    3. Ying Guo & Xiantao Xiao, 2022. "Author-level altmetrics for the evaluation of Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 973-990, February.
    4. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    5. Juan Miguel Campanario, 2014. "The effect of citations on the significance of decimal places in the computation of journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 289-298, May.
    6. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    7. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    8. Juan Miguel Campanario, 2011. "Empirical study of journal impact factors obtained using the classical two-year citation window versus a five-year citation window," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 189-204, April.
    9. Gabriel-Alexandru Vȋiu & Mihai Păunescu, 2021. "The lack of meaningful boundary differences between journal impact factor quartiles undermines their independent use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1495-1525, February.
    10. Péter Vinkler, 2012. "The Garfield impact factor, one of the fundamental indicators in scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 471-483, August.
    11. Ziqiang Zeng & Lantian Shi, 2021. "A two-dimensional journal classification method based on output and input factors: perspectives from citation and authorship related indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3929-3964, May.
    12. Zeki Simsek & Ciaran Heavey & Justin J. P. Jansen, 2013. "Journal Impact as a Diffusion Process: A Conceptualization and the Case of the Journal of Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 50(8), pages 1374-1407, December.
    13. Alexandru T. Balaban, 2012. "Positive and negative aspects of citation indices and journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 241-247, August.
    14. Hamid Bouabid & Vincent Larivière, 2013. "The lengthening of papers’ life expectancy: a diachronous analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 695-717, December.
    15. Eliseo Reategui & Alause Pires & Michel Carniato & Sergio Roberto Kieling Franco, 2020. "Evaluation of Brazilian research output in education: confronting international and national contexts," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 427-444, October.
    16. Juan Miguel Campanario & Jesús Carretero & Vera Marangon & Antonio Molina & Germán Ros, 2011. "Effect on the journal impact factor of the number and document type of citing records: a wide-scale study," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 75-84, April.
    17. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2023. "Correlating article citedness and journal impact: an empirical investigation by field on a large-scale dataset," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1877-1894, March.
    18. Walters, William H., 2014. "Do Article Influence scores overestimate the citation impact of social science journals in subfields that are related to higher-impact natural science disciplines?," Journal of Informetrics, Elsevier, vol. 8(2), pages 421-430.
    19. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.
    20. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0685-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.