IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v53y2002i2d10.1023_a1014848323806.html
   My bibliography  Save this article

Journal impact measures in bibliometric research

Author

Listed:
  • Wolfgang Glänzel

    (ISSRU E-mail)

  • Henk F. Moed

    (Leiden University)

Abstract

The Impact Factor introduced by Eugene Garfield is a fundamental citation-based measure for significance and performance of scientific journals. It is perhaps the most popular bibliometric product used in bibliometrics itself, as well as outside the scientific community. First, a concise review of the background and history of the ISI impact factor and the basic ideas underlying it are given. A cross-citation matrix is used to visualise the construction of the Impact Factor and several related journal citation measures.Both strengths and flaws of the impact factor are discussed. Several attempts made by different authors to introduce more sophisticated journal citation measures and the reasons why many indicators aiming at a correction of methodological limitations of the Impact Factor were not successful are described. The next section is devoted to the analysis of basic technical and methodological aspects. In this context, the most important sources of possible biases and distortions for calculation and use of journal citation measures are studied. Thereafter, main characteristics of application contexts are summarised. The last section is concerned with questions of statistical reliability of journal citation measures. It is shown that in contrast to a common misbelief statistical methods can be applied to discrete "skewed" distributions, and that the statistical reliability of these statistics can be used as a basis for application of journal impact measures in comparative analyses. Finally, the question of sufficiency or insufficiency of a single, howsoever complex measure for characterising the citation impact of scientific journals is discussed.

Suggested Citation

  • Wolfgang Glänzel & Henk F. Moed, 2002. "Journal impact measures in bibliometric research," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 171-193, February.
    • Handle: RePEc:spr:scient:v:53:y:2002:i:2:d:10.1023_a:1014848323806
    DOI: 10.1023/A:1014848323806
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1023/A:1014848323806
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1023/A:1014848323806?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Danny P. Wallace, 1986. "The relationship between journal productivity and obsolescence," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 37(3), pages 136-145, May.
    2. H. F. Moed & Th. N. Leeuwen & J. Reedijk, 1999. "Towards appropriate indicators of journal impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(3), pages 575-589, November.
    3. Isao Asai, 1981. "Adjusted age distribution and its application to impact factor and immediacy index," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 32(3), pages 172-174, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Changyong & Cho, Yangrae & Seol, Hyeonju & Park, Yongtae, 2012. "A stochastic patent citation analysis approach to assessing future technological impacts," Technological Forecasting and Social Change, Elsevier, vol. 79(1), pages 16-29.
    2. Geert Campenhout & Tom Caneghem & Steve Uytbergen, 2008. "A comparison of overall and sub-area journal influence: The case of the accounting literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 61-90, October.
    3. Wolfgang Glänzel & András Schubert & Bart Thijs & Koenraad Debackere, 2011. "A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 415-424, May.
    4. Milojević, Staša & Radicchi, Filippo & Bar-Ilan, Judit, 2017. "Citation success index − An intuitive pair-wise journal comparison metric," Journal of Informetrics, Elsevier, vol. 11(1), pages 223-231.
    5. Narongrit Sombatsompop & T. Markpin & N. Premkamolnetr, 2004. "A modified method for calculating the Impact Factors of journals in ISI Journal Citation Reports: Polymer Science Category in 1997–2001," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(2), pages 217-235, June.
    6. José María Gómez-Sancho & María Jesús Mancebón-Torrubia, 2009. "The evaluation of scientific production: Towards a neutral impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 435-458, November.
    7. Jang, Hyun Jin & Woo, Han-Gyun & Lee, Changyong, 2017. "Hawkes process-based technology impact analysis," Journal of Informetrics, Elsevier, vol. 11(2), pages 511-529.
    8. Peter Jacso, 2012. "Grim tales about the impact factor and the h-index in the Web of Science and the Journal Citation Reports databases: reflections on Vanclay’s criticism," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 325-354, August.
    9. Wallace, Danny P. & Van Fleet, Connie & Downs, Lacey J., 2011. "The research core of the knowledge management literature," International Journal of Information Management, Elsevier, vol. 31(1), pages 14-20.
    10. Tove Faber Frandsen, 2008. "On the ratio of citable versus non-citable items in economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(3), pages 439-451, March.
    11. Ming-Yueh Tsay, 2009. "An analysis and comparison of scientometric data between journals of physics, chemistry and engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 279-293, February.
    12. Johannes Stegmann & Guenter Grohmann, 2001. "Citation rates, knowledge export and international visibility of dermatology journals listed and not listed in theJournal Citation Reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(3), pages 483-502, March.
    13. Gerard Pasterkamp & Joris I. Rotmans & Dominique V. P. Kleijn & Cornelius Borst, 2007. "Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(1), pages 153-165, January.
    14. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    15. Cecelia Brown, 2004. "The Matthew Effect of the Annual Reviews series and the flow of scientific communication through the World Wide Web," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(1), pages 25-30, May.
    16. Dašić Predrag, 2015. "State and Analysis of Scientific Journals in the Field of “Economic Sciences” for the Period 1995-2014," Economic Themes, Sciendo, vol. 53(4), pages 547-581, December.
    17. Primož Južnič & Stojan Pečlin & Matjaž Žaucer & Tilen Mandelj & Miro Pušnik & Franci Demšar, 2010. "Scientometric indicators: peer-review, bibliometric methods and conflict of interests," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 429-441, November.
    18. Wolfgang Glänzel, 2009. "The multi-dimensionality of journal impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 355-374, February.
    19. Dar-Zen Chen & Chang-Pin Lin & Mu-Hsuan Huang & Chen-Yu Huang, 2010. "Constructing a new patent bibliometric performance measure by using modified citation rate analyses with dynamic backward citation windows," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(1), pages 149-163, January.
    20. Tai Quan Peng & Zhen-Zhen Wang, 2013. "Network closure, brokerage, and structural influence of journals: a longitudinal study of journal citation network in Internet research (2000–2010)," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 675-693, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:53:y:2002:i:2:d:10.1023_a:1014848323806. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.