IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v46y1999i3d10.1007_bf02459613.html
   My bibliography  Save this article

Towards appropriate indicators of journal impact

Author

Listed:
  • H. F. Moed

    (Leiden University)

  • Th. N. Leeuwen

    (Leiden University)

  • J. Reedijk

    (Leiden University)

Abstract

This paper reviews a range of studies conducted by the authors on indicators reflecting scholarly journal impact. A critical examination of the journal impact data in theJournal Citation Reports (JCR), published by the Institute for Scientific Information (ISI) has shown that the JCR impact factor is inaccurate and biased towards journals revealing a rapid maturing or decline in impact. In addition, it was found that the JCR cited half life is an inappropriate measure of decline of journal impact. More appropriate impact measures of scholarly journals are proposed. A new classification system is explored, describing both maturing and decline of journal impact as measured through citations. Suggestions for future research are made, analysing in more detail the distribution of citations among papers in a journal.

Suggested Citation

  • H. F. Moed & Th. N. Leeuwen & J. Reedijk, 1999. "Towards appropriate indicators of journal impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(3), pages 575-589, November.
    • Handle: RePEc:spr:scient:v:46:y:1999:i:3:d:10.1007_bf02459613
    DOI: 10.1007/BF02459613
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/BF02459613
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/BF02459613?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wolfgang Glänzel & Henk F. Moed, 2002. "Journal impact measures in bibliometric research," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 171-193, February.
    2. José María Gómez-Sancho & María Jesús Mancebón-Torrubia, 2010. "A new approach to measuring scientific production in JCR journals and its application to Spanish public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 271-293, October.
    3. Johannes Stegmann & Guenter Grohmann, 2001. "Citation rates, knowledge export and international visibility of dermatology journals listed and not listed in theJournal Citation Reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(3), pages 483-502, March.
    4. Wolfgang Glänzel, 2009. "The multi-dimensionality of journal impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 355-374, February.
    5. Primož Južnič & Stojan Pečlin & Matjaž Žaucer & Tilen Mandelj & Miro Pušnik & Franci Demšar, 2010. "Scientometric indicators: peer-review, bibliometric methods and conflict of interests," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 429-441, November.
    6. Zeki Simsek & Ciaran Heavey & Justin J. P. Jansen, 2013. "Journal Impact as a Diffusion Process: A Conceptualization and the Case of the Journal of Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 50(8), pages 1374-1407, December.
    7. Dag W. Aksnes & Gunnar Sivertsen, 2004. "The effect of highly cited papers on national citation indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 59(2), pages 213-224, February.
    8. Milojević, Staša & Radicchi, Filippo & Bar-Ilan, Judit, 2017. "Citation success index − An intuitive pair-wise journal comparison metric," Journal of Informetrics, Elsevier, vol. 11(1), pages 223-231.
    9. Ming-Yueh Tsay, 2009. "An analysis and comparison of scientometric data between journals of physics, chemistry and engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 279-293, February.
    10. Gerard Pasterkamp & Joris I. Rotmans & Dominique V. P. Kleijn & Cornelius Borst, 2007. "Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(1), pages 153-165, January.
    11. José María Gómez-Sancho & María Jesús Mancebón-Torrubia, 2009. "The evaluation of scientific production: Towards a neutral impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 435-458, November.
    12. Rüdiger Mutz & Hans-Dieter Daniel, 2012. "The generalized propensity score methodology for estimating unbiased journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 377-390, August.
    13. Didegah, Fereshteh & Thelwall, Mike & Gazni, Ali, 2012. "An international comparison of journal publishing and citing behaviours," Journal of Informetrics, Elsevier, vol. 6(4), pages 516-531.
    14. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    15. Peter Jacso, 2012. "Grim tales about the impact factor and the h-index in the Web of Science and the Journal Citation Reports databases: reflections on Vanclay’s criticism," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 325-354, August.
    16. Frandsen, Tove Faber, 2007. "Journal self-citations—Analysing the JIF mechanism," Journal of Informetrics, Elsevier, vol. 1(1), pages 47-58.
    17. Tai Quan Peng & Zhen-Zhen Wang, 2013. "Network closure, brokerage, and structural influence of journals: a longitudinal study of journal citation network in Internet research (2000–2010)," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 675-693, December.
    18. Geert Campenhout & Tom Caneghem & Steve Uytbergen, 2008. "A comparison of overall and sub-area journal influence: The case of the accounting literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 61-90, October.
    19. Jerome K. Vanclay, 2009. "Bias in the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 3-12, January.
    20. Tove Faber Frandsen, 2008. "On the ratio of citable versus non-citable items in economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(3), pages 439-451, March.
    21. Vanclay, Jerome K., 2008. "Ranking forestry journals using the h-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 326-334.
    22. Ziqiang Zeng & Lantian Shi, 2021. "A two-dimensional journal classification method based on output and input factors: perspectives from citation and authorship related indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3929-3964, May.
    23. Péter Vinkler, 2002. "Subfield problems in applying the Garfield (Impact) Factors in practice," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 267-279, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:46:y:1999:i:3:d:10.1007_bf02459613. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.