IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v92y2012i2d10.1007_s11192-012-0769-7.html
   My bibliography  Save this article

Grim tales about the impact factor and the h-index in the Web of Science and the Journal Citation Reports databases: reflections on Vanclay’s criticism

Author

Listed:
  • Peter Jacso

    (University of Hawaii)

Abstract

This paper reflects on the most current and some of the recent contributions of JK Vanclay, focusing on his methods, findings, and criticism about the journal citations reports and the web of science databases, the journal impact factor and the h-index. It is argued and demonstrated that some of the recent papers of the author about scientometric issues, measures and sources show so much demagoguery, ignorance and arrogance, have so much prejudice and bias, so profound errors in using the databases, calculating metrics, and interpreting search results that the papers are very unlikely to be meant as a genuine contribution from an academic who is a graduate of—among others—Oxford University, professor and dean in a respected university, a well-published and well-cited author and a recipient of the Queen’s Award (all the above in forest science). The papers are much more likely to serve as props for a staged, mock-up scenario based on slipshod research in an experiment, to illustrate the deficiencies in the processes and in the assessment of scholarly publishing productivity and impact in order to present the idealized solution of Vanclay: using the h-index, portrayed as the Prince, mounted on the shoulder of the White Horse, Google Scholar.

Suggested Citation

  • Peter Jacso, 2012. "Grim tales about the impact factor and the h-index in the Web of Science and the Journal Citation Reports databases: reflections on Vanclay’s criticism," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 325-354, August.
  • Handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0769-7
    DOI: 10.1007/s11192-012-0769-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-012-0769-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-012-0769-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alexandru T. Balaban, 2012. "Positive and negative aspects of citation indices and journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 241-247, August.
    2. Judit Bar-Ilan, 2008. "Which h-index? — A comparison of WoS, Scopus and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 257-271, February.
    3. Vanclay, Jerome K., 2008. "Ranking forestry journals using the h-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 326-334.
    4. Bar-Ilan, Judit, 2010. "Rankings of information and library science journals by JIF and by h-type indices," Journal of Informetrics, Elsevier, vol. 4(2), pages 141-147.
    5. Graeme Hirst, 1978. "Discipline impact factors: A method for determining core journal lists," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 29(4), pages 171-172, July.
    6. H. F. Moed & Th. N. Leeuwen & J. Reedijk, 1999. "Towards appropriate indicators of journal impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(3), pages 575-589, November.
    7. Ronald Rousseau, 2005. "Median and percentile impact factors: A set of new indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(3), pages 431-441, June.
    8. Narongrit Sombatsompop & T. Markpin & N. Premkamolnetr, 2004. "A modified method for calculating the Impact Factors of journals in ISI Journal Citation Reports: Polymer Science Category in 1997–2001," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(2), pages 217-235, June.
    9. David A. Pendlebury & Jonathan Adams, 2012. "Comments on a critique of the Thomson Reuters journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 395-401, August.
    10. Guang Yu & Liang Wang, 2007. "The self-cited rate of scientific journals and the manipulation of their impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(3), pages 321-330, December.
    11. Lokman I. Meho & Kiduk Yang, 2007. "Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(13), pages 2105-2125, November.
    12. Moed, Henk F., 2010. "Measuring contextual citation impact of scientific journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 265-277.
    13. Chun-Yang Yin & Mohd Jindra Aris & Xi Chen, 2010. "Combination of Eigenfactor TM and h-index to evaluate scientific journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 639-648, September.
    14. A. I. Pudovkin & Eugene Garfield, 2012. "Rank normalization of impact factors will resolve Vanclay’s dilemma with TRIF," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 409-412, August.
    15. Lutz Bornmann & Rüdiger Mutz & Hans‐Dieter Daniel, 2009. "Do we need the h index and its variants in addition to standard bibliometric measures?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(6), pages 1286-1289, June.
    16. Jerome K. Vanclay, 2009. "Bias in the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 3-12, January.
    17. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    18. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    19. Juan Miguel Campanario, 2011. "Empirical study of journal impact factors obtained using the classical two-year citation window versus a five-year citation window," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 189-204, April.
    20. Guang Yu & Xiao-Hong Wang & Da-Ren Yu, 2005. "The influence of publication delays on impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(2), pages 235-246, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stuart Brody, 2013. "Impact factor: Imperfect but not yet replaceable," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 255-257, July.
    2. Fiorenzo Franceschini & Domenico Maisano & Luca Mastrogiacomo, 2015. "Errors in DOI indexing by bibliometric databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2181-2186, March.
    3. Verónica Amarante & Martín Brun & Cecilia Rossel, 2020. "Poverty and inequality in Latin America’s research agenda: A bibliometric review," Development Policy Review, Overseas Development Institute, vol. 38(4), pages 465-482, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    2. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    3. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    4. Sangwal, Keshra, 2013. "Citation and impact factor distributions of scientific journals published in individual countries," Journal of Informetrics, Elsevier, vol. 7(2), pages 487-504.
    5. Liu, Xuan Zhen & Fang, Hui, 2020. "A comparison among citation-based journal indicators and their relative changes with time," Journal of Informetrics, Elsevier, vol. 14(1).
    6. Zhang, Lin & Thijs, Bart & Glänzel, Wolfgang, 2011. "The diffusion of H-related literature," Journal of Informetrics, Elsevier, vol. 5(4), pages 583-593.
    7. Ziqiang Zeng & Lantian Shi, 2021. "A two-dimensional journal classification method based on output and input factors: perspectives from citation and authorship related indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3929-3964, May.
    8. Zeki Simsek & Ciaran Heavey & Justin J. P. Jansen, 2013. "Journal Impact as a Diffusion Process: A Conceptualization and the Case of the Journal of Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 50(8), pages 1374-1407, December.
    9. Moussa, Salim & Touzani, Mourad, 2010. "Ranking marketing journals using the Google Scholar-based hg-index," Journal of Informetrics, Elsevier, vol. 4(1), pages 107-117.
    10. Finardi, Ugo, 2013. "Correlation between Journal Impact Factor and Citation Performance: An experimental study," Journal of Informetrics, Elsevier, vol. 7(2), pages 357-370.
    11. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    12. Judit Bar-Ilan, 2012. "Journal report card," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 249-260, August.
    13. Walters, William H., 2014. "Do Article Influence scores overestimate the citation impact of social science journals in subfields that are related to higher-impact natural science disciplines?," Journal of Informetrics, Elsevier, vol. 8(2), pages 421-430.
    14. Juan Miguel Campanario, 2014. "The effect of citations on the significance of decimal places in the computation of journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 289-298, May.
    15. Ana Teresa Santos & Sandro Mendonça, 2022. "Do papers (really) match journals’ “aims and scope”? A computational assessment of innovation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7449-7470, December.
    16. Petridis, Konstantinos & Malesios, Chrisovalantis & Arabatzis, Garyfallos & Thanassoulis, Emmanuel, 2013. "Efficiency analysis of forestry journals: Suggestions for improving journals’ quality," Journal of Informetrics, Elsevier, vol. 7(2), pages 505-521.
    17. Mike Thelwall, 2012. "Journal impact evaluation: a webometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 429-441, August.
    18. Maor Weinberger & Maayan Zhitomirsky-Geffet, 2021. "Diversity of success: measuring the scholarly performance diversity of tenured professors in the Israeli academia," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 2931-2970, April.
    19. Stuart Brody, 2013. "Impact factor: Imperfect but not yet replaceable," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 255-257, July.
    20. Xin Gu & Karen L. Blackmore, 2016. "Recent trends in academic journal growth," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 693-716, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0769-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.