IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v82y2010i3d10.1007_s11192-010-0175-y.html
   My bibliography  Save this article

Journal Impact Factors for evaluating scientific performance: use of h-like indicators

Author

Listed:
  • Sebastian K. Boell

    (University of New South Wales)

  • Concepción S. Wilson

    (University of New South Wales)

Abstract

This article introduces the Impact Factor squared or IF2-index, an h-like indicator of research performance. This indicator reflects the degree to which large entities such as countries and/or their states participate in top-level research in a field or subfield. The IF2-index uses the Journal Impact Factor (JIF) of research publications instead of the number of citations. This concept is applied to other h-type indexes and their results compared to the IF2-index. These JIF-based indexes are then used to assess the overall performance of cancer research in Australia and its states over 8 years from 1999 to 2006. The IF2-index has three advantages when evaluating larger research units: firstly, it provides a stable value that does not change over time, reflecting the degree to which a research unit participated in top-level research in a given year; secondly, it can be calculated closely approximating the publication date of yearly datasets; and finally, it provides an additional dimension when a full article-based citation analysis is not feasible. As the index reflects the degree of participation in top-level research it may favor larger units when units of different sizes are compared.

Suggested Citation

  • Sebastian K. Boell & Concepción S. Wilson, 2010. "Journal Impact Factors for evaluating scientific performance: use of h-like indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 613-626, March.
    • Handle: RePEc:spr:scient:v:82:y:2010:i:3:d:10.1007_s11192-010-0175-y
    DOI: 10.1007/s11192-010-0175-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-010-0175-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-010-0175-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jean-Francois Molinari & Alain Molinari, 2008. "A new methodology for ranking scientific institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(1), pages 163-174, April.
    2. Mariana Pires Luz & Carla Marques-Portella & Mauro Mendlowicz & Sonia Gleiser & Evandro Silva Freire Coutinho & Ivan Figueira, 2008. "Institutional h-index: The performance of a new metric in the evaluation of Brazilian Psychiatric Post-graduation Programs," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 361-368, November.
    3. Per O. Seglen, 1994. "Causal relationship between article citedness and journal impact," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 45(1), pages 1-11, January.
    4. Charles Oppenheim, 2007. "Using the h‐index to rank influential British researchers in information science and librarianship," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(2), pages 297-301, January.
    5. András Schubert, 2009. "Using the h-index for assessing single publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(3), pages 559-565, March.
    6. Vanclay, Jerome K., 2008. "Ranking forestry journals using the h-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 326-334.
    7. Anthony F. J. Raan, 2006. "Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(3), pages 491-502, June.
    8. Schubert, András & Glänzel, Wolfgang, 2007. "A systematic analysis of Hirsch-type indices for journals," Journal of Informetrics, Elsevier, vol. 1(3), pages 179-184.
    9. Michael Schreiber, 2008. "An empirical investigation of the g‐index for 26 physicists in comparison with the h‐index, the A‐index, and the R‐index," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(9), pages 1513-1522, July.
    10. Lutz Bornmann & Gerlind Wallon & Anna Ledin, 2008. "Is the h index related to (standard) bibliometric measures and to the assessments by peers? An investigation of the h index by using molecular life sciences data," Research Evaluation, Oxford University Press, vol. 17(2), pages 149-156, June.
    11. Burrell, Quentin L., 2007. "On the h-index, the size of the Hirsch core and Jin's A-index," Journal of Informetrics, Elsevier, vol. 1(2), pages 170-177.
    12. Lutz Bornmann & Hans‐Dieter Daniel, 2007. "What do we know about the h index?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(9), pages 1381-1385, July.
    13. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    14. Rodrigo Costas & María Bordons, 2008. "Is g-index better than h-index? An exploratory study at the individual level," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 267-288, November.
    15. Egghe, L., 2008. "The influence of merging on h-type indices," Journal of Informetrics, Elsevier, vol. 2(3), pages 252-262.
    16. Tibor Braun & Wolfgang Glänzel & András Schubert, 2006. "A Hirsch-type index for journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 169-173, October.
    17. András Schubert & András Korn & András Telcs, 2009. "Hirsch-type indices for characterizing networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 375-382, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. D. Gnana Bharathi, 2011. "Methodology for the evaluation of scientific journals: Aggregated Citations of Cited Articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(3), pages 563-574, March.
    2. Eduardo Araujo Oliveira & Roberto Peicots-Filho & Daniella Reis Martelli & Isabel Gomes Quirino & Maria Christina Lopes Oliveira & Mariana Guerra Duarte & Sergio Veloso Pinheiro & Enrico Antonio Colos, 2013. "Is there a correlation between journal impact factor and researchers’ performance? A study comprising the fields of clinical nephrology and neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 149-160, November.
    3. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.
    4. repec:jes:wpaper:y:2012:v:4:p:636-647 is not listed on IDEAS
    5. Claus-Christian Carbon, 2011. "The Carbon_h-Factor: Predicting Individuals' Research Impact at Early Stages of Their Career," PLOS ONE, Public Library of Science, vol. 6(12), pages 1-7, December.
    6. Eduardo A. Oliveira & Enrico A. Colosimo & Daniella R. Martelli & Isabel G. Quirino & Maria Christina L. Oliveira & Leonardo S. Lima & Ana Cristina Simões e Silva & Hercílio Martelli-Júnior, 2012. "Comparison of Brazilian researchers in clinical medicine: are criteria for ranking well-adjusted?," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 429-443, February.
    7. Carmen Anton & Nelu Florea & Silviu-Mihail Tiþã, 2012. "Comparison Of Scientific Socio-Economic Research Performances In Eastern European Universities," CES Working Papers, Centre for European Studies, Alexandru Ioan Cuza University, vol. 4(4), pages 636-647, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    2. Vieira, E.S. & Gomes, J.A.N.F., 2010. "A research impact indicator for institutions," Journal of Informetrics, Elsevier, vol. 4(4), pages 581-590.
    3. Cabrerizo, F.J. & Alonso, S. & Herrera-Viedma, E. & Herrera, F., 2010. "q2-Index: Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core," Journal of Informetrics, Elsevier, vol. 4(1), pages 23-28.
    4. John Panaretos & Chrisovaladis Malesios, 2009. "Assessing scientific research performance and impact with single indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 635-670, December.
    5. Bornmann, Lutz & Mutz, Rüdiger & Hug, Sven E. & Daniel, Hans-Dieter, 2011. "A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants," Journal of Informetrics, Elsevier, vol. 5(3), pages 346-359.
    6. Fiorenzo Franceschini & Domenico Maisano & Anna Perotti & Andrea Proto, 2010. "Analysis of the ch-index: an indicator to evaluate the diffusion of scientific research output by citers," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 203-217, October.
    7. Zhang, Lin & Thijs, Bart & Glänzel, Wolfgang, 2011. "The diffusion of H-related literature," Journal of Informetrics, Elsevier, vol. 5(4), pages 583-593.
    8. Parul Khurana & Kiran Sharma, 2022. "Impact of h-index on author’s rankings: an improvement to the h-index for lower-ranked authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4483-4498, August.
    9. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    10. Norris, Michael & Oppenheim, Charles, 2010. "Peer review and the h-index: Two studies," Journal of Informetrics, Elsevier, vol. 4(3), pages 221-232.
    11. Franceschini, Fiorenzo & Maisano, Domenico, 2011. "Structured evaluation of the scientific output of academic research groups by recent h-based indicators," Journal of Informetrics, Elsevier, vol. 5(1), pages 64-74.
    12. Judit Bar-Ilan & Mark Levene, 2015. "The hw-rank: an h-index variant for ranking web pages," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2247-2253, March.
    13. Pascal Bador & Thierry Lafouge, 2010. "Comparative analysis between impact factor and h-index for pharmacology and psychiatry journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 65-79, July.
    14. Woeginger, Gerhard J., 2008. "An axiomatic analysis of Egghe’s g-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 364-368.
    15. Anna Tietze & Philip Hofmann, 2019. "The h-index and multi-author hm-index for individual researchers in condensed matter physics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 171-185, April.
    16. Franceschini, Fiorenzo & Maisano, Domenico, 2010. "The Hirsch spectrum: A novel tool for analyzing scientific journals," Journal of Informetrics, Elsevier, vol. 4(1), pages 64-73.
    17. Kuan, Chung-Huei & Huang, Mu-Hsuan & Chen, Dar-Zen, 2013. "Cross-field evaluation of publications of research institutes using their contributions to the fields’ MVPs determined by h-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 455-468.
    18. Gad Saad, 2010. "Applying the h-index in exploring bibliometric properties of elite marketing scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(2), pages 423-433, May.
    19. van Eck, N.J.P. & Waltman, L., 2008. "Generalizing the h- and g-indices," ERIM Report Series Research in Management ERS-2008-049-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    20. Petr Praus, 2019. "High-ranked citations percentage as an indicator of publications quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 319-329, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:82:y:2010:i:3:d:10.1007_s11192-010-0175-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.