IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v82y2010i3d10.1007_s11192-010-0175-y.html
   My bibliography  Save this article

Journal Impact Factors for evaluating scientific performance: use of h-like indicators

Author

Listed:
  • Sebastian K. Boell

    () (University of New South Wales)

  • Concepción S. Wilson

    () (University of New South Wales)

Abstract

This article introduces the Impact Factor squared or IF2-index, an h-like indicator of research performance. This indicator reflects the degree to which large entities such as countries and/or their states participate in top-level research in a field or subfield. The IF2-index uses the Journal Impact Factor (JIF) of research publications instead of the number of citations. This concept is applied to other h-type indexes and their results compared to the IF2-index. These JIF-based indexes are then used to assess the overall performance of cancer research in Australia and its states over 8 years from 1999 to 2006. The IF2-index has three advantages when evaluating larger research units: firstly, it provides a stable value that does not change over time, reflecting the degree to which a research unit participated in top-level research in a given year; secondly, it can be calculated closely approximating the publication date of yearly datasets; and finally, it provides an additional dimension when a full article-based citation analysis is not feasible. As the index reflects the degree of participation in top-level research it may favor larger units when units of different sizes are compared.

Suggested Citation

  • Sebastian K. Boell & Concepción S. Wilson, 2010. "Journal Impact Factors for evaluating scientific performance: use of h-like indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 613-626, March.
  • Handle: RePEc:spr:scient:v:82:y:2010:i:3:d:10.1007_s11192-010-0175-y
    DOI: 10.1007/s11192-010-0175-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-010-0175-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lutz Bornmann & Gerlind Wallon & Anna Ledin, 2008. "Is the h index related to (standard) bibliometric measures and to the assessments by peers? An investigation of the h index by using molecular life sciences data," Research Evaluation, Oxford University Press, vol. 17(2), pages 149-156, June.
    2. Jean-Francois Molinari & Alain Molinari, 2008. "A new methodology for ranking scientific institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(1), pages 163-174, April.
    3. Burrell, Quentin L., 2007. "On the h-index, the size of the Hirsch core and Jin's A-index," Journal of Informetrics, Elsevier, vol. 1(2), pages 170-177.
    4. Mariana Pires Luz & Carla Marques-Portella & Mauro Mendlowicz & Sonia Gleiser & Evandro Silva Freire Coutinho & Ivan Figueira, 2008. "Institutional h-index: The performance of a new metric in the evaluation of Brazilian Psychiatric Post-graduation Programs," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 361-368, November.
    5. András Schubert, 2009. "Using the h-index for assessing single publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(3), pages 559-565, March.
    6. Vanclay, Jerome K., 2008. "Ranking forestry journals using the h-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 326-334.
    7. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    8. Rodrigo Costas & María Bordons, 2008. "Is g-index better than h-index? An exploratory study at the individual level," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 267-288, November.
    9. Egghe, L., 2008. "The influence of merging on h-type indices," Journal of Informetrics, Elsevier, vol. 2(3), pages 252-262.
    10. Tibor Braun & Wolfgang Glänzel & András Schubert, 2006. "A Hirsch-type index for journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 169-173, October.
    11. Schubert, András & Glänzel, Wolfgang, 2007. "A systematic analysis of Hirsch-type indices for journals," Journal of Informetrics, Elsevier, vol. 1(3), pages 179-184.
    12. András Schubert & András Korn & András Telcs, 2009. "Hirsch-type indices for characterizing networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 375-382, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. D. Gnana Bharathi, 2011. "Methodology for the evaluation of scientific journals: Aggregated Citations of Cited Articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(3), pages 563-574, March.
    2. Eduardo Araujo Oliveira & Roberto Peicots-Filho & Daniella Reis Martelli & Isabel Gomes Quirino & Maria Christina Lopes Oliveira & Mariana Guerra Duarte & Sergio Veloso Pinheiro & Enrico Antonio Colos, 2013. "Is there a correlation between journal impact factor and researchers’ performance? A study comprising the fields of clinical nephrology and neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 149-160, November.
    3. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, Open Access Journal, vol. 6(2), pages 1-1, April.
    4. Claus-Christian Carbon, 2011. "The Carbon_h-Factor: Predicting Individuals' Research Impact at Early Stages of Their Career," PLOS ONE, Public Library of Science, vol. 6(12), pages 1-7, December.
    5. Eduardo A. Oliveira & Enrico A. Colosimo & Daniella R. Martelli & Isabel G. Quirino & Maria Christina L. Oliveira & Leonardo S. Lima & Ana Cristina Simões e Silva & Hercílio Martelli-Júnior, 2012. "Comparison of Brazilian researchers in clinical medicine: are criteria for ranking well-adjusted?," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 429-443, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:82:y:2010:i:3:d:10.1007_s11192-010-0175-y. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla) or (Springer Nature Abstracting and Indexing). General contact details of provider: http://www.springer.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.