IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v111y2017i3d10.1007_s11192-017-2351-9.html
   My bibliography  Save this article

A theoretical model of the relationship between the h-index and other simple citation indicators

Author

Listed:
  • Lucio Bertoli-Barsotti

    (University of Bergamo)

  • Tommaso Lando

    (University of Bergamo
    VŠB -TU Ostrava)

Abstract

Of the existing theoretical formulas for the h-index, those recently suggested by Burrell (J Informetr 7:774–783, 2013b) and by Bertoli-Barsotti and Lando (J Informetr 9(4):762–776, 2015) have proved very effective in estimating the actual value of the h-index Hirsch (Proc Natl Acad Sci USA 102:16569–16572, 2005), at least at the level of the individual scientist. These approaches lead (or may lead) to two slightly different formulas, being based, respectively, on a “standard” and a “shifted” version of the geometric distribution. In this paper, we review the genesis of these two formulas—which we shall call the “basic” and “improved” Lambert-W formula for the h-index—and compare their effectiveness with that of a number of instances taken from the well-known Glänzel–Schubert class of models for the h-index (based, instead, on a Paretian model) by means of an empirical study. All the formulas considered in the comparison are “ready-to-use”, i.e., functions of simple citation indicators such as: the total number of publications; the total number of citations; the total number of cited paper; the number of citations of the most cited paper. The empirical study is based on citation data obtained from two different sets of journals belonging to two different scientific fields: more specifically, 231 journals from the area of “Statistics and Mathematical Methods” and 100 journals from the area of “Economics, Econometrics and Finance”, totaling almost 100,000 and 20,000 publications, respectively. The citation data refer to different publication/citation time windows, different types of “citable” documents, and alternative approaches to the analysis of the citation process (“prospective” and “retrospective”). We conclude that, especially in its improved version, the Lambert-W formula for the h-index provides a quite robust and effective ready-to-use rule that should be preferred to other known formulas if one’s goal is (simply) to derive a reliable estimate of the h-index.

Suggested Citation

  • Lucio Bertoli-Barsotti & Tommaso Lando, 2017. "A theoretical model of the relationship between the h-index and other simple citation indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1415-1448, June.
    • Handle: RePEc:spr:scient:v:111:y:2017:i:3:d:10.1007_s11192-017-2351-9
    DOI: 10.1007/s11192-017-2351-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2351-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2351-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2015. "Bibliometric evaluation vs. informed peer review: Evidence from Italy," Research Policy, Elsevier, vol. 44(2), pages 451-466.
    2. Aggelos Bletsas & John N. Sahalos, 2009. "Hirsch index rankings require scaling and higher moment," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(12), pages 2577-2586, December.
    3. Loet Leydesdorff & Tobias Opthof, 2010. "Scopus's source normalized impact per paper (SNIP) versus a journal impact factor based on fractional counting of citations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(11), pages 2365-2369, November.
    4. John Panaretos & Chrisovaladis Malesios, 2009. "Assessing scientific research performance and impact with single indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 635-670, December.
    5. Juan E. Iglesias & Carlos Pecharromán, 2007. "Scaling the h-index for different scientific ISI fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(3), pages 303-320, December.
    6. David I. Stern, 2013. "Uncertainty Measures for Economics Journal Impact Factors," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 173-189, March.
    7. Burrell, Quentin L., 2013. "A stochastic approach to the relation between the impact factor and the uncitedness factor," Journal of Informetrics, Elsevier, vol. 7(3), pages 676-682.
    8. Burrell, Quentin L., 2007. "Hirsch's h-index: A stochastic model," Journal of Informetrics, Elsevier, vol. 1(1), pages 16-25.
    9. Filippo Radicchi & Claudio Castellano, 2013. "Analysis of bibliometric indicators for individual scholars in a large data set," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 627-637, December.
    10. Quentin L. Burrell, 2013. "Formulae for the h-index: A lack of robustness in Lotkaian informetrics?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(7), pages 1504-1514, July.
    11. Leo Egghe & Ronald Rousseau, 2006. "An informetric model for the Hirsch-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 121-129, October.
    12. Vanclay, Jerome K., 2008. "Ranking forestry journals using the h-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 326-334.
    13. Bar-Ilan, Judit, 2010. "Rankings of information and library science journals by JIF and by h-type indices," Journal of Informetrics, Elsevier, vol. 4(2), pages 141-147.
    14. Peter Vinkler, 2013. "Quantity and impact through a single indicator," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(5), pages 1084-1085, May.
    15. Seiler, Christian & Wohlrabe, Klaus, 2014. "How robust are journal rankings based on the impact factor? Evidence from the economic sciences," Journal of Informetrics, Elsevier, vol. 8(4), pages 904-911.
    16. Pascal Bador & Thierry Lafouge, 2010. "Comparative analysis between impact factor and h-index for pharmacology and psychiatry journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 65-79, July.
    17. Schubert, András & Glänzel, Wolfgang, 2007. "A systematic analysis of Hirsch-type indices for journals," Journal of Informetrics, Elsevier, vol. 1(3), pages 179-184.
    18. Peter Vinkler, 2013. "Quantity and impact through a single indicator," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(5), pages 1084-1085, May.
    19. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    20. Chrisovalantis Malesios, 2015. "Some variations on the standard theoretical models for the h-index: A comparative analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2384-2388, November.
    21. Burrell, Quentin L., 2013. "The h-index: A case of the tail wagging the dog?," Journal of Informetrics, Elsevier, vol. 7(4), pages 774-783.
    22. Leo Egghe & Ronald Rousseau, 2012. "The Hirsch index of a shifted Lotka function and its relation with the impact factor," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(5), pages 1048-1053, May.
    23. Hamid Bouabid & Mohamed Dalimi & Zayer ElMajid, 2011. "Impact evaluation of the voluntary early retirement policy on research and technology outputs of the faculties of science in Morocco," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 125-132, January.
    24. Anne‐Wil Harzing & Ron van der Wal, 2009. "A Google Scholar h‐index for journals: An alternative metric to measure journal impact in economics and business," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 41-46, January.
    25. Peter Ingwersen, 2012. "The pragmatics of a diachronic journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 319-324, August.
    26. Schreiber, Michael, 2015. "Restricting the h-index to a publication and citation time window: A case study of a timed Hirsch index," Journal of Informetrics, Elsevier, vol. 9(1), pages 150-155.
    27. Egghe, L., 2013. "The functional relation between the impact factor and the uncitedness factor revisited," Journal of Informetrics, Elsevier, vol. 7(1), pages 183-189.
    28. Star X. Zhao & Paul L. Zhang & Jiang Li & Alice M. Tan & Fred Y. Ye, 2014. "Abstracting the core subnet of weighted networks based on link strengths," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(5), pages 984-994, May.
    29. András Schubert, 2012. "A Hirsch-type index of co-author partnership ability," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 303-308, April.
    30. Fred Y. Ye, 2009. "An investigation on mathematical models of the h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 493-498, November.
    31. Leo Egghe & Ronald Rousseau, 2012. "The Hirsch index of a shifted Lotka function and its relation with the impact factor," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(5), pages 1048-1053, May.
    32. Schreiber, M. & Malesios, C.C. & Psarakis, S., 2012. "Exploratory factor analysis for the Hirsch index, 17 h-type variants, and some traditional bibliometric indicators," Journal of Informetrics, Elsevier, vol. 6(3), pages 347-358.
    33. Hsu, Jiann-wien & Huang, Ding-wei, 2012. "A scaling between Impact Factor and uncitedness," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(5), pages 2129-2134.
    34. Edit Csajbók & Anna Berhidi & Lívia Vasas & András Schubert, 2007. "Hirsch-index for countries based on Essential Science Indicators data," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(1), pages 91-117, October.
    35. András Schubert & András Korn & András Telcs, 2009. "Hirsch-type indices for characterizing networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 375-382, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lucio Bertoli-Barsotti & Tommaso Lando, 2017. "The h-index as an almost-exact function of some basic statistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1209-1228, November.
    2. Deming Lin & Tianhui Gong & Wenbin Liu & Martin Meyer, 2020. "An entropy-based measure for the evolution of h index research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2283-2298, December.
    3. David A. Groneberg & Doris Klingelhöfer & Dörthe Brüggmann & Cristian Scutaru & Axel Fischer & David Quarcoo, 2019. "New quality and quantity indices in science (NewQIS): results of the first decade—project progress review," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 451-478, October.
    4. Marek Gagolewski & Barbara Żogała-Siudem & Grzegorz Siudem & Anna Cena, 2022. "Ockham’s index of citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2829-2845, May.
    5. Brito, Ricardo & Navarro, Alonso Rodríguez, 2021. "The inconsistency of h-index: A mathematical analysis," Journal of Informetrics, Elsevier, vol. 15(1).
    6. Wei, Shelia X. & Tong, Tong & Rousseau, Ronald & Wang, Wanru & Ye, Fred Y., 2022. "Relations among the h-, g-, ψ-, and p-index and offset-ability," Journal of Informetrics, Elsevier, vol. 16(4).
    7. Bertoli-Barsotti, Lucio & Lando, Tommaso, 2019. "How mean rank and mean size may determine the generalised Lorenz curve: With application to citation analysis," Journal of Informetrics, Elsevier, vol. 13(1), pages 387-396.
    8. Huchang Liao & Ming Tang & Li Luo & Chunyang Li & Francisco Chiclana & Xiao-Jun Zeng, 2018. "A Bibliometric Analysis and Visualization of Medical Big Data Research," Sustainability, MDPI, vol. 10(1), pages 1-18, January.
    9. Linying Jia & Ao Cheng & Naqash Alam & Yuxuan Qian & Zeyao Ma & Honghao Ren & Rong Wang & Enqi Liu, 2021. "Global Trends in Atherosclerosis Research in the Epigenetics Field: Bibliometric and Visualization Studies," IJERPH, MDPI, vol. 18(24), pages 1-12, December.
    10. Biró, Tamás S. & Telcs, András & Józsa, Máté & Néda, Zoltán, 2023. "Gintropic scaling of scientometric indexes," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 618(C).
    11. Wojciech Charemza & Michal Lewandowski & Lukasz Wozny, 2021. "Efficiency in rewarding academic journal publications. The case of Poland," KAE Working Papers 2021-062, Warsaw School of Economics, Collegium of Economic Analysis.
    12. Mingyang Wang & Shijia Jiao & Kah-Hin Chai & Guangsheng Chen, 2019. "Building journal’s long-term impact: using indicators detected from the sustained active articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 261-283, October.
    13. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.
    14. Gangan Prathap, 2018. "Letter to the editor: Dimensionless citation indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1433-1435, June.
    15. Lucio Bertoli-Barsotti, 2017. "Reply to the comments of Prathap," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1137-1140, August.
    16. Gangan Prathap, 2017. "Letter to the editor: comments on the paper of Lucio Bertoli-Barsotti and Tommaso Lando: a theoretical model of the relationship between the h-index and other simple citation indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1133-1136, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bertoli-Barsotti, Lucio & Lando, Tommaso, 2015. "On a formula for the h-index," Journal of Informetrics, Elsevier, vol. 9(4), pages 762-776.
    2. Wei, Shelia X. & Tong, Tong & Rousseau, Ronald & Wang, Wanru & Ye, Fred Y., 2022. "Relations among the h-, g-, ψ-, and p-index and offset-ability," Journal of Informetrics, Elsevier, vol. 16(4).
    3. Lucio Bertoli-Barsotti & Tommaso Lando, 2017. "The h-index as an almost-exact function of some basic statistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1209-1228, November.
    4. Tokmachev, Andrey M., 2023. "Hidden scales in statistics of citation indicators," Journal of Informetrics, Elsevier, vol. 17(1).
    5. Bertoli-Barsotti, Lucio & Lando, Tommaso, 2019. "How mean rank and mean size may determine the generalised Lorenz curve: With application to citation analysis," Journal of Informetrics, Elsevier, vol. 13(1), pages 387-396.
    6. Zhang, Lin & Thijs, Bart & Glänzel, Wolfgang, 2011. "The diffusion of H-related literature," Journal of Informetrics, Elsevier, vol. 5(4), pages 583-593.
    7. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2019. "A new parameter for (normalized) evaluation of H-index: countries as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1065-1078, March.
    8. Burrell, Quentin L., 2013. "The h-index: A case of the tail wagging the dog?," Journal of Informetrics, Elsevier, vol. 7(4), pages 774-783.
    9. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.
    10. Anna Tietze & Philip Hofmann, 2019. "The h-index and multi-author hm-index for individual researchers in condensed matter physics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 171-185, April.
    11. Lando, Tommaso & Bertoli-Barsotti, Lucio, 2017. "Measuring the citation impact of journals with generalized Lorenz curves," Journal of Informetrics, Elsevier, vol. 11(3), pages 689-703.
    12. Mingyang Wang & Shijia Jiao & Kah-Hin Chai & Guangsheng Chen, 2019. "Building journal’s long-term impact: using indicators detected from the sustained active articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 261-283, October.
    13. John Panaretos & Chrisovaladis Malesios, 2009. "Assessing scientific research performance and impact with single indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 635-670, December.
    14. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    15. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    16. Petridis, Konstantinos & Malesios, Chrisovalantis & Arabatzis, Garyfallos & Thanassoulis, Emmanuel, 2013. "Efficiency analysis of forestry journals: Suggestions for improving journals’ quality," Journal of Informetrics, Elsevier, vol. 7(2), pages 505-521.
    17. Hu, Zewen & Wu, Yishan, 2014. "Regularity in the time-dependent distribution of the percentage of never-cited papers: An empirical pilot study based on the six journals," Journal of Informetrics, Elsevier, vol. 8(1), pages 136-146.
    18. Edgar D. Zanotto & Vinicius Carvalho, 2021. "Article age- and field-normalized tools to evaluate scientific impact and momentum," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 2865-2883, April.
    19. Fred Y. Ye, 2009. "An investigation on mathematical models of the h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 493-498, November.
    20. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2020. "Prolificacy and visibility versus reputation in the hard sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 207-221, April.

    More about this item

    Keywords

    Journal ranking; h-index for journals; Journal impact factor; Glänzel–Schubert formula; Geometric distribution; Lambert W function;
    All these keywords.

    JEL classification:

    • C46 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Specific Distributions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:111:y:2017:i:3:d:10.1007_s11192-017-2351-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.