IDEAS home Printed from https://ideas.repec.org/a/gam/jpubli/v12y2024i2p12-d1380265.html

Coping with the Inequity and Inefficiency of the H-Index: A Cross-Disciplinary Empirical Analysis

Author

Listed:
  • Fabio Zagonari

    (Dipartimento di Scienze per la Qualità della Vita, Università di Bologna, C.so d’Augusto 237, 47921 Rimini, Italy)

  • Paolo Foschi

    (Dipartimento di Scienze Statistiche “Paolo Fortunati”, Università di Bologna, 40126 Bologna, Italy)

Abstract

This paper measures two main inefficiency features (many publications other than articles; many co-authors’ reciprocal citations) and two main inequity features (more co-authors in some disciplines; more citations for authors with more experience). It constructs a representative dataset based on a cross-disciplinary balanced sample (10,000 authors with at least one publication indexed in Scopus from 2006 to 2015). It estimates to what extent four additional improvements of the H-index as top-down regulations (∆H h = H h − H h+1 from H 1 = based on publications to H 5 = net per-capita per-year based on articles) account for inefficiency and inequity across twenty-five disciplines and four subjects. Linear regressions and ANOVA results show that the single improvements of the H-index considerably and decreasingly explain the inefficiency and inequity features but make these vaguely comparable across disciplines and subjects, while the overall improvement of the H-index (H 1 –H 5 ) marginally explains these features but make disciplines and subjects clearly comparable, to a greater extent across subjects than disciplines. Fitting a Gamma distribution to H 5 for each discipline and subject by maximum likelihood shows that the estimated probability densities and the percentages of authors characterised by H 5 ≥ 1 to H 5 ≥ 3 are different across disciplines but similar across subjects.

Suggested Citation

  • Fabio Zagonari & Paolo Foschi, 2024. "Coping with the Inequity and Inefficiency of the H-Index: A Cross-Disciplinary Empirical Analysis," Publications, MDPI, vol. 12(2), pages 1-30, April.
  • Handle: RePEc:gam:jpubli:v:12:y:2024:i:2:p:12-:d:1380265
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2304-6775/12/2/12/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2304-6775/12/2/12/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John Mingers & Martin Meyer, 2017. "Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1111-1121, August.
    2. Tolga Yuret, 2018. "Author-weighted impact factor and reference return ratio: can we attain more equality among fields?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2097-2111, September.
    3. Matthias Kuppler, 2022. "Predicting the future impact of Computer Science researchers: Is there a gender bias?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6695-6732, November.
    4. John Mingers & Martin Meyer, 2017. "Erratum to: Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1123-1124, August.
    5. James C. Ryan, 2016. "A validation of the individual annual h-index (hIa): application of the hIa to a qualitatively and quantitatively different sample," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(1), pages 577-590, October.
    6. Zahid Halim & Shafaq Khan, 2019. "A data science-based framework to categorize academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 393-423, April.
    7. Tanmoy Konar, 2021. "Author-Suggested, Weighted Citation Index: A Novel Approach for Determining the Contribution of Individual Researchers," Publications, MDPI, vol. 9(3), pages 1-8, July.
    8. Corey J A Bradshaw & Justin M Chalker & Stefani A Crabtree & Bart A Eijkelkamp & John A Long & Justine R Smith & Kate Trinajstic & Vera Weisbecker, 2021. "A fairer way to compare researchers at any career stage and in any discipline using open-access citation data," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-15, September.
    9. Rizwan Ghani & Faiza Qayyum & Muhammad Tanvir Afzal & Hermann Maurer, 2019. "Comprehensive evaluation of h-index and its extensions in the domain of mathematics," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 809-822, March.
    10. Yves Fassin, 2020. "The HF-rating as a universal complement to the h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 965-990, November.
    11. Abdulrahman A. Alshdadi & Muhammad Usman & Madini O. Alassafi & Muhammad Tanvir Afzal & Rayed AlGhamdi, 2023. "Formulation of rules for the scientific community using deep learning," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1825-1852, March.
    12. Eungi Kim & Da-Yeong Jeong, 2023. "Dominant Characteristics of Subject Categories in a Multiple-Category Hierarchical Scheme: A Case Study of Scopus," Publications, MDPI, vol. 11(4), pages 1-13, December.
    13. Lorna Wildgaard, 2015. "A comparison of 17 author-level bibliometric indicators for researchers in Astronomy, Environmental Science, Philosophy and Public Health in Web of Science and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 873-906, September.
    14. Yinyu Jin & Sha Yuan & Zhou Shao & Wendy Hall & Jie Tang, 2021. "Turing Award elites revisited: patterns of productivity, collaboration, authorship and impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2329-2348, March.
    15. Muhammad Usman & Ghulam Mustafa & Muhammad Tanvir Afzal, 2021. "Ranking of author assessment parameters using Logistic Regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 335-353, January.
    16. Ana C. M. Brito & Filipi N. Silva & Diego R. Amancio, 2023. "Analyzing the influence of prolific collaborations on authors productivity and visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2471-2487, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fabio Zagonari, 2025. "Ethicametrics: A New Interdisciplinary Science," Stats, MDPI, vol. 8(3), pages 1-19, June.
    2. Omar S. Asfour & Jamal Al-Qawasmi, 2024. "Research Metrics in Architecture: An Analysis of the Current Challenges Compared to Engineering Disciplines," Publications, MDPI, vol. 12(4), pages 1-17, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Diana Barros (a) Aurora A.C. Teixeira (b), 2021. "A Portrait of Development Economics in the Last Sixty Years," Journal of Economic Development, Chung-Ang Unviersity, Department of Economics, vol. 46(2), pages 69-118, June.
    2. Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "A novel method for depicting academic disciplines through Google Scholar Citations: The case of Bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1251-1273, March.
    3. Mahsa Kaveh & Mahdieh Mirzabeigi & Hajar Sotudeh & Amirsaeid Moloodi, 2022. "The effects of the challenges in the transliteration of Persian names into English on the recall of retrieved results in the web of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 1099-1128, February.
    4. Luna-Morales Maria Elena & Luna-Morales Evelia & Pérez-Angón Miguel Ángel, 2021. "Influence of the international collaboration in the field of metric studies of science and technology: the case of Mexico (1971–2018)," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2485-2511, March.
    5. Anne K. Krüger, 2020. "Quantification 2.0? Bibliometric Infrastructures in Academic Evaluation," Politics and Governance, Cogitatio Press, vol. 8(2), pages 58-67.
    6. Michael Gusenbauer, 2019. "Google Scholar to overshadow them all? Comparing the sizes of 12 academic search engines and bibliographic databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 177-214, January.
    7. Fabio Zagonari, 2019. "Scientific Production and Productivity for Characterizing an Author’s Publication History: Simple and Nested Gini’s and Hirsch’s Indexes Combined," Publications, MDPI, vol. 7(2), pages 1-30, May.
    8. Jaime A. Teixeira da Silva, 2018. "The Google Scholar h-index: useful but burdensome metric," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 631-635, October.
    9. Ghulam Mustafa & Abid Rauf & Muhammad Tanvir Afzal, 2024. "MRET: Modified Recursive Elimination Technique for ranking author assessment parameters," PLOS ONE, Public Library of Science, vol. 19(6), pages 1-30, June.
    10. Maura Mezzetti & Ilia Negri, 2024. "Hierarchical Bayesian model to estimate and compare research productivity of Italian academic statisticians," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(12), pages 7443-7474, December.
    11. Enrique Orduna-Malea & Selenay Aytac & Clara Y. Tran, 2019. "Universities through the eyes of bibliographic databases: a retroactive growth comparison of Google Scholar, Scopus and Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 433-450, October.
    12. Jeppe Nicolaisen & Tove Faber Frandsen, 2021. "Number of references: a large-scale study of interval ratios," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 259-285, January.
    13. Anne K. Krüger, 2020. "Quantification 2.0? Bibliometric Infrastructures in Academic Evaluation," Politics and Governance, Cogitatio Press, vol. 8(2), pages 58-67.
    14. Deming Lin & Tianhui Gong & Wenbin Liu & Martin Meyer, 2020. "An entropy-based measure for the evolution of h index research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2283-2298, December.
    15. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    16. Wu, Jiang & Ou, Guiyan & Liu, Xiaohui & Dong, Ke, 2022. "How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence," Journal of Informetrics, Elsevier, vol. 16(2).
    17. Yu, Shuo & Alqahtani, Fayez & Tolba, Amr & Lee, Ivan & Jia, Tao & Xia, Feng, 2022. "Collaborative Team Recognition: A Core Plus Extension Structure," Journal of Informetrics, Elsevier, vol. 16(4).
    18. George Bogdan Drăgan & Victor Tiberius & Katharina Rosin & Wissal Ben Arfi & Adrian Micu & Alexandru Căpățînă, 2026. "Motivation and collaboration: Unraveling entrepreneurship scholars’ research performance," Review of Managerial Science, Springer, vol. 20(4), pages 1291-1332, April.
    19. Vital, Adilson & Silva, Filipi N. & Oliveira, Osvaldo N. & Amancio, Diego R., 2025. "Predicting citation impact of research papers using GPT and other text embeddings," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 674(C).
    20. Martín-Martín, Alberto & Orduna-Malea, Enrique & Thelwall, Mike & Delgado López-Cózar, Emilio, 2018. "Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories," Journal of Informetrics, Elsevier, vol. 12(4), pages 1160-1177.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jpubli:v:12:y:2024:i:2:p:12-:d:1380265. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.