IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i12d10.1007_s11192-024-05154-5.html
   My bibliography  Save this article

Hierarchical Bayesian model to estimate and compare research productivity of Italian academic statisticians

Author

Listed:
  • Maura Mezzetti

    (Università degli Studi di Roma Tor Vergata)

  • Ilia Negri

    (Università della Calabria)

Abstract

A new method for measuring scientific productivity is proposed. Each researcher is initially associated with a cumulative score over time, reflecting the quality of the papers based on the journals in which they have published throughout their career. The second measure, an average speed over time from varying production speeds, is derived through the estimation of a two-level hierarchical Bayesian model for piecewise linear regression. These productivity indicators are validated and compared to other commonly used bibliometric indexes. The proposed method is applied to compare the productivity of females and males at different career levels in Italian academia, with a focus on statisticians. The study also contributes to the literature on the gender gap, showing that among those who remain at the lower levels of the university career hierarchy, women tend to have higher and more consistent scientific production over time compared to their male colleagues.

Suggested Citation

  • Maura Mezzetti & Ilia Negri, 2024. "Hierarchical Bayesian model to estimate and compare research productivity of Italian academic statisticians," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(12), pages 7443-7474, December.
    • Handle: RePEc:spr:scient:v:129:y:2024:i:12:d:10.1007_s11192-024-05154-5
    DOI: 10.1007/s11192-024-05154-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-05154-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-024-05154-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Beaudry, Catherine & Larivière, Vincent, 2016. "Which gender gap? Factors affecting researchers’ scientific impact in science and medicine," Research Policy, Elsevier, vol. 45(9), pages 1790-1817.
    2. John Mingers & Martin Meyer, 2017. "Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1111-1121, August.
    3. Kaare Aagaard & Carter Bloch & Jesper W. Schneider, 2015. "Impacts of performance-based research funding systems: The case of the Norwegian Publication Indicator," Research Evaluation, Oxford University Press, vol. 24(2), pages 106-117.
    4. Maura Mezzetti & Daniele Borzelli & Andrea d’Avella, 2022. "A Bayesian approach to model individual differences and to partition individuals: case studies in growth and learning curves," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(5), pages 1245-1271, December.
    5. D. A. Stephens, 1994. "Bayesian Retrospective Multiple‐Changepoint Identification," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 43(1), pages 159-178, March.
    6. Vincent Larivière & Chaoqun Ni & Yves Gingras & Blaise Cronin & Cassidy R. Sugimoto, 2013. "Bibliometrics: Global gender disparities in science," Nature, Nature, vol. 504(7479), pages 211-213, December.
    7. Peida Zhan & Hong Jiao & Kaiwen Man & Lijun Wang, 2019. "Using JAGS for Bayesian Cognitive Diagnosis Modeling: A Tutorial," Journal of Educational and Behavioral Statistics, , vol. 44(4), pages 473-503, August.
    8. Maria De Paola & Michela Ponzo & Vincenzo Scoppa, 2018. "Are Men Given Priority for Top Jobs? Investigating the Glass Ceiling in Italian Academia," Journal of Human Capital, University of Chicago Press, vol. 12(3), pages 475-503.
    9. Vincent Larivière & Rodrigo Costas, 2016. "How Many Is Too Many? On the Relationship between Research Productivity and Impact," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-10, September.
    10. John Mingers & Martin Meyer, 2017. "Erratum to: Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1123-1124, August.
    11. Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
    12. Eduardo B Araújo & Nuno A M Araújo & André A Moreira & Hans J Herrmann & José S Andrade Jr., 2017. "Gender differences in scientific collaborations: Women are more egalitarian than men," PLOS ONE, Public Library of Science, vol. 12(5), pages 1-10, May.
    13. Teplitskiy, Misha & Duede, Eamon & Menietti, Michael & Lakhani, Karim R., 2022. "How status of research papers affects the way they are read and cited," Research Policy, Elsevier, vol. 51(4).
    14. Petersen, Alexander M. & Pan, Raj K. & Pammolli, Fabio & Fortunato, Santo, 2019. "Methods to account for citation inflation in research evaluation," Research Policy, Elsevier, vol. 48(7), pages 1855-1865.
    15. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2015. "Should the research performance of scientists be distinguished by gender?," Journal of Informetrics, Elsevier, vol. 9(1), pages 25-38.
    16. María Bordons & Fernanda Morillo & M. Teresa Fernández & Isabel Gómez, 2003. "One step further in the production of bibliometric indicators at the micro level: Differences by gender and professional category of scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 159-173, June.
    17. Mark D Lindner & Karina D Torralba & Nasim A Khan, 2018. "Scientific productivity: An exploratory study of metrics and incentives," PLOS ONE, Public Library of Science, vol. 13(4), pages 1-16, April.
    18. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2014. "Are the authors of highly cited articles also the most productive ones?," Journal of Informetrics, Elsevier, vol. 8(1), pages 89-97.
    19. Giovanni Abramo & Ciriaco Andrea D'Angelo, 2015. "The VQR, Italy's second national research assessment: Methodological failures and ranking distortions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2202-2214, November.
    20. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2015. "The relationship between the number of authors of a publication, its citations and the impact factor of the publishing journal: Evidence from Italy," Journal of Informetrics, Elsevier, vol. 9(4), pages 746-761.
    21. Jappelli, Tullio & Nappi, Carmela Anna & Torrini, Roberto, 2017. "Gender effects in research evaluation," Research Policy, Elsevier, vol. 46(5), pages 911-924.
    22. Alberto Baccini & Giuseppe De Nicolao, 2016. "Do they agree? Bibliometric evaluation versus informed peer review in the Italian research assessment exercise," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1651-1671, September.
    23. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2023. "Correlating article citedness and journal impact: an empirical investigation by field on a large-scale dataset," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1877-1894, March.
    24. Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Di Costa, 2010. "Testing the trade-off between productivity and quality in research activities," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(1), pages 132-140, January.
    25. Rørstad, Kristoffer & Aksnes, Dag W., 2015. "Publication rate expressed by age, gender and academic position – A large-scale analysis of Norwegian academic staff," Journal of Informetrics, Elsevier, vol. 9(2), pages 317-333.
    26. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2019. "A gender analysis of top scientists’ collaboration behavior: evidence from Italy," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 405-418, August.
    27. Elba Mauleón & María Bordons, 2006. "Productivity, impact and publication habits by gender in the area of Materials Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(1), pages 199-218, January.
    28. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    29. Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Di Costa, 2010. "Testing the trade‐off between productivity and quality in research activities," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(1), pages 132-140, January.
    30. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    31. Giovanni Abramo & Ciriaco Andrea D’Angelo & Alessandro Caprasecca, 2009. "The contribution of star scientists to overall sex differences in research productivity," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 137-156, October.
    32. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
    33. González-Pereira, Borja & Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2010. "A new approach to the metric of journals’ scientific prestige: The SJR indicator," Journal of Informetrics, Elsevier, vol. 4(3), pages 379-391.
    34. Hande Eslen‐Ziya & Tevfik Murat Yildirim, 2022. "Perceptions of gendered‐challenges in academia: How women academics see gender hierarchies as barriers to achievement," Gender, Work and Organization, Wiley Blackwell, vol. 29(1), pages 301-308, January.
    35. Peter Sjögårde & Per Ahlgren, 2024. "Normalization of direct citations for clustering in publication-level networks: evaluation of six approaches," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(3), pages 1949-1968, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yongchao Ma & Ying Teng & Zhongzhun Deng & Li Liu & Yi Zhang, 2023. "Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2105-2143, April.
    2. Abramo, Giovanni & D'Angelo, CiriacoAndrea & Di Costa, Flavia, 2024. "The moderating role of personal characteristics of authors in the publications’ quality for quantity trade-off," Journal of Informetrics, Elsevier, vol. 18(1).
    3. Giovanni Abramo & Ciriaco Andrea D’Angelo & Francesco Rosati, 2016. "The north–south divide in the Italian higher education system," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2093-2117, December.
    4. Marina Pilkina & Andrey Lovakov, 2022. "Gender disparities in Russian academia: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3577-3591, June.
    5. Christopher Zou & Jordan B. Peterson, 2016. "Quantifying the scientific output of new researchers using the zp-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 901-916, March.
    6. Thelwall, Mike, 2018. "Do females create higher impact research? Scopus citations and Mendeley readers for articles from five countries," Journal of Informetrics, Elsevier, vol. 12(4), pages 1031-1041.
    7. Thelwall, Mike & Kousha, Kayvan & Stuart, Emma & Makita, Meiko & Abdoli, Mahshid & Wilson, Paul & Levitt, Jonathan, 2023. "Do bibliometrics introduce gender, institutional or interdisciplinary biases into research evaluations?," Research Policy, Elsevier, vol. 52(8).
    8. Jeppe Nicolaisen & Tove Faber Frandsen, 2021. "Number of references: a large-scale study of interval ratios," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 259-285, January.
    9. Jonas Lindahl & Cristian Colliander & Rickard Danell, 2020. "Early career performance and its correlation with gender and publication output during doctoral education," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 309-330, January.
    10. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    11. Corsi, Marcella & D’Ippoliti, Carlo & Zacchia, Giulia, 2019. "Diversity of backgrounds and ideas: The case of research evaluation in economics," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    12. Jyoti Paswan & Vivek Kumar Singh, 2020. "Gender and research publishing analyzed through the lenses of discipline, institution types, impact and international collaboration: a case study from India," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 497-515, April.
    13. Mancuso, Raffaele & Rossi-Lamastra, Cristina & Franzoni, Chiara, 2023. "Topic choice, gendered language, and the under-funding of female scholars in mission-oriented research," Research Policy, Elsevier, vol. 52(6).
    14. Simoes, Nadia & Crespo, Nuno, 2020. "Self-Citations and scientific evaluation: Leadership, influence, and performance," Journal of Informetrics, Elsevier, vol. 14(1).
    15. Junwan Liu & Yinglu Song & Sai Yang, 2020. "Gender disparities in the field of economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1477-1498, November.
    16. Bornmann, Lutz & Williams, Richard, 2017. "Can the journal impact factor be used as a criterion for the selection of junior researchers? A large-scale empirical study based on ResearcherID data," Journal of Informetrics, Elsevier, vol. 11(3), pages 788-799.
    17. Wu, Jiang & Ou, Guiyan & Liu, Xiaohui & Dong, Ke, 2022. "How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence," Journal of Informetrics, Elsevier, vol. 16(2).
    18. Lutz Bornmann & Werner Marx, 2014. "How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 487-509, January.
    19. repec:osf:osfxxx:yr8me_v1 is not listed on IDEAS
    20. Yu, Xiaoyao & Szymanski, Boleslaw K. & Jia, Tao, 2021. "Become a better you: Correlation between the change of research direction and the change of scientific performance," Journal of Informetrics, Elsevier, vol. 15(3).
    21. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2015. "Should the research performance of scientists be distinguished by gender?," Journal of Informetrics, Elsevier, vol. 9(1), pages 25-38.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:12:d:10.1007_s11192-024-05154-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.