IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v59y2025i2d10.1007_s11135-024-02008-3.html
   My bibliography  Save this article

How to assess the impact of fellowships on academic careers? Latent transition analyses for funding programmes of the Alexander von Humboldt Foundation

Author

Listed:
  • Rüdiger Mutz

    (University of Zurich)

  • Hans-Dieter Daniel

    (University of Zurich)

Abstract

Although fellowship programmes continue to be seen as an effective means of advancing young researchers' academic careers, the impact of fellowship programmes on fellows' career development is still unclear. The central question of this article concerns the evaluation of fellowship programmes: What methodological challenges does the evaluation of fellowship programmes pose with regard to career development, and how these can be addressed in the context of evaluations? Specifically, there are three key methodological challenges facing research evaluation in the context of career development, which can be described by the terms 'impact', 'validity and fairness', and 'tailored programmes'. A career is understood as a transition between positions over time; career stages can be understood as latent categorical variables, i.e. types of career stages (temporary, full-time). Transition is modelled statistically using latent transition analyses within a person-centred approach. Covariates, such as funding programmes, can impact both the initial configurations (i.e. the frequency of fellows in different career stages) and the transition itself. A funding programme is fair if all fellows, regardless of their characteristics (gender, career stage, cohort), have the same chances of success. Different types of fellows with different career trajectories indicate heterogeneous subpopulations that require tailoring of funding programmes. The approach is illustrated with data on the career development of 1418 fellows from three Alexander von Humboldt Foundation programmes. The majority of fellows benefit in their academic careers from the funding, but the null hypothesis of no specific effects (e.g. programmes, age, gender) could not be rejected (endogenous and homogeneous trajectories).

Suggested Citation

  • Rüdiger Mutz & Hans-Dieter Daniel, 2025. "How to assess the impact of fellowships on academic careers? Latent transition analyses for funding programmes of the Alexander von Humboldt Foundation," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(2), pages 1153-1175, April.
  • Handle: RePEc:spr:qualqt:v:59:y:2025:i:2:d:10.1007_s11135-024-02008-3
    DOI: 10.1007/s11135-024-02008-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-024-02008-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-024-02008-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
    2. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Rejoinder on: Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 484-486, September.
    3. Vermunt, Jeroen K., 2010. "Latent Class Modeling with Covariates: Two Improved Three-Step Approaches," Political Analysis, Cambridge University Press, vol. 18(4), pages 450-469.
    4. Chaojiang Wu & Erjia Yan & Yongjun Zhu & Kai Li, 2021. "Gender imbalance in the productivity of funded projects: A study of the outputs of National Institutes of Health R01 grants," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(11), pages 1386-1399, November.
    5. Dag W. Aksnes & Kristoffer Rorstad & Fredrik Piro & Gunnar Sivertsen, 2011. "Are female researchers less cited? A large-scale study of Norwegian scientists," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(4), pages 628-636, April.
    6. Gilles Celeux & Gilda Soromenho, 1996. "An entropy criterion for assessing the number of clusters in a mixture model," Journal of Classification, Springer;The Classification Society, vol. 13(2), pages 195-212, September.
    7. Sarah Seus & Susanne Bührer, 2022. "The evaluation of the Austrian START programme: an impact analysis of a research funding programme using a multi-method approach," The Journal of Technology Transfer, Springer, vol. 47(3), pages 673-698, June.
    8. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 433-465, September.
    9. repec:nas:journl:v:115:y:2018:p:4887-4890 is not listed on IDEAS
    10. Dag W. Aksnes & Kristoffer Rorstad & Fredrik Piro & Gunnar Sivertsen, 2011. "Are female researchers less cited? A large‐scale study of Norwegian scientists," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(4), pages 628-636, April.
    11. Danielle Lee, 2024. "Exploring the determinants of research performance for early-career researchers: a literature review," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 181-235, January.
    12. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    13. Qi Chen & Wen Luo & Gregory J. Palardy & Ryan Glaman & Amber McEnturff, 2017. "The Efficacy of Common Fit Indices for Enumerating Classes in Growth Mixture Models When Nested Data Structure Is Ignored," SAGE Open, , vol. 7(1), pages 21582440177, March.
    14. Junming Huang & Alexander J. Gates & Roberta Sinatra & Albert-László Barabási, 2020. "Historical comparison of gender inequality in scientific careers across countries and disciplines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(9), pages 4609-4616, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    2. Zhang, Ming-Ze & Wang, Tang-Rong & Lyu, Peng-Hui & Chen, Qi-Mei & Li, Ze-Xia & Ngai, Eric W.T., 2024. "Impact of gender composition of academic teams on disruptive output," Journal of Informetrics, Elsevier, vol. 18(2).
    3. , Aisdl, 2021. "Top economics universities and research institutions in Vietnam: evidence from the SSHPA dataset," OSF Preprints xvnkj, Center for Open Science.
    4. Abramo, Giovanni & Aksnes, Dag W. & D’Angelo, Ciriaco Andrea, 2021. "Gender differences in research performance within and between countries: Italy vs Norway," Journal of Informetrics, Elsevier, vol. 15(2).
    5. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    6. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    7. Roberto Mari & Antonello Maruotti, 2022. "A two-step estimator for generalized linear models for longitudinal data with time-varying measurement error," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(2), pages 273-300, June.
    8. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    9. Fulvia Pennoni & Beata Bal-Domańska, 2022. "NEETs and Youth Unemployment: A Longitudinal Comparison Across European Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 162(2), pages 739-761, July.
    10. Fulvia Pennoni & Francesco Bartolucci & Silvia Pandolfi, 2024. "Variable Selection for Hidden Markov Models with Continuous Variables and Missing Data," Journal of Classification, Springer;The Classification Society, vol. 41(3), pages 568-589, November.
    11. Antonello Maruotti & Jan Bulla & Tanya Mark, 2019. "Assessing the influence of marketing activities on customer behaviors: a dynamic clustering approach," METRON, Springer;Sapienza Università di Roma, vol. 77(1), pages 19-42, April.
    12. Lawson, Cornelia & Salter, Ammon, 2023. "Exploring the effect of overlapping institutional applications on panel decision-making," Research Policy, Elsevier, vol. 52(9).
    13. repec:osf:socarx:9n347_v1 is not listed on IDEAS
    14. Mike Thelwall, 2020. "Female citation impact superiority 1996–2018 in six out of seven English‐speaking nations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(8), pages 979-990, August.
    15. Tahmooresnejad, Leila & Turkina, Ekaterina, 2022. "Female inventors over time: Factors affecting female Inventors’ innovation performance," Journal of Informetrics, Elsevier, vol. 16(1).
    16. Maria Marino & Alessio Farcomeni, 2015. "Linear quantile regression models for longitudinal experiments: an overview," METRON, Springer;Sapienza Università di Roma, vol. 73(2), pages 229-247, August.
    17. Francesco Bartolucci & Donata Favaro & Fulvia Pennoni & Dario Sciulli, 2024. "An Analysis of the Effect of Streaming on Civic Participation Through a Causal Hidden Markov Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 172(1), pages 163-190, March.
    18. Hamzehali Nourmohammadi & Fateme Hodaei, 2014. "Perspective of Iranian women’s scientific production in high priority fields of science and technology," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1455-1471, February.
    19. Hajar Sotudeh & Nahid Khoshian, 2014. "Gender differences in science: the case of scientific productivity in Nano Science & Technology during 2005–2007," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 457-472, January.
    20. Caynnã Santos & Rosa Monteiro & Mónica Lopes & Monise Martinez & Virgínia Ferreira, 2023. "From Late Bloomer to Booming: A Bibliometric Analysis of Women’s, Gender, and Feminist Studies in Portugal," Social Sciences, MDPI, vol. 12(7), pages 1-26, July.
    21. Francesco Bartolucci & Fulvia Pennoni & Giorgio Vittadini, 2023. "A Causal Latent Transition Model With Multivariate Outcomes and Unobserved Heterogeneity: Application to Human Capital Development," Journal of Educational and Behavioral Statistics, , vol. 48(4), pages 387-419, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:59:y:2025:i:2:d:10.1007_s11135-024-02008-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.