IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v59y2025i2d10.1007_s11135-024-02008-3.html
   My bibliography  Save this article

How to assess the impact of fellowships on academic careers? Latent transition analyses for funding programmes of the Alexander von Humboldt Foundation

Author

Listed:
  • Rüdiger Mutz

    (University of Zurich)

  • Hans-Dieter Daniel

    (University of Zurich)

Abstract

Although fellowship programmes continue to be seen as an effective means of advancing young researchers' academic careers, the impact of fellowship programmes on fellows' career development is still unclear. The central question of this article concerns the evaluation of fellowship programmes: What methodological challenges does the evaluation of fellowship programmes pose with regard to career development, and how these can be addressed in the context of evaluations? Specifically, there are three key methodological challenges facing research evaluation in the context of career development, which can be described by the terms 'impact', 'validity and fairness', and 'tailored programmes'. A career is understood as a transition between positions over time; career stages can be understood as latent categorical variables, i.e. types of career stages (temporary, full-time). Transition is modelled statistically using latent transition analyses within a person-centred approach. Covariates, such as funding programmes, can impact both the initial configurations (i.e. the frequency of fellows in different career stages) and the transition itself. A funding programme is fair if all fellows, regardless of their characteristics (gender, career stage, cohort), have the same chances of success. Different types of fellows with different career trajectories indicate heterogeneous subpopulations that require tailoring of funding programmes. The approach is illustrated with data on the career development of 1418 fellows from three Alexander von Humboldt Foundation programmes. The majority of fellows benefit in their academic careers from the funding, but the null hypothesis of no specific effects (e.g. programmes, age, gender) could not be rejected (endogenous and homogeneous trajectories).

Suggested Citation

  • Rüdiger Mutz & Hans-Dieter Daniel, 2025. "How to assess the impact of fellowships on academic careers? Latent transition analyses for funding programmes of the Alexander von Humboldt Foundation," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(2), pages 1153-1175, April.
  • Handle: RePEc:spr:qualqt:v:59:y:2025:i:2:d:10.1007_s11135-024-02008-3
    DOI: 10.1007/s11135-024-02008-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-024-02008-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-024-02008-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Vermunt, Jeroen K., 2010. "Latent Class Modeling with Covariates: Two Improved Three-Step Approaches," Political Analysis, Cambridge University Press, vol. 18(4), pages 450-469.
    2. Gilles Celeux & Gilda Soromenho, 1996. "An entropy criterion for assessing the number of clusters in a mixture model," Journal of Classification, Springer;The Classification Society, vol. 13(2), pages 195-212, September.
    3. Sarah Seus & Susanne Bührer, 2022. "The evaluation of the Austrian START programme: an impact analysis of a research funding programme using a multi-method approach," The Journal of Technology Transfer, Springer, vol. 47(3), pages 673-698, June.
    4. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    5. van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
    6. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Rejoinder on: Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 484-486, September.
    7. Chaojiang Wu & Erjia Yan & Yongjun Zhu & Kai Li, 2021. "Gender imbalance in the productivity of funded projects: A study of the outputs of National Institutes of Health R01 grants," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(11), pages 1386-1399, November.
    8. repec:nas:journl:v:115:y:2018:p:4887-4890 is not listed on IDEAS
    9. Danielle Lee, 2024. "Exploring the determinants of research performance for early-career researchers: a literature review," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 181-235, January.
    10. Junming Huang & Alexander J. Gates & Roberta Sinatra & Albert-László Barabási, 2020. "Historical comparison of gender inequality in scientific careers across countries and disciplines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(9), pages 4609-4616, March.
    11. Dag W. Aksnes & Kristoffer Rorstad & Fredrik Piro & Gunnar Sivertsen, 2011. "Are female researchers less cited? A large-scale study of Norwegian scientists," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(4), pages 628-636, April.
    12. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 433-465, September.
    13. Dag W. Aksnes & Kristoffer Rorstad & Fredrik Piro & Gunnar Sivertsen, 2011. "Are female researchers less cited? A large‐scale study of Norwegian scientists," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(4), pages 628-636, April.
    14. Qi Chen & Wen Luo & Gregory J. Palardy & Ryan Glaman & Amber McEnturff, 2017. "The Efficacy of Common Fit Indices for Enumerating Classes in Growth Mixture Models When Nested Data Structure Is Ignored," SAGE Open, , vol. 7(1), pages 21582440177, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    2. Zhang, Ming-Ze & Wang, Tang-Rong & Lyu, Peng-Hui & Chen, Qi-Mei & Li, Ze-Xia & Ngai, Eric W.T., 2024. "Impact of gender composition of academic teams on disruptive output," Journal of Informetrics, Elsevier, vol. 18(2).
    3. , Aisdl, 2021. "Top economics universities and research institutions in Vietnam: evidence from the SSHPA dataset," OSF Preprints xvnkj, Center for Open Science.
    4. Abramo, Giovanni & Aksnes, Dag W. & D’Angelo, Ciriaco Andrea, 2021. "Gender differences in research performance within and between countries: Italy vs Norway," Journal of Informetrics, Elsevier, vol. 15(2).
    5. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    6. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    7. Roberto Mari & Antonello Maruotti, 2022. "A two-step estimator for generalized linear models for longitudinal data with time-varying measurement error," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(2), pages 273-300, June.
    8. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    9. Fulvia Pennoni & Beata Bal-Domańska, 2022. "NEETs and Youth Unemployment: A Longitudinal Comparison Across European Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 162(2), pages 739-761, July.
    10. Lawson, Cornelia & Salter, Ammon, 2023. "Exploring the effect of overlapping institutional applications on panel decision-making," Research Policy, Elsevier, vol. 52(9).
    11. Tahmooresnejad, Leila & Turkina, Ekaterina, 2022. "Female inventors over time: Factors affecting female Inventors’ innovation performance," Journal of Informetrics, Elsevier, vol. 16(1).
    12. Francesco Bartolucci & Fulvia Pennoni & Giorgio Vittadini, 2023. "A Causal Latent Transition Model With Multivariate Outcomes and Unobserved Heterogeneity: Application to Human Capital Development," Journal of Educational and Behavioral Statistics, , vol. 48(4), pages 387-419, August.
    13. Wen Lou & Yuehua Zhao & Yuchen Chen & Jin Zhang, 2018. "Research or management? An investigation of the impact of leadership roles on the research performance of academic administrators," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 191-209, October.
    14. Antonio Punzo & Salvatore Ingrassia & Antonello Maruotti, 2021. "Multivariate hidden Markov regression models: random covariates and heavy-tailed distributions," Statistical Papers, Springer, vol. 62(3), pages 1519-1555, June.
    15. Zhu, Wanying & Jin, Ching & Ma, Yifang & Xu, Cong, 2023. "Earlier recognition of scientific excellence enhances future achievements and promotes persistence," Journal of Informetrics, Elsevier, vol. 17(2).
    16. Tullio, Federico & Bartolucci, Francesco, 2019. "Evaluating time-varying treatment effects in latent Markov models: An application to the effect of remittances on poverty dynamics," MPRA Paper 91459, University Library of Munich, Germany.
    17. Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
    18. Thelwall, Mike, 2018. "Do females create higher impact research? Scopus citations and Mendeley readers for articles from five countries," Journal of Informetrics, Elsevier, vol. 12(4), pages 1031-1041.
    19. Alessio Farcomeni, 2015. "Latent class recapture models with flexible behavioural response," Statistica, Department of Statistics, University of Bologna, vol. 75(1), pages 5-17.
    20. Francesco Bartolucci & Alessio Farcomeni, 2022. "A hidden Markov space–time model for mapping the dynamics of global access to food," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(1), pages 246-266, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:59:y:2025:i:2:d:10.1007_s11135-024-02008-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.