IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0278297.html
   My bibliography  Save this article

Developing evidence-based resources for evaluating postgraduate trainees in the biomedical sciences

Author

Listed:
  • Jacqueline E McLaughlin
  • Rebekah L Layton
  • Paul B Watkins
  • Robert A Nicholas
  • Kim L R Brouwer

Abstract

Postgraduate trainees elevate the academic strength of institutions by conducting research, promoting innovation, securing grant funding, training undergraduate students, and building alliances. Rigorous and systematic program evaluation can help ensure that postgraduate training programs are achieving the program’s intended outcomes. The purpose of this project was to develop evidence-based evaluation tools that could be shared across federally funded biomedical training programs to enhance program evaluation capacity. This manuscript describes the evidence-based process used to determine program evaluation needs of these programs at a research-intensive university. Using a multi-phased sequential exploratory mixed methods approach, data were collected from trainees, employers, leaders, and program directors. Data analyses included document analysis of program plans, inductive coding of focus groups and interviews, and descriptive analysis of surveys. Two overarching categories–Trainee Skills and Program Characteristics—were identified including six themes each. Program directors prioritized communication, social and behavioral skills, and collaboration as the trainee skills that they needed the most help evaluating. Furthermore, program directors prioritized the following program characteristics as those that they needed the most help evaluating: training environment, trainee outcomes, and opportunities offered. Surveys, interview scripts, and related resources for the categories and themes were developed and curated on a publicly available website for program directors to use in their program evaluations.

Suggested Citation

  • Jacqueline E McLaughlin & Rebekah L Layton & Paul B Watkins & Robert A Nicholas & Kim L R Brouwer, 2022. "Developing evidence-based resources for evaluating postgraduate trainees in the biomedical sciences," PLOS ONE, Public Library of Science, vol. 17(12), pages 1-13, December.
    • Handle: RePEc:plo:pone00:0278297
    DOI: 10.1371/journal.pone.0278297
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0278297
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0278297&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0278297?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Cooksy, Leslie J. & Gill, Paige & Kelly, P. Adam, 2001. "The program logic model as an integrative framework for a multimethod evaluation," Evaluation and Program Planning, Elsevier, vol. 24(2), pages 119-128, May.
    2. Jacqueline E McLaughlin & Lana M Minshew & Daniel Gonzalez & Kelsey Lamb & Nicholas J Klus & Jeffrey Aubé & Wendy Cox & Kim L R Brouwer, 2019. "Can they imagine the future? A qualitative study exploring the skills employers seek in pharmaceutical sciences doctoral graduates," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-12, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tim Benijts, 2014. "A Business Sustainability Model for Government Corporations. A Belgian Case Study," Business Strategy and the Environment, Wiley Blackwell, vol. 23(3), pages 204-216, March.
    2. Ullrich-French, Sarah & Cole, Amy N. & Montgomery, Anna K., 2016. "Evaluation development for a physical activity positive youth development program for girls," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 67-76.
    3. Vinícius P. Rodrigues & Daniela C. A. Pigosso & Jakob W. Andersen & Tim C. McAloone, 2018. "Evaluating the Potential Business Benefits of Ecodesign Implementation: A Logic Model Approach," Sustainability, MDPI, vol. 10(6), pages 1-26, June.
    4. Shu-Ping Chen & Wen-Pin Chang & Bryan Fleet & Santoch Rai & Steve Panteluk & Alberto Choy & DeAnn Hunter, 2021. "Is a Forensic Cohabitation Program Recovery-Oriented? A Logic Model Analysis," IJERPH, MDPI, vol. 19(1), pages 1-11, December.
    5. Sanou, Aboubakary & Kouyaté, Bocar & Bibeau, Gilles & Nguyen, Vinh-Kim, 2011. "Evaluability Assessment of an immunization improvement strategy in rural Burkina Faso: Intervention theory versus reality, information need and evaluations," Evaluation and Program Planning, Elsevier, vol. 34(3), pages 303-315, August.
    6. Judy Smeed & Terri Bourke & Julie Nickerson & Tracy Corsbie, 2015. "Testing Times for the Implementation of Curriculum Change," SAGE Open, , vol. 5(2), pages 21582440155, April.
    7. Fletcher-Hildebrand, Shaneice & Williamson, Linzi & Lawson, Karen & Dell, Colleen, 2023. "Remotely and collaboratively evaluating a campus-based therapy dog program during the COVID-19 pandemic," Evaluation and Program Planning, Elsevier, vol. 98(C).
    8. Adler, Marina A., 2002. "The utility of modeling in evaluation planning: the case of the coordination of domestic violence services in Maryland," Evaluation and Program Planning, Elsevier, vol. 25(3), pages 203-213, August.
    9. Park, Chul Hyun & Welch, Eric W. & Sriraj, P.S., 2016. "An integrative theory-driven framework for evaluating travel training programs," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 7-20.
    10. Saunders, Ruth P. & Ward, Dianne & Felton, Gwen M. & Dowda, Marsha & Pate, Russell R., 2006. "Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP)," Evaluation and Program Planning, Elsevier, vol. 29(4), pages 352-364, November.
    11. Bozeman, Barry & Rimes, Heather & Youtie, Jan, 2015. "The evolving state-of-the-art in technology transfer research: Revisiting the contingent effectiveness model," Research Policy, Elsevier, vol. 44(1), pages 34-49.
    12. Johnson, Knowlton & Hays, Carol & Center, Hayden & Daley, Charlotte, 2004. "Building capacity and sustainable prevention innovations: a sustainability planning model," Evaluation and Program Planning, Elsevier, vol. 27(2), pages 135-149, May.
    13. McLinden, Daniel, 2017. "And then the internet happened: Thoughts on the future of concept mapping," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 293-300.
    14. Saunders, Ruth P. & Wilcox, Sara & Baruth, Meghan & Dowda, Marsha, 2014. "Process evaluation methods, implementation fidelity results and relationship to physical activity and healthy eating in the Faith, Activity, and Nutrition (FAN) study," Evaluation and Program Planning, Elsevier, vol. 43(C), pages 93-102.
    15. Victoria A. Johnson & Kevin R. Ronan & David M. Johnston & Robin Peace, 2016. "Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory‐Based Evaluation," Risk Analysis, John Wiley & Sons, vol. 36(11), pages 2120-2135, November.
    16. Schalock, Robert L. & Lee, Tim & Verdugo, Miguel & Swart, Kees & Claes, Claudia & van Loon, Jos & Lee, Chun-Shin, 2014. "An evidence-based approach to organization evaluation and change in human service organizations evaluation and program planning," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 110-118.
    17. Lenihan, Helena, 2011. "Enterprise policy evaluation: Is there a 'new' way of doing it?," Evaluation and Program Planning, Elsevier, vol. 34(4), pages 323-332, November.
    18. Gretchen B. Jordan, 2013. "Logic modeling: a tool for designing program evaluations," Chapters, in: Albert N. Link & Nicholas S. Vonortas (ed.), Handbook on the Theory and Practice of Program Evaluation, chapter 6, pages 143-165, Edward Elgar Publishing.
    19. Cole, Donald C. & Levin, Carol & Loechl, Cornelia & Thiele, Graham & Grant, Frederick & Girard, Aimee Webb & Sindi, Kirimi & Low, Jan, 2016. "Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya," Evaluation and Program Planning, Elsevier, vol. 56(C), pages 11-22.
    20. Elizabeth O. Ofili & Daniel Sarpong & Richard Yanagihara & Paul B. Tchounwou & Emma Fernández-Repollet & Mohamad Malouhi & Muhammed Y. Idris & Kimberly Lawson & Nadine H. Spring & Brian M. Rivers, 2021. "The Research Centers in Minority Institutions (RCMI) Consortium: A Blueprint for Inclusive Excellence," IJERPH, MDPI, vol. 18(13), pages 1-17, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0278297. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.