IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v112y2025ics0149718925001120.html

Protocol for the pragmatic evaluation of the Department of the Air Force’s Personal Financial Readiness Program

Author

Listed:
  • O’Neal, Catherine Walker
  • Lucier-Greer, Mallory
  • Richardson, Evin W.
  • Miranda, Haley E.
  • Tate, Allan
  • McKay, Brian K.

Abstract

Federal policy mandates that United States military members receive numerous financial trainings across their career to improve their financial literacy and equip them to make informed financial decisions that, ultimately, promote positive individual and family well-being. Connected to this mandate, systematic evaluation efforts of the Department of the Air Force’s Personal Financial Readiness program were initiated to identify program outcomes and downstream results while simultaneously informing program improvements and modifications. When situated in a discussion of evaluation theory and design practices, documenting these outcome and process evaluation protocols can provide valuable insight for scientist-practitioners designing multi-site program evaluations in the context of real-world constraints, as is often the case for large institutions, including the military. The evaluation design includes a prospective cohort design for the outcome evaluation with surveys completed before and after training and 3- and 6-months following training. The surveys provide data on short-, mid-, and long-term outcomes. Data collected for the process evaluation, include targeted surveys and interviews with individuals conducting and participating in the training. Together, this protocol illustrates a theory-informed evaluation design of a complex, multi-site set of trainings utilizing diverse data collection methods to conduct a rigorous outcome and process evaluation.

Suggested Citation

  • O’Neal, Catherine Walker & Lucier-Greer, Mallory & Richardson, Evin W. & Miranda, Haley E. & Tate, Allan & McKay, Brian K., 2025. "Protocol for the pragmatic evaluation of the Department of the Air Force’s Personal Financial Readiness Program," Evaluation and Program Planning, Elsevier, vol. 112(C).
  • Handle: RePEc:eee:epplan:v:112:y:2025:i:c:s0149718925001120
    DOI: 10.1016/j.evalprogplan.2025.102645
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718925001120
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2025.102645?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Velasco, Veronica & Griffin, Kenneth W. & Antichi, Mariella & Celata, Corrado, 2015. "A large-scale initiative to disseminate an evidence-based drug abuse prevention program in Italy: Lessons learned for practitioners and researchers," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 27-38.
    2. Gavarkovs, Adam G. & Blunt, Wendy & Petrella, Robert J., 2019. "A protocol for designing online training to support the implementation of community-based interventions," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 77-87.
    3. Hayes, Holly & Scott, Victoria & Abraczinskas, Michelle & Scaccia, Jonathan & Stout, Soma & Wandersman, Abraham, 2016. "A formative multi-method approach to evaluating training," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 199-207.
    4. Donald Bruce Ross & Catherine Walker O’Neal & Amy Laura Arnold & Jay A. Mancini, 2017. "Money Matters in Marriage: Financial Concerns, Warmth, and Hostility Among Military Couples," Journal of Family and Economic Issues, Springer, vol. 38(4), pages 572-581, December.
    5. Catania, Joseph A. & Gibson, David R. & Marin, Barbara & Coates, Thomas J. & Greenblatt, Ruth M., 1990. "Response bias in assessing sexual behaviors relevant to HIV transmission," Evaluation and Program Planning, Elsevier, vol. 13(1), pages 19-29, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul, Sudipta & Burman, Rajarshi Roy & Singh, Rahul, 2024. "Training effectiveness evaluation: Advancing a Kirkpatrick model based composite framework," Evaluation and Program Planning, Elsevier, vol. 107(C).
    2. Claudia Meroni & Veronica Velasco, 2023. "School-Based Interventions for Migrant Students in the Framework of the Health Promoting Whole-School Approach: An Umbrella Review," Sustainability, MDPI, vol. 15(3), pages 1-29, January.
    3. Melissa A. Curran & Emily Parrott & Sun Young Ahn & Joyce Serido & Soyeon Shim, 2018. "Young Adults’ Life Outcomes and Well-Being: Perceived Financial Socialization from Parents, the Romantic Partner, and Young Adults’ Own Financial Behaviors," Journal of Family and Economic Issues, Springer, vol. 39(3), pages 445-456, September.
    4. Sprague-Jones, Jessica & McKenney, Kimberly & Firman, Casandra & Susskind, Yve & Bash, Kirstie, 2025. "Development of the protective factors Survey, military families (PFS-MF)," Children and Youth Services Review, Elsevier, vol. 169(C).
    5. Jeffrey Dew, 2021. "Ten Years of Marriage and Cohabitation Research in the Journal of Family and Economic Issues," Journal of Family and Economic Issues, Springer, vol. 42(1), pages 52-61, July.
    6. Pelucha, Martin & Kveton, Viktor & Potluka, Oto, 2019. "Using mixed method approach in measuring effects of training in firms: Case study of the European Social Fund support," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 146-155.
    7. Xiaomin Li & Melissa A. Curran & Ashley B. LeBaron & Joyce Serido & Soyeon Shim, 2020. "Romantic Attachment Orientations, Financial Behaviors, and Life Outcomes Among Young Adults: A Mediating Analysis of a College Cohort," Journal of Family and Economic Issues, Springer, vol. 41(4), pages 658-671, December.
    8. Clairee Peterson & Catherine Walker O’Neal & Mallory Lucier-Greer, 2025. "Service Members’ Couple Finances: An Examination of Financial anxiety, Financial Decision-Making, and Agreement on Spending and Relationship Outcomes," Journal of Family and Economic Issues, Springer, vol. 46(2), pages 545-557, June.
    9. Jocelyn S. Wikle & Chelom E. Leavitt & Jeremy B. Yorgason & Jeffrey P. Dew & Heather M. Johnson, 2021. "The Protective Role of Couple Communication in Moderating Negative Associations Between Financial Stress and Sexual Outcomes for Newlyweds," Journal of Family and Economic Issues, Springer, vol. 42(2), pages 282-299, June.
    10. Veronica Velasco & Paola Scattola & Laura Gavazzeni & Lara Marchesi & Ioana Elena Nita & Gilberto Giudici, 2021. "Prevention and Harm Reduction Interventions for Adult Gambling at the Local Level: An Umbrella Review of Empirical Evidence," IJERPH, MDPI, vol. 18(18), pages 1-20, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:112:y:2025:i:c:s0149718925001120. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.