IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v111y2025ics0149718925000771.html

Advancing methods for program evaluation in substance use by strengthening the application of epidemiology, economic evaluation, and implementation science: Reflections on the opportunities for synergy

Author

Listed:
  • Blackburn, Natalie A.
  • Philbrick, Sarah
  • Patel, Sheila V.
  • Cance, Jessica D.
  • Elek, Elvira
  • Gibbons, Brent
  • Khan, Sazid
  • Lambdin, Barrot H.
  • Graham, Phillip W.

Abstract

Program evaluation is necessary to assess the success of evidence-based programs in real-world, non-trial settings. In its most basic form, it involves understanding processes that impact the health and well-being of individuals and communities. Increasingly, robust program evaluations are integrating approaches from implementation science and economic evaluation to strengthen assessment, achievement, and sustainment of the intended impacts of evidence-based programs, while traditionally employing epidemiological methods to assess outcomes. Epidemiology, economic evaluation, and implementation science operate in overlapping yet siloed arenas, which can make it challenging for program evaluators to effectively engage all three disciplines. Furthermore, given their overlap, practitioners in these disciplines must understand differences in their purpose and lexicon to foster synergies. We use the Centers for Disease Control and Prevention Evaluation Framework and an example from substance use prevention to reflect on specific concepts and terminology within each of these disciplines and how distinctions impact the ability of multidisciplinary teams to collaborate on evaluations. The implications apply to those designing, testing, implementing, and evaluating evidence-based programs—all of whom have the opportunity to consider and strengthen these elements when developing processes and measuring impact. The substance use prevention field needs to better understand how these disciplines can complement one another to enrich process, outcome, and impact evaluations, given the complexities of substance use behaviors and evidence-based programs to address them. With this synergy, clearer communication of findings from the different components can be achieved.

Suggested Citation

  • Blackburn, Natalie A. & Philbrick, Sarah & Patel, Sheila V. & Cance, Jessica D. & Elek, Elvira & Gibbons, Brent & Khan, Sazid & Lambdin, Barrot H. & Graham, Phillip W., 2025. "Advancing methods for program evaluation in substance use by strengthening the application of epidemiology, economic evaluation, and implementation science: Reflections on the opportunities for synerg," Evaluation and Program Planning, Elsevier, vol. 111(C).
  • Handle: RePEc:eee:epplan:v:111:y:2025:i:c:s0149718925000771
    DOI: 10.1016/j.evalprogplan.2025.102610
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718925000771
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2025.102610?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Don Husereau & Michael Drummond & Federico Augustovski & Esther Bekker-Grob & Andrew H. Briggs & Chris Carswell & Lisa Caulley & Nathorn Chaiyakunapruk & Dan Greenberg & Elizabeth Loder & Josephine Ma, 2022. "Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) Statement: Updated Reporting Guidance for Health Economic Evaluations," Applied Health Economics and Health Policy, Springer, vol. 20(2), pages 213-221, March.
    2. Zanti, Sharon & Berkowitz, Emily & Katz, Matthew & Nelson, Amy Hawn & Burnett, T.C. & Culhane, Dennis & Zhou, Yixi, 2022. "Leveraging integrated data for program evaluation: Recommendations from the field," Evaluation and Program Planning, Elsevier, vol. 95(C).
    3. Glasgow, R.E. & Vogt, T.M. & Boles, S.M., 1999. "Evaluating the public health impact of health promotion interventions: The RE-AIM framework," American Journal of Public Health, American Public Health Association, vol. 89(9), pages 1322-1327.
    4. ., 2022. "Final considerations," Chapters, in: Income Distribution, Growth and Unemployment, chapter 15, pages 220-228, Edward Elgar Publishing.
    5. Don Husereau & Michael Drummond & Federico Augustovski & Esther Bekker-Grob & Andrew H. Briggs & Chris Carswell & Lisa Caulley & Nathorn Chaiyakunapruk & Dan Greenberg & Elizabeth Loder & Josephine Ma, 2022. "Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) Statement: Updated Reporting Guidance for Health Economic Evaluations," Applied Health Economics and Health Policy, Springer, vol. 20(2), pages 213-221, March.
    6. Drummond, Michael F. & Sculpher, Mark J. & Claxton, Karl & Stoddart, Greg L. & Torrance, George W., 2015. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 4, number 9780199665884.
    7. Spiegelman, D., 2016. "Evaluating public health interventions: 1. examples, definitions, and a personal note," American Journal of Public Health, American Public Health Association, vol. 106(1), pages 70-73.
    8. Haoran Jiang & Hongshik Ahn & Xiaolin Li, 2022. "Group Testing with Consideration of the Dilution Effect," Mathematics, MDPI, vol. 10(3), pages 1-14, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wanni Arachchige Dona, Sithara & McKenna, Kaitlyn & Ho, Thi Quynh Anh & Bohingamu Mudiyanselage, Shalika & Seymour, Monique & Le, Ha N.D. & Gold, Lisa, 2025. "Health-related quality of life, service utilisation and costs for anxiety disorders in children and young people: A systematic review and meta-analysis," Social Science & Medicine, Elsevier, vol. 373(C).
    2. Adal, Tadele G. & van der Mei, Ingrid & Taylor, Bruce V. & de Graaff, Barbara & Palmer, Andrew J. & Chen, Gang & Henson, Glen J. & Roydhouse, Jessica & Campbell, Julie A., 2024. "Investigation of the health economic analysis of informal care for people living with a chronic neurological disease: A systematic review and meta-analysis of the global evidence for multiple sclerosi," Social Science & Medicine, Elsevier, vol. 363(C).
    3. de Melo Santos, Carlos Jefferson & Sant’Anna, Angelo Marcio Oliveira, 2024. "Evaluation of the public policy impacts on Monkeypox in Brazil," Evaluation and Program Planning, Elsevier, vol. 103(C).
    4. Schroeder, Elizabeth-Ann & Westlake, David & Daher, Shahd & Adara, Linda & Ayayo, Sharon & Bennett, Verity & Kim, Sungwook & Lugg-Widger, Fiona & Meindl, Melissa & Meister, Lena & Munnery, Kim & Pallm, 2024. "The cost-effectiveness and cost-consequences of a school-based social worker intervention: A within-trial economic evaluation," Children and Youth Services Review, Elsevier, vol. 166(C).
    5. Angelis, Aris & Kanavos, Panos, 2017. "Multiple Criteria Decision Analysis (MCDA) for evaluating new medicines in Health Technology Assessment and beyond: The Advance Value Framework," Social Science & Medicine, Elsevier, vol. 188(C), pages 137-156.
    6. Antonios Garas & Sophie Guthmuller & Athanasios Lapatinas, 2021. "The development of nations conditions the disease space," PLOS ONE, Public Library of Science, vol. 16(1), pages 1-35, January.
    7. Ghislaine van Mastrigt & Caroline van Heugten & Anne Visser-Meily & Leonarda Bremmers & Silvia Evers, 2022. "Estimating the Burden of Stroke: Two-Year Societal Costs and Generic Health-Related Quality of Life of the Restore4Stroke Cohort," IJERPH, MDPI, vol. 19(17), pages 1-15, September.
    8. Yichen Zhang & Yuxuan Wei & Huangqianyu Li & Yixuan Chen & Yiran Guo & Sheng Han & Luwen Shi & Xiaodong Guan, 2022. "Prices and Clinical Benefit of National Price-Negotiated Anticancer Medicines in China," PharmacoEconomics, Springer, vol. 40(7), pages 715-724, July.
    9. Chia-Chin Li & Ying-Chun Lin & Ji-An Liang & K. S. Clifford Chao & Te-Chun Hsia & Chun-Ru Chien, 2023. "Health Economic Evaluation of Proton Therapy for Lung Cancer: A Systematic Review," IJERPH, MDPI, vol. 20(6), pages 1-10, March.
    10. Irina Pokhilenko & Luca M. M. Janssen & Aggie T. G. Paulus & Ruben M. W. A. Drost & William Hollingworth & Joanna C. Thorn & Sian Noble & Judit Simon & Claudia Fischer & Susanne Mayer & Luis Salvador-, 2023. "Development of an Instrument for the Assessment of Health-Related Multi-sectoral Resource Use in Europe: The PECUNIA RUM," Applied Health Economics and Health Policy, Springer, vol. 21(2), pages 155-166, March.
    11. Chiranjeev Sanyal & Don Husereau, 2020. "Systematic Review of Economic Evaluations of Services Provided by Community Pharmacists," Applied Health Economics and Health Policy, Springer, vol. 18(3), pages 375-392, June.
    12. Yesim Tozan & Joshua Kiyingi & Sooyoung Kim & Flavia Namuwonge & Florence Namuli & Vicent Ssentumbwe & Rashida Namirembe & Edwinnah Kasidi & Ozge Sensoy Bahar & Mary M Mckay & Fred M Ssewamala, 2024. "Micro-costing analysis of a combination intervention for improved mental health and HIV risk behaviors among school-going adolescent girls in Uganda," PLOS Mental Health, Public Library of Science, vol. 1(7), pages 1-14, December.
    13. Jungyoon Kim & Valerie Pacino & Hongmei Wang & April Recher & Isha Jain & Vaibhavi Mone & Jihyun Ma & Mary Jo Spurgin & Daniel Jeffrey & Stephen Mohring & Jane Potter, 2021. "System Redesign: The Value of a Primary Care Liaison Model to Address Unmet Social Needs among Older Primary Care Patients," IJERPH, MDPI, vol. 18(21), pages 1-11, October.
    14. Dong-Won Kang & Patricio B. Lynn & Li Wang & Shouhao Zhou & Chan Shen, 2025. "Cost-Effectiveness of Fruquintinib for Refractory Metastatic Colorectal Cancer in the USA," PharmacoEconomics - Open, Springer, vol. 9(1), pages 93-101, January.
    15. Gonot-Schoupinsky, Freda N. & Garip, Gulcan, 2019. "A flexible framework for planning and evaluating early-stage health interventions: FRAME-IT," Evaluation and Program Planning, Elsevier, vol. 77(C).
    16. Valentina Prevolnik Rupel & Marko Ogorevc, 2023. "EQ-5D-5L Value Set for Slovenia," PharmacoEconomics, Springer, vol. 41(11), pages 1515-1524, November.
    17. Julie A. Campbell & Glen J. Henson & Valery Fuh Ngwa & Hasnat Ahmad & Bruce V. Taylor & Ingrid Mei & Andrew J. Palmer, 2025. "Estimation of Transition Probabilities from a Large Cohort (> 6000) of Australians Living with Multiple Sclerosis (MS) for Changing Disability Severity Classifications, MS Phenotype, and Disease-Modif," PharmacoEconomics, Springer, vol. 43(2), pages 223-239, February.
    18. Chelsea M. Cooper & Mary Drake & Justine A. Kavle & Joyce Nyoni & Ruth Lemwayi & Lemmy Mabuga & Anne Pfitzer & Mary Makungu & Elizabeth Massawe & John George, 2021. "Implementing a Novel Facility-Community Intervention for Strengthening Integration of Infant Nutrition and Family Planning in Mara and Kagera, Tanzania," IJERPH, MDPI, vol. 18(8), pages 1-21, April.
    19. Christopher M Doran & Irina Kinchin, 2020. "Economic and epidemiological impact of youth suicide in countries with the highest human development index," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-11, May.
    20. Boniface Oyugi & Olena Nizalova & Sally Kendall & Stephen Peckham, 2024. "Does a free maternity policy in Kenya work? Impact and cost–benefit consideration based on demographic health survey data," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 25(1), pages 77-89, February.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:111:y:2025:i:c:s0149718925000771. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.