IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v111y2025ics0149718925000771.html

Advancing methods for program evaluation in substance use by strengthening the application of epidemiology, economic evaluation, and implementation science: Reflections on the opportunities for synergy

Author

Listed:
  • Blackburn, Natalie A.
  • Philbrick, Sarah
  • Patel, Sheila V.
  • Cance, Jessica D.
  • Elek, Elvira
  • Gibbons, Brent
  • Khan, Sazid
  • Lambdin, Barrot H.
  • Graham, Phillip W.

Abstract

Program evaluation is necessary to assess the success of evidence-based programs in real-world, non-trial settings. In its most basic form, it involves understanding processes that impact the health and well-being of individuals and communities. Increasingly, robust program evaluations are integrating approaches from implementation science and economic evaluation to strengthen assessment, achievement, and sustainment of the intended impacts of evidence-based programs, while traditionally employing epidemiological methods to assess outcomes. Epidemiology, economic evaluation, and implementation science operate in overlapping yet siloed arenas, which can make it challenging for program evaluators to effectively engage all three disciplines. Furthermore, given their overlap, practitioners in these disciplines must understand differences in their purpose and lexicon to foster synergies. We use the Centers for Disease Control and Prevention Evaluation Framework and an example from substance use prevention to reflect on specific concepts and terminology within each of these disciplines and how distinctions impact the ability of multidisciplinary teams to collaborate on evaluations. The implications apply to those designing, testing, implementing, and evaluating evidence-based programs—all of whom have the opportunity to consider and strengthen these elements when developing processes and measuring impact. The substance use prevention field needs to better understand how these disciplines can complement one another to enrich process, outcome, and impact evaluations, given the complexities of substance use behaviors and evidence-based programs to address them. With this synergy, clearer communication of findings from the different components can be achieved.

Suggested Citation

  • Blackburn, Natalie A. & Philbrick, Sarah & Patel, Sheila V. & Cance, Jessica D. & Elek, Elvira & Gibbons, Brent & Khan, Sazid & Lambdin, Barrot H. & Graham, Phillip W., 2025. "Advancing methods for program evaluation in substance use by strengthening the application of epidemiology, economic evaluation, and implementation science: Reflections on the opportunities for synerg," Evaluation and Program Planning, Elsevier, vol. 111(C).
  • Handle: RePEc:eee:epplan:v:111:y:2025:i:c:s0149718925000771
    DOI: 10.1016/j.evalprogplan.2025.102610
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718925000771
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2025.102610?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Don Husereau & Michael Drummond & Federico Augustovski & Esther Bekker-Grob & Andrew H. Briggs & Chris Carswell & Lisa Caulley & Nathorn Chaiyakunapruk & Dan Greenberg & Elizabeth Loder & Josephine Ma, 2022. "Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) Statement: Updated Reporting Guidance for Health Economic Evaluations," Applied Health Economics and Health Policy, Springer, vol. 20(2), pages 213-221, March.
    2. Glasgow, R.E. & Vogt, T.M. & Boles, S.M., 1999. "Evaluating the public health impact of health promotion interventions: The RE-AIM framework," American Journal of Public Health, American Public Health Association, vol. 89(9), pages 1322-1327.
    3. Don Husereau & Michael Drummond & Federico Augustovski & Esther Bekker-Grob & Andrew H. Briggs & Chris Carswell & Lisa Caulley & Nathorn Chaiyakunapruk & Dan Greenberg & Elizabeth Loder & Josephine Ma, 2022. "Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) Statement: Updated Reporting Guidance for Health Economic Evaluations," Applied Health Economics and Health Policy, Springer, vol. 20(2), pages 213-221, March.
    4. Zanti, Sharon & Berkowitz, Emily & Katz, Matthew & Nelson, Amy Hawn & Burnett, T.C. & Culhane, Dennis & Zhou, Yixi, 2022. "Leveraging integrated data for program evaluation: Recommendations from the field," Evaluation and Program Planning, Elsevier, vol. 95(C).
    5. Spiegelman, D., 2016. "Evaluating public health interventions: 1. examples, definitions, and a personal note," American Journal of Public Health, American Public Health Association, vol. 106(1), pages 70-73.
    6. ., 2022. "Final considerations," Chapters, in: Income Distribution, Growth and Unemployment, chapter 15, pages 220-228, Edward Elgar Publishing.
    7. Drummond, Michael F. & Sculpher, Mark J. & Claxton, Karl & Stoddart, Greg L. & Torrance, George W., 2015. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 4, number 9780199665884.
    8. Haoran Jiang & Hongshik Ahn & Xiaolin Li, 2022. "Group Testing with Consideration of the Dilution Effect," Mathematics, MDPI, vol. 10(3), pages 1-14, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adal, Tadele G. & van der Mei, Ingrid & Taylor, Bruce V. & de Graaff, Barbara & Palmer, Andrew J. & Chen, Gang & Henson, Glen J. & Roydhouse, Jessica & Campbell, Julie A., 2024. "Investigation of the health economic analysis of informal care for people living with a chronic neurological disease: A systematic review and meta-analysis of the global evidence for multiple sclerosi," Social Science & Medicine, Elsevier, vol. 363(C).
    2. Chia-Chin Li & Ying-Chun Lin & Ji-An Liang & K. S. Clifford Chao & Te-Chun Hsia & Chun-Ru Chien, 2023. "Health Economic Evaluation of Proton Therapy for Lung Cancer: A Systematic Review," IJERPH, MDPI, vol. 20(6), pages 1-10, March.
    3. Wanni Arachchige Dona, Sithara & McKenna, Kaitlyn & Ho, Thi Quynh Anh & Bohingamu Mudiyanselage, Shalika & Seymour, Monique & Le, Ha N.D. & Gold, Lisa, 2025. "Health-related quality of life, service utilisation and costs for anxiety disorders in children and young people: A systematic review and meta-analysis," Social Science & Medicine, Elsevier, vol. 373(C).
    4. de Melo Santos, Carlos Jefferson & Sant’Anna, Angelo Marcio Oliveira, 2024. "Evaluation of the public policy impacts on Monkeypox in Brazil," Evaluation and Program Planning, Elsevier, vol. 103(C).
    5. Schroeder, Elizabeth-Ann & Westlake, David & Daher, Shahd & Adara, Linda & Ayayo, Sharon & Bennett, Verity & Kim, Sungwook & Lugg-Widger, Fiona & Meindl, Melissa & Meister, Lena & Munnery, Kim & Pallm, 2024. "The cost-effectiveness and cost-consequences of a school-based social worker intervention: A within-trial economic evaluation," Children and Youth Services Review, Elsevier, vol. 166(C).
    6. Angelis, Aris & Kanavos, Panos, 2017. "Multiple Criteria Decision Analysis (MCDA) for evaluating new medicines in Health Technology Assessment and beyond: The Advance Value Framework," Social Science & Medicine, Elsevier, vol. 188(C), pages 137-156.
    7. Yichen Zhang & Yuxuan Wei & Huangqianyu Li & Yixuan Chen & Yiran Guo & Sheng Han & Luwen Shi & Xiaodong Guan, 2022. "Prices and Clinical Benefit of National Price-Negotiated Anticancer Medicines in China," PharmacoEconomics, Springer, vol. 40(7), pages 715-724, July.
    8. Siwaporn Niyomsri & Mantiwee Nimworapan & Wanwarang Wongcharoen & Piyameth Dilokthornsakul, 2023. "Economic Evaluation of Direct Oral Anticoagulants Compared to Warfarin for Venous Thromboembolism in Thailand: A Cost-Utility Analysis," IJERPH, MDPI, vol. 20(4), pages 1-15, February.
    9. Antonios Garas & Sophie Guthmuller & Athanasios Lapatinas, 2021. "The development of nations conditions the disease space," PLOS ONE, Public Library of Science, vol. 16(1), pages 1-35, January.
    10. Ghislaine van Mastrigt & Caroline van Heugten & Anne Visser-Meily & Leonarda Bremmers & Silvia Evers, 2022. "Estimating the Burden of Stroke: Two-Year Societal Costs and Generic Health-Related Quality of Life of the Restore4Stroke Cohort," IJERPH, MDPI, vol. 19(17), pages 1-15, September.
    11. Susanne Mayer & Agata Łaszewska & Judit Simon, 2022. "Unit Costs in Health Economic Evaluations: Quo Vadis, Austria?," IJERPH, MDPI, vol. 20(1), pages 1-12, December.
    12. Chiranjeev Sanyal & Don Husereau, 2020. "Systematic Review of Economic Evaluations of Services Provided by Community Pharmacists," Applied Health Economics and Health Policy, Springer, vol. 18(3), pages 375-392, June.
    13. Andrew J. Mirelman & Miqdad Asaria & Bryony Dawkins & Susan Griffin & Richard Cookson & Peter Berman, 2020. "Fairer Decisions, Better Health for All: Health Equity and Cost-Effectiveness Analysis," World Scientific Book Chapters, in: Paul Revill & Marc Suhrcke & Rodrigo Moreno-Serra & Mark Sculpher (ed.), Global Health Economics Shaping Health Policy in Low- and Middle-Income Countries, chapter 4, pages 99-132, World Scientific Publishing Co. Pte. Ltd..
    14. Julie A. Campbell & Glen J. Henson & Valery Fuh Ngwa & Hasnat Ahmad & Bruce V. Taylor & Ingrid Mei & Andrew J. Palmer, 2025. "Estimation of Transition Probabilities from a Large Cohort (> 6000) of Australians Living with Multiple Sclerosis (MS) for Changing Disability Severity Classifications, MS Phenotype, and Disease-Modif," PharmacoEconomics, Springer, vol. 43(2), pages 223-239, February.
    15. Chelsea M. Cooper & Mary Drake & Justine A. Kavle & Joyce Nyoni & Ruth Lemwayi & Lemmy Mabuga & Anne Pfitzer & Mary Makungu & Elizabeth Massawe & John George, 2021. "Implementing a Novel Facility-Community Intervention for Strengthening Integration of Infant Nutrition and Family Planning in Mara and Kagera, Tanzania," IJERPH, MDPI, vol. 18(8), pages 1-21, April.
    16. Christopher M Doran & Irina Kinchin, 2020. "Economic and epidemiological impact of youth suicide in countries with the highest human development index," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-11, May.
    17. Francisco Javier de la Garza Iga & Marinés Mejía Alvarez & Joshua D Cockroft & Julia Rabin & Ana Cordón & Dina Maria Elias Rodas & Maria del Pilar Grazioso & Maria Espinola & Christine O’Dea & Ch, 2023. "Using the project ECHO™ model to teach mental health topics in rural Guatemala: An implementation science-guided evaluation," International Journal of Social Psychiatry, , vol. 69(8), pages 2031-2041, December.
    18. Qi Cao & Erik Buskens & Hans L. Hillege & Tiny Jaarsma & Maarten Postma & Douwe Postmus, 2019. "Stratified treatment recommendation or one-size-fits-all? A health economic insight based on graphical exploration," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 475-482, April.
    19. Dongzhe Hong & Lei Si & Minghuan Jiang & Hui Shao & Wai-kit Ming & Yingnan Zhao & Yan Li & Lizheng Shi, 2019. "Cost Effectiveness of Sodium-Glucose Cotransporter-2 (SGLT2) Inhibitors, Glucagon-Like Peptide-1 (GLP-1) Receptor Agonists, and Dipeptidyl Peptidase-4 (DPP-4) Inhibitors: A Systematic Review," PharmacoEconomics, Springer, vol. 37(6), pages 777-818, June.
    20. Yakubu Adole Agada-Amade & Daniel Chukwuemeka Ogbuabor & Eric Obikeze & Ejemai Eboreime & Obinna Emmanuel Onwujekwe, 2024. "Cost-benefit analysis of haemodialysis in patients with end-stage kidney disease in Abuja, Nigeria," Health Economics Review, Springer, vol. 14(1), pages 1-8, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:111:y:2025:i:c:s0149718925000771. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.