IDEAS home Printed from https://ideas.repec.org/a/wly/jocnur/v28y2019i13-14p2486-2498.html
   My bibliography  Save this article

Evaluation frameworks in health services: An integrative review of use, attributes and elements

Author

Listed:
  • Natalie Bradford
  • Shirley Chambers
  • Adrienne Hudson
  • Jacqui Jauncey‐Cooke
  • Robyn Penny
  • Carol Windsor
  • Patsy Yates

Abstract

Aims and objective To synthesise the evidence on the use of evaluation frameworks by nurses and midwives in research designed to improve healthcare services and practice. A secondary aim was to identify the attributes and elements of evaluation frameworks. Background Evaluation is an integral component of any initiative to improve outcomes or change clinical practice. Yet often an evaluation may not yield the information required to sustain or integrate an initiative into practice. Evaluation frameworks can support effective evaluations, but there is a lack of consensus regarding elements and attributes of frameworks that support use. Methods We undertook an integrative review to synthesise the use of evaluation frameworks in practice guided by the Preferred Reporting Items for Systematic review and Meta‐Analysis flow diagram and checklist 2009 (Supporting Information File 4). The protocol was registered with PROSPERO (CRD42018087033). A broad range of electronic databases were systematically searched using keywords. Findings Twenty‐five papers were included from a diverse range of clinical areas and across high‐, middle‐ and low‐income nations. Twenty of the research projects had used nine existing frameworks, and five had developed an evaluation specific to an initiative. Frameworks supported the processes of evaluation and made them more meaningful by simplifying a complex process (providing structure and guidance for the evaluation processes); identifying and including stakeholders; explaining reasons for outcomes; generating transferable lessons; and identifying the mechanisms driving or inhibiting change. Conclusion Nurses and midwives reported that frameworks were useful in undertaking evaluations. Each framework had positive attributes and missing or confusing elements. When undertaking an evaluation, it is pertinent to review the elements and attributes of a framework to ensure it includes evaluation measures that are relevant to specific projects. Relevance to clinical practice Nurses are actively involved in evaluation of clinical practice. This review identifies important elements to consider when choosing a framework for evaluation.

Suggested Citation

  • Natalie Bradford & Shirley Chambers & Adrienne Hudson & Jacqui Jauncey‐Cooke & Robyn Penny & Carol Windsor & Patsy Yates, 2019. "Evaluation frameworks in health services: An integrative review of use, attributes and elements," Journal of Clinical Nursing, John Wiley & Sons, vol. 28(13-14), pages 2486-2498, July.
    • Handle: RePEc:wly:jocnur:v:28:y:2019:i:13-14:p:2486-2498
    DOI: 10.1111/jocn.14842
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/jocn.14842
    Download Restriction: no
    File URL: https://libkey.io/10.1111/jocn.14842?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Glenn Gardner & Anne Gardner & Jane O'Connell, 2014. "Using the Donabedian framework to examine the quality and safety of nursing service innovation," Journal of Clinical Nursing, John Wiley & Sons, vol. 23(1-2), pages 145-155, January.
    2. Glasgow, R.E. & Vogt, T.M. & Boles, S.M., 1999. "Evaluating the public health impact of health promotion interventions: The RE-AIM framework," American Journal of Public Health, American Public Health Association, vol. 89(9), pages 1322-1327.
    3. Robyn A Penny & Natalie K Bradford & Danette Langbecker, 2018. "Registered nurse and midwife experiences of using videoconferencing in practice: A systematic review of qualitative studies," Journal of Clinical Nursing, John Wiley & Sons, vol. 27(5-6), pages 739-752, March.
    4. Glasgow, R.E. & Lichtenstein, E. & Marcus, A.C., 2003. "Why Don't We See More Translation of Health Promotion Research to Practice? Rethinking the Efficacy-to-Effectiveness Transition," American Journal of Public Health, American Public Health Association, vol. 93(8), pages 1261-1267.
    5. Louise O’Byrne & Sheree Smith, 2011. "Models to enhance research capacity and capability in clinical nurses: a narrative review," Journal of Clinical Nursing, John Wiley & Sons, vol. 20(9‐10), pages 1365-1371, May.
    6. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    7. Gaglio, B. & Shoup, J.A. & Glasgow, R.E., 2013. "The RE-AIM framework: A systematic review of use over time," American Journal of Public Health, American Public Health Association, vol. 103(6), pages 38-46.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Glasgow, LaShawn & Adams, Elizabeth & Smith, Lucia Rojas & Renaud, Jeanette, 2020. "Key Insights on Participation Measurement from Real-world Health Care Interventions," Evaluation and Program Planning, Elsevier, vol. 78(C).
    2. Liliana Tenney & Amy G. Huebschmann & Carol E. Brown & Natalie V. Schwatka & Lee S. Newman, 2022. "Leveraging an Implementation Science Framework to Measure the Impact of Efforts to Scale Out a Total Worker Health ® Intervention to Employers," IJERPH, MDPI, vol. 19(3), pages 1-20, January.
    3. Shanahan, Meghan & Fleming, Phyllis & Nocera, Maryalice & Sullivan, Kelly & Murphy, Robert & Zolotor, Adam, 2014. "Process evaluation of a statewide abusive head trauma prevention program," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 18-25.
    4. Gonot-Schoupinsky, Freda N. & Garip, Gulcan, 2019. "A flexible framework for planning and evaluating early-stage health interventions: FRAME-IT," Evaluation and Program Planning, Elsevier, vol. 77(C).
    5. Chelsea M. Cooper & Mary Drake & Justine A. Kavle & Joyce Nyoni & Ruth Lemwayi & Lemmy Mabuga & Anne Pfitzer & Mary Makungu & Elizabeth Massawe & John George, 2021. "Implementing a Novel Facility-Community Intervention for Strengthening Integration of Infant Nutrition and Family Planning in Mara and Kagera, Tanzania," IJERPH, MDPI, vol. 18(8), pages 1-21, April.
    6. Saria Hassan & Alexis Cooke & Haneefa Saleem & Dorothy Mushi & Jessie Mbwambo & Barrot H. Lambdin, 2019. "Evaluating the Integrated Methadone and Anti-Retroviral Therapy Strategy in Tanzania Using the RE-AIM Framework," IJERPH, MDPI, vol. 16(5), pages 1-15, February.
    7. Kristen C. Reilly & Patricia Tucker & Jennifer D. Irwin & Andrew M. Johnson & Erin S. Pearson & Dirk E. Bock & Shauna M. Burke, 2018. "“C.H.A.M.P. Families”: Description and Theoretical Foundations of a Paediatric Overweight and Obesity Intervention Targeting Parents—A Single-Centre Non-Randomised Feasibility Study," IJERPH, MDPI, vol. 15(12), pages 1-23, December.
    8. Holly Blake & Betsy Lai & Emil Coman & Jonathan Houdmont & Amanda Griffiths, 2019. "Move-It: A Cluster-Randomised Digital Worksite Exercise Intervention in China: Outcome and Process Evaluation," IJERPH, MDPI, vol. 16(18), pages 1-23, September.
    9. Bradley MacDonald & Xanne Janssen & Alison Kirk & Mhairi Patience & Ann-Marie Gibson, 2018. "An Integrative, Systematic Review Exploring the Research, Effectiveness, Adoption, Implementation, and Maintenance of Interventions to Reduce Sedentary Behaviour in Office Workers," IJERPH, MDPI, vol. 15(12), pages 1-29, December.
    10. Marsha L. Brierley & Lindsey R. Smith & Angel M. Chater & Daniel P. Bailey, 2022. "A-REST (Activity to Reduce Excessive Sitting Time): A Feasibility Trial to Reduce Prolonged Sitting in Police Staff," IJERPH, MDPI, vol. 19(15), pages 1-27, July.
    11. Katrien De Cocker & Greet Cardon & Jason A. Bennie & Tracy Kolbe-Alexander & Femke De Meester & Corneel Vandelanotte, 2018. "From Evidence-Based Research to Practice-Based Evidence: Disseminating a Web-Based Computer-Tailored Workplace Sitting Intervention through a Health Promotion Organisation," IJERPH, MDPI, vol. 15(5), pages 1-11, May.
    12. Ditte Marie Bruun & Eik Bjerre & Peter Krustrup & Klaus Brasso & Christoffer Johansen & Mikael Rørth & Julie Midtgaard, 2014. "Community-Based Recreational Football: A Novel Approach to Promote Physical Activity and Quality of Life in Prostate Cancer Survivors," IJERPH, MDPI, vol. 11(6), pages 1-19, May.
    13. Harriet Koorts & Adrian Bauman & Nancy Edwards & William Bellew & Wendy J. Brown & Mitch J. Duncan & David R. Lubans & Andrew J. Milat & Philip J. Morgan & Nicole Nathan & Andrew Searles & Karen Lee &, 2022. "Tensions and Paradoxes of Scaling Up: A Critical Reflection on Physical Activity Promotion," IJERPH, MDPI, vol. 19(21), pages 1-16, November.
    14. Krisdaniel Berreta & Cynthia Nguyen & Alexis M. Stoner & Lindsey Ridgeway & Angela Wilson & Natalie Fadel & Duke Biber, 2023. "A RE-AIM Analysis of a Mental Health App for Undergraduate and Medical Students during the COVID-19 Pandemic: A Retrospective Cross-Sectional Study," IJERPH, MDPI, vol. 20(13), pages 1-9, June.
    15. Hutto, Brent & Saunders, Ruth P. & Wilcox, Sara & Jake-Schoffman, Danielle E. & Bernhart, John A. & Dunn, Caroline G. & Kaczynski, Andrew T. & James, Katherine L., 2021. "Pathways of influences leading to adoption of the Faith, Activity and Nutrition (FAN) program in a statewide initiative," Evaluation and Program Planning, Elsevier, vol. 87(C).
    16. Chanté Johannes & Nicolette V. Roman & Sunday O. Onagbiye & Simone Titus & Lloyd L. Leach, 2024. "Strategies and Best Practices That Enhance the Physical Activity Levels of Undergraduate University Students: A Systematic Review," IJERPH, MDPI, vol. 21(2), pages 1-22, February.
    17. Tamara M. Haegerich & Corinne David-Ferdon & Rita K. Noonan & Brian J. Manns & Holly C. Billie, 2017. "Technical Packages in Injury and Violence Prevention to Move Evidence Into Practice," Evaluation Review, , vol. 41(1), pages 78-108, February.
    18. Kristen C. Reilly & Daniel Briatico & Jennifer D. Irwin & Patricia Tucker & Erin S. Pearson & Shauna M. Burke, 2019. "Participants’ Perceptions of “C.H.A.M.P. Families”: A Parent-Focused Intervention Targeting Paediatric Overweight and Obesity," IJERPH, MDPI, vol. 16(12), pages 1-24, June.
    19. Karen Setty & Ryan Cronk & Shannan George & Darcy Anderson & Għanja O’Flaherty & Jamie Bartram, 2019. "Adapting Translational Research Methods to Water, Sanitation, and Hygiene," IJERPH, MDPI, vol. 16(20), pages 1-31, October.
    20. Natale, Ruby A. & Kolomeyer, Ellen & Robleto, Ana & Jaffery, Zafreen & Spector, Rachel, 2020. "Utilizing the RE-AIM framework to determine effectiveness of a preschool intervention program on social-emotional outcomes," Evaluation and Program Planning, Elsevier, vol. 79(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jocnur:v:28:y:2019:i:13-14:p:2486-2498. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1365-2702 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.