IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v58y2016icp1-19.html
   My bibliography  Save this article

Narrative review of strategies by organizations for building evaluation capacity

Author

Listed:
  • Norton, Sophie
  • Milat, Andrew
  • Edwards, Barry
  • Giffin, Michael

Abstract

Program evaluation is an important source of information to assist organizations to make “evidence-informed” decisions about program planning and development. The objectives of this study were to identify evaluated strategies used by organizations and program developers to build the program evaluation capacity of their workforce, and to describe success factors and lessons learned. Common elements for successful evaluation capacity building (ECB) include: a tailored strategy based on needs assessment, an organizational commitment to evaluation and ECB, experiential learning, training with a practical element, and some form of ongoing technical support within the workplace. ECB is a relatively new field of endeavor, and, while existing studies in ECB are characterized by lower levels of evidence, they suggest the most successful approaches to ECB are likely to be multifaceted. To build the level of evidence in this field, more rigorous study designs need to be implemented in the future.

Suggested Citation

  • Norton, Sophie & Milat, Andrew & Edwards, Barry & Giffin, Michael, 2016. "Narrative review of strategies by organizations for building evaluation capacity," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 1-19.
    • Handle: RePEc:eee:epplan:v:58:y:2016:i:c:p:1-19
    DOI: 10.1016/j.evalprogplan.2016.04.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915300616
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2016.04.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Levine, Roger & Russ-Eft, Darlene & Burling, Andrea & Stephens, Jennifer & Downey, Joanna, 2013. "Evaluating health services research capacity building programs: Implications for health services and human resource development," Evaluation and Program Planning, Elsevier, vol. 37(C), pages 1-11.
    2. Greenhalgh, Trisha & Robert, Glenn & Macfarlane, Fraser & Bate, Paul & Kyriakidou, Olympia & Peacock, Richard, 2005. "Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review," Social Science & Medicine, Elsevier, vol. 61(2), pages 417-430, July.
    3. Fleming, M. Lynette & Easton, Janice, 2010. "Building environmental educators' evaluation capacity through distance education," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 172-177, May.
    4. Naccarella, Lucio & Pirkis, Jane & Kohn, Fay & Morley, Belinda & Burgess, Philip & Blashki, Grant, 2007. "Building evaluation capacity: Definitional and practical implications from an Australian case study," Evaluation and Program Planning, Elsevier, vol. 30(3), pages 231-236, August.
    5. Satterlund, Travis D. & Treiber, Jeanette & Kipke, Robin & Kwon, Nicole & Cassady, Diana, 2013. "Accommodating diverse clients’ needs in evaluation capacity building: A case study of the Tobacco Control Evaluation Center," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 49-55.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Schwarzman, Joanna & Bauman, Adrian & Gabbe, Belinda J. & Rissel, Chris & Shilton, Trevor & Smith, Ben J., 2019. "Understanding the factors that influence health promotion evaluation: The development and validation of the evaluation practice analysis survey," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 76-83.
    2. Kumar Chaudhary, Anil & Diaz, John & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Evaluation capacity building in the nonformal education context: Challenges and strategies," Evaluation and Program Planning, Elsevier, vol. 79(C).
    3. Yu.V. Lyandau & I.A. Kalinina & A.P. Garnov & Y.Yu. Garnova, 2018. "Research of the Russian Companies’ Potential and the Success Factors," European Research Studies Journal, European Research Studies Journal, vol. 0(Special1), pages 250-260.
    4. Merritt, Eileen G. & Stern, Marc J. & Powell, Robert B. & Frensley, Brandon T., 2023. "Benefits of participation in a community of practice focused on evaluation and programmatic improvement for environmental educators," Evaluation and Program Planning, Elsevier, vol. 99(C).
    5. repec:ers:journl:v:special_issue:y:2018:i:1:p:250-260 is not listed on IDEAS
    6. Nielsen, Steffen Bohni & Lemire, Sebastian & Bourgeois, Isabelle & Fierro, Leslie A., 2023. "Mapping the evaluation capacity building landscape: A bibliometric analysis of scholarly communities and themes," Evaluation and Program Planning, Elsevier, vol. 99(C).
    7. Schwarzman, Joanna & Bauman, Adrian & Gabbe, Belinda J. & Rissel, Chris & Shilton, Trevor & Smith, Ben J., 2022. "How practitioner, organisational and system-level factors act to influence health promotion evaluation capacity: Validation of a conceptual framework," Evaluation and Program Planning, Elsevier, vol. 91(C).
    8. Lawarée, Justin & Jacob, Steve & Ouimet, Mathieu, 2020. "A scoping review of knowledge syntheses in the field of evaluation across four decades of practice," Evaluation and Program Planning, Elsevier, vol. 79(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kumar Chaudhary, Anil & Diaz, John & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Evaluation capacity building in the nonformal education context: Challenges and strategies," Evaluation and Program Planning, Elsevier, vol. 79(C).
    2. Tseng, Shu-Hui, 2011. "An assessment scale of ECB: Perspectives from the faculty and staff of technical colleges in Taiwan," Evaluation and Program Planning, Elsevier, vol. 34(2), pages 154-159, May.
    3. Jesus Gonzalez-Feliu, 2013. "Vehicle Routing in Multi-Echelon Distribution Systems with Cross-Docking: A Systematic Lexical-Metanarrative Analysis," Post-Print halshs-00834573, HAL.
    4. Gagliardi, Dimitri & Ramlogan, Ronnie & Navarra, Pierluigi & Dello Russo, Cinzia, 2018. "Diffusion of complementary evolving pharmaceutical innovations: The case of Abacavir and its pharmacogenetic companion diagnostic in Italy," Technological Forecasting and Social Change, Elsevier, vol. 134(C), pages 223-233.
    5. Isabella Bonacci & Andrea Mazzitelli & Donato Morea, 2020. "Evaluating Climate between Working Excellence and Organizational Innovation: What Comes First?," Sustainability, MDPI, vol. 12(8), pages 1-29, April.
    6. Hansen, Henrik & Trifkovic, Neda, 2013. "Systematic Reviews: Questions, Methods and Usage," MPRA Paper 47993, University Library of Munich, Germany.
    7. Crohn, Kara & Birnbaum, Matthew, 2010. "Environmental education evaluation: Time to reflect, time for change," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 155-158, May.
    8. Robert Kaba Alhassan & Edward Nketiah-Amponsah & Daniel Kojo Arhinful, 2016. "A Review of the National Health Insurance Scheme in Ghana: What Are the Sustainability Threats and Prospects?," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-16, November.
    9. Kahiya, Eldrede T., 2018. "Five decades of research on export barriers: Review and future directions," International Business Review, Elsevier, vol. 27(6), pages 1172-1188.
    10. Mathew Azarian & Hao Yu & Asmamaw Tadege Shiferaw & Tor Kristian Stevik, 2023. "Do We Perform Systematic Literature Review Right? A Scientific Mapping and Methodological Assessment," Logistics, MDPI, vol. 7(4), pages 1-32, November.
    11. Prattana Punnakitikashem & Philip Hallinger, 2019. "Bibliometric Review of the Knowledge Base on Healthcare Management for Sustainability, 1994–2018," Sustainability, MDPI, vol. 12(1), pages 1-17, December.
    12. Deprez, Jana & Leroy, Hannes & Euwema, Martin, 2018. "Three chronological steps toward encouraging intrapreneurship: Lessons from the Wehkamp case," Business Horizons, Elsevier, vol. 61(1), pages 135-145.
    13. Gupta, Samir & Maltz, Elliot, 2015. "Interdependency, dynamism, and variety (IDV) network modeling to explain knowledge diffusion at the fuzzy front-end of innovation," Journal of Business Research, Elsevier, vol. 68(11), pages 2434-2442.
    14. Liberati, Elisa Giulia & Gorli, Mara & Moja, Lorenzo & Galuppo, Laura & Ripamonti, Silvio & Scaratti, Giuseppe, 2015. "Exploring the practice of patient centered care: The role of ethnography and reflexivity," Social Science & Medicine, Elsevier, vol. 133(C), pages 45-52.
    15. Kim, Jinhee & de Leeuw, Evelyne & Harris-Roxas, Ben & Sainsbury, Peter, 2023. "Five urban health research traditions: A meta-narrative review," Social Science & Medicine, Elsevier, vol. 336(C).
    16. Bourgeois, Isabelle & Whynot, Jane & Thériault, Étienne, 2015. "Application of an organizational evaluation capacity self-assessment instrument to different organizations: Similarities and lessons learned," Evaluation and Program Planning, Elsevier, vol. 50(C), pages 47-55.
    17. Maria Chiara Demartini & Valentina Beretta, 2020. "La gestione della cronicit? nelle aziende sanitarie: una rassegna della letteratura," MECOSAN, FrancoAngeli Editore, vol. 0(116), pages 7-30.
    18. Gonot-Schoupinsky, Freda N. & Garip, Gulcan & Sheffield, David, 2022. "Facilitating the planning and evaluation of narrative intervention reviews: Systematic Transparency Assessment in Intervention Reviews (STAIR)," Evaluation and Program Planning, Elsevier, vol. 91(C).
    19. Calderón-Larrañaga, Sara & Greenhalgh, Trish & Finer, Sarah & Clinch, Megan, 2024. "What does social prescribing look like in practice? A qualitative case study informed by practice theory," Social Science & Medicine, Elsevier, vol. 343(C).
    20. Ford, Rebecca & Maidment, Chris & Vigurs, Carol & Fell, Michael J. & Morris, Madeleine, 2021. "Smart local energy systems (SLES): A framework for exploring transition, context, and impacts," Technological Forecasting and Social Change, Elsevier, vol. 166(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:58:y:2016:i:c:p:1-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.