IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v58y2016icp1-19.html
   My bibliography  Save this article

Narrative review of strategies by organizations for building evaluation capacity

Author

Listed:
  • Norton, Sophie
  • Milat, Andrew
  • Edwards, Barry
  • Giffin, Michael

Abstract

Program evaluation is an important source of information to assist organizations to make “evidence-informed” decisions about program planning and development. The objectives of this study were to identify evaluated strategies used by organizations and program developers to build the program evaluation capacity of their workforce, and to describe success factors and lessons learned. Common elements for successful evaluation capacity building (ECB) include: a tailored strategy based on needs assessment, an organizational commitment to evaluation and ECB, experiential learning, training with a practical element, and some form of ongoing technical support within the workplace. ECB is a relatively new field of endeavor, and, while existing studies in ECB are characterized by lower levels of evidence, they suggest the most successful approaches to ECB are likely to be multifaceted. To build the level of evidence in this field, more rigorous study designs need to be implemented in the future.

Suggested Citation

  • Norton, Sophie & Milat, Andrew & Edwards, Barry & Giffin, Michael, 2016. "Narrative review of strategies by organizations for building evaluation capacity," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 1-19.
  • Handle: RePEc:eee:epplan:v:58:y:2016:i:c:p:1-19
    DOI: 10.1016/j.evalprogplan.2016.04.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915300616
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2016.04.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Levine, Roger & Russ-Eft, Darlene & Burling, Andrea & Stephens, Jennifer & Downey, Joanna, 2013. "Evaluating health services research capacity building programs: Implications for health services and human resource development," Evaluation and Program Planning, Elsevier, vol. 37(C), pages 1-11.
    2. Fleming, M. Lynette & Easton, Janice, 2010. "Building environmental educators' evaluation capacity through distance education," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 172-177, May.
    3. Naccarella, Lucio & Pirkis, Jane & Kohn, Fay & Morley, Belinda & Burgess, Philip & Blashki, Grant, 2007. "Building evaluation capacity: Definitional and practical implications from an Australian case study," Evaluation and Program Planning, Elsevier, vol. 30(3), pages 231-236, August.
    4. Greenhalgh, Trisha & Robert, Glenn & Macfarlane, Fraser & Bate, Paul & Kyriakidou, Olympia & Peacock, Richard, 2005. "Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review," Social Science & Medicine, Elsevier, vol. 61(2), pages 417-430, July.
    5. Satterlund, Travis D. & Treiber, Jeanette & Kipke, Robin & Kwon, Nicole & Cassady, Diana, 2013. "Accommodating diverse clients’ needs in evaluation capacity building: A case study of the Tobacco Control Evaluation Center," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 49-55.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Schwarzman, Joanna & Bauman, Adrian & Gabbe, Belinda J. & Rissel, Chris & Shilton, Trevor & Smith, Ben J., 2019. "Understanding the factors that influence health promotion evaluation: The development and validation of the evaluation practice analysis survey," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 76-83.
    2. Kumar Chaudhary, Anil & Diaz, John & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Evaluation capacity building in the nonformal education context: Challenges and strategies," Evaluation and Program Planning, Elsevier, vol. 79(C).
    3. Yu.V. Lyandau & I.A. Kalinina & A.P. Garnov & Y.Yu. Garnova, 2018. "Research of the Russian Companies’ Potential and the Success Factors," European Research Studies Journal, European Research Studies Journal, vol. 0(Special1), pages 250-260.
    4. Merritt, Eileen G. & Stern, Marc J. & Powell, Robert B. & Frensley, Brandon T., 2023. "Benefits of participation in a community of practice focused on evaluation and programmatic improvement for environmental educators," Evaluation and Program Planning, Elsevier, vol. 99(C).
    5. repec:ers:journl:v:special_issue:y:2018:i:1:p:250-260 is not listed on IDEAS
    6. Nielsen, Steffen Bohni & Lemire, Sebastian & Bourgeois, Isabelle & Fierro, Leslie A., 2023. "Mapping the evaluation capacity building landscape: A bibliometric analysis of scholarly communities and themes," Evaluation and Program Planning, Elsevier, vol. 99(C).
    7. Schwarzman, Joanna & Bauman, Adrian & Gabbe, Belinda J. & Rissel, Chris & Shilton, Trevor & Smith, Ben J., 2022. "How practitioner, organisational and system-level factors act to influence health promotion evaluation capacity: Validation of a conceptual framework," Evaluation and Program Planning, Elsevier, vol. 91(C).
    8. Lawarée, Justin & Jacob, Steve & Ouimet, Mathieu, 2020. "A scoping review of knowledge syntheses in the field of evaluation across four decades of practice," Evaluation and Program Planning, Elsevier, vol. 79(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kumar Chaudhary, Anil & Diaz, John & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Evaluation capacity building in the nonformal education context: Challenges and strategies," Evaluation and Program Planning, Elsevier, vol. 79(C).
    2. Tseng, Shu-Hui, 2011. "An assessment scale of ECB: Perspectives from the faculty and staff of technical colleges in Taiwan," Evaluation and Program Planning, Elsevier, vol. 34(2), pages 154-159, May.
    3. Lijuan Du & Li Xu & Yanping Li & Changshun Liu & Zhenhua Li & Jefferson S. Wong & Bo Lei, 2019. "China’s Agricultural Irrigation and Water Conservancy Projects: A Policy Synthesis and Discussion of Emerging Issues," Sustainability, MDPI, vol. 11(24), pages 1-20, December.
    4. Costa Climent, Ricardo & Haftor, Darek M., 2021. "Business model theory-based prediction of digital technology use: An empirical assessment," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    5. Alexandra Mudd & Rebecca Feo & Tiffany Conroy & Alison Kitson, 2020. "Where and how does fundamental care fit within seminal nursing theories: A narrative review and synthesis of key nursing concepts," Journal of Clinical Nursing, John Wiley & Sons, vol. 29(19-20), pages 3652-3666, October.
    6. Genus, Audley & Iskandarova, Marfuga, 2018. "Responsible innovation: its institutionalisation and a critique," Technological Forecasting and Social Change, Elsevier, vol. 128(C), pages 1-9.
    7. Jesus Gonzalez-Feliu, 2013. "Vehicle Routing in Multi-Echelon Distribution Systems with Cross-Docking: A Systematic Lexical-Metanarrative Analysis," Post-Print halshs-00834573, HAL.
    8. Gagliardi, Dimitri & Ramlogan, Ronnie & Navarra, Pierluigi & Dello Russo, Cinzia, 2018. "Diffusion of complementary evolving pharmaceutical innovations: The case of Abacavir and its pharmacogenetic companion diagnostic in Italy," Technological Forecasting and Social Change, Elsevier, vol. 134(C), pages 223-233.
    9. Mike Danilovic & Marleen Hensbergen & Maya Hoveskog & Liudmila Zadayannaya, 2015. "Exploring Diffusion and Dynamics of Corporate Social Responsibility," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 22(3), pages 129-141, May.
    10. Isabella Bonacci & Andrea Mazzitelli & Donato Morea, 2020. "Evaluating Climate between Working Excellence and Organizational Innovation: What Comes First?," Sustainability, MDPI, vol. 12(8), pages 1-29, April.
    11. Hansen, Henrik & Trifkovic, Neda, 2013. "Systematic Reviews: Questions, Methods and Usage," MPRA Paper 47993, University Library of Munich, Germany.
    12. Chaiwichit Chianchana, 2020. "Research Synthesis on Educational Models," GATR Journals gjbssr569, Global Academy of Training and Research (GATR) Enterprise.
    13. Crohn, Kara & Birnbaum, Matthew, 2010. "Environmental education evaluation: Time to reflect, time for change," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 155-158, May.
    14. Robert Kaba Alhassan & Edward Nketiah-Amponsah & Daniel Kojo Arhinful, 2016. "A Review of the National Health Insurance Scheme in Ghana: What Are the Sustainability Threats and Prospects?," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-16, November.
    15. repec:oup:rseval:v:32:y:2024:i:2:p:286-298. is not listed on IDEAS
    16. Isabel Saz-Gil & Ignacio Bretos & Millán Díaz-Foncea, 2021. "Cooperatives and Social Capital: A Narrative Literature Review and Directions for Future Research," Sustainability, MDPI, vol. 13(2), pages 1-18, January.
    17. Kahiya, Eldrede T., 2018. "Five decades of research on export barriers: Review and future directions," International Business Review, Elsevier, vol. 27(6), pages 1172-1188.
    18. Fleming, M. Lynette & Easton, Janice, 2010. "Building environmental educators' evaluation capacity through distance education," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 172-177, May.
    19. Mathew Azarian & Hao Yu & Asmamaw Tadege Shiferaw & Tor Kristian Stevik, 2023. "Do We Perform Systematic Literature Review Right? A Scientific Mapping and Methodological Assessment," Logistics, MDPI, vol. 7(4), pages 1-32, November.
    20. Ferlie, Ewan & Crilly, Tessa & Jashapara, Ashok & Peckham, Anna, 2012. "Knowledge mobilisation in healthcare: A critical review of health sector and generic management literature," Social Science & Medicine, Elsevier, vol. 74(8), pages 1297-1304.
    21. Rogers, Alison F. & Kelly, Leanne M. & McCoy, Alicia, 2019. "Pathways to becoming an internal evaluator: Perspectives from the Australian non-government sector," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 102-109.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:58:y:2016:i:c:p:1-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.