IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v67y2018icp189-199.html

To evaluate or not: Evaluability study of 40 interventions of Belgian development cooperation

Author

Listed:
  • Holvoet, Nathalie
  • Van Esbroeck, Dirk
  • Inberg, Liesbeth
  • Popelier, Lisa
  • Peeters, Bob
  • Verhofstadt, Ellen

Abstract

Due to an increasing importance of evaluations within development cooperation, it has become all the more important to analyse if initial conditions for quality and relevant evaluations are met. This article presents the findings from an evaluability study of 40 interventions of Belgian development cooperation. A study framework was developed focusing on three key dimensions (i.e. theoretical evaluability, practical evaluability and the evaluation context) and subdivided over the different OECD/DAC criteria. Drawing upon a combination of desk and field research, the study framework was subsequently applied on a set of 40 interventions in Benin, DRC, Rwanda and Belgium. Findings highlight that the context dimension scores remarkably better than the theoretical and practical evaluability in particular. The large majority of the interventions have the conditions in place to satisfactorily evaluate effectiveness and efficiency while the opposite holds for sustainability and impact in particular. These findings caution against commissioning of evaluations that ritually focus on all OECD/DAC criteria regardless of their readiness. It underscores the usefulness of a flexible ‘portfolio’ approach towards evaluations, in which a more systematic use of evaluability assessment from the start of interventions could play a role.

Suggested Citation

  • Holvoet, Nathalie & Van Esbroeck, Dirk & Inberg, Liesbeth & Popelier, Lisa & Peeters, Bob & Verhofstadt, Ellen, 2018. "To evaluate or not: Evaluability study of 40 interventions of Belgian development cooperation," Evaluation and Program Planning, Elsevier, vol. 67(C), pages 189-199.
    • Handle: RePEc:eee:epplan:v:67:y:2018:i:c:p:189-199
    DOI: 10.1016/j.evalprogplan.2017.12.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718917301507
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2017.12.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. D’Ostie-Racine, Léna & Dagenais, Christian & Ridde, Valéry, 2013. "An evaluability assessment of a West Africa based Non-Governmental Organization's (NGO) progressive evaluation strategy," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 71-79.
    2. Rob Lloyd & Derek Poate & Espen Villanger, 2014. "Results measurement and evaluability: a comparative analysis," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(4), pages 378-391, December.
    3. Holvoet, Nathalie & Dewachter, Sara, 2013. "Building national M&E systems in the context of changing aid modalities: The underexplored potential of National Evaluation Societies," Evaluation and Program Planning, Elsevier, vol. 41(C), pages 47-57.
    4. Holvoet, N. & Renard, Robrecht, 2007. "Monitoring and evaluation under the PRSP: Solid rock or quicksand?," Evaluation and Program Planning, Elsevier, vol. 30(1), pages 66-81, February.
    5. Lant Pritchett & Salimah Samji & Jeffrey S. Hammer, 2012. "It's All about MeE: Using Structured Experiential Learning ('e') to Crawl the Design Space," WIDER Working Paper Series wp-2012-104, World Institute for Development Economic Research (UNU-WIDER).
    6. repec:idb:brikps:27118 is not listed on IDEAS
    7. Smith, M. F., 1990. "Evaluability assessment: Reflections on the process," Evaluation and Program Planning, Elsevier, vol. 13(4), pages 359-364, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Holvoet, Nathalie & Casten, Wanda & Demissie, Eshetu Woldeyohannes & Dewachter, Sara & Gamboa, Marian Kaye C. & Adhanom, Tewelde Gebremariam & Ibrahim, Abdurahman Hamza & Makundi, Hezron & Manguni, Gr, 2023. "Theory-based evaluation of the impact of Master’s programmes in development studies: Insights from a mixed-methods and multicultural alumni action research project," Evaluation and Program Planning, Elsevier, vol. 97(C).
    2. Valérie Pattyn & Marjolein Bouterse, 2020. "Explaining use and non-use of policy evaluations in a mature evaluation setting," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 7(1), pages 1-9, December.
    3. Valérie Pattyn, 2019. "Towards Appropriate Impact Evaluation Methods," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(2), pages 174-179, April.
    4. Shyam Singh & Nathalie Holvoet & Vivek Pandey, 2018. "Bridging Sustainability and Corporate Social Responsibility: Culture of Monitoring and Evaluation of CSR Initiatives in India," Sustainability, MDPI, vol. 10(7), pages 1-19, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Landiyanto, Erlangga Agustino, 2015. "Transformation of the national monitoring and evaluation arrangement in decentralized Indonesia," MPRA Paper 69073, University Library of Munich, Germany.
    2. repec:osf:osfxxx:nwp8k_v1 is not listed on IDEAS
    3. Cameron, Lisa & Olivia, Susan & Shah, Manisha, 2019. "Scaling up sanitation: Evidence from an RCT in Indonesia," Journal of Development Economics, Elsevier, vol. 138(C), pages 1-16.
    4. Holvoet, Nathalie & Inberg, Liesbeth & Sekirime, Susan, 2013. "Institutional analysis of monitoring and evaluation systems: comparing M&E systems in Ugandas health and education sector," IOB Working Papers 2013.03, Universiteit Antwerpen, Institute of Development Policy (IOB).
    5. Ankel-Peters, Jörg & Schmidt, Christoph M., 2023. "Rural electrification, the credibility revolution, and the limits of evidence-based policy," Ruhr Economic Papers 1051, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    6. Rose, Julian & Neubauer, Florian & Ankel-Peters, Jörg, 2024. "Long-Term Effects of the Targeting the Ultra-Poor Program - A Reproducibility and Replicability Assessment of Banerjee et al. (2021)," I4R Discussion Paper Series 142, The Institute for Replication (I4R).
    7. Cornick, Jorge & Trejos, Alberto, 2016. "Building Public Capabilities for Productive Development Policies: Costa Rican Case Studies," IDB Publications (Working Papers) 8017, Inter-American Development Bank.
    8. Woolcock, Michael, 2013. "Using Case Studies to Explore the External Validity of 'Complex' Development Interventions," Working Paper Series rwp13-048, Harvard University, John F. Kennedy School of Government.
    9. Albert Munyanyi, 2025. "From Shelfware to Action: Unpacking the Utilization of Project Evaluation Reports in Zimbabwe’s Development Sector," International Journal of Research and Scientific Innovation, International Journal of Research and Scientific Innovation (IJRSI), vol. 12(5), pages 1003-1017, May.
    10. Matthijs Janssen, 2016. "What bangs for your bucks? Assessing the design and impact of transformative policy," Innovation Studies Utrecht (ISU) working paper series 16-05, Utrecht University, Department of Innovation Studies, revised Dec 2016.
    11. Sara Nadel and Lant Pritchett, 2016. "Searching for the Devil in the Details: Learning about Development Program Design," Working Papers 434, Center for Global Development.
    12. Nadel, Sara & Pritchett, Lant, 2016. "Searching for the Devil in the Details: Learning about Development Program Design," Working Paper Series rwp16-041, Harvard University, John F. Kennedy School of Government.
    13. Masselus, Lise & Petrik, Christina & Ankel-Peters, Jörg, 2024. "Lost in the design space? Construct validity in the microfinance literature," Ruhr Economic Papers 1097, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    14. Arkedis, Jean & Creighton, Jessica & Dixit, Akshay & Fung, Archon & Kosack, Stephen & Levy, Dan & Tolmie, Courtney, 2019. "Can Transparency and Accountability Programs Improve Health? Experimental Evidence from Indonesia and Tanzania," Working Paper Series rwp19-020, Harvard University, John F. Kennedy School of Government.
    15. Sanou, Aboubakary & Kouyaté, Bocar & Bibeau, Gilles & Nguyen, Vinh-Kim, 2011. "Evaluability Assessment of an immunization improvement strategy in rural Burkina Faso: Intervention theory versus reality, information need and evaluations," Evaluation and Program Planning, Elsevier, vol. 34(3), pages 303-315, August.
    16. Farah Hani & Miguel Angel Santos, 2021. "Diagnosing Human Capital as a Binding Constraint to Growth: Tests, Symptoms and Prescriptions," Growth Lab Working Papers 168, Harvard's Growth Lab.
    17. Holvoet, Nathalie & Casten, Wanda & Demissie, Eshetu Woldeyohannes & Dewachter, Sara & Gamboa, Marian Kaye C. & Adhanom, Tewelde Gebremariam & Ibrahim, Abdurahman Hamza & Makundi, Hezron & Manguni, Gr, 2023. "Theory-based evaluation of the impact of Master’s programmes in development studies: Insights from a mixed-methods and multicultural alumni action research project," Evaluation and Program Planning, Elsevier, vol. 97(C).
    18. Albert Munyanyi, 2025. "From Shelfware to Action: Unpacking the Utilization of Project Evaluation Reports in Zimbabwe’s Development Sector," International Journal of Research and Scientific Innovation, International Journal of Research and Scientific Innovation (IJRSI), vol. 12(5), pages 1276-1290, May.
    19. Hammer, Jeffrey & Spears, Dean, 2013. "Village sanitation and children's human capital : evidence from a randomized experiment by the Maharashtra government," Policy Research Working Paper Series 6580, The World Bank.
    20. Michael Clemens, Gabriel Demombynes, 2013. "The New Transparency in Development Economics: Lessons from the Millennium Villages Controversy," Working Papers 342, Center for Global Development.
    21. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2019. "All that Glitters is not Gold. The Political Economy of Randomized Evaluations in Development," Development and Change, International Institute of Social Studies, vol. 50(3), pages 735-762, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:67:y:2018:i:c:p:189-199. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.