IDEAS home Printed from https://ideas.repec.org/p/unu/wpaper/wp-2020-20.html
   My bibliography  Save this paper

The impact of impact evaluation: Are impact evaluation and impact evaluation synthesis contributing to evidence generation and use in low- and middle-income countries?

Author

Listed:
  • Richard Manning
  • Ian Goldman
  • Gonzalo Hernández Licona

Abstract

In 2006 the Center for Global Development's report 'When Will We Ever Learn? Improving lives through impact evaluation' bemoaned the lack of rigorous impact evaluations. The authors of the present paper researched international organizations and countries including Mexico, Colombia, South Africa, Uganda, and Philippines to understand how impact evaluations and systematic reviews are being implemented and used, drawing out the emerging lessons.

Suggested Citation

  • Richard Manning & Ian Goldman & Gonzalo Hernández Licona, 2020. "The impact of impact evaluation: Are impact evaluation and impact evaluation synthesis contributing to evidence generation and use in low- and middle-income countries?," WIDER Working Paper Series wp-2020-20, World Institute for Development Economic Research (UNU-WIDER).
    • Handle: RePEc:unu:wpaper:wp-2020-20
    as

    Download full text from publisher

    File URL: https://www.wider.unu.edu/sites/default/files/Publications/Working-paper/PDF/wp2020-20.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jonas Hjort & Diana Moreira & Gautam Rao & Juan Francisco Santini, 2021. "How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities," American Economic Review, American Economic Association, vol. 111(5), pages 1442-1480, May.
    2. Ruth Stewart & Harsha Dayal & Laurenz Langer & Carina van Rooyen, 2019. "The evidence ecosystem in South Africa: growing resilience and institutionalisation of evidence use," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-12, December.
    3. Howard White, 2019. "The twenty-first century experimenting society: the four waves of the evidence revolution," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-7, December.
    4. Fox, Jonathan A., 2015. "Social Accountability: What Does the Evidence Really Say?," World Development, Elsevier, vol. 72(C), pages 346-361.
    5. Shayda Mae Sabet & Annette N. Brown, 2018. "Is impact evaluation still on the rise? The new trends in 2010–2015," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 10(3), pages 291-304, July.
    6. Julia Raifman & Felix Lam & Janeen Madan Keller & Alexander Radunsky & William Savedoff, 2018. "How well are aid agencies evaluating programs? An assessment of the quality of global health evaluations," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 10(2), pages 277-289, April.
    7. Legovini, Arianna & Di Maro, Vincenzo & Piza, Caio, 2015. "Impact evaluation helps deliver development projects," Policy Research Working Paper Series 7157, The World Bank.
    8. Drew B. Cameron & Anjini Mishra & Annette N. Brown, 2016. "The growth of impact evaluation for international development: how much have we learned?," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(1), pages 1-21, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Obie Porteous, 2022. "Research Deserts and Oases: Evidence from 27 Thousand Economics Journal Articles on Africa," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1235-1258, December.
    2. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Documents de travail du Centre d'Economie de la Sorbonne 22008, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    3. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Post-Print halshs-03623394, HAL.
    4. Vivalt, Eva & Coville, Aidan, 2023. "How do policymakers update their beliefs?," Journal of Development Economics, Elsevier, vol. 165(C).
    5. O’Leary, Susan & Smith, David, 2020. "Moments of resistance: An internally persuasive view of performance and impact reports in non-governmental organizations," Accounting, Organizations and Society, Elsevier, vol. 85(C).
    6. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-03623394, HAL.
    7. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    8. Dean Neu & Gregory D. Saxton & Abu S. Rahaman, 2022. "Social Accountability, Ethics, and the Occupy Wall Street Protests," Journal of Business Ethics, Springer, vol. 180(1), pages 17-31, September.
    9. Christopher J. Ruhm, 2019. "Shackling the Identification Police?," Southern Economic Journal, John Wiley & Sons, vol. 85(4), pages 1016-1026, April.
    10. Julia Fischer-Mackey, 2024. "What Do Practitioners Want from Research? Exploring Ugandan and American Development Practitioners’ Interest in Research," Progress in Development Studies, , vol. 24(1), pages 27-47, January.
    11. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    12. Ogbe, Michael & Lujala, Päivi, 2021. "Spatial crowdsourcing in natural resource revenue management," Resources Policy, Elsevier, vol. 72(C).
    13. Fischer, Harry W. & Ali, Syed Shoaib, 2019. "Reshaping the public domain: Decentralization, the Mahatma Gandhi National Rural Employment Guarantee Act (MGNREGA), and trajectories of local democracy in rural India," World Development, Elsevier, vol. 120(C), pages 147-158.
    14. Ludger Niemann & Thomas Hoppe, 2021. "How to Sustain Sustainability Monitoring in Cities: Lessons from 49 Community Indicator Initiatives across 10 Latin American Countries," Sustainability, MDPI, vol. 13(9), pages 1-16, May.
    15. Gaduh,Arya Budhiastra & Pradhan,Menno Prasad & Priebe,Jan & Susanti,Dewi, 2021. "Scores, Camera, Action : Social Accountability and Teacher Incentives in Remote Areas," Policy Research Working Paper Series 9748, The World Bank.
    16. David William Walker, 2016. "How Systemic Inquiry Releases Citizen Knowledge to Reform Schools: Community Scorecard Case Studies," Systemic Practice and Action Research, Springer, vol. 29(4), pages 313-334, August.
    17. Chowdhury Mohammad Sakib Anwar & Alexander Matros & Sonali SenGupta, 2022. "Public Good Provision with a Distributor," Papers 2210.10642, arXiv.org.
    18. Larry L. Orr, 2018. "The Role of Evaluation in Building Evidence-Based Policy," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 51-59, July.
    19. Salazar, Lina & Aramburu, Julián & González-Flores, Mario & Winters, Paul, 2016. "Sowing for food security: A case study of smallholder farmers in Bolivia," Food Policy, Elsevier, vol. 65(C), pages 32-52.
    20. Francis Rathinam & Sayak Khatua & Zeba Siddiqui & Manya Malik & Pallavi Duggal & Samantha Watson & Xavier Vollenweider, 2021. "Using big data for evaluating development outcomes: A systematic map," Campbell Systematic Reviews, John Wiley & Sons, vol. 17(3), September.

    More about this item

    Keywords

    Evaluation; Evidence use; Impact evaluation; Research synthesis; Systematic review;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:unu:wpaper:wp-2020-20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Siméon Rapin (email available below). General contact details of provider: https://edirc.repec.org/data/widerfi.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.