IDEAS home Printed from https://ideas.repec.org/p/idb/brikps/2801.html
   My bibliography  Save this paper

Do We Know What Works?: A Systematic Review of Impact Evaluations of Social Programs in Latin America and the Caribbean

Author

Listed:
  • Bouillon, César P.
  • Tejerina, Luis

Abstract

This working paper analyzes the topics that usually arise from systematic reviews of poverty reduction programs programs and initiates a discussion about them. All evaluations included in the review have a control group and use the rigorous statistical methodologies (randomization or experimental design, propensity score matching, and instrumental variables) to estimate the impact of the interventions. Using this criteria 51 studies from 47 social programs were included. This working paper was distributed in the "Seminar What Next for Social Policy: Building on the Experience of Conditional Cash Transfer Programs", from the 2006 IDB Annual Meeting held in Belo Horizonte, Minas Gerais, Brazil on April 1, 2006.

Suggested Citation

  • Bouillon, César P. & Tejerina, Luis, 2006. "Do We Know What Works?: A Systematic Review of Impact Evaluations of Social Programs in Latin America and the Caribbean," IDB Publications (Working Papers) 2801, Inter-American Development Bank.
    • Handle: RePEc:idb:brikps:2801
    as

    Download full text from publisher

    File URL: https://publications.iadb.org/publications/english/document/Do-We-Know-What-Works-A-Systematic-Review-of-Impact-Evaluations-of-Social-Programs-in-Latin-America-and-the-Caribbean.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sebastian Galiani & Paul Gertler & Ernesto Schargrodsky, 2005. "Water for Life: The Impact of the Privatization of Water Services on Child Mortality," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 83-120, February.
    2. Gustavo Yamada & Patricia Pérez (ed.), 2005. "Evaluación de impacto de proyectos de desarrollo en el Perú," Books, Fondo Editorial, Universidad del Pacífico, edition 1, volume 1, number 05-10, Decembrie.
    3. Joshua Angrist & Eric Bettinger & Michael Kremer, 2004. "Long-Term Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia," NBER Working Papers 10713, National Bureau of Economic Research, Inc.
    4. Jere R. Behrman & Yingmei Cheng & Petra E. Todd, 2004. "Evaluating Preschool Programs When Length of Exposure to the Program Varies: A Nonparametric Approach," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 108-132, February.
    5. Suzanne Duryea & Andrew Morrison, 2004. "The Effect of Conditional Transfers on School Performance and Child Labor: Evidence from an Ex-Post Impact Evaluation in Costa Rica," Research Department Publications 4359, Inter-American Development Bank, Research Department.
    6. World Bank, 2006. "Repositioning Nutrition as Central to Development : A Strategy for Large Scale Action," World Bank Publications - Books, The World Bank Group, number 7409, December.
    7. Jaramillo, Miguel & Parodi, Sandro, 2004. "El seguro escolar gratuito y el seguro materno infantil: análisis de su incidencia e impacto sobre el acceso a los servicios de salud y sobre la equidad en el acceso," Working Papers 37732, Group for the Analysis of Development (GRADE).
    8. Galiani, Sebastian & Schargrodsky, Ernesto, 2004. "Effects of land titling on child health," Economics & Human Biology, Elsevier, vol. 2(3), pages 353-372, December.
    9. Aroca, Patricio A., 2002. "Microcredit Impact Assessment: The Brazilian and Chilean Cases," IDB Publications (Working Papers) 4533, Inter-American Development Bank.
    10. Emanuela Galasso & Martin Ravallion, 2004. "Social Protection in a Crisis: Argentina's Plan Jefes y Jefas," The World Bank Economic Review, World Bank, vol. 18(3), pages 367-399.
    11. Jean O. Lanjouw & Philip I. Levy, 2002. "Untitled: A Study of Formal and Informal Property Rights in Urban Ecuador," Economic Journal, Royal Economic Society, vol. 112(482), pages 986-1019, October.
    12. Galdo, Virgilio & Briceño, Bertha, 2005. "Evaluating the Impact on Child Mortality of a Water Supply and Sewerage Expansion in Quito: Is Water Enough?," IDB Publications (Working Papers) 2833, Inter-American Development Bank.
    13. Valdivia, Martin, 2004. "Poverty, health infrastructure and the nutrition of Peruvian children," Economics & Human Biology, Elsevier, vol. 2(3), pages 489-510, December.
    14. Carlos Medina & Jairo Núñez, 2005. "The Impact of Public and Private Job Training in Colombia," Research Department Publications 3177, Inter-American Development Bank, Research Department.
    15. Antonio Trujillo & Jorge Portillo & John Vernon, 2005. "The Impact of Subsidized Health Insurance for the Poor: Evaluating the Colombian Experience Using Propensity Score Matching," International Journal of Health Economics and Management, Springer, vol. 5(3), pages 211-239, September.
    16. Patricio A. Aroca, 2002. "Microcredit Impact Assessment: The Brazilian and Chilean Cases," IDB Publications (Working Papers) 80432, Inter-American Development Bank.
    17. Skoufias, Emmanuel & McClafferty, Bonnie, 2001. "Is PROGRESA working?," FCND discussion papers 118, International Food Policy Research Institute (IFPRI).
    18. Emanuela Galasso & Martin Ravallion & Agustin Salvia, 2004. "Assisting the Transition from Workfare to Work: A Randomized Experiment," ILR Review, Cornell University, ILR School, vol. 58(1), pages 128-142, October.
    19. Paxson, Christina*Schady, Norbert, 1999. "Do school facilities matter? : the case of the Peruvian Social Fund (FONCODES)," Policy Research Working Paper Series 2229, The World Bank.
    20. Das, Jishnu & Quy-Toan Do & Ozler, Berk, 2004. "Conditional cash transfers and the equity-efficiency debate," Policy Research Working Paper Series 3280, The World Bank.
    21. Shapiro, Joseph & Trevino, Jorge Moreno, 2004. "Compensatory education for disadvantaged Mexican students : an impact evaluation using propensity score matching," Policy Research Working Paper Series 3334, The World Bank.
    22. Deon Filmer, 2007. "If you build it, will they come? School availability and school enrolment in 21 poor countries," Journal of Development Studies, Taylor & Francis Journals, vol. 43(5), pages 901-928.
    23. Valdivia, Martin, 2004. "Poverty, health infrastructure and the nutrition of Peruvian children," Economics & Human Biology, Elsevier, vol. 2(3), pages 489-510, December.
    24. repec:idb:brikps:publication-detail,7101.html?id=23705 is not listed on IDEAS
    25. Menno Pradhan & Laura Rawlings & Geert Ridder, 1997. "Bolivian Social Investment Fund Analysis of Baseline Data for Impact Evaluation," Tinbergen Institute Discussion Papers 97-024/4, Tinbergen Institute.
    26. Jalan, Jyotsna & Ravallion, Martin, 2003. "Estimating the Benefit Incidence of an Antipoverty Program by Propensity-Score Matching," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 19-30, January.
    27. Sebastian Galiani & Ernesto Schargrodsky, 2004. "The Health Effects of Land Titling," Working Papers 78, Universidad de San Andres, Departamento de Economia, revised Dec 2004.
    28. Davis, Benjamin & Handa, Sudhanshu & Ruiz -Arranz, Marta & Stampini, Marco & Winters, Paul, 2002. "Conditionality and the impact of program design on household welfare: comparing two diverse cash transfer programs in rural Mexico," ESA Working Papers 289104, Food and Agriculture Organization of the United Nations, Agricultural Development Economics Division (ESA).
    29. Wodon, Quentin & Minowa, Mari, 2001. "Training for the Urban Unemployed: A Reevaluation of Mexico's Training Program, Probecat," MPRA Paper 12310, University Library of Munich, Germany.
    30. Fabio Soares & Yuri Suarez Dillon Soares, 2005. "The Socio-Economic Impact of Favela- Bairro: What do the Data Say?," OVE Working Papers 0805, Inter-American Development Bank, Office of Evaluation and Oversight (OVE).
    31. -, 2005. "Objetivos de desarrollo del milenio: una mirada desde América Latina y el Caribe," Libros y Documentos Institucionales, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 2797 edited by Cepal.
    32. Betcherman, Gordon & Olivas, Karina & Dar, Amit, 2004. "Impacts of active labor market programs : new evidence from evaluations with particular attention to developing and transition countries," Social Protection Discussion Papers and Notes 29142, The World Bank.
    33. Suzanne Duryea & Andrew Morrison, 2004. "The Effect of Conditional Transfers on School Performance and Child Labor: Evidence from an Ex-Post Impact Evaluation in Costa Rica," Research Department Publications 4359, Inter-American Development Bank, Research Department.
    34. Rao, Vijayendra & Ibanez, Ana Maria, 2003. "The social impact of social funds in Jamaica - a mixed-methods analysis of participation, targeting, and collective action in community-driven development," Policy Research Working Paper Series 2970, The World Bank.
    35. Benjamin Davis & Sudhanshu Handa & Marta Ruiz-Arranz & Marco Stampini & Paul Winters, 2002. "Conditionality and the Impact of Programme Design on Household welfare: Comparing two diverse cash transfer programmes in rural Mexico," Working Papers 02-10, Agricultural and Development Economics Division of the Food and Agriculture Organization of the United Nations (FAO - ESA).
    36. Stefan Dercon (QEH), Tessa Bold, Cesar Calvo, "undated". "Insurance for the Poor?," QEH Working Papers qehwps125, Queen Elizabeth House, University of Oxford.
    37. John Newman & Menno Pradhan & Laura B. Rawlings & Geert Ridder & Ramiro Coa & Jose Luis Evia, 2002. "An Impact Evaluation of Education, Health, and Water Supply Investments by the Bolivian Social Investment Fund," The World Bank Economic Review, World Bank, vol. 16(2), pages 241-274, August.
    38. Cueto, Santiago & Chinen, Marjorie, 2001. "Impacto educativo de un programa de desayunos escolares en escuelas rurales del Perú," Working Papers 37766, Group for the Analysis of Development (GRADE).
    39. Rawlings, Laura B.*Rubio, Gloria M., 2003. "Evaluating the impact of conditional cash transfer programs : lessons from Latin America," Policy Research Working Paper Series 3119, The World Bank.
    40. Laura B. Rawlings & Lynne Sherburne-Benz & Julie van Domelen, 2004. "Evaluating Social Funds : A Cross-Country Analysis of Community Investments," World Bank Publications - Books, The World Bank Group, number 15057, December.
    41. World Bank, 2000. "Nicaragua : Ex-Post Impact Evaluation of the Emergency Social Investment Fund," World Bank Publications - Reports 14956, The World Bank Group.
    42. Calderón-Madrid, Angel & Trejo, Belem, 2002. "The Impact of the Mexican Training Program for Unemployed Workers on Re-employment Dynamics and on Earnings," 10th International Conference on Panel Data, Berlin, July 5-6, 2002 A2-1, International Conferences on Panel Data.
    43. Cristian Aedo, "undated". "The Impact of Training Policies in Latin America and the Caribbean: The Case of "Programa Joven"," ILADES-UAH Working Papers inv131, Universidad Alberto Hurtado/School of Economics and Business.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Heinrich, Carolyn J. & Lopez, Yeri, 2009. "Does Community Participation Produce Dividends in Social Investment Fund Projects?," World Development, Elsevier, vol. 37(9), pages 1554-1568, September.
    2. Maren Duvendack & Philip Mader, 2020. "Impact Of Financial Inclusion In Low‐ And Middle‐Income Countries: A Systematic Review Of Reviews," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 594-629, July.
    3. Rafael Novella & Laura Ripani & Claudia Vazquez, 2021. "Conditional cash transfers, female bargaining power and parental labour supply," Journal of International Development, John Wiley & Sons, Ltd., vol. 33(2), pages 422-436, March.
    4. Verónica Amarante & Martín Brun, 2018. "Cash Transfers in Latin America: Effects on Poverty and Redistribution," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Fall 2018), pages 1-31, November.
    5. Jose Cuesta & Fidel Jaramillo, 2009. "Taxonomy of Causes, Impacts and Policy Responses to the Food Price Crisis in the Andean Region," Research Department Publications 4623, Inter-American Development Bank, Research Department.
    6. María Alzúa & Guillermo Cruces & Laura Ripani, 2013. "Welfare programs and labor supply in developing countries: experimental evidence from Latin America," Journal of Population Economics, Springer;European Society for Population Economics, vol. 26(4), pages 1255-1284, October.
    7. Giovanni Andrea Cornia, 2010. "Income Distribution under Latin America's New Left Regimes," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 11(1), pages 85-114.
    8. Verónica Amarante & Martín Brun, 2018. "Cash Transfers in Latin America: Effects on Poverty and Redistribution," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Fall 2018), pages 1-31, November.
    9. Patrick J. McEwan, 2012. "Cost-effectiveness analysis of education and health interventions in developing countries," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 4(2), pages 189-213, June.
    10. Pessino, Carola & Izquierdo, Alejandro & Vuletin, Guillermo, 2018. "Better Spending for Better Lives: How Latin America and the Caribbean Can Do More with Less," IDB Publications (Books), Inter-American Development Bank, number 9152, March.
    11. Martin Leites & Gustavo Pereira & Andres Rius & Gonzalo Salas & Andrea Vigorito, 2017. "PROTOCOL: The effect of cash transfers on social solidarity: A systematic review," Campbell Systematic Reviews, John Wiley & Sons, vol. 13(1), pages 1-49.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. César P. Bouillon & Luis Tejerina, 2006. "Do We Know What Works?: A Systematic Review of Impact Evaluations of Social Programs in Latin America and the Caribbean," IDB Publications (Working Papers) 80443, Inter-American Development Bank.
    2. Inter-American Development Bank (IDB), 2005. "The Millennium Development Goals in Latin America and the Caribbean: Progress, Priorities and IDB Support for their Implementation," IDB Publications (Books), Inter-American Development Bank, number 53698, February.
    3. repec:idb:brikps:340 is not listed on IDEAS
    4. Todd, Petra E., 2012. "Effectiveness of interventions aimed at improving women's employability and quality of work : a critical review," Policy Research Working Paper Series 6189, The World Bank.
    5. Verónica Escudero & Jochen Kluve & Elva López Mourelo & Clemente Pignatti, 2019. "Active Labour Market Programmes in Latin America and the Caribbean: Evidence from a Meta-Analysis," Journal of Development Studies, Taylor & Francis Journals, vol. 55(12), pages 2644-2661, December.
    6. Betcherman, Gordon & Olivas, Karina & Dar, Amit, 2004. "Impacts of active labor market programs : new evidence from evaluations with particular attention to developing and transition countries," Social Protection Discussion Papers and Notes 29142, The World Bank.
    7. Margaret Grosh & Carlo del Ninno & Emil Tesliuc & Azedine Ouerghi, 2008. "For Protection and Promotion : The Design and Implementation of Effective Safety Nets," World Bank Publications - Books, The World Bank Group, number 6582, December.
    8. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    9. Kluve, Jochen., 2016. "A review of the effectiveness of active labour market programmes with a focus on Latin America and the Caribbean," ILO Working Papers 994901193402676, International Labour Organization.
    10. David Coady, 2015. "Designing and Evaluating Social Safety Nets: Theory, Evidence, and Policy Conclusions," Working Papers id:7496, eSocialSciences.
    11. Leonardo Gasparini & Francisco Haimovich & Sergio Olivieri, 2007. "Labor Informality Effects of a Poverty-Alleviation Program," CEDLAS, Working Papers 0053, CEDLAS, Universidad Nacional de La Plata.
    12. Almeida, Rita K. & Galasso, Emanuela, 2010. "Jump-starting Self-employment? Evidence for Welfare Participants in Argentina," World Development, Elsevier, vol. 38(5), pages 742-755, May.
    13. Marco Sanfilippo & Bruno Martorano & Chris De Neubourg, 2012. "The Impact of Social Protection on Children: A review of the literature," Papers inwopa666, Innocenti Working Papers.
    14. Justine Burns & Malcolm Kewsell & Rebecca Thornton, 2009. "Evaluating the Impact of Health Programmes," SALDRU Working Papers 40, Southern Africa Labour and Development Research Unit, University of Cape Town.
    15. Ghazala Mansuri, 2004. "Community-Based and -Driven Development: A Critical Review," The World Bank Research Observer, World Bank, vol. 19(1), pages 1-39.
    16. Almeida, Rita K. & Galasso, Emanuela, 2007. "Jump-Starting Self-Employment? Evidence among Welfare Participants in Argentina," IZA Discussion Papers 2902, Institute of Labor Economics (IZA).
    17. Hessel Oosterbeek & Juan Ponce & Norbert Schady, 2008. "The Impact of Cash Transfers on School Enrollment: Evidence from Ecuador," Tinbergen Institute Discussion Papers 08-037/3, Tinbergen Institute.
    18. Lilik Sugiharti, 2017. "Education Performance and the Determinants of Secondary School Enrolment in Indonesia," GATR Journals gjbssr477, Global Academy of Training and Research (GATR) Enterprise.
    19. Monkkonen, Paavo, 2016. "Where do Property Rights Matter More? Explaining the Variation in Demand for Property Titles across Cities in Mexico," World Development, Elsevier, vol. 88(C), pages 67-78.
    20. Behrman, Jere R. & Skoufias, Emmanuel, 2004. "Correlates and determinants of child anthropometrics in Latin America: background and overview of the symposium," Economics & Human Biology, Elsevier, vol. 2(3), pages 335-351, December.
    21. Deininger, Klaus & Ali, Daniel Ayalew & Alemu, Tekie, 2008. "Impacts of land certification on tenure security, investment, and land markets : evidence from Ethiopia," Policy Research Working Paper Series 4764, The World Bank.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:idb:brikps:2801. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Felipe Herrera Library (email available below). General contact details of provider: https://edirc.repec.org/data/iadbbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.