IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this book chapter or follow this series

Evaluating Anti-Poverty Programs

  • Ravallion, Martin

The chapter critically reviews the methods available for the ex post counterfactual analysis of programs that are assigned exclusively to individuals, households or locations. The emphasis is on the problems encountered in applying these methods to anti-poverty programs in developing countries, drawing on examples from actual evaluations. Two main lessons emerge. Firstly, despite the claims of advocates, no single method dominates; rigorous, policy-relevant evaluations should be open-minded about methodology, adapting to the problem, setting and data constraints. Secondly, future efforts to draw useful lessons from evaluations call for more policy-relevant data and methods than used in the classic assessment of mean impact for those assigned to the program.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.sciencedirect.com/science/article/B7P5D-4RWXCH1-P/1/2c7e700530cdc01e6774950b0913e658
Download Restriction: Full text for ScienceDirect subscribers only

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

as
in new window

This chapter was published in:
  • T. Paul Schultz & John A. Strauss (ed.), 2008. "Handbook of Development Economics," Handbook of Development Economics, Elsevier, edition 1, volume 4, number 5.
  • This item is provided by Elsevier in its series Handbook of Development Economics with number 5-59.
    Handle: RePEc:eee:devchp:5-59
    Contact details of provider: Web page: http://www.elsevier.com/wps/find/bookseriesdescription.cws_home/BS_HE/description

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as in new window
    1. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
    2. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 958-996, October.
    3. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    4. Joshua Angrist & Eric Bettinger & Erik Bloom & Elizabeth King & Michael Kremer, 2001. "Vouchers for Private Schooling in Colombia: Evidence from a Randomized Natural Experiment," NBER Working Papers 8343, National Bureau of Economic Research, Inc.
    5. Sebastian Galiani & Paul Gertler & Ernesto Schargrodsky, 2002. "Water for Life: The Impact of the Privatization of Water Services on Child Mortality," Working Papers 54, Universidad de San Andres, Departamento de Economia, revised Sep 2005.
    6. Deaton, A.S., 1993. "Data and Econometric Tools for Development Analysis," Papers 172, Princeton, Woodrow Wilson School - Development Studies.
    7. Robert Moffitt, 2002. "The role of randomized field trials in social science research: a perspective from evaluations of reforms of social welfare programs," CeMMAP working papers CWP23/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Roberto Agodini & Mark Dynarski, 2004. "Are Experiments the Only Option? A Look at Dropout Prevention Programs," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 180-194, February.
    9. Dubin, Jeffrey A. & Rivers, Douglas, 1993. "Experimental estimates of the impact of wage subsidies," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 219-242, March.
    10. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-09, January.
    11. Dehejia, Rajeev, 2005. "Practical propensity score matching: a reply to Smith and Todd," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 355-364.
    12. Atkinson, A B, 1987. "On the Measurement of Poverty," Econometrica, Econometric Society, vol. 55(4), pages 749-64, July.
    13. Joshua Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," NBER Working Papers 8456, National Bureau of Economic Research, Inc.
    14. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
    15. Glewwe, Paul & Kremer, Michael & Moulin, Sylvie & Zitzewitz, Eric, 2004. "Retrospective vs. prospective analyses of school inputs: the case of flip charts in Kenya," Journal of Development Economics, Elsevier, vol. 74(1), pages 251-268, June.
    16. Hoddinott, John & Skoufias, Emmanual, 2003. "The impact of Progresa on food consumption," FCND discussion papers 150, International Food Policy Research Institute (IFPRI).
    17. Petra E. Todd & Jeffrey A. Smith, 2001. "Reconciling Conflicting Evidence on the Performance of Propensity-Score Matching Methods," American Economic Review, American Economic Association, vol. 91(2), pages 112-118, May.
    18. Stephen A. Woodbury, 2009. "Unemployment," Book chapters authored by Upjohn Institute researchers, in: Kenneth G. Dau-Schmidt & Seth D. Harris & Orley Lobel (ed.), Labor and Employment Law and Economics, volume 2, pages 480-516 W.E. Upjohn Institute for Employment Research.
    19. Jalan, Jyotsna & Ravallion, Martin, 2001. "Does piped water reduce diarrhea for children in rural India ?," Policy Research Working Paper Series 2664, The World Bank.
    20. Behrman, Jere R & Sengupta, Piyali & Todd, Petra, 2005. "Progressing through PROGRESA: An Impact Assessment of a School Subsidy Experiment in Rural Mexico," Economic Development and Cultural Change, University of Chicago Press, vol. 54(1), pages 237-75, October.
    21. Jalan, Jyotsna & Ravallion, Martin, 1998. "Are there dynamic gains from a poor-area development program?," Journal of Public Economics, Elsevier, vol. 67(1), pages 65-85, January.
    22. Galasso, Emanuela & Ravallion, Martin, 2003. "Social protection in a crisis - Argentina's Plan Jefes y Jefas," Policy Research Working Paper Series 3165, The World Bank.
    23. Martin Ravallion & Emanuela Galasso & Teodoro Lazo & Ernesto Philipp, 2005. "What Can Ex-Participants Reveal about a Program’s Impact?," Journal of Human Resources, University of Wisconsin Press, vol. 40(1).
    24. Jeffrey Smith & Petra Todd, 2003. "Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators?," University of Western Ontario, CIBC Centre for Human Capital and Productivity Working Papers 20035, University of Western Ontario, CIBC Centre for Human Capital and Productivity.
    25. van de Walle, Dominique, 2002. "Choosing Rural Road Investments to Help Reduce Poverty," World Development, Elsevier, vol. 30(4), pages 575-589, April.
    26. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-in-Differences Estimates?," The Quarterly Journal of Economics, MIT Press, vol. 119(1), pages 249-275, February.
    27. van de Walle, Dominique, 2003. "Testing Vietnam's public safety net," Social Protection Discussion Papers 27874, The World Bank.
    28. Emanuela Galasso & Martin Ravallion & Agustin Salvia, 2004. "Assisting the transition from workfare to work: A randomized experiment," Industrial and Labor Relations Review, ILR Review, Cornell University, ILR School, vol. 58(1), pages 128-142, October.
    29. Heckman, James J & Smith, Jeffrey, 1997. "Making the Most Out of Programme Evaluations and Social Experiments: Accounting for Heterogeneity in Programme Impacts," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 487-535, October.
    30. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2002. "Removing the Veil of Ignorance in Assessing the Distributional Impacts of Social Policies," NBER Working Papers 8840, National Bureau of Economic Research, Inc.
    31. Sadoulet, Elisabeth & Janvry, Alain de & Davis, Benjamin, 2001. "Cash Transfer Programs with Income Multipliers: PROCAMPO in Mexico," World Development, Elsevier, vol. 29(6), pages 1043-1056, June.
    32. Rosenzweig, Mark R & Wolpin, Kenneth I, 1986. "Evaluating the Effects of Optimally Distributed Public Programs: ChildHealth and Family Planning Interventions," American Economic Review, American Economic Association, vol. 76(3), pages 470-82, June.
    33. Esther Duflo, 2000. "Schooling and Labor Market Consequences of School Construction in Indonesia: Evidence from an Unusual Policy Experiment," NBER Working Papers 7860, National Bureau of Economic Research, Inc.
    34. Jacoby, Hanan, 1997. "Is there an intrahousehold 'flypaper effect'?," FCND discussion papers 31, International Food Policy Research Institute (IFPRI).
    35. White, Howard, 2009. "Theory-Based Impact Evaluation," 3ie Publications 2009-3, International Initiative for Impact Evaluation (3ie).
    36. Anne Case & Angus Deaton, 1996. "Large Cash Transfers to the Elderly in South Africa," NBER Working Papers 5572, National Bureau of Economic Research, Inc.
    37. Basu, Kaushik & Narayan, Ambar & Ravallion, Martin, 1999. "Is knowledge shared within households?," Policy Research Working Paper Series 2261, The World Bank.
    38. Erich Battistin & Enrico Rettore, 2002. "Testing for programme effects in a regression discontinuity design with imperfect compliance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(1), pages 39-57.
    39. Gary Burtless, 1995. "The Case for Randomized Field Trials in Economic and Policy Research," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 63-84, Spring.
    40. Brian A. Jacob & Lars Lefgren, 2002. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," NBER Working Papers 8918, National Bureau of Economic Research, Inc.
    41. Anne Morrison Piehl & Suzanne J. Cooper & Anthony A. Braga & David M. Kennedy, 1999. "Testing for Structural Breaks in the Evaluation of Programs," NBER Working Papers 7226, National Bureau of Economic Research, Inc.
    42. Ravallion, Martin, 2000. "Monitoring Targeting Performance When Decentralized Allocations to the Poor Are Unobserved," World Bank Economic Review, World Bank Group, vol. 14(2), pages 331-45, May.
    43. Martin Ravallion & Gaurav Datt, 1995. "Is Targeting Through a Work Requirement Efficient? Some Evidence for Rural India," Monash Economics Working Papers archive-41, Monash University, Department of Economics.
    44. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule To Estimate The Effect Of Class Size On Scholastic Achievement," The Quarterly Journal of Economics, MIT Press, vol. 114(2), pages 533-575, May.
    45. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    46. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    47. Esther Duflo, 2003. "Grandmothers and Granddaughters: Old-Age Pensions and Intrahousehold Allocation in South Africa," World Bank Economic Review, World Bank Group, vol. 17(1), pages 1-25, June.
    48. Paul Gertler, 2004. "Do Conditional Cash Transfers Improve Child Health? Evidence from PROGRESA's Control Randomized Experiment," American Economic Review, American Economic Association, vol. 94(2), pages 336-341, May.
    49. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc.
    50. Joshua Angrist & Jinyong Hahn, 2004. "When to Control for Covariates? Panel Asymptotics for Estimates of Treatment Effects," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 58-72, February.
    51. Markus Frölich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
    52. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    53. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    54. John Newman & Menno Pradhan & Laura B. Rawlings & Geert Ridder & Ramiro Coa & Jose Luis Evia, 2002. "An Impact Evaluation of Education, Health, and Water Supply Investments by the Bolivian Social Investment Fund," World Bank Economic Review, World Bank Group, vol. 16(2), pages 241-274, August.
    55. Raghav Gaiha & Katsushi Imai, 2002. "Rural Public Works and Poverty Alleviation--the case of the employment guarantee scheme in Maharashtra," International Review of Applied Economics, Taylor & Francis Journals, vol. 16(2), pages 131-151.
    56. Foster, James & Greer, Joel & Thorbecke, Erik, 1984. "A Class of Decomposable Poverty Measures," Econometrica, Econometric Society, vol. 52(3), pages 761-66, May.
    57. Rao, Vijayendra & Ibanez, Ana Maria, 2003. "The social impact of social funds in Jamaica - a mixed-methods analysis of participation, targeting, and collective action in community-driven development," Policy Research Working Paper Series 2970, The World Bank.
    58. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    59. Christina Paxson & Norbert R. Schady, 2002. "The Allocation and Impact of Social Funds: Spending on School Infrastructure in Peru," World Bank Economic Review, World Bank Group, vol. 16(2), pages 297-319, August.
    60. Michael Lokshin & Martin Ravallion, 2000. "Welfare Impacts of the 1998 Financial Crisis in Russia and the Response of the Public Safety Net," The Economics of Transition, The European Bank for Reconstruction and Development, vol. 8(2), pages 269-295, July.
    61. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097 Elsevier.
    62. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
    63. Gary Burtless, 1985. "Are targeted wage subsidies harmful? Evidence from a wage voucher experiment," Industrial and Labor Relations Review, ILR Review, Cornell University, ILR School, vol. 39(1), pages 105-114, October.
    64. Ravallion, Martin & Chen, Shaohua, 2005. "Hidden impact? Household saving in response to a poor-area development project," Journal of Public Economics, Elsevier, vol. 89(11-12), pages 2183-2204, December.
    65. Smith, Jeffrey & Todd, Petra, 2005. "Rejoinder," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 365-375.
    66. Juan Jose Diaz & Sudhanshu Handa, 2006. "An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator: Evidence from Mexico’s PROGRESA Program," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    67. Robert S. Chase, 2002. "Supporting Communities in Transition: The Impact of the Armenian Social Investment Fund," World Bank Economic Review, World Bank Group, vol. 16(2), pages 219-240, August.
    68. Heckman, James J & Ichimura, Hidehiko & Todd, Petra E, 1997. "Matching as an Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 605-54, October.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:eee:devchp:5-59. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.