Advanced Search
MyIDEAS: Login to save this paper or follow this series

Evaluating anti-poverty programs

Contents:

Author Info

  • Ravallion, Martin

Abstract

The author critically reviews the methods available for the ex-post counterfactual analysis of programs that are assigned exclusively to individuals, households, or locations. The discussion covers both experimental and non-experimental methods (including propensity-score matching, discontinuity designs, double and triple differences, and instrumental variables). Two main lessons emerge. First, despite the claims of advocates, no single method dominates; rigorous, policy-relevant evaluations should be open-minded about methodology. Second, future efforts to draw more useful lessons from evaluations will call for more policy-relevant measures and deeper explanations of measured impacts than are possible from the classic ("black box") assessment of mean impact.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www-wds.worldbank.org/servlet/WDSContentServer/WDSP/IB/2008/01/24/000158349_20080124085813/Rendered/PDF/wps3625.pdf
Download Restriction: no

Bibliographic Info

Paper provided by The World Bank in its series Policy Research Working Paper Series with number 3625.

as in new window
Length:
Date of creation: 01 Jun 2005
Date of revision:
Handle: RePEc:wbk:wbrwps:3625

Contact details of provider:
Postal: 1818 H Street, N.W., Washington, DC 20433
Phone: (202) 477-1234
Email:
Web page: http://www.worldbank.org/
More information through EDIRC

Related research

Keywords: Poverty Monitoring&Analysis; Rural Poverty Reduction; Scientific Research&Science Parks; Science Education; Poverty Impact Evaluation;

Other versions of this item:

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. White, Howard, 2009. "Theory-Based Impact Evaluation," 3ie Publications, International Initiative for Impact Evaluation (3ie) 2009-3, International Initiative for Impact Evaluation (3ie).
  2. Gary Burtless, 1985. "Are targeted wage subsidies harmful? Evidence from a wage voucher experiment," Industrial and Labor Relations Review, ILR Review, Cornell University, ILR School, vol. 39(1), pages 105-114, October.
  3. Sebastian Galiani & Paul Gertler & Ernesto Schargrodsky, 2002. "Water for Life: The Impact of the Privatization of Water Services on Child Mortality," Working Papers, Universidad de San Andres, Departamento de Economia 54, Universidad de San Andres, Departamento de Economia, revised Sep 2005.
  4. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-in-Differences Estimates?," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 119(1), pages 249-275, February.
  5. Joshua Angrist & Eric Bettinger & Erik Bloom & Elizabeth King & Michael Kremer, 2002. "Vouchers for private schooling in colombia: Evidence from a randomized natural experiment," Natural Field Experiments, The Field Experiments Website 00203, The Field Experiments Website.
  6. Paul Gertler, 2004. "Do Conditional Cash Transfers Improve Child Health? Evidence from PROGRESA's Control Randomized Experiment," American Economic Review, American Economic Association, American Economic Association, vol. 94(2), pages 336-341, May.
  7. Martin Ravallion & Gaurav Datt, 1995. "Is Targeting Through a Work Requirement Efficient? Some Evidence for Rural India," Development Research Unit Working Paper Series, Monash University, Department of Economics archive-41, Monash University, Department of Economics.
  8. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, American Economic Association, vol. 9(2), pages 85-110, Spring.
  9. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
  10. van de Walle, Dominique, 2002. "Choosing Rural Road Investments to Help Reduce Poverty," World Development, Elsevier, Elsevier, vol. 30(4), pages 575-589, April.
  11. Stephen A. Woodbury, 2009. "Unemployment," Book chapters authored by Upjohn Institute researchers, W.E. Upjohn Institute for Employment Research, in: Kenneth G. Dau-Schmidt & Seth D. Harris & Orley Lobel (ed.), Labor and Employment Law and Economics, volume 2, pages 480-516 W.E. Upjohn Institute for Employment Research.
  12. Carneiro, Pedro & Hansen, Karsten T & Heckman, James J, 2002. "Removing the veil of ignorance in assessing the distributional impacts of social policies," Working Paper Series, IFAU - Institute for Evaluation of Labour Market and Education Policy 2002:2, IFAU - Institute for Evaluation of Labour Market and Education Policy.
  13. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, Econometric Society, vol. 62(2), pages 467-75, March.
  14. van de Walle, Dominique, 2003. "Testing Vietnam's public safety net," Social Protection Discussion Papers 27874, The World Bank.
  15. Anne Morrison Piehl & Suzanne J. Cooper & Anthony A. Braga & David M. Kennedy, 2003. "Testing for Structural Breaks in the Evaluation of Programs," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 550-558, August.
  16. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
  17. John Newman & Menno Pradhan & Laura B. Rawlings & Geert Ridder & Ramiro Coa & Jose Luis Evia, 2002. "An Impact Evaluation of Education, Health, and Water Supply Investments by the Bolivian Social Investment Fund," World Bank Economic Review, World Bank Group, World Bank Group, vol. 16(2), pages 241-274, August.
  18. Galasso, Emanuela & Ravallion, Martin & Salvia, Agustin, 2001. "Assisting the transition from workfare to work : a randomized experiment," Policy Research Working Paper Series 2738, The World Bank.
  19. Esther Duflo, 2000. "Schooling and Labor Market Consequences of School Construction in Indonesia: Evidence from an Unusual Policy Experiment," NBER Working Papers 7860, National Bureau of Economic Research, Inc.
  20. Joshua D. Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Journal of Economic Perspectives, American Economic Association, American Economic Association, vol. 15(4), pages 69-85, Fall.
  21. Dubin, Jeffrey A. & Rivers, Douglas, 1993. "Experimental estimates of the impact of wage subsidies," Journal of Econometrics, Elsevier, Elsevier, vol. 56(1-2), pages 219-242, March.
  22. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule To Estimate The Effect Of Class Size On Scholastic Achievement," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 114(2), pages 533-575, May.
  23. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, Elsevier, vol. 125(1-2), pages 305-353.
  24. Esther Duflo, 2000. "Grandmothers and Granddaughters: Old Age Pension and Intra-household Allocation in South Africa," NBER Working Papers 8061, National Bureau of Economic Research, Inc.
  25. Paul Glewwe & Michael Kremer & Sylvie Moulin & Eric Zitzewitz, 2004. "Retrospective vs. prospective analyses of school inputs: The case of flip charts in kenya," Natural Field Experiments, The Field Experiments Website 00256, The Field Experiments Website.
  26. Heckman, James J & Smith, Jeffrey, 1997. "Making the Most Out of Programme Evaluations and Social Experiments: Accounting for Heterogeneity in Programme Impacts," Review of Economic Studies, Wiley Blackwell, Wiley Blackwell, vol. 64(4), pages 487-535, October.
  27. Roberto Agodini & Mark Dynarski, 2004. "Are Experiments the Only Option? A Look at Dropout Prevention Programs," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 180-194, February.
  28. Dehejia, Rajeev, 2005. "Practical propensity score matching: a reply to Smith and Todd," Journal of Econometrics, Elsevier, Elsevier, vol. 125(1-2), pages 355-364.
  29. Christina Paxson & Norbert R. Schady, 2002. "The Allocation and Impact of Social Funds: Spending on School Infrastructure in Peru," World Bank Economic Review, World Bank Group, World Bank Group, vol. 16(2), pages 297-319, August.
  30. Basu, Kaushik & Narayan, Ambar & Ravallion, Martin, 1999. "Is knowledge shared within households?," Policy Research Working Paper Series 2261, The World Bank.
  31. Jacoby, Hanan, 1997. "Is there an intrahousehold 'flypaper effect'?," FCND discussion papers, International Food Policy Research Institute (IFPRI) 31, International Food Policy Research Institute (IFPRI).
  32. Jalan, Jyotsna & Ravallion, Martin, 2003. "Does piped water reduce diarrhea for children in rural India?," Journal of Econometrics, Elsevier, Elsevier, vol. 112(1), pages 153-173, January.
  33. Rao, Vijayendra & Ibanez, Ana Maria, 2003. "The social impact of social funds in Jamaica - a mixed-methods analysis of participation, targeting, and collective action in community-driven development," Policy Research Working Paper Series 2970, The World Bank.
  34. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 106(5), pages 958-996, October.
  35. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, American Economic Association, vol. 76(4), pages 604-20, September.
  36. Juan Jose Diaz & Sudhanshu Handa, 2006. "An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator: Evidence from Mexico’s PROGRESA Program," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
  37. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, Elsevier, vol. 74(1), pages 199-250, June.
  38. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, Econometric Society, vol. 66(5), pages 1017-1098, September.
  39. Ravallion, Martin & Chen, Shaohua, 2005. "Hidden impact? Household saving in response to a poor-area development project," Journal of Public Economics, Elsevier, Elsevier, vol. 89(11-12), pages 2183-2204, December.
  40. Martin Ravallion & Emanuela Galasso & Teodoro Lazo & Ernesto Philipp, 2005. "What Can Ex-Participants Reveal about a Program’s Impact?," Journal of Human Resources, University of Wisconsin Press, vol. 40(1).
  41. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, Elsevier, vol. 30(1-2), pages 239-267.
  42. Anne Case & Angus Deaton, 1996. "Large Cash Transfers to the Elderly in South Africa," NBER Working Papers 5572, National Bureau of Economic Research, Inc.
  43. Galasso, Emanuela & Ravallion, Martin, 2003. "Social protection in a crisis - Argentina's Plan Jefes y Jefas," Policy Research Working Paper Series 3165, The World Bank.
  44. Brian A. Jacob & Lars Lefgren, 2002. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," NBER Working Papers 8918, National Bureau of Economic Research, Inc.
  45. Hoddinott, John & Skoufias, Emmanual, 2003. "The impact of Progresa on food consumption," FCND briefs, International Food Policy Research Institute (IFPRI) 150, International Food Policy Research Institute (IFPRI).
  46. Robert Moffitt, 2002. "The role of randomized field trials in social science research: a perspective from evaluations of reforms of social welfare programs," CeMMAP working papers, Centre for Microdata Methods and Practice, Institute for Fiscal Studies CWP23/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  47. Erich Battistin & Enrico Rettore, 2002. "Testing for programme effects in a regression discontinuity design with imperfect compliance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(1), pages 39-57.
  48. Joshua Angrist & Jinyong Hahn, 2004. "When to Control for Covariates? Panel Asymptotics for Estimates of Treatment Effects," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 58-72, February.
  49. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, Econometric Society, vol. 69(1), pages 201-09, January.
  50. Markus Frölich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
  51. Sadoulet, Elisabeth & Janvry, Alain de & Davis, Benjamin, 2001. "Cash Transfer Programs with Income Multipliers: PROCAMPO in Mexico," World Development, Elsevier, Elsevier, vol. 29(6), pages 1043-1056, June.
  52. Jalan, Jyotsna & Ravallion, Martin, 1996. "Are there dynamic gains from a poor-area development program?," Policy Research Working Paper Series 1695, The World Bank.
  53. repec:fth:prinin:455 is not listed on IDEAS
  54. Robert S. Chase, 2002. "Supporting Communities in Transition: The Impact of the Armenian Social Investment Fund," World Bank Economic Review, World Bank Group, World Bank Group, vol. 16(2), pages 219-240, August.
  55. Behrman, Jere R & Sengupta, Piyali & Todd, Petra, 2005. "Progressing through PROGRESA: An Impact Assessment of a School Subsidy Experiment in Rural Mexico," Economic Development and Cultural Change, University of Chicago Press, vol. 54(1), pages 237-75, October.
  56. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, Elsevier, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097 Elsevier.
  57. Atkinson, A B, 1987. "On the Measurement of Poverty," Econometrica, Econometric Society, Econometric Society, vol. 55(4), pages 749-64, July.
  58. Deaton, Angus, 1995. "Data and econometric tools for development analysis," Handbook of Development Economics, Elsevier, in: Hollis Chenery & T.N. Srinivasan (ed.), Handbook of Development Economics, edition 1, volume 3, chapter 33, pages 1785-1882 Elsevier.
  59. Petra E. Todd & Jeffrey A. Smith, 2001. "Reconciling Conflicting Evidence on the Performance of Propensity-Score Matching Methods," American Economic Review, American Economic Association, American Economic Association, vol. 91(2), pages 112-118, May.
  60. Raghav Gaiha & Katsushi Imai, 2002. "Rural Public Works and Poverty Alleviation--the case of the employment guarantee scheme in Maharashtra," International Review of Applied Economics, Taylor & Francis Journals, Taylor & Francis Journals, vol. 16(2), pages 131-151.
  61. Ravallion, Martin, 2000. "Monitoring Targeting Performance When Decentralized Allocations to the Poor Are Unobserved," World Bank Economic Review, World Bank Group, World Bank Group, vol. 14(2), pages 331-45, May.
  62. Foster, James & Greer, Joel & Thorbecke, Erik, 1984. "A Class of Decomposable Poverty Measures," Econometrica, Econometric Society, Econometric Society, vol. 52(3), pages 761-66, May.
  63. Gary Burtless, 1995. "The Case for Randomized Field Trials in Economic and Policy Research," Journal of Economic Perspectives, American Economic Association, American Economic Association, vol. 9(2), pages 63-84, Spring.
  64. Smith, Jeffrey & Todd, Petra, 2005. "Rejoinder," Journal of Econometrics, Elsevier, Elsevier, vol. 125(1-2), pages 365-375.
  65. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, Econometric Society, vol. 72(1), pages 159-217, 01.
  66. Heckman, James J & Ichimura, Hidehiko & Todd, Petra E, 1997. "Matching as an Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Wiley Blackwell, Wiley Blackwell, vol. 64(4), pages 605-54, October.
  67. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc.
  68. Rosenzweig, Mark R & Wolpin, Kenneth I, 1986. "Evaluating the Effects of Optimally Distributed Public Programs: ChildHealth and Family Planning Interventions," American Economic Review, American Economic Association, American Economic Association, vol. 76(3), pages 470-82, June.
  69. Michael Lokshin & Martin Ravallion, 2000. "Welfare Impacts of the 1998 Financial Crisis in Russia and the Response of the Public Safety Net," The Economics of Transition, The European Bank for Reconstruction and Development, The European Bank for Reconstruction and Development, vol. 8(2), pages 269-295, July.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:3625. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Roula I. Yazigi).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.