IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/1945.html
   My bibliography  Save this paper

Evaluating a targeted social program when placement is decentralized

Author

Listed:
  • Ravallion, Martin
  • Wodon, Quentin

Abstract

An assessment of the welfare gains from a targeted social program can be seriously biased unless it takes proper account of the endogeneity of program participation. Bias comes from two sources of placement endogeneity: the purposive targeting of the geographic areas to receive the program, and the targeting of individual recipients within selected areas. Decentralization of program placement decisions is common, because of the administrative cost of centralized placement decisions and the fact that local groups and governments are likely to be better informed about who most needs help. But full decentralization is uncommon; the center typically retains control of broad geographic targeting. The authors argue that partial decentralization of program placement decisions creates control and instrumental variables useful for identifying program benefits. The central allocation to a local level of government is presumably based on observable indicators. The central allocation will also influence the allocation to an individual but is unlikely to determine outcomes at the individual level conditional on individual program participation. So with suitable controls for the welfare-relevant geographiccharacteristics determining program placement decisions, the center's allocation across areas can be used as an instrumental variable for individual participation. The authors use Bangladesh's Food for Education program to illustrate their approach. A single post-intervention cross-sectional household survey was used to identify the impact of the program on school attendance, using geographic placement at the village level as an instrument for individual program placement. To deal with bias from the endogeneity of village selection, the authors used a detailed community survey coordinated with the household survey to control for likely sources of heterogeneity in geographic influences on school attendance, consistent with prior information on how the government targeted the program geographically. They found that the programs had significant and sizable impacts on school attendance. At mean points, the program's incentive increased attendance by 24 percent of the maximum feasible days of schooling. A regression estimator ignoring the purposive program placement was found to result in a substantial underestimation of the program's impact. Indeed, the simplest possible control group method--assuming that nonparticipants provide a valid counterfactual--performed much better than a regression method treating placement as exogenous.

Suggested Citation

  • Ravallion, Martin & Wodon, Quentin, 1998. "Evaluating a targeted social program when placement is decentralized," Policy Research Working Paper Series 1945, The World Bank.
  • Handle: RePEc:wbk:wbrwps:1945
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/1998/07/01/000009265_3980901110136/Rendered/PDF/multi_page.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Robert Moffitt, 1991. "Program Evaluation With Nonexperimental Data," Evaluation Review, , vol. 15(3), pages 291-314, June.
    2. Heckman, James J, 1996. "Randomization as an Instrumental Variable: Notes," The Review of Economics and Statistics, MIT Press, vol. 78(2), pages 336-341, May.
    3. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sharma, Manohar & Zeller, Manfred, 1999. "Placement and Outreach of Group-Based Credit Organizations: The Cases of ASA, BRAC, and PROSHIKA in Bangladesh," World Development, Elsevier, vol. 27(12), pages 2123-2136, December.
    2. Ahmed, Akhter U. & Arends-Kuenning, Mary, 2006. "Do crowded classrooms crowd out learning? Evidence from the food for education program in Bangladesh," World Development, Elsevier, vol. 34(4), pages 665-684, April.
    3. Jonathan Conning & Michael Kevane, 2000. "Community Based Targeting for Social Safety Nets," Department of Economics Working Papers 2000-09, Department of Economics, Williams College.
    4. Quentin Wodon, 2000. "Low income energy assistance and disconnection in France," Applied Economics Letters, Taylor & Francis Journals, vol. 7(12), pages 775-779.
    5. Conning, Jonathan & Kevane, Michael, 2002. "Community-Based Targeting Mechanisms for Social Safety Nets: A Critical Review," World Development, Elsevier, vol. 30(3), pages 375-394, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    2. Gershon Feder & Rinku Murgai & Jaime B. Quizon, 2004. "Sending Farmers Back to School: The Impact of Farmer Field Schools in Indonesia," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 26(1), pages 45-62.
    3. Coady, David & Xinyi Dai & Limin Wang, 2001. "Community programs and women's participation : the Chinese experience," Policy Research Working Paper Series 2622, The World Bank.
    4. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.
    5. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    6. Aakvik, Arild & Tjøtta, Sigve, 2011. "Do collective actions clear common air? The effect of international environmental protocols on sulphur emissions," European Journal of Political Economy, Elsevier, vol. 27(2), pages 343-351, June.
    7. Schmidt, Christoph M. & Baltussen, Rob & Sauerborn, Rainer, 2000. "The Evaluation of Community-Based Interventions: Group Randomization, Limits and Alternatives," IZA Discussion Papers 206, Institute of Labor Economics (IZA).
    8. Ghazala Naz, 2010. "Effect of a Family Policy Reform on Immigrants' Labour Supply and Earnings," LABOUR, CEIS, vol. 24(1), pages 74-92, March.
    9. Ghazala Naz, 2004. "The impact of cash-benefit reform on parents’ labour force participation," Journal of Population Economics, Springer;European Society for Population Economics, vol. 17(2), pages 369-383, June.
    10. James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
    11. R. Hujer & K.-O. Maurer & M. Wellner, 1997. "Estimating the Effect of Training on Unemployment Duration in West Germany - A Discrete Hazard-Rate Model with Instrumental Variables," Econometrics 9704001, University Library of Munich, Germany.
    12. Humphreys, Keith & Phibbs, Ciaran S. & Moos, Rudolf H., 1996. "Addressing self-selection effects in evaluations of mutual help groups and professional mental health services: An introduction to two-stage sample selection models," Evaluation and Program Planning, Elsevier, vol. 19(4), pages 301-308, November.
    13. Carolyn Heinrich & Jeffrey Wenger, 2002. "The Economic Contributions of James J. Heckman and Daniel L. McFadden," Review of Political Economy, Taylor & Francis Journals, vol. 14(1), pages 69-89.
    14. Makate, Marshall & Makate, Clifton, 2016. "Is poor sanitation killing more children in rural Zimbabwe? Results of propensity score matching method," MPRA Paper 72831, University Library of Munich, Germany, revised 02 Aug 2016.
    15. Robert J. LaLonde, 2003. "Employment and Training Programs," NBER Chapters, in: Means-Tested Transfer Programs in the United States, pages 517-586, National Bureau of Economic Research, Inc.
    16. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.
    17. Nobuhiko Fuwa & Asa Jose U. Sajise, 2009. "Exploring Environmental Services Incentive Policies for the Philippines Rice Sector: The Case of Intra-Species Agrobiodiversity Conservation," Natural Resource Management and Policy, in: Leslie Lipper & Takumi Sakuyama & Randy Stringer & David Zilberman (ed.), Payment for Environmental Services in Agricultural Landscapes, chapter 10, pages 221-238, Springer.
    18. Paul Ellickson & Sanjog Misra, 2012. "Enriching interactions: Incorporating outcome data into static discrete games," Quantitative Marketing and Economics (QME), Springer, vol. 10(1), pages 1-26, March.
    19. Jinho Bae & Chang-Jin Kim & Dong Kim, 2012. "The evolution of the monetary policy regimes in the U.S," Empirical Economics, Springer, vol. 43(2), pages 617-649, October.
    20. Marco Caliendo & Stefan Tübbicke, 2020. "New evidence on long-term effects of start-up subsidies: matching estimates and their robustness," Empirical Economics, Springer, vol. 59(4), pages 1605-1631, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:1945. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.