Substitution Bias and External Validity: Why an Innovative Anti-poverty Program Showed no Net Impact
AbstractThe net impact of development interventions can depend on the availability of close substitutes to the intervention. We analyze a randomized trial of an innovative anti-poverty program in South India which provides “ultra-poor” households with inputs to create a new, sustainable livelihood. We find no statistically significant evidence of lasting net impact on consumption, income or asset accumulation. Instead, income from the new livelihood substituted for earnings from wage labor. A very similar intervention made a large difference elsewhere in South Asia, however, where wage labor alternatives were less compelling. The analysis highlights the roles of substitution bias and dropout bias in shaping evaluation results and delimiting external validity.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Center for Economic Institutions, Institute of Economic Research, Hitotsubashi University in its series CEI Working Paper Series with number 2013-03.
Length: 57, 14 p.
Date of creation: Jul 2013
Date of revision:
Find related papers by JEL classification:
- O1 - Economic Development, Technological Change, and Growth - - Economic Development
- J2 - Labor and Demographic Economics - - Demand and Supply of Labor
- C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
- I3 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Anirudh Krishna & Meri Poghosyan & Narayan Das, 2012. "How Much Can Asset Transfers Help the Poorest? Evaluating the Results of BRAC's Ultra-Poor Programme (2002--2008)," Journal of Development Studies, Taylor & Francis Journals, vol. 48(2), pages 254-267, May.
- Angus Deaton, 2010.
"Instruments, Randomization, and Learning about Development,"
Journal of Economic Literature,
American Economic Association, vol. 48(2), pages 424-55, June.
- Angus Deaton, 2010. "Instruments, randomization, and learning about development," Working Papers 1224, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
- Das, Jishnu & Dercon, Stefan & Habyarimana, James & Krishnan, Pramila & Muralidharan, Karthik & Sundararaman, Venkatesh, 2011.
"School inputs, household substitution, and test scores,"
Policy Research Working Paper Series
5629, The World Bank.
- Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan & Karthik Muralidharan & Venkatesh Sundararaman, 2013. "School Inputs, Household Substitution, and Test Scores," American Economic Journal: Applied Economics, American Economic Association, vol. 5(2), pages 29-57, April.
- Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan & Karthik Muralidharan & Venkatesh Sundararaman, 2011. "School Inputs, Household Substitution, and Test Scores," NBER Working Papers 16830, National Bureau of Economic Research, Inc.
- James Heckman & Neil Hohmann & Jeffrey Smith, 1998.
"Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment,"
UWO Department of Economics Working Papers
9819, University of Western Ontario, Department of Economics.
- James Heckman & Neil Hohmann & Jeffrey Smith & Michael Khoo, 2000. "Substitution And Dropout Bias In Social Experiments: A Study Of An Influential Social Experiment," The Quarterly Journal of Economics, MIT Press, vol. 115(2), pages 651-694, May.
- M. Shahe Emran & Stephen C. Smith & Virginia Robano, 2009. "Assessing the Frontiers of Ultra-Poverty Reduction: Evidence from CFPR/TUP, an Innovative Program in Bangladesh," Working Papers 2009-06, The George Washington University, Institute for International Economic Policy.
- Matin, Imran & Hulme, David, 2003. "Programs for the Poorest: Learning from the IGVGD Program in Bangladesh," World Development, Elsevier, vol. 31(3), pages 647-665, March.
- Mallick, Debdulal, 2009. "How effective is a Big Push to the Small? Evidence from a Quasi-random Experiment," MPRA Paper 22824, University Library of Munich, Germany.
- AfDB AfDB, . "AfDB Group Annual Report 2010," Annual Report, African Development Bank, number 310, 8.
- AfDB AfDB, . "AfDB Group Annual Report 2010 (Arabic)," Annual Report, African Development Bank, number 311, 8.
- AfDB AfDB, . "Annual Report in Brief 2010," Annual Report, African Development Bank, number 304, 8.
- Hunt Allcott, 2012. "Site Selection Bias in Program Evaluation," NBER Working Papers 18373, National Bureau of Economic Research, Inc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Reiko Suzuki).
If references are entirely missing, you can add them using this form.