Evaluation of development programs : randomized controlled trials or regressions ?
AbstractCan project evaluation methods be used to evaluate programs: complex interventions involving multiple activities? A program evaluation cannot be based simply on separate evaluations of its components if interactions between the activities are important. In this paper a measure is proposed, the total program effect (TPE), which is an extension of the average treatment effect on the treated (ATET). It explicitly takes into account that in the real world (with heterogeneous treatment effects) individual treatment effects and program assignment are often correlated. The TPE can also deal with the common situation in which such a correlation is the result of decisions on (intended) program participation not being taken centrally. In this context RCTs are less suitable even for the simplest interventions. The TPE can be estimated by applying regression techniques to observational data from a representative sample from the targeted population. The approach is illustrated with an evaluation of a health insurance program in Vietnam.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by The World Bank in its series Policy Research Working Paper Series with number 6587.
Date of creation: 01 Sep 2013
Date of revision:
Poverty Monitoring&Analysis; Health Monitoring&Evaluation; Science Education; Scientific Research&Science Parks; Statistical&Mathematical Sciences;
This paper has been announced in the following NEP Reports:
- NEP-ALL-2013-09-13 (All new papers)
- NEP-DEV-2013-09-13 (Development)
- NEP-ECM-2013-09-13 (Econometrics)
- NEP-PPM-2013-09-13 (Project, Program & Portfolio Management)
- NEP-SEA-2013-09-13 (South East Asia)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Imbens, Guido W & Angrist, Joshua D, 1994.
"Identification and Estimation of Local Average Treatment Effects,"
Econometric Society, vol. 62(2), pages 467-75, March.
- Joshua D. Angrist & Guido W. Imbens, 1995. "Identification and Estimation of Local Average Treatment Effects," NBER Technical Working Papers 0118, National Bureau of Economic Research, Inc.
- Das, J. & Dercon, S. & Habyarimana, J. & Krishnan, P., 2004.
"Teacher Shocks and Student Learning: Evidence from Zambia,"
Cambridge Working Papers in Economics
0514, Faculty of Economics, University of Cambridge.
- Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan, 2007. "Teacher Shocks and Student Learning: Evidence from Zambia," Journal of Human Resources, University of Wisconsin Press, vol. 42(4).
- Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan, 2004. "Teacher Shocks and Student Learning: Evidence from Zambia," CSAE Working Paper Series 2004-26, Centre for the Study of African Economies, University of Oxford.
- Stefan Dercon, 2004. "Teacher Shocks and Student Learning: Evidence from Zambia," Economics Series Working Papers WPS/2004-26, University of Oxford, Department of Economics.
- Das, Jishnu & Dercon, Stefan & Habyarimana, James & Krishnan, Pramila, 2005. "Teacher shocks and student learning : evidence from Zambia," Policy Research Working Paper Series 3602, The World Bank.
- Alain de Janvry & Frederico Finan & Elisabeth Sadoulet, 2012.
"Local Electoral Incentives and Decentralized Program Performance,"
The Review of Economics and Statistics,
MIT Press, vol. 94(3), pages 672-685, August.
- Alain de Janvry & Frederico Finan & Elisabeth Sadoulet, 2010. "Local Electoral Incentives and Decentralized Program Performance," NBER Working Papers 16635, National Bureau of Economic Research, Inc.
- de Janvry, Alain & Finan, Frederico S. & Sadoulet, Elisabeth, 2010. "Local Electoral Incentives and Decentralized Program Performance," IZA Discussion Papers 5382, Institute for the Study of Labor (IZA).
- Shahidur R. Khandker & Zaid Bakht & Gayatri B. Koolwal, 2009.
"The Poverty Impact of Rural Roads: Evidence from Bangladesh,"
Economic Development and Cultural Change,
University of Chicago Press, vol. 57(4), pages 685-722, 07.
- Khandker, Shahidur R. & Bakht, Zaid & Koolwal, Gayatri B., 2006. "The poverty impact of rural roads : evidencefrom Bangladesh," Policy Research Working Paper Series 3875, The World Bank.
- Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
- Chen, Shaohua & Mu, Ren & Ravallion, Martin, 2009. "Are there lasting impacts of aid to poor areas?," Journal of Public Economics, Elsevier, vol. 93(3-4), pages 512-528, April.
- Angus Deaton, 2010.
"Instruments, randomization, and learning about development,"
1224, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
- Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-55, June.
- Ravallion, Martin, 2008.
"Evaluation in the practice of development,"
Policy Research Working Paper Series
4547, The World Bank.
- Abhijit V. Banerjee & Esther Duflo, 2008.
"The Experimental Approach to Development Economics,"
NBER Working Papers
14467, National Bureau of Economic Research, Inc.
- Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, 05.
- Banerjee, Abhijit & Duflo, Esther, 2008. "The Experimental Approach to Development Economics," CEPR Discussion Papers 7037, C.E.P.R. Discussion Papers.
- James Heckman, 1997. "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 441-462.
- Elbers, Chris & Gunning, Jan Willem & de Hoop, Kobus, 2009. "Assessing Sector-wide Programs with Statistical Impact Evaluation: A Methodological Proposal," World Development, Elsevier, vol. 37(2), pages 513-520, February.
- Almeida, Rita K. & Galasso, Emanuela, 2010. "Jump-starting Self-employment? Evidence for Welfare Participants in Argentina," World Development, Elsevier, vol. 38(5), pages 742-755, May.
- White, Howard, 2006. "Impact evaluation: the experience of the Independent Evaluation Group of the World Bank," MPRA Paper 1111, University Library of Munich, Germany.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Roula I. Yazigi).
If references are entirely missing, you can add them using this form.