An evaluation of the performance of regression discontinuity design on PROGRESA
AbstractWhile providing the most reliable method of evaluating social programs, randomized experiments in developing and developed countries alike are accompanied by political risks and ethical issues that jeopardize the chances of adopting them. In this paper the authors use a unique data set from rural Mexico collected for the purposes of evaluating the impact of the PROGRESA poverty alleviation program to examine the performance of a quasi-experimental estimator, the Regression Discontinuity Design (RDD). Using as a benchmark the impact estimates based on the experimental nature of the sample, we examine how estimates differ when we use the RDD as the estimator for evaluating program impact on two key indicators: child school attendance and child work. Overall the performance of the RDD was remarkably good. The RDD estimates of program impact agreed with the experimental estimates in 10 out of the 12 possible cases. The two cases in which the RDD method failed to reveal any significant program impact on the school attendance of boys and girls were in the first year of the program (round 3). RDD estimates comparable to the experimental estimates were obtained when we used as a comparison group children from non-eligible households in the control localities.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by The World Bank in its series Policy Research Working Paper Series with number 3386.
Date of creation: 01 Sep 2004
Date of revision:
Scientific Research&Science Parks; Public Health Promotion; Health Monitoring&Evaluation; Housing&Human Habitats; Anthropology; Scientific Research&Science Parks; Science Education; VN-Acb Mis -- IFC-00535908; Health Monitoring&Evaluation; Housing&Human Habitats;
Other versions of this item:
- Buddelmeyer, Hielke & Skoufias, Emmanuel, 2003. "An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA," IZA Discussion Papers 827, Institute for the Study of Labor (IZA).
- I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
- I28 - Health, Education, and Welfare - - Education - - - Government Policy
- I32 - Health, Education, and Welfare - - Welfare and Poverty - - - Measurement and Analysis of Poverty
- J13 - Labor and Demographic Economics - - Demographic Economics - - - Fertility; Family Planning; Child Care; Children; Youth
This paper has been announced in the following NEP Reports:
- NEP-ALL-2004-08-31 (All new papers)
- NEP-DEV-2004-08-31 (Development)
- NEP-ECM-2004-08-31 (Econometrics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Rajeev H. Dehejia & Sadek Wahba, 2002.
"Propensity score matching methods for non-experimental causal studies,"
0102-14, Columbia University, Department of Economics.
- Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
- Rajeev H. Dehejia & Sadek Wahba, 1998. "Propensity Score Matching Methods for Non-experimental Causal Studies," NBER Working Papers 6829, National Bureau of Economic Research, Inc.
- Dehejia, R.H. & Wahba, S., 1998. "Propensity Score Matching Methods for Non-Experimental Causal Studies," Discussion Papers 1998_02, Columbia University, Department of Economics.
- Paul Schultz, T., 2004.
"School subsidies for the poor: evaluating the Mexican Progresa poverty program,"
Journal of Development Economics,
Elsevier, vol. 74(1), pages 199-250, June.
- T. Paul Schultz, 2001. "School Subsidies for the Poor: Evaluating the Mexican Progresa Poverty Program," Working Papers 834, Economic Growth Center, Yale University.
- Petra E. Todd & Jeffrey A. Smith, 2001. "Reconciling Conflicting Evidence on the Performance of Propensity-Score Matching Methods," American Economic Review, American Economic Association, vol. 91(2), pages 112-118, May.
- Emmanuel Skoufias & Susan Wendy Parker, 2001. "Conditional Cash Transfers and Their Impact on Child Work and Schooling: Evidence from the PROGRESA Program in Mexico," Journal of LACEA Economia, LACEA - LATIN AMERICAN AND CARIBBEAN ECONOMIC ASSOCIATION.
- Jinyong Hahn & Petra Todd & Wilbert Van der Klaauw, 1999. "Evaluating the Effect of an Antidiscrimination Law Using a Regression-Discontinuity Design," NBER Working Papers 7131, National Bureau of Economic Research, Inc.
- Behrman, Jere R. & Deolalikar, Anil B., 1988. "Health and nutrition," Handbook of Development Economics, in: Hollis Chenery & T.N. Srinivasan (ed.), Handbook of Development Economics, edition 1, volume 1, chapter 14, pages 631-711 Elsevier.
- Wilbert van der Klaauw, 2002. "Estimating the Effect of Financial Aid Offers on College Enrollment: A Regression-Discontinuity Approach," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 43(4), pages 1249-1287, November.
- Judy L. Baker, 2000. "Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners," World Bank Publications, The World Bank, number 13949.
- Heckman, James J & Ichimura, Hidehiko & Todd, Petra E, 1997. "Matching as an Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 605-54, October.
- James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
- Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097 Elsevier.
- Frölich, Markus & Melly, Blaise, 2008.
"Quantile Treatment Effects in the Regression Discontinuity Design,"
IZA Discussion Papers
3638, Institute for the Study of Labor (IZA).
- Frandsen, Brigham R. & Frölich, Markus & Melly, Blaise, 2012. "Quantile treatment effects in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 168(2), pages 382-395.
- Rafael Lalive & M. Alejandra Cattaneo, 2009.
"Social Interactions and Schooling Decisions,"
The Review of Economics and Statistics,
MIT Press, vol. 91(3), pages 457-477, August.
- Rafael Lalive & Alejandra Cattaneo, 2006. "Social Interactions and Schooling Decisions," CESifo Working Paper Series 1787, CESifo Group Munich.
- Rafael Lalive & Alejandra Cattaneo, 2006. "Social Interactions and Schooling Decisions," IEW - Working Papers 298, Institute for Empirical Research in Economics - University of Zurich.
- Lalive, Rafael & Cattaneo, Maria Alejandra, 2006. "Social Interactions and Schooling Decisions," IZA Discussion Papers 2250, Institute for the Study of Labor (IZA).
- Cattaneo, Alejandra & Lalive, Rafael, 2006. "Social Interactions and Schooling Decisions," CEPR Discussion Papers 5816, C.E.P.R. Discussion Papers.
- Battistin, Erich & Rettore, Enrico, 2008. "Ineligibles and eligible non-participants as a double comparison group in regression-discontinuity designs," Journal of Econometrics, Elsevier, vol. 142(2), pages 715-730, February.
- Peralta, Maria Alexandra & Swinton, Scott M. & Maredia, Mywish K., 2011. "Accounting for selection bias in impact analysis of a rural development program: An application using propensity score matching," 2012 Conference, August 18-24, 2012, Foz do Iguacu, Brazil 126398, International Association of Agricultural Economists.
- Burgert, Derik, 2006. "Einstellungschancen von Älteren – Wie wirkt der Schwellenwert im Kündigungsschutz?," MPRA Paper 5846, University Library of Munich, Germany.
- Esther Duflo & Rachel Glennerster & Michael Kremer, 2006.
"Using Randomization in Development Economics Research: A Toolkit,"
NBER Technical Working Papers
0333, National Bureau of Economic Research, Inc.
- Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, Elsevier.
- Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2007. "Using Randomization in Development Economics Research: A Toolkit," CEPR Discussion Papers 6059, C.E.P.R. Discussion Papers.
- Burgert, Derik, 2005. "Schwellenwerte im deutschen Kündigungsschutzrecht Ein Beschäftigungshindernis für kleine Unternehmen?," MPRA Paper 5969, University Library of Munich, Germany.
- Derik Burgert, 2005. "Schwellenwerte im deutschen Kündigungsschutzrecht - Ein Beschäftigungshindernis für kleine Unternehmen?," FFB-Discussionpaper 51, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
- Maureen A. Pirog & Anne L. Buffardi & Colleen K. Chrisinger & Pradeep Singh & John Briney, 2009. "Are the alternatives to randomized assignment nearly as good? Statistical corrections to nonrandomized evaluations," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 28(1), pages 169-172.
- Jere R. Behrman & Susan W. Parker & Petra E. Todd, 2005. "Long-Term Impacts of the Oportunidades Conditional Cash Transfer Program on Rural Youth in Mexico," Ibero America Institute for Econ. Research (IAI) Discussion Papers 122, Ibero-America Institute for Economic Research.
- Burgert, Derik, 2005. "The Impact of German Job Protection Legislation on Job Creation in Small Establishments - An Application of the Regression Discontinuity Design," MPRA Paper 5971, University Library of Munich, Germany.
- Cook, Thomas D., 2008. ""Waiting for Life to Arrive": A history of the regression-discontinuity design in Psychology, Statistics and Economics," Journal of Econometrics, Elsevier, vol. 142(2), pages 636-654, February.
- Nguyen Viet, Cuong, 2006. "An Introduction to Alternative Methods in Program Impact Evaluation," MPRA Paper 24900, University Library of Munich, Germany.
- Viviane Azevedo & Cesar Bouillon & Patricia Yanez-Pagans, 2009. "How Much Are We Willing To Pay to Send Poor Adolescents to School? Simulating Changes to Mexico`s Oportunidades in Urban Areas," Research Department Publications 4631, Inter-American Development Bank, Research Department.
- Eliana Cardoso & Andre Portela Souza, 2004. "The Impact of Cash Transfers on Child Labor and School Attendance in Brazil," Vanderbilt University Department of Economics Working Papers 0407, Vanderbilt University Department of Economics.
- Solomon Asfaw & Silvio Daidone & Benjamin Davis & Josh Dewbre & Alessandro Romeo & Paul Winters & Katia Covarrubias & Habiba Djebbari, 2012. "Analytical Framework for Evaluating the Productive Impact of Cash Transfer Programmes on Household Behaviour ? Methodological Guidelines for the From Protection to Production Project," Working Papers 101, International Policy Centre for Inclusive Growth.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Roula I. Yazigi).
If references are entirely missing, you can add them using this form.