The Mixing Problem in Programme Evaluation
AbstractA common concern of evaluation studies is to learn the distribution of outcomes when a specified treatment policy, or assignment rule, determines the treatment received by each member of a specified population. Recent studies have emphasized evaluation of policies providing the same treatment to all members of the population. In particular, experiments with randomized treatments have this objective. Social programmes mandating homogeneous treatment of the population are of interest, but so are ones in which treatment varies across the population. This paper examines the use of empirical evidence on programmes with homogeneous treatments to infer the outcomes that would occur if treatment were to vary across the population. Experimental evidence from the Perry Pre-school Project is used to illustrate the inferential problem and the main findings of the analysis. Copyright 1997 by The Review of Economic Studies Limited.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Wiley Blackwell in its journal Review of Economic Studies.
Volume (Year): 64 (1997)
Issue (Month): 4 (October)
Contact details of provider:
Web page: http://www.blackwellpublishing.com/journal.asp?ref=0034-6527
Other versions of this item:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Horowitz, J.L. & Manski, C.F., 1992.
"Identification and Robustness in the Presence of Errors in Data,"
92-05, University of Iowa, Department of Economics.
- Manski, C.F., 1990. "The Selection Problem," Working papers 90-12, Wisconsin Madison - Social Systems.
- Robinson, Chris, 1989. "The Joint Determination of Union Status and Union Wage Effects: Some Tests of Alternative Models," Journal of Political Economy, University of Chicago Press, vol. 97(3), pages 639-67, June.
- Manski, C.F. & Sandefur, G.D. & Mclanahan, S. & Powers, D., 1990. "Alternative Estimates Of The Effect Of Family Stucture During Adolescence On Hight School Graduation," Working papers 90-31, Wisconsin Madison - Social Systems.
- Bjorklund, Anders & Moffitt, Robert, 1987. "The Estimation of Wage Gains and Welfare Gains in Self-selection," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 42-49, February.
- Heckman, James J & Honore, Bo E, 1990. "The Empirical Content of the Roy Model," Econometrica, Econometric Society, vol. 58(5), pages 1121-49, September.
- Guido W. Imbens & Whitney K. Newey, 2009.
"Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity,"
Econometric Society, vol. 77(5), pages 1481-1512, 09.
- Guido W. Imbens & Whitney K. Newey, 2002. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," NBER Technical Working Papers 0285, National Bureau of Economic Research, Inc.
- Whitney Newey & Guido Imbens, 2004. "Identification and Estimation of Triangular Simultaneous Equations Models without Additivity," Econometric Society 2004 North American Summer Meetings 594, Econometric Society.
- Guido W. Imbens, 2010.
"Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009),"
Journal of Economic Literature,
American Economic Association, vol. 48(2), pages 399-423, June.
- Guido W. Imbens, 2009. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," NBER Working Papers 14896, National Bureau of Economic Research, Inc.
- Marco Caliendo & Viktor Steiner, 2005. "Aktive Arbeitsmarktpolitik in Deutschland: Bestandsaufnahme und Bewertung der mikroökonomischen Evaluationsergebnisse," Discussion Papers of DIW Berlin 515, DIW Berlin, German Institute for Economic Research.
- Fan, Yanqin & Park, Sang Soo, 2009. "Partial identification of the distribution of treatment effects and its confidence sets," MPRA Paper 37148, University Library of Munich, Germany.
- Caliendo, Marco & Hujer, Reinhard & Thomsen, Stephan L., 2005.
"Identifying Effect Heterogeneity to Improve the Effiency of Job Creation Schemes in Germany?,"
ZEW Discussion Papers
05-21, ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
- Marco Caliendo & Reinhard Hujer & Stephan Thomsen, 2008. "Identifying effect heterogeneity to improve the efficiency of job creation schemes in Germany," Applied Economics, Taylor & Francis Journals, vol. 40(9), pages 1101-1122.
- Caliendo, Marco & Hujer, Reinhard & Thomsen, Stephan L., 2005. "Identifying effect heterogeneity to improve the efficiency of job creation schemes in Germany," IAB Discussion Paper 200508, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
- Manski, Charles F., 2000. "Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice," Journal of Econometrics, Elsevier, vol. 95(2), pages 415-442, April.
- Charles F. Manski, 2001. "Designing Programs for Heterogeneous Populations: The Value of Covariate Information," American Economic Review, American Economic Association, vol. 91(2), pages 103-106, May.
- V. Joseph Hotz & Guido W. Imbens & Julie H. Mortimer, 1999. "Predicting the Efficacy of Future Training Programs Using Past Experiences," NBER Technical Working Papers 0238, National Bureau of Economic Research, Inc.
- repec:att:wimass:9505 is not listed on IDEAS
- John V. Pepper, 1999.
"What Do Welfare-to-Work Demonstrations Reveal to Welfare Reformers?,"
JCPR Working Papers
105, Northwestern University/University of Chicago Joint Center for Poverty Research.
- John V. Pepper, 1999. "What Do Welfare-to-Work Demonstrations Reveal to Welfare Reformers?," Virginia Economics Online Papers 317, University of Virginia, Department of Economics.
- Tomas Philipson, 1999.
"External Treatment Effects and Program Implementation Bias,"
9929, Harris School of Public Policy Studies, University of Chicago.
- Tomas J. Philipson, 2000. "External Treatment Effects and Program Implementation Bias," NBER Technical Working Papers 0250, National Bureau of Economic Research, Inc.
- Charles F. Manski, 1999. "Statistical Treatment Rules for Heterogeneous Populations: With Application to Randomized Experiments," NBER Technical Working Papers 0242, National Bureau of Economic Research, Inc.
- C. F. Manski, .
"Learning about social programs from experiments with random assignment of treatments,"
Institute for Research on Poverty Discussion Papers
1061-95, University of Wisconsin Institute for Research on Poverty.
- Sergio Firpo, 2004.
"Efficient Semiparametric Estimation of Quantile Treatment Effects,"
Econometric Society 2004 North American Summer Meetings
605, Econometric Society.
- Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, 01.
- Caliendo, Marco & Steiner, Viktor, 2005. "Aktive Arbeitsmarktpolitik in Deutschland : Bestandsaufnahme und Bewertung der mikroökonomischen Evaluationsergebnisse (Active labour market policy in Germany * review ans assessment of the microecon," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 38(2/3), pages 396-418.
- repec:iab:iabzaf:v:38:i:2/3:p:396-418 is not listed on IDEAS
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.