Can Propensity Score Analysis Replicate Estimates Based on Random Assignment in Evaluations of School Choice? A Within-Study Comparison
AbstractThe ability of propensity score analysis (PSA) to match impact estimates derived from random assignment (RA) is examined using data from the evaluation of two interdistrict magnet schools. As in previous within study comparisons, the estimates provided by PSA and RA differ substantially when PSA is implemented using comparison groups that are not similar to the treatment group and without pretreatment measures of academic performance. Adding pretreatment measures of the performance to the PSA, however, substantially improves the match between PSA and RA estimates. Although the results should not be generalized too readily, they suggest that nonexperimental estimators can, in some circumstances, provide valid estimates of the causal impact of school choice programs.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Center for Policy Research, Maxwell School, Syracuse University in its series Center for Policy Research Working Papers with number 124.
Length: 37 pages
Date of creation: Sep 2010
Date of revision:
Contact details of provider:
Postal: 426 Eggers Hall, Syracuse, New York USA 13244-1020
Phone: (315) 443-3114
Fax: (315) 443-1081
Web page: http://www.maxwell.syr.edu/cpr.aspx
More information through EDIRC
Nonexperimental; quasi-experimental; propensity score analysis; design replication; school choice.;
Find related papers by JEL classification:
- C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
- I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
- C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
- I28 - Health, Education, and Welfare - - Education - - - Government Policy
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Elizabeth Ty Wilde & Robinson Hollister, 2007. "How close is close enough? Evaluating propensity score matching using data from a class size reduction experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(3), pages 455-477.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Kelly Bogart) or (Katrina Wingle).
If references are entirely missing, you can add them using this form.