Using lotteries to evaluate schools of choice: Evidence from a national study of charter schools
AbstractThis paper draws on data and experiences observing and analyzing school lotteries from the National Evaluation of Charter School Impacts (Gleason et al., 2010) to describe the challenges associated with lottery-based research. In that study, covering 36 charter middle schools in 15 states, we found that charter schools did not affect student achievement or behavior on average, although there was substantial variation across schools. In this paper, we discuss the prevalence of oversubscribed charter schools at the time the study was conducted (the 2005–2006 and 2006–2007 school years), which was lower than commonly reported. We then describe how the sample of schools that participated in the study compared to all other charter middle schools nationwide, to provide some insight into the generalizabilty of findings from lottery-based studies. In general, oversubscribed charter schools were more likely to be located in urban areas and serve a higher-achieving population of students than those without excess demand. We also describe common features of school lotteries and waitlists, and examine implications of these features for a school's ability to support a lottery-based study. Finally, we summarize lessons learned for conducting lottery-based research on charter schools, drawing on our observations of the schools’ lotteries and analysis of the data from these lotteries.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Elsevier in its journal Economics of Education Review.
Volume (Year): 31 (2012)
Issue (Month): 2 ()
Contact details of provider:
Web page: http://www.elsevier.com/locate/econedurev
School choice; Charter schools; Lotteries; Randomized control trials;
Find related papers by JEL classification:
- I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Julie Berry Cullen & Brian A Jacob & Steven Levitt, 2006. "The Effect of School Choice on Participants: Evidence from Randomized Lotteries," Econometrica, Econometric Society, vol. 74(5), pages 1191-1230, 09.
- Will Dobbie & Roland G. Fryer, 2011. "Are High-Quality Schools Enough to Increase Achievement among the Poor? Evidence from the Harlem Children's Zone," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 158-87, July.
- Dee, Thomas S. & Fu, Helen, 2004. "Do charter schools skim students or drain resources?," Economics of Education Review, Elsevier, vol. 23(3), pages 259-271, June.
- Ni, Yongmei & Rorrer, Andrea K., 2012. "Twice considered: Charter schools and student achievement in Utah," Economics of Education Review, Elsevier, vol. 31(5), pages 835-849.
- Carruthers, Celeste K., 2012. "New schools, new students, new teachers: Evaluating the effectiveness of charter schools," Economics of Education Review, Elsevier, vol. 31(2), pages 280-292.
- Toma, Eugenia & Zimmer, Ron, 2012. "Two decades of charter schools: Expectations, reality, and the future," Economics of Education Review, Elsevier, vol. 31(2), pages 209-212.
- Alexandra Resch & Jillian Berk & Lauren Akers, 2014. "Recognizing and Conducting Opportunistic Experiments in Education: A Guide for Policymakers and Researchers," Mathematica Policy Research Reports 8126, Mathematica Policy Research.
- Ana I. Balsa & Alejandro Cid, 2012.
"Impact Evaluation of a Privately Managed Tuition-Free Middle school in a Poor Neighborhood in Montevideo,"
Documentos de Trabajo/Working Papers
1202, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
- Cid, Alejandro & Balsa, Ana, 2012. "Impact Evaluation of a Privately Managed Tuition-Free Middle school in a Poor Neighborhood in Montevideo," MPRA Paper 39913, University Library of Munich, Germany.
- Kevin Booker & Brian Gill & Tim Sass & Ron Zimmer, 2014. "Charter High Schools' Effects on Long-Term Attainment and Earnings," Mathematica Policy Research Reports 8005, Mathematica Policy Research.
- Zimmer, Ron & Gill, Brian & Booker, Kevin & Lavertu, Stéphane & Witte, John, 2012. "Examining charter student achievement effects across seven states," Economics of Education Review, Elsevier, vol. 31(2), pages 213-224.
- Davis, Devora H. & Raymond, Margaret E., 2012. "Choices for studying choice: Assessing charter school effectiveness using two quasi-experimental methods," Economics of Education Review, Elsevier, vol. 31(2), pages 225-236.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If references are entirely missing, you can add them using this form.