IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/17632.html
   My bibliography  Save this paper

Getting Beneath the Veil of Effective Schools: Evidence from New York City

Author

Listed:
  • Will Dobbie
  • Roland G. Fryer, Jr

Abstract

Charter schools were developed, in part, to serve as an R&D engine for traditional public schools, resulting in a wide variety of school strategies and outcomes. In this paper, we collect unparalleled data on the inner-workings of 35 charter schools and correlate these data with credible estimates of each school's effectiveness. We find that traditionally collected input measures -- class size, per pupil expenditure, the fraction of teachers with no certification, and the fraction of teachers with an advanced degree -- are not correlated with school effectiveness. In stark contrast, we show that an index of five policies suggested by over forty years of qualitative research -- frequent teacher feedback, the use of data to guide instruction, high-dosage tutoring, increased instructional time, and high expectations -- explains approximately 50 percent of the variation in school effectiveness. Our results are robust to controls for three alternative theories of schooling: a model emphasizing the provision of wrap-around services, a model focused on teacher selection and retention, and the "No Excuses'' model of education. We conclude by showing that our index provides similar results in a separate sample of charter schools.

Suggested Citation

  • Will Dobbie & Roland G. Fryer, Jr, 2011. "Getting Beneath the Veil of Effective Schools: Evidence from New York City," NBER Working Papers 17632, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:17632
    Note: ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w17632.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Card & Martin D. Dooley & A. Abigail Payne, 2010. "School Competition and Efficiency with Publicly Funded Catholic Schools," American Economic Journal: Applied Economics, American Economic Association, vol. 2(4), pages 150-176, October.
    2. Caroline Minter Hoxby, 2003. "School Choice and School Productivity. Could School Choice Be a Tide that Lifts All Boats?," NBER Chapters, in: The Economics of School Choice, pages 287-342, National Bureau of Economic Research, Inc.
    3. Joshua D. Angrist & Parag A. Pathak & Christopher R. Walters, 2013. "Explaining Charter School Effectiveness," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 1-27, October.
    4. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    5. Caroline M. Hoxby, 2000. "Does Competition among Public Schools Benefit Students and Taxpayers?," American Economic Review, American Economic Association, vol. 90(5), pages 1209-1238, December.
    6. Caroline M. Hoxby, 2003. "The Economics of School Choice," NBER Books, National Bureau of Economic Research, Inc, number hox03-1.
    7. Borland, Melvin V. & Howsen, Roy M, 1992. "Student academic achievement and the degree of market concentration in education," Economics of Education Review, Elsevier, vol. 11(1), pages 31-39, March.
    8. David Card & Alan B. Krueger, 1992. "School Quality and Black-White Relative Earnings: A Direct Assessment," The Quarterly Journal of Economics, Oxford University Press, vol. 107(1), pages 151-200.
    9. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    10. Cullen, Julie Berry & Jacob, Brian A. & Levitt, Steven D., 2005. "The impact of school choice on student outcomes: an analysis of the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 729-760, June.
    11. Chakrabarti, Rajashri, 2008. "Can increasing private school participation and monetary loss in a voucher program affect public school performance? Evidence from Milwaukee," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1371-1393, June.
    12. Couch, Jim F & Shughart, William F, II & Williams, Al L, 1993. "Private School Enrollment and Public School Performance," Public Choice, Springer, vol. 76(4), pages 301-312, August.
    13. Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak & Christopher R. Walters, 2012. "Who Benefits from KIPP?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(4), pages 837-860, September.
    14. Jesse M. Rothstein, 2006. "Good Principals or Good Peers? Parental Valuation of School Characteristics, Tiebout Equilibrium, and the Incentive Effects of Competition among Jurisdictions," American Economic Review, American Economic Association, vol. 96(4), pages 1333-1350, September.
    15. Jepsen, Christopher, 2002. "The role of aggregation in estimating the effects of private school competition on student achievement," Journal of Urban Economics, Elsevier, vol. 52(3), pages 477-500, November.
    16. Christopher Jepsen, 2003. "The Effectiveness of Catholic Primary Schooling," Journal of Human Resources, University of Wisconsin Press, vol. 38(4).
    17. David J. Deming & Justine S. Hastings & Thomas J. Kane & Douglas O. Staiger, 2014. "School Choice, School Quality, and Postsecondary Attainment," American Economic Review, American Economic Association, vol. 104(3), pages 991-1013, March.
    18. Justine S. Hastings & Thomas J. Kane & Douglas O. Staiger, 2006. "Gender and Performance: Evidence from School Assignment by Randomized Lottery," American Economic Review, American Economic Association, vol. 96(2), pages 232-236, May.
    19. Jonah E. Rockoff & Brian A. Jacob & Thomas J. Kane & Douglas O. Staiger, 2011. "Can You Recognize an Effective Teacher When You Recruit One?," Education Finance and Policy, MIT Press, vol. 6(1), pages 43-74, January.
    20. Caroline Minter Hoxby, 1994. "Do Private Schools Provide Competition for Public Schools?," NBER Working Papers 4978, National Bureau of Economic Research, Inc.
    21. Will Dobbie & Roland G. Fryer, 2011. "Are High-Quality Schools Enough to Increase Achievement among the Poor? Evidence from the Harlem Children's Zone," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 158-187, July.
    22. Joseph G. Altonji & Thomas A. Dunn, 1995. "The Effects of School and Family Characteristics on the Return to Education," NBER Working Papers 5072, National Bureau of Economic Research, Inc.
    23. Cecilia Elena Rouse, 1998. "Private School Vouchers and Student Achievement: An Evaluation of the Milwaukee Parental Choice Program," The Quarterly Journal of Economics, Oxford University Press, vol. 113(2), pages 553-602.
    24. Roland G. Fryer, Jr, 2011. "Injecting Successful Charter School Strategies into Traditional Public Schools: A Field Experiment in Houston," NBER Working Papers 17494, National Bureau of Economic Research, Inc.
    25. Vilsa E. Curto & Roland G. Fryer, Jr., 2011. "Estimating the Returns to Urban Boarding Schools: Evidence from SEED," NBER Working Papers 16746, National Bureau of Economic Research, Inc.
    26. Atila Abdulkadiroğlu & Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak, 2011. "Accountability and Flexibility in Public Schools: Evidence from Boston's Charters And Pilots," The Quarterly Journal of Economics, Oxford University Press, vol. 126(2), pages 699-748.
    27. Hsieh, Chang-Tai & Urquiola, Miguel, 2006. "The effects of generalized school choice on achievement and stratification: Evidence from Chile's voucher program," Journal of Public Economics, Elsevier, vol. 90(8-9), pages 1477-1503, September.
    28. Roland G. Fryer & Steven D. Levitt, 2004. "Understanding the Black-White Test Score Gap in the First Two Years of School," The Review of Economics and Statistics, MIT Press, vol. 86(2), pages 447-464, May.
    29. Jesse Rothstein, 2007. "Does Competition Among Public Schools Benefit Students and Taxpayers? Comment," American Economic Review, American Economic Association, vol. 97(5), pages 2026-2037, December.
    30. Caroline M. Hoxby & Sonali Murarka, 2009. "Charter Schools in New York City: Who Enrolls and How They Affect Their Students' Achievement," NBER Working Papers 14852, National Bureau of Economic Research, Inc.
    31. Christopher R. Geller & David L. Sjoquist & Mary Beth Walker, 2006. "The Effect of Private School Competition on Public School Performance in Georgia," Public Finance Review, , vol. 34(1), pages 4-32, January.
    32. Boumahid Rachid et Thomas Alban, 1997. "The returns to education," Papers 248, LIRHE - Universite des sciences sociales Toulouse.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Sorting through heterogeneity of impact to enhance policy learning
      by Jed Friedman in Development Impact on 2012-11-21 19:18:30

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joshua D. Angrist & Parag A. Pathak & Christopher R. Walters, 2013. "Explaining Charter School Effectiveness," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 1-27, October.
    2. Isabella Sulis & Mariano Porcu, 2015. "Assessing Divergences in Mathematics and Reading Achievement in Italian Primary Schools: A Proposal of Adjusted Indicators of School Effectiveness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 122(2), pages 607-634, June.
    3. Alain Trannoy, 2016. "Equality of Opportunity: A progress report," Revue d'économie politique, Dalloz, vol. 126(5), pages 621-651.
    4. John P. Papay & Richard J. Murnane & John B. Willett, 2014. "Income-based Inequality in Educational Outcomes: Learning from State Longitudinal Data Systems," NBER Working Papers 20802, National Bureau of Economic Research, Inc.
    5. Victor Lavy, 2012. "Expanding School Resources and Increasing Time on Task: Effects of a Policy Experiment in Israel on Student Academic Achievement and Behavior," NBER Working Papers 18369, National Bureau of Economic Research, Inc.
    6. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    7. Ana Inés Balsa & Alejandro Cid, 2016. "A randomized impact evaluation of a tuition-free private school targeting low income students in Uruguay," Journal of Applied Economics, Universidad del CEMA, vol. 19, pages 65-94, May.
    8. repec:mpr:mprres:8005 is not listed on IDEAS
    9. Kevin Booker & Brian Gill & Tim Sass & Ron Zimmer, "undated". "Charter High Schools' Effects on Long-Term Attainment and Earnings (Working Paper)," Mathematica Policy Research Reports cfe561a4b1924b7eafb64f918, Mathematica Policy Research.
    10. Estrada, Ricardo & Gignoux, Jérémie, 2017. "Benefits to elite schools and the expected returns to education: Evidence from Mexico City," European Economic Review, Elsevier, vol. 95(C), pages 168-194.
    11. Ebrahim Azimi & Jane Friesen & Simon Woodcock, 2023. "Private Schools and Student Achievement," Education Finance and Policy, MIT Press, vol. 18(4), pages 623-653, Fall.
    12. Joshua M. Cowen & Marcus A. Winters, 2013. "Do Charters Retain Teachers Differently? Evidence from Elementary Schools in Florida," Education Finance and Policy, MIT Press, vol. 8(1), pages 14-42, January.
    13. Will Dobbie & Roland G. Fryer, Jr, 2013. "The Medium-Term Impacts of High-Achieving Charter Schools on Non-Test Score Outcomes," NBER Working Papers 19581, National Bureau of Economic Research, Inc.
    14. repec:mpr:mprres:7927 is not listed on IDEAS
    15. Philip Oreopoulos & Robert S. Brown & Adam M. Lavecchia, 2017. "Pathways to Education: An Integrated Approach to Helping At-Risk High School Students," Journal of Political Economy, University of Chicago Press, vol. 125(4), pages 947-984.
    16. Joshua Goodman, 2014. "Flaking Out: Student Absences and Snow Days as Disruptions of Instructional Time," NBER Working Papers 20221, National Bureau of Economic Research, Inc.
    17. Regan-Stansfield, Joseph, 2018. "Does greater primary school autonomy improve pupil attainment? Evidence from primary school converter academies in England✰," Economics of Education Review, Elsevier, vol. 63(C), pages 167-179.
    18. Roland Fryer & Philipp Harms, 2018. "Two-Armed Restless Bandits with Imperfect Information: Stochastic Control and Indexability," Mathematics of Operations Research, INFORMS, vol. 43(2), pages 399-427, May.
    19. Roland G. Fryer, Jr. & Philipp Harms, 2013. "Two-Armed Restless Bandits with Imperfect Information: Stochastic Control and Indexability," NBER Working Papers 19043, National Bureau of Economic Research, Inc.
    20. Kertesi, Gábor & Kézdi, Gábor, 2012. "A roma és nem roma tanulók teszteredményei közti különbségekről és e különbségek okairól [The Roma/non-Roma test-score gap in Hungarian education]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(7), pages 798-853.
    21. Dennis Epple & Richard Romano & Ron Zimmer, 2015. "Charter Schools: A Survey of Research on Their Characteristics and Effectiveness," NBER Working Papers 21256, National Bureau of Economic Research, Inc.
    22. Julie Berry Cullen & Steven D. Levitt & Erin Robertson & Sally Sadoff, 2013. "What Can Be Done to Improve Struggling High Schools?," Journal of Economic Perspectives, American Economic Association, vol. 27(2), pages 133-152, Spring.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Friesen, Jane & Harris, Benjamin Cerf & Woodcock, Simon, 2013. "Open Enrolment and Student Achievement," CLSSRN working papers clsrn_admin-2013-46, Vancouver School of Economics, revised 22 Mar 2014.
    2. Song, Yang, 2019. "Sorting, school performance and quality: Evidence from China," Journal of Comparative Economics, Elsevier, vol. 47(1), pages 238-261.
    3. Masi, Barbara, 2018. "A ticket to ride: The unintended consequences of school transport subsidies," Economics of Education Review, Elsevier, vol. 63(C), pages 100-115.
    4. David Card & Martin D. Dooley & A. Abigail Payne, 2010. "School Competition and Efficiency with Publicly Funded Catholic Schools," American Economic Journal: Applied Economics, American Economic Association, vol. 2(4), pages 150-176, October.
    5. Filer, Randall K. & Münich, Daniel, 2013. "Responses of private and public schools to voucher funding," Economics of Education Review, Elsevier, vol. 34(C), pages 269-285.
    6. repec:hal:spmain:info:hdl:2441/1jgbspo1909q48svne93o55rca is not listed on IDEAS
    7. W. Bentley MacLeod & Miguel Urquiola, 2018. "Is Education Consumption or Investment? Implications for the Effect of School Competition," NBER Working Papers 25117, National Bureau of Economic Research, Inc.
    8. Alexis Le Chapelain, 2014. "Market for Education and Student Achievement," Sciences Po publications info:hdl:2441/1jgbspo1909, Sciences Po.
    9. Will Dobbie & Roland G. Fryer, Jr, 2009. "Are High Quality Schools Enough to Close the Achievement Gap? Evidence from a Social Experiment in Harlem," NBER Working Papers 15473, National Bureau of Economic Research, Inc.
    10. Roland G. Fryer, Jr, 2016. "The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments," NBER Working Papers 22130, National Bureau of Economic Research, Inc.
    11. Nicholas Bloom & Renata Lemos & Raffaella Sadun & John Van Reenen, 2015. "Does Management Matter in schools?," Economic Journal, Royal Economic Society, vol. 0(584), pages 647-674, May.
    12. Roland G. Fryer, Jr, 2011. "Injecting Successful Charter School Strategies into Traditional Public Schools: A Field Experiment in Houston," NBER Working Papers 17494, National Bureau of Economic Research, Inc.
    13. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    14. Calsamiglia, Caterina & Güell, Maia, 2014. "The Illusion of School Choice: Empirical Evidence from Barcelona," IZA Discussion Papers 8202, Institute of Labor Economics (IZA).
    15. Atila Abdulkadiroğlu & Joshua Angrist & Parag Pathak, 2014. "The Elite Illusion: Achievement Effects at Boston and New York Exam Schools," Econometrica, Econometric Society, vol. 82(1), pages 137-196, January.
    16. Will Dobbie & Roland G. Fryer, 2011. "Are High-Quality Schools Enough to Increase Achievement among the Poor? Evidence from the Harlem Children's Zone," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 158-187, July.
    17. Felipe Barrera-Osorio & Darío Maldonado & Catherine Rodríguez, 2012. "Calidad de la Educación Básica y Media en Colombia: Diagnóstico y Propuestas," Documentos CEDE 10321, Universidad de los Andes, Facultad de Economía, CEDE.
    18. Stephen Gibbons & Stephen Machin & Olmo Silva, 2008. "Choice, Competition, and Pupil Achievement," Journal of the European Economic Association, MIT Press, vol. 6(4), pages 912-947, June.
    19. Alexis Le Chapelain, 2014. "Market for education and student achievement [Marché de l’éducation et réussite scolaire]," SciencePo Working papers tel-03510563, HAL.
    20. Alexis Le Chapelain, 2014. "Market for education and student achievement [Marché de l’éducation et réussite scolaire]," SciencePo Working papers Main tel-03510563, HAL.
    21. Julie Berry Cullen & Steven D. Levitt & Erin Robertson & Sally Sadoff, 2013. "What Can Be Done to Improve Struggling High Schools?," Journal of Economic Perspectives, American Economic Association, vol. 27(2), pages 133-152, Spring.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • J10 - Labor and Demographic Economics - - Demographic Economics - - - General
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:17632. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.