IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/23461.html
   My bibliography  Save this paper

Differentiated Accountability and Education Production: Evidence from NCLB Waivers

Author

Listed:
  • Steven W. Hemelt
  • Brian Jacob

Abstract

In 2011, the U.S. Department of Education granted states the opportunity to apply for waivers from the core requirements of No Child Left Behind (NCLB). In exchange, states implemented systems of differentiated accountability in which they identified and intervened in their lowest-performing schools (“Priority” schools) and schools with the largest achievement gaps between subgroups of students (“Focus” schools). We use administrative data from Michigan in a series of regression-discontinuity analyses to study the effects of these reforms on schools and students. Overall, we find that neither reform had appreciable impacts on various measures of school staffing, student composition, or academic achievement. We find some evidence that the Focus designation led to small, short-run reductions in the within-school math achievement gap – but that these reductions were driven by stagnant performance of lower-achieving students alongside declines in the performance of their higher-achieving peers. These findings serve as a cautionary tale for the capacity of the accountability provisions embedded in the recent reauthorization of NCLB, the Every Student Succeeds Act (ESSA), to meaningfully improve student and school outcomes.

Suggested Citation

  • Steven W. Hemelt & Brian Jacob, 2017. "Differentiated Accountability and Education Production: Evidence from NCLB Waivers," NBER Working Papers 23461, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:23461
    Note: CH ED LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w23461.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Robert Bifulco & William Duncombe & John Yinger, 2005. "Does whole-school reform boost student performance? The case of New York City," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(1), pages 47-72.
    2. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust data-driven inference in the regression-discontinuity design," Stata Journal, StataCorp LP, vol. 14(4), pages 909-946, December.
    3. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    4. Thomas S. Dee & Brian Jacob, 2011. "The impact of no Child Left Behind on student achievement," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 418-446, June.
    5. Sade Bonilla & Thomas S. Dee, 2020. "The Effects of School Reform under NCLB Waivers: Evidence from Focus Schools in Kentucky," Education Finance and Policy, MIT Press, vol. 15(1), pages 75-103, Winter.
    6. Stephanie Riegg Cellini & Fernando Ferreira & Jesse Rothstein, 2010. "The Value of School Facility Investments: Evidence from a Dynamic Regression Discontinuity Design," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 215-261.
    7. Sebastian Calonico & Matias D. Cattaneo & Rocío Titiunik, 2015. "Optimal Data-Driven Regression Discontinuity Plots," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1753-1769, December.
    8. Thomas Dee & Elise Dizon-Ross, 2017. "School Performance, Accountability and Waiver Reforms: Evidence from Louisiana," NBER Working Papers 23463, National Bureau of Economic Research, Inc.
    9. Thomas Dee, 2012. "School Turnarounds: Evidence from the 2009 Stimulus," NBER Working Papers 17990, National Bureau of Economic Research, Inc.
    10. David J. Deming & Sarah Cohodes & Jennifer Jennings & Christopher Jencks, 2016. "School Accountability, Postsecondary Attainment, and Earnings," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 848-862, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sade Bonilla & Thomas S. Dee, 2020. "The Effects of School Reform under NCLB Waivers: Evidence from Focus Schools in Kentucky," Education Finance and Policy, MIT Press, vol. 15(1), pages 75-103, Winter.
    2. Steven W. Hemelt & Brian A. Jacob, 2020. "How Does an Accountability Program that Targets Achievement Gaps Affect Student Performance?," Education Finance and Policy, MIT Press, vol. 15(1), pages 45-74, Winter.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steven W. Hemelt & Brian A. Jacob, 2020. "How Does an Accountability Program that Targets Achievement Gaps Affect Student Performance?," Education Finance and Policy, MIT Press, vol. 15(1), pages 45-74, Winter.
    2. Sade Bonilla & Thomas S. Dee, 2020. "The Effects of School Reform under NCLB Waivers: Evidence from Focus Schools in Kentucky," Education Finance and Policy, MIT Press, vol. 15(1), pages 75-103, Winter.
    3. Thomas Dee & Elise Dizon-Ross, 2017. "School Performance, Accountability and Waiver Reforms: Evidence from Louisiana," NBER Working Papers 23463, National Bureau of Economic Research, Inc.
    4. Mellace, Giovanni & Ventura, Marco, 2019. "Intended and unintended effects of public incentives for innovation. Quasi-experimental evidence from Italy," Discussion Papers on Economics 9/2019, University of Southern Denmark, Department of Economics.
    5. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    6. Chu, Yu-Wei Luke & Cuffe, Harold E, 2020. "Do Struggling Students Benefit From Continued Student Loan Access? Evidence From University and Beyond," Working Paper Series 21067, Victoria University of Wellington, School of Economics and Finance.
    7. Deng, Guoying & Gan, Li & Hernandez, Manuel A., 2015. "Do natural disasters cause an excessive fear of heights? Evidence from the Wenchuan earthquake," Journal of Urban Economics, Elsevier, vol. 90(C), pages 79-89.
    8. Brachert, Matthias, 2018. "The regional effects of professional sports franchises: Causal evidence from four European football leagues," IWH Discussion Papers 10/2018, Halle Institute for Economic Research (IWH).
    9. Peter Ganong & Simon Jäger, 2018. "A Permutation Test for the Regression Kink Design," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 494-504, April.
    10. Nene Oumou & Jonathan Goyette, 2016. "Can microcredit impact the activity of small and medium enterprises? New evidence from a Regression Discontinuity Design in Panama," Cahiers de recherche 16-05, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    11. Michael Hillebrecht & Stefan Klonner & Rainer Sauerborn & Alie Sié & Aurélia Souares, 2021. "The Demand for Health Insurance in a Poor Economy: Evidence from Burkina Faso," Economic Development and Cultural Change, University of Chicago Press, vol. 69(4), pages 1273-1300.
    12. Fang, Hongsheng & Su, Yunqing & Lu, Weijun, 2022. "Tax incentive and corporate financial performance: Evidence from income tax revenue sharing reform in China," Journal of Asian Economics, Elsevier, vol. 81(C).
    13. Powdthavee, Nattavudh, 2020. "The Causal Effect of Education on Climate Literacy and Pro-Environmental Behaviours: Evidence from a Nationwide Natural Experiment," IZA Discussion Papers 13210, Institute of Labor Economics (IZA).
    14. Cappelletti, Giuseppe & Ponte Marques, Aurea & Salleo, Carmelo & Martín, Diego Vila, 2020. "How do banking groups react to macroprudential policies? Cross-border spillover effects of higher capital buffers on lending, risk-taking and internal markets," Working Paper Series 2497, European Central Bank.
    15. David M. Brasington, 2022. "Cutting Funding for Police Protection: The Consequences for the Size of Newly-Constructed Housing," The Journal of Real Estate Finance and Economics, Springer, vol. 65(4), pages 549-571, November.
    16. Jones, Daniel B. & Zhan, Crystal, 2020. "Ethnic diversity and citizens’ support for local public good provision: Evidence from California parcel tax elections," Journal of Economic Behavior & Organization, Elsevier, vol. 174(C), pages 108-130.
    17. Mellace, Giovanni & Ventura, Marco, 2023. "The short-run effects of public incentives for innovation in Italy," Economic Modelling, Elsevier, vol. 120(C).
    18. Powdthavee, Nattavudh, 2021. "Education and pro-environmental attitudes and behaviours: A nonparametric regression discontinuity analysis of a major schooling reform in England and Wales," Ecological Economics, Elsevier, vol. 181(C).
    19. Burgherr, David, 2022. "Behavioral Responses to a Pension Savings Mandate : Quasi-experimental Evidence from Swiss Tax Data," CAGE Online Working Paper Series 645, Competitive Advantage in the Global Economy (CAGE).
    20. de Gendre, Alexandra & Lynch, John & Meunier, Aurélie & Pilkington, Rhiannon & Schurer, Stefanie, 2021. "Child Health and Parental Responses to an Unconditional Cash Transfer at Birth," IZA Discussion Papers 14693, Institute of Labor Economics (IZA).

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General
    • J08 - Labor and Demographic Economics - - General - - - Labor Economics Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:23461. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.