IDEAS home Printed from https://ideas.repec.org/a/eee/pubeco/v110y2014icp124-146.html
   My bibliography  Save this article

Incentives and responses under No Child Left Behind: Credible threats and the role of competition

Author

Listed:
  • Chakrabarti, Rajashri

Abstract

NCLB mandated the institution of Adequate Yearly Progress (AYP) objectives, and schools are assigned an AYP pass/fail based on performance in these objectives. AYP-fail status is associated with negative publicity and often sanctions. Using data from Wisconsin and alternate regression discontinuity designs, I study the incentives and responses of schools that failed AYP once. Math-induced AYP-failures showed strong improvements in math, while reading-induced AYP-failures showed marked improvements in reading. Consistent with incentives, these schools showed no positive effect in other high stakes objectives. In contrast, test-participation failures showed no effect in either high stakes reading or math, while they showed some evidence of positive (though not statistically significant) effects in test participation. Improvements in reading are associated with parallel effects in low stakes language arts (possibly due to spillover effects), while there is no evidence of effects in low stakes science or social studies. Nor is there evidence of effects on graduation rates. Performance in low stakes grades suffered, and so did performance in weaker subgroups in spite of their inclusion in AYP computations. There is evidence of focus on marginal students around high stakes cutoffs in subject areas AYP-failed schools improved in, but this did not come at the expense of ends. Credibility of threat mattered—AYP-failed schools that faced more competition responded considerably more strongly in the objectives they had incentives in.

Suggested Citation

  • Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
  • Handle: RePEc:eee:pubeco:v:110:y:2014:i:c:p:124-146
    DOI: 10.1016/j.jpubeco.2013.08.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047272713001643
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jpubeco.2013.08.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Caroline Minter Hoxby, 2003. "School Choice and School Productivity. Could School Choice Be a Tide that Lifts All Boats?," NBER Chapters, in: The Economics of School Choice, pages 287-342, National Bureau of Economic Research, Inc.
    2. Figlio, David N. & Rouse, Cecilia Elena, 2006. "Do accountability and voucher threats improve low-performing schools?," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 239-255, January.
    3. Alan I. Barreca & Jason M. Lindo & Glen R. Waddell, 2016. "Heaping-Induced Bias In Regression-Discontinuity Designs," Economic Inquiry, Western Economic Association International, vol. 54(1), pages 268-293, January.
    4. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    5. Caroline M. Hoxby, 2003. "The Economics of School Choice," NBER Books, National Bureau of Economic Research, Inc, number hox03-1, January.
    6. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    7. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    8. Thomas S. Dee & Brian Jacob, 2011. "The impact of no Child Left Behind on student achievement," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 418-446, June.
    9. Chakrabarti Rajashri, 2013. "Impact of Voucher Design on Public School Performance: Evidence from Florida and Milwaukee Voucher Programs," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 14(1), pages 349-394, July.
    10. Marigee Bacolod & John DiNardo & Mireille Jacobson, 2012. "Beyond Incentives: Do Schools Use Accountability Rewards Productively?," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 149-163.
    11. Chakrabarti, Rajashri, 2008. "Can increasing private school participation and monetary loss in a voucher program affect public school performance? Evidence from Milwaukee," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1371-1393, June.
    12. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    13. Martin R. West & Paul E. Peterson, 2006. "The Efficacy of Choice Threats Within School Accountability Systems: Results from Legislatively Induced Experiments," Economic Journal, Royal Economic Society, vol. 116(510), pages 46-62, March.
    14. Jonah Rockoff & Lesley J. Turner, 2010. "Short-Run Impacts of Accountability on School Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 2(4), pages 119-147, November.
    15. Julie Berry Cullen & Randall Reback, 2006. "Tinkering Toward Accolades: School Gaming Under a Performance Accountability System," NBER Working Papers 12286, National Bureau of Economic Research, Inc.
    16. Chakrabarti Rajashri, 2013. "Impact of Voucher Design on Public School Performance: Evidence from Florida and Milwaukee Voucher Programs," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 13(1), pages 349-394, January.
    17. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    18. John M. Krieg, 2008. "Are Students Left Behind? The Distributional Effects of the No Child Left Behind Act," Education Finance and Policy, MIT Press, vol. 3(2), pages 250-281, April.
    19. Hanley Chiang, "undated". "How Accountability Pressure on Failing Schools Affects Student Achievement," Mathematica Policy Research Reports c58a3b537e324447b94a2bd41, Mathematica Policy Research.
    20. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    21. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    22. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    23. Derek Neal & Diane Whitmore Schanzenbach, 2010. "Left Behind by Design: Proficiency Counts and Test-Based Accountability," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 263-283, May.
    24. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    25. Springer, Matthew G., 2008. "The influence of an NCLB accountability plan on the distribution of student test score gains," Economics of Education Review, Elsevier, vol. 27(5), pages 556-563, October.
    26. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    27. Randall Reback & Jonah Rockoff & Heather L. Schwartz, 2011. "Under Pressure: Job Security, Resource Allocation, and Productivity in Schools Under NCLB," NBER Working Papers 16745, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Seth Gershenson, 2016. "Performance Standards and Employee Effort: Evidence From Teacher Absences," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(3), pages 615-638, June.
    2. Gregg, John J. & Lavertu, Stéphane, 2023. "Test-based accountability and educational equity: Breaking through local district politics?," Economics of Education Review, Elsevier, vol. 97(C).
    3. Richard Murphy & Felix Weinhardt, 2020. "Top of the Class: The Importance of Ordinal Rank," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(6), pages 2777-2826.
    4. Tom Ahn & Jacob L. Vigdor, 2021. "When Incentives Matter Too Much: Explaining Significant Responses to Irrelevant Information," Journal of Human Capital, University of Chicago Press, vol. 15(4), pages 629-664.
    5. Machado, Anaely & Terra, Rafael & Tannuri-Pianto, Maria, 2024. "Higher education responses to accountability," Economics of Education Review, Elsevier, vol. 98(C).
    6. Seth Gershenson & Stephen B. Holt & Nicholas Papageorge, 2015. "Who Believes in Me? The Effect of Student-Teacher Demographic Match on Teacher Expectations," Upjohn Working Papers 15-231, W.E. Upjohn Institute for Employment Research.
    7. Cook, Jason B., 2018. "The effect of charter competition on unionized district revenues and resource allocation," Journal of Public Economics, Elsevier, vol. 158(C), pages 48-62.
    8. Patricia M. Anderson & Kristin F. Butcher & Diane Whitmore Schanzenbach, 2017. "Adequate (or Adipose?) Yearly Progress: Assessing the Effect of “No Child Left Behind” on Children's Obesity," Education Finance and Policy, MIT Press, vol. 12(1), pages 54-76, Winter.
    9. Rajashri Chakrabarti & Nicole Gorton & Joydeep Roy, 2018. "Getting ahead by spending more? Local community response to state merit aid programs," Staff Reports 872, Federal Reserve Bank of New York.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    2. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    3. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    4. Patricia M. Anderson & Kristin F. Butcher & Diane Whitmore Schanzenbach, 2017. "Adequate (or Adipose?) Yearly Progress: Assessing the Effect of “No Child Left Behind” on Children's Obesity," Education Finance and Policy, MIT Press, vol. 12(1), pages 54-76, Winter.
    5. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    6. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    7. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    8. Michael Coelli & Gigi Foster & Andrew Leigh, 2018. "Do School Principals Respond to Increased Public Scrutiny? New Survey Evidence from Australia," The Economic Record, The Economic Society of Australia, vol. 94(S1), pages 73-101, June.
    9. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    10. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    11. Sims, David P., 2013. "Can failure succeed? Using racial subgroup rules to analyze the effect of school accountability failure on student performance," Economics of Education Review, Elsevier, vol. 32(C), pages 262-274.
    12. Evan Riehl & Meredith Welch, 2023. "Accountability, Test Prep Incentives, and the Design of Math and English Exams," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 60-96, January.
    13. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    14. Filer, Randall K. & Münich, Daniel, 2013. "Responses of private and public schools to voucher funding," Economics of Education Review, Elsevier, vol. 34(C), pages 269-285.
    15. Hemelt, Steven W., 2011. "Performance effects of failure to make Adequate Yearly Progress (AYP): Evidence from a regression discontinuity framework," Economics of Education Review, Elsevier, vol. 30(4), pages 702-723, August.
    16. Lau, Christopher V., 2020. "Are federal student loan accountability regulations effective?," Economics of Education Review, Elsevier, vol. 75(C).
    17. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    18. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    19. Cuesta, José Ignacio & González, Felipe & Larroulet Philippi, Cristian, 2020. "Distorted quality signals in school markets," Journal of Development Economics, Elsevier, vol. 147(C).
    20. Gregg, John J. & Lavertu, Stéphane, 2023. "Test-based accountability and educational equity: Breaking through local district politics?," Economics of Education Review, Elsevier, vol. 97(C).

    More about this item

    Keywords

    No Child Left Behind; Incentives; Public school performance; Regression discontinuity;
    All these keywords.

    JEL classification:

    • H4 - Public Economics - - Publicly Provided Goods
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:pubeco:v:110:y:2014:i:c:p:124-146. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505578 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.