IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/11597.html
   My bibliography  Save this paper

Do Accountability and Voucher Threats Improve Low-Performing Schools?

Author

Listed:
  • David N. Figlio
  • Cecilia Rouse

Abstract

In this paper we study the effects of the threat of school vouchers and school stigma in Florida on the performance of "low-performing" schools using student-level data from a subset of districts. Estimates of the change in school-level high-stakes test scores from the first year of the reform are consistent with the early results used by the state of Florida to claim large-scale improvements associated with the threat of voucher assignment. However, we also find that much of this estimated effect may be due to other factors. While we estimate a small relative improvement in reading scores on the high-stakes test for voucher-threatened/stigmatized schools, we estimate a much smaller relative improvement on a lower-stakes, nationally norm-referenced, test. Further, the relative gains in reading scores are explained largely by changing student characteristics. We find more evidence for a positive differential effect on math test scores on both the low- and highstakes tests, however, the results from the lower-stakes test appear primarily limited to students in the high-stakes grade. Finally, we find some evidence that the relative improvements following the introduction of the A Plan by low-performing schools were more due to the stigma of receiving the low grade rather than the threat of vouchers.

Suggested Citation

  • David N. Figlio & Cecilia Rouse, 2005. "Do Accountability and Voucher Threats Improve Low-Performing Schools?," NBER Working Papers 11597, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:11597
    Note: CH ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w11597.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Frey, Donald E., 1992. "Can privatizing education really improve achievement? An essay review," Economics of Education Review, Elsevier, vol. 11(4), pages 427-438, December.
    2. David N. Figlio & Maurice E. Lucas, 2004. "What's in a Grade? School Report Cards and the Housing Market," American Economic Review, American Economic Association, vol. 94(3), pages 591-604, June.
    3. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    4. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    5. Julie Berry Cullen & Randall Reback, 2006. "Tinkering Toward Accolades: School Gaming Under a Performance Accountability System," NBER Working Papers 12286, National Bureau of Economic Research, Inc.
    6. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    7. Cecilia Elena Rouse, 1998. "Private School Vouchers and Student Achievement: An Evaluation of the Milwaukee Parental Choice Program," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(2), pages 553-602.
    8. Griliches, Zvi, 1977. "Estimating the Returns to Schooling: Some Econometric Problems," Econometrica, Econometric Society, vol. 45(1), pages 1-22, January.
    9. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    10. Eric A. Hanushek & Margaret E. Raymond, 2002. "Improving educational quality: how best to evaluate our schools," Conference Series ; [Proceedings], Federal Reserve Bank of Boston, vol. 47(Jun), pages 193-247.
    11. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    12. Figlio, David N. & Rouse, Cecilia Elena, 2006. "Do accountability and voucher threats improve low-performing schools?," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 239-255, January.
    13. Krueger, Alan B. & Zhu, Pei, 2002. "Another Look at the New York City School Voucher Experiment," IZA Discussion Papers 663, Institute of Labor Economics (IZA).
    14. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    15. Melissa A. Clark, "undated". "Education Reform, Redistribution, and Student Achievement: Evidence from the Kentucky Education Reform Act," Mathematica Policy Research Reports 80c79eb4bd384723b5e7da0c9, Mathematica Policy Research.
    16. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    17. Paul Peterson & William Howell & Patrick J. Wolf & David Campbell, 2003. "School Vouchers. Results from Randomized Experiments," NBER Chapters, in: The Economics of School Choice, pages 107-144, National Bureau of Economic Research, Inc.
    18. David N. Figlio & Lawrence S. Getzler, 2002. "Accountability , Ability and Disability: Gaming the System," NBER Working Papers 9307, National Bureau of Economic Research, Inc.
    19. Brian A. Jacob, 2002. "Accountability, Incentives and Behavior: The Impact of High-Stakes Testing in the Chicago Public Schools," NBER Working Papers 8968, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    2. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    3. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    4. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    5. Rezende, Marcelo, 2010. "The effects of accountability on higher education," Economics of Education Review, Elsevier, vol. 29(5), pages 842-856, October.
    6. Patricia M. Anderson & Kristin F. Butcher & Diane Whitmore Schanzenbach, 2017. "Adequate (or Adipose?) Yearly Progress: Assessing the Effect of “No Child Left Behind” on Children's Obesity," Education Finance and Policy, MIT Press, vol. 12(1), pages 54-76, Winter.
    7. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    8. Brian A. Jacob, 2007. "Test-Based Accountability and Student Achievement: An Investigation of Differential Performance on NAEP and State Assessments," NBER Working Papers 12817, National Bureau of Economic Research, Inc.
    9. Cuesta, José Ignacio & González, Felipe & Larroulet Philippi, Cristian, 2020. "Distorted quality signals in school markets," Journal of Development Economics, Elsevier, vol. 147(C).
    10. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    11. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    12. Bertoni, Marco & Brunello, Giorgio & Rocco, Lorenzo, 2013. "When the cat is near, the mice won't play: The effect of external examiners in Italian schools," Journal of Public Economics, Elsevier, vol. 104(C), pages 65-77.
    13. Joydeep Roy, 2011. "Impact of School Finance Reform on Resource Equalization and Academic Performance: Evidence from Michigan," Education Finance and Policy, MIT Press, vol. 6(2), pages 137-167, April.
    14. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    15. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    16. Colleen Donovan & David N. Figlio & Mark Rush, 2006. "Cramming: The Effects of School Accountability on College-Bound Students," NBER Working Papers 12628, National Bureau of Economic Research, Inc.
    17. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    18. Michael Coelli & Gigi Foster & Andrew Leigh, 2018. "Do School Principals Respond to Increased Public Scrutiny? New Survey Evidence from Australia," The Economic Record, The Economic Society of Australia, vol. 94(S1), pages 73-101, June.
    19. Brian A. Jacob, 2002. "Accountability, Incentives and Behavior: The Impact of High-Stakes Testing in the Chicago Public Schools," NBER Working Papers 8968, National Bureau of Economic Research, Inc.
    20. Evan Riehl & Meredith Welch, 2023. "Accountability, Test Prep Incentives, and the Design of Math and English Exams," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 60-96, January.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:11597. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.