IDEAS home Printed from https://ideas.repec.org/a/eee/pubeco/v106y2013icp57-67.html
   My bibliography  Save this article

A natural experiment in school accountability: The impact of school performance information on pupil progress

Author

Listed:
  • Burgess, Simon
  • Wilson, Deborah
  • Worth, Jack

Abstract

We test the hypothesis that the abolition of school performance tables negatively affects school effectiveness. Our data allow us to implement a classic difference-in-difference analysis comparing outcomes in England and Wales, before and after the abolition of the tables in Wales. We find significant and robust evidence that this reform markedly reduced school effectiveness in Wales relative to England. There is significant heterogeneity across schools: schools in the top quartile of the league tables show no effect. We also report that the reform had no systematic significant impact on either sorting by ability or by socioeconomic status.

Suggested Citation

  • Burgess, Simon & Wilson, Deborah & Worth, Jack, 2013. "A natural experiment in school accountability: The impact of school performance information on pupil progress," Journal of Public Economics, Elsevier, vol. 106(C), pages 57-67.
  • Handle: RePEc:eee:pubeco:v:106:y:2013:i:c:p:57-67
    DOI: 10.1016/j.jpubeco.2013.06.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047272713001291
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    2. Stephen G. Donald & Kevin Lang, 2007. "Inference with Difference-in-Differences and Other Panel Data," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 221-233, May.
    3. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    4. Machin, Stephen & McNally, Sandra, 2008. "The literacy hour," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1441-1462, June.
    5. Simon Burgess & Ellen Greaves & Anna Vignoles & Deborah Wilson, 2015. "What Parents Want: School Preferences and School Choice," Economic Journal, Royal Economic Society, vol. 125(587), pages 1262-1289, September.
    6. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    7. Lechner, Michael, 2011. "The Estimation of Causal Effects by Difference-in-Difference Methods," Foundations and Trends(R) in Econometrics, now publishers, vol. 4(3), pages 165-224, November.
    8. Derek Neal & Diane Whitmore Schanzenbach, 2010. "Left Behind by Design: Proficiency Counts and Test-Based Accountability," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 263-283, May.
    9. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, Oxford University Press, vol. 119(1), pages 249-275.
    10. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, Oxford University Press, vol. 114(2), pages 533-575.
    11. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, February.
    12. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    13. Propper Carol & Sutton Matt & Whitnall Carolyn & Windmeijer Frank, 2008. "Did 'Targets and Terror' Reduce Waiting Times in England for Hospital Care?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 8(2), pages 1-27, January.
    14. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, Oxford University Press, vol. 118(3), pages 843-877.
    15. Thomas S. Dee & Brian Jacob, 2011. "The impact of no Child Left Behind on student achievement," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 418-446, June.
    16. Eric A. Hanushek & Margaret E. Raymond, 2005. "Does school accountability lead to improved student performance?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(2), pages 297-327.
    17. Hansen, Christian B., 2007. "Asymptotic properties of a robust variance matrix estimator for panel data when T is large," Journal of Econometrics, Elsevier, vol. 141(2), pages 597-620, December.
    18. Simon Burgess & Carol Propper & Helen Slater & Deborah Wilson, 2005. "Who wins and who loses from school accountability? The distribution of educational gain in English secondary schools," The Centre for Market and Public Organisation 05/128, The Centre for Market and Public Organisation, University of Bristol, UK.
    19. Justine S. Hastings & Jeffrey M. Weinstein, 2008. "Information, School Choice, and Academic Achievement: Evidence from Two Experiments," The Quarterly Journal of Economics, Oxford University Press, vol. 123(4), pages 1373-1414.
    20. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, June.
    21. Mizala, Alejandra & Urquiola, Miguel, 2013. "School markets: The impact of information approximating schools' effectiveness," Journal of Development Economics, Elsevier, vol. 103(C), pages 313-335.
    22. Gwyn Bevan & Richard Hamblin, 2009. "Hitting and missing targets by ambulance services for emergency calls: effects of different systems of performance measurement within the UK," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 161-190, January.
    23. Propper, Carol & Sutton, Matt & Whitnall, Carolyn & Windmeijer, Frank, 2010. "Incentives and targets in hospital care: Evidence from a natural experiment," Journal of Public Economics, Elsevier, vol. 94(3-4), pages 318-335, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Beland, Louis-Philippe & Murphy, Richard, 2016. "Ill Communication: Technology, distraction & student performance," Labour Economics, Elsevier, vol. 41(C), pages 61-76.
    2. Joseph Regan-Stansfield, 2017. "The Impact of Standardised Testing on Later High Stakes Test Outcomes," Working Papers 161114030, Lancaster University Management School, Economics Department.
    3. Bergbauer, Annika B. & Hanushek, Eric A. & Woessmann, Ludger, 2018. "Testing," IZA Discussion Papers 11683, Institute of Labor Economics (IZA).
    4. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    5. Santosh Kumar & Ramona Molitor & Sebastian Vollmer, 2014. "Children of Drought: Rainfall Shocks and Early Child Health in Rural India," Working Papers 1407, Sam Houston State University, Department of Economics and International Business.
    6. Kim, Dongwoo & Koedel, Cory & Ni, Shawn & Podgursky, Michael, 2017. "Labor market frictions and production efficiency in public schools," Economics of Education Review, Elsevier, vol. 60(C), pages 54-67.
    7. Morozumi, Atsuyoshi & Tanaka, Ryuichi, 2020. "Should School-Level Results of National Assessments Be Made Public?," IZA Discussion Papers 13450, Institute of Labor Economics (IZA).
    8. Gjefsen, Hege Marie & Gunnes, Trude, 2016. "The effects of School Accountability on Teacher Mobility and Teacher Sorting," MPRA Paper 69664, University Library of Munich, Germany.
    9. Gerdes, Christer, 2015. "Does Performance Information Affect Job Seekers in Selecting Private Providers in Voucher-Based ALMP Programs?," IZA Discussion Papers 8992, Institute of Labor Economics (IZA).
    10. Carmen Aina & Massimiliano Bratti & Enrico Lippo, 2021. "Ranking high schools using university student performance in Italy," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(1), pages 293-321, April.
    11. Hege Marie Gjefsen & Trude Gunnes, 2015. "School accountability Incentives or sorting?," Discussion Papers 815, Statistics Norway, Research Department.
    12. Burgess, Simon, 2016. "Human Capital and Education: The State of the Art in the Economics of Education," IZA Discussion Papers 9885, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Roel Elk & Marc Steeg & Dinand Webbink, 2013. "Can Financial Incentives for Regional Education Authorities Reduce School Dropout?," De Economist, Springer, vol. 161(4), pages 367-398, December.
    3. Haeck, Catherine & Lefebvre, Pierre & Merrigan, Philip, 2014. "The distributional impacts of a universal school reform on mathematical achievements: A natural experiment from Canada," Economics of Education Review, Elsevier, vol. 41(C), pages 137-160.
    4. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    5. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    6. De Witte, Kristof & Geys, Benny & Solondz, Catharina, 2014. "Public expenditures, educational outcomes and grade inflation: Theory and evidence from a policy intervention in the Netherlands," Economics of Education Review, Elsevier, vol. 40(C), pages 152-166.
    7. Morozumi, Atsuyoshi & Tanaka, Ryuichi, 2020. "Should School-Level Results of National Assessments Be Made Public?," IZA Discussion Papers 13450, Institute of Labor Economics (IZA).
    8. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    9. Hagemann, Andreas, 2019. "Placebo inference on treatment effects when the number of clusters is small," Journal of Econometrics, Elsevier, vol. 213(1), pages 190-209.
    10. Sansone, Dario, 2019. "Pink work: Same-sex marriage, employment and discrimination," Journal of Public Economics, Elsevier, vol. 180(C).
    11. Gudibande, Rohan Ravindra & Jacob, Arun, 2020. "Minimum wages for domestic workers: impact evaluation of the Indian experience," World Development, Elsevier, vol. 130(C).
    12. María Alzúa & Guillermo Cruces & Laura Ripani, 2013. "Welfare programs and labor supply in developing countries: experimental evidence from Latin America," Journal of Population Economics, Springer;European Society for Population Economics, vol. 26(4), pages 1255-1284, October.
    13. Guido Neidhöfer & Miguel Niño‐Zarazúa, 2019. "The Long(er)‐Term Impacts of Chile Solidario on Human Capital and Labor Income," Population and Development Review, The Population Council, Inc., vol. 45(S1), pages 209-244, December.
    14. Michael Hellwig & Dominik Schober & Luis Cabral, 2018. "Incentive Regulation: Evidence From German Electricity Networks," Working Papers 18-03, New York University, Leonard N. Stern School of Business, Department of Economics.
    15. Herrero Prieto, Luis César, 2009. "La investigación en economía de la cultura en España: un estudio bibliométrico/Research in Cultural Economics in Spain: A Bibliometric Study," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 27, pages 35-62, Abril.
    16. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    17. Goldbach, Stefan & Nagengast, Arne J. & Steinmüller, Elias & Wamser, Georg, 2019. "The effect of investing abroad on investment at home: On the role of technology, tax savings, and internal capital markets," Journal of International Economics, Elsevier, vol. 116(C), pages 58-73.
    18. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    19. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    20. Cuesta, José Ignacio & González, Felipe & Larroulet Philippi, Cristian, 2020. "Distorted quality signals in school markets," Journal of Development Economics, Elsevier, vol. 147(C).

    More about this item

    Keywords

    School accountability; School effectiveness; Performance tables;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:pubeco:v:106:y:2013:i:c:p:57-67. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Nithya Sathishkumar). General contact details of provider: http://www.elsevier.com/locate/inca/505578 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.