IDEAS home Printed from https://ideas.repec.org/a/spr/sochwe/v46y2016i2p359-387.html
   My bibliography  Save this article

School accountability: can we reward schools and avoid pupil selection?

Author

Listed:
  • Erwin Ooghe
  • Erik Schokkaert

Abstract

School accountability schemes require measures of school performance, and these measures are in practice often based on pupil test scores. It is well-known that insufficiently correcting these test scores for pupil characteristics may provide incentives for pupil selection. Building further on results from the theory of fair allocation, we show that the trade-off between reward and pupil selection is not only a matter of sufficient information. A school accountability scheme that rewards school performance will create incentives for pupil selection, even under perfect information, unless the educational production function satisfies an (unrealistic) separability assumption. We propose different compromise solutions and discuss the resulting incentives in theory. The empirical relevance of our analysis—i.e., the rejection of the separability assumption and the magnitude of the incentives in the different compromise solutions—is illustrated with Flemish data. The traditional value-added model turns out to be an acceptable compromise. Copyright Springer-Verlag Berlin Heidelberg 2016

Suggested Citation

  • Erwin Ooghe & Erik Schokkaert, 2016. "School accountability: can we reward schools and avoid pupil selection?," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 46(2), pages 359-387, February.
  • Handle: RePEc:spr:sochwe:v:46:y:2016:i:2:p:359-387
    DOI: 10.1007/s00355-015-0917-0
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00355-015-0917-0
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s00355-015-0917-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Schokkaert, Erik & Van de Voorde, Carine, 2009. "Direct versus indirect standardization in risk adjustment," Journal of Health Economics, Elsevier, vol. 28(2), pages 361-374, March.
    2. Hausman, Jerry A & Wise, David A, 1979. "Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment," Econometrica, Econometric Society, vol. 47(2), pages 455-473, March.
    3. Gadi Barlevy & Derek Neal, 2012. "Pay for Percentile," American Economic Review, American Economic Association, vol. 102(5), pages 1805-1831, August.
    4. Figlio, David N. & Rouse, Cecilia Elena, 2006. "Do accountability and voucher threats improve low-performing schools?," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 239-255, January.
    5. Burgess, Simon & Propper, Carol & Wilson, Deborah & Slater, Helen, 2005. "Who wins and who loses from school accountability? The distribution of educational gain in English secondary schools," CEPR Discussion Papers 5248, C.E.P.R. Discussion Papers.
    6. Schokkaert, Erik & Van de Voorde, Carine, 2004. "Risk selection and the specification of the conventional risk adjustment formula," Journal of Health Economics, Elsevier, vol. 23(6), pages 1237-1259, November.
    7. Verbeek, Marno & Nijman, Theo, 1992. "Testing for Selectivity Bias in Panel Data Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(3), pages 681-703, August.
    8. Thomas J. Kane & Douglas O. Staiger, 2002. "The Promise and Pitfalls of Using Imprecise School Accountability Measures," Journal of Economic Perspectives, American Economic Association, vol. 16(4), pages 91-114, Fall.
    9. Peter Arcidiacono & Cory Koedel, 2014. "Race and College Success: Evidence from Missouri," American Economic Journal: Applied Economics, American Economic Association, vol. 6(3), pages 20-57, July.
    10. Lefranc, Arnaud & Pistolesi, Nicolas & Trannoy, Alain, 2009. "Equality of opportunity and luck: Definitions and testable conditions, with an application to income in France," Journal of Public Economics, Elsevier, vol. 93(11-12), pages 1189-1207, December.
    11. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    12. Mundlak, Yair, 1978. "On the Pooling of Time Series and Cross Section Data," Econometrica, Econometric Society, vol. 46(1), pages 69-85, January.
    13. Eric A. Hanushek & Margaret E. Raymond, 2005. "Does school accountability lead to improved student performance?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(2), pages 297-327.
    14. Fleurbaey, Marc, 2012. "Fairness, Responsibility, and Welfare," OUP Catalogue, Oxford University Press, number 9780199653591.
    15. Nijman, T.E. & Verbeek, M.J.C.M., 1992. "Testing for selectivity in panel data models," Other publications TiSEM 7ec34a6c-1d84-4052-971c-d, Tilburg University, School of Economics and Management.
    16. Martin R. West & Paul E. Peterson, 2006. "The Efficacy of Choice Threats Within School Accountability Systems: Results from Legislatively Induced Experiments," Economic Journal, Royal Economic Society, vol. 116(510), pages 46-62, March.
    17. Dennis Epple & Richard Romano, 2008. "Educational Vouchers And Cream Skimming," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 49(4), pages 1395-1435, November.
    18. Wooldridge, Jeffrey M., 1995. "Selection corrections for panel data models under conditional mean independence assumptions," Journal of Econometrics, Elsevier, vol. 68(1), pages 115-132, July.
    19. repec:mpr:mprres:6364 is not listed on IDEAS
    20. John Cawley & James Heckman & Edward Vytlacil, 1999. "On Policies To Reward The Value Added By Educators," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 720-727, November.
    21. Ladd, Helen F. & Walsh, Randall P., 2002. "Implementing value-added measures of school effectiveness: getting the incentives right," Economics of Education Review, Elsevier, vol. 21(1), pages 1-17, February.
    22. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 1, number 1, June.
    23. Jim Taylor & Anh Ngoc Nguyen, 2006. "An Analysis of the Value Added by Secondary Schools in England: Is the Value Added Indicator of Any Value?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 68(2), pages 203-224, April.
    24. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 2, number 2, June.
    25. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    26. Eric A. Hanushek & Margaret E. Raymond, 2004. "The Effect of School Accountability Systems on the Level and Distribution of Student Achievement," Journal of the European Economic Association, MIT Press, vol. 2(2-3), pages 406-415, 04/05.
    27. Semykina, Anastasia & Wooldridge, Jeffrey M., 2010. "Estimating panel data models in the presence of endogeneity and selection," Journal of Econometrics, Elsevier, vol. 157(2), pages 375-380, August.
    28. Meyer, Robert H., 1997. "Value-added indicators of school performance: A primer," Economics of Education Review, Elsevier, vol. 16(3), pages 283-301, June.
    29. Erik Schokkaert & Geert Dhaene & Carine Van De Voorde, 1998. "Risk adjustment and the trade‐off between efficiency and risk selection: an application of the theory of fair compensation," Health Economics, John Wiley & Sons, Ltd., vol. 7(5), pages 465-480, August.
    30. Hanley Chiang, "undated". "How Accountability Pressure on Failing Schools Affects Student Achievement," Mathematica Policy Research Reports c58a3b537e324447b94a2bd41, Mathematica Policy Research.
    31. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    32. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    2. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    3. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    4. Ludger Wößmann, 2008. "Efficiency and equity of European education and training policies," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 15(2), pages 199-230, April.
    5. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    6. Sims, David P., 2013. "Can failure succeed? Using racial subgroup rules to analyze the effect of school accountability failure on student performance," Economics of Education Review, Elsevier, vol. 32(C), pages 262-274.
    7. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    8. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    9. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    10. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    11. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    12. Derek Neal, 2011. "The Design of Performance Pay in Education," NBER Working Papers 16710, National Bureau of Economic Research, Inc.
    13. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    14. Hemelt, Steven W., 2011. "Performance effects of failure to make Adequate Yearly Progress (AYP): Evidence from a regression discontinuity framework," Economics of Education Review, Elsevier, vol. 30(4), pages 702-723, August.
    15. Hege Marie Gjefsen & Trude Gunnes, 2015. "School accountability Incentives or sorting?," Discussion Papers 815, Statistics Norway, Research Department.
    16. Diane Whitmore Schanzenbach, 2015. "Current themes in education policy in the United States," Chapters, in: John Karl Scholz & Hyungypo Moon & Sang-Hyup Lee (ed.), Social Policies in an Age of Austerity, chapter 7, pages 165-180, Edward Elgar Publishing.
    17. Evan Riehl & Meredith Welch, 2023. "Accountability, Test Prep Incentives, and the Design of Math and English Exams," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 60-96, January.
    18. Michael Coelli & Gigi Foster & Andrew Leigh, 2018. "Do School Principals Respond to Increased Public Scrutiny? New Survey Evidence from Australia," The Economic Record, The Economic Society of Australia, vol. 94(S1), pages 73-101, June.
    19. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    20. Ludger Wößmann, 2006. "Bildungspolitische Lehren aus den internationalen Schülertests: Wettbewerb, Autonomie und externe Leistungsüberprüfung," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 7(3), pages 417-444, August.

    More about this item

    JEL classification:

    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:sochwe:v:46:y:2016:i:2:p:359-387. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.