IDEAS home Printed from https://ideas.repec.org/p/cpb/discus/149.html
   My bibliography  Save this paper

School responsiveness to quality ranking: An empirical analysis of secondary education in the Netherlands

Author

Listed:
  • Pierre Koning
  • Karen van der Wiel

Abstract

As from 1997, the national newspaper Trouw has published quality scores of secondary schools in every year, using information of the schools inspectorate on, amongst other things, the average grades at the final examinations and the throughput of pupils in lower forms. How do schools respond to the publication of the rankings? As from 1997, the national newspaper Trouw has published quality scores of secondary schools in every year, using information of the schools inspectorate on, amongst other things, the average grades at the final examinations and the throughput of pupils in lower forms. How do schools respond to the publication of the rankings? We contribute to the literature in two respects. First, the current analysis is the first to address the impact of quality scores that have been published by a newspaper (Trouw), rather than public interventions that aim to track and improve failing schools. Second, our research design exploits the substantial lags in the registration and publication of the Trouw scores and takes into account all possible outcomes of the ratings, instead of the lowest category only. Overall, we find evidence that school quality performance does respond to the Trouw quality scores. Both average grades increase and the number of diplomas go up after receiving a negative score. These responses cannot be attributed to gaming activities of the school board, as an improvement is also observed in the gaming-proof quality indicators. For schools that receive the most negative ranking, the short-term effects (one year after a change in the ranking of schools) of quality transparency on final exam grades equal 10% to 30% of a standard deviation compared to the average of this variable. The long-run effects are roughly equal to the short-term effects.

Suggested Citation

  • Pierre Koning & Karen van der Wiel, 2010. "School responsiveness to quality ranking: An empirical analysis of secondary education in the Netherlands," CPB Discussion Paper 149, CPB Netherlands Bureau for Economic Policy Analysis.
  • Handle: RePEc:cpb:discus:149
    as

    Download full text from publisher

    File URL: https://www.cpb.nl/sites/default/files/publicaties/download/school-responsiveness.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Justine S. Hastings & Jeffrey M. Weinstein, 2008. "Information, School Choice, and Academic Achievement: Evidence from Two Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(4), pages 1373-1414.
    2. Figlio, David N. & Rouse, Cecilia Elena, 2006. "Do accountability and voucher threats improve low-performing schools?," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 239-255, January.
    3. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    4. Elbert Dijkgraaf & Raymond Gradus & J. Jong, 2013. "Competition and educational quality: evidence from the Netherlands," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 40(4), pages 607-634, November.
    5. Marigee Bacolod & John DiNardo & Mireille Jacobson, 2012. "Beyond Incentives: Do Schools Use Accountability Rewards Productively?," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 149-163.
    6. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    7. repec:pri:edures:24ers.pdf is not listed on IDEAS
    8. David N. Figlio & Maurice E. Lucas, 2004. "What's in a Grade? School Report Cards and the Housing Market," American Economic Review, American Economic Association, vol. 94(3), pages 591-604, June.
    9. Thomas S. Dee & Brian Jacob, 2011. "The impact of no Child Left Behind on student achievement," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 418-446, June.
    10. Eric A. Hanushek & Margaret E. Raymond, 2005. "Does school accountability lead to improved student performance?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(2), pages 297-327.
    11. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    12. David N. Figlio & Lawrence S. Getzler, 2002. "Accountability , Ability and Disability: Gaming the System," NBER Working Papers 9307, National Bureau of Economic Research, Inc.
    13. repec:mpr:mprres:6364 is not listed on IDEAS
    14. Pierre Koning & Karen van der Wiel, 2010. "Ranking the schools: How quality information affects school choice in the Netherlands," CPB Discussion Paper 150, CPB Netherlands Bureau for Economic Policy Analysis.
    15. Jonah Rockoff & Lesley J. Turner, 2010. "Short-Run Impacts of Accountability on School Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 2(4), pages 119-147, November.
    16. Pope, Devin G., 2009. "Reacting to rankings: Evidence from "America's Best Hospitals"," Journal of Health Economics, Elsevier, vol. 28(6), pages 1154-1165, December.
    17. Julie Berry Cullen & Randall Reback, 2006. "Tinkering Toward Accolades: School Gaming Under a Performance Accountability System," NBER Working Papers 12286, National Bureau of Economic Research, Inc.
    18. Eric A. Hanushek & Margaret E. Raymond, 2004. "The Effect of School Accountability Systems on the Level and Distribution of Student Achievement," Journal of the European Economic Association, MIT Press, vol. 2(2-3), pages 406-415, 04/05.
    19. Koning, Pierre & van der Wiel, Karen, 2010. "Ranking the Schools: How Quality Information Affects School Choice in the Netherlands," IZA Discussion Papers 4984, Institute of Labor Economics (IZA).
    20. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    21. repec:pri:cepsud:156rouse is not listed on IDEAS
    22. Hanley Chiang, "undated". "How Accountability Pressure on Failing Schools Affects Student Achievement," Mathematica Policy Research Reports c58a3b537e324447b94a2bd41, Mathematica Policy Research.
    23. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Publish school rankings, and bad schools improve
      by Economic Logician in Economic Logic on 2010-06-24 19:01:00
    2. School Report Cards Work
      by Alex Tabarrok in Marginal Revolution on 2011-02-26 18:01:00
    3. School Report Cards Work
      by Alex Tabarrok in Cafe Hayek on 2011-02-26 18:01:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Camargo, Braz & Camelo, Rafael & Firpo, Sergio & Ponczek, Vladimir, 2014. "Information, Market Incentives, and Student Performance," IZA Discussion Papers 7941, Institute of Labor Economics (IZA).
    2. MOROZUMI Atsuyoshi & TANAKA Ryuichi, 2023. "School Accountability and Student Achievement: Neighboring schools matter," Discussion papers 23004, Research Institute of Economy, Trade and Industry (RIETI).
    3. Pierre Koning & Karen van der Wiel, 2010. "Ranking the schools: How quality information affects school choice in the Netherlands," CPB Discussion Paper 150, CPB Netherlands Bureau for Economic Policy Analysis.
    4. Steven F. Lehrer & R. Vincent Pohl & Kyungchul Song, 2022. "Multiple Testing and the Distributional Effects of Accountability Incentives in Education," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1552-1568, October.
    5. De Witte, Kristof & Geys, Benny & Solondz, Catharina, 2014. "Public expenditures, educational outcomes and grade inflation: Theory and evidence from a policy intervention in the Netherlands," Economics of Education Review, Elsevier, vol. 40(C), pages 152-166.
    6. Morozumi, Atsuyoshi & Tanaka, Ryuichi, 2020. "Should School-Level Results of National Assessments Be Made Public?," IZA Discussion Papers 13450, Institute of Labor Economics (IZA).
    7. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    8. Yuta Kuroda, 2022. "What does the disclosure of school quality information bring? The effect through the housing market," Journal of Regional Science, Wiley Blackwell, vol. 62(1), pages 125-149, January.
    9. Borghans Lex & Golsteyn Bart H. H. & Zölitz Ulf, 2015. "Parental Preferences for Primary School Characteristics," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 15(1), pages 85-117, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    2. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    3. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    4. Michael Coelli & Gigi Foster & Andrew Leigh, 2018. "Do School Principals Respond to Increased Public Scrutiny? New Survey Evidence from Australia," The Economic Record, The Economic Society of Australia, vol. 94(S1), pages 73-101, June.
    5. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    6. Camargo, Braz & Camelo, Rafael & Firpo, Sergio & Ponczek, Vladimir, 2014. "Information, Market Incentives, and Student Performance," IZA Discussion Papers 7941, Institute of Labor Economics (IZA).
    7. Michael Hurwitz & Jonathan Smith, 2018. "Student Responsiveness To Earnings Data In The College Scorecard," Economic Inquiry, Western Economic Association International, vol. 56(2), pages 1220-1243, April.
    8. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    9. Morozumi, Atsuyoshi & Tanaka, Ryuichi, 2020. "Should School-Level Results of National Assessments Be Made Public?," IZA Discussion Papers 13450, Institute of Labor Economics (IZA).
    10. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    11. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    12. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    13. Hemelt, Steven W., 2011. "Performance effects of failure to make Adequate Yearly Progress (AYP): Evidence from a regression discontinuity framework," Economics of Education Review, Elsevier, vol. 30(4), pages 702-723, August.
    14. Ferreyra, Maria Marta & Liang, Pierre Jinghong, 2012. "Information asymmetry and equilibrium monitoring in education," Journal of Public Economics, Elsevier, vol. 96(1), pages 237-254.
    15. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    16. Patricia M. Anderson & Kristin F. Butcher & Diane Whitmore Schanzenbach, 2017. "Adequate (or Adipose?) Yearly Progress: Assessing the Effect of “No Child Left Behind” on Children's Obesity," Education Finance and Policy, MIT Press, vol. 12(1), pages 54-76, Winter.
    17. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    18. Lovenheim, Michael F. & Walsh, Patrick, 2018. "Does choice increase information? Evidence from online school search behavior," Economics of Education Review, Elsevier, vol. 62(C), pages 91-103.
    19. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    20. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.

    More about this item

    JEL classification:

    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare
    • I20 - Health, Education, and Welfare - - Education - - - General
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Economic Logic blog

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpb:discus:149. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/cpbgvnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.