IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/5465.html
   My bibliography  Save this paper

Short-run learning dynamics under a test-based accountability system : evidence from Pakistan

Author

Listed:
  • Barrera-Osorio, Felipe
  • Raju, Dhushyanth

Abstract

Low student learning is a common finding in much of the developing world. This paper uses a relatively unique dataset of five semiannual rounds of standardized test data to characterize and explain the short-term changes in student learning. The data are collected as part of the quality assurance system for a public-private partnership program that offers public subsidies conditional on minimum learning levels to low-cost private schools in Pakistan. Apart from a large positive distributional shift in learning between the first two test rounds, the learning distributions over test rounds show little progress. Schools are ejected from the program if they fail to achieve a minimum pass rate in the test in two consecutive attempts, making the test high stakes. Sharp regression discontinuity estimates show that the threat of program exit on schools that barely failed the test for the first time induces large learning gains. The large change in learning between the first two test rounds is likely attributable to this accountability pressure given that a large share of new program entrants failed in the first test round. Schools also qualify for substantial annual teacher bonuses if they achieve a minimum score in a composite measure of student test participation and mean test score. Sharp regression discontinuity estimates do not show that the prospect of future teacher bonus rewards induces learning gains for schools that barely did not qualify for the bonus.

Suggested Citation

  • Barrera-Osorio, Felipe & Raju, Dhushyanth, 2010. "Short-run learning dynamics under a test-based accountability system : evidence from Pakistan," Policy Research Working Paper Series 5465, The World Bank.
  • Handle: RePEc:wbk:wbrwps:5465
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2010/11/01/000158349_20101101161208/Rendered/PDF/WPS5465.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Russell Davidson & Jean-Yves Duclos, 2013. "Testing for Restricted Stochastic Dominance," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 84-125, January.
    2. Kenneth Y. Chay & Patrick J. McEwan & Miguel Urquiola, 2005. "The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools," American Economic Review, American Economic Association, vol. 95(4), pages 1237-1258, September.
    3. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja & Tristan Zajonc, 2011. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 29-54, July.
    4. Barrera-Osorio, Felipe & Raju, Dhushyanth, 2011. "Evaluating public per-student subsidies to low-cost private schools : regression-discontinuity evidence from Pakistan," Policy Research Working Paper Series 5638, The World Bank.
    5. repec:mpr:mprres:6364 is not listed on IDEAS
    6. Das, Jishnu & Pandey, Priyanka & Zajonc, Tristan, 2006. "Learning levels and gaps in Pakistan," Policy Research Working Paper Series 4067, The World Bank.
    7. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    8. Russell Davidson, 2009. "Testing for Restricted Stochastic Dominance: Some Further Results," Review of Economic Analysis, Digital Initiatives at the University of Waterloo Library, vol. 1(1), pages 34-59, September.
    9. Hanley Chiang, "undated". "How Accountability Pressure on Failing Schools Affects Student Achievement," Mathematica Policy Research Reports c58a3b537e324447b94a2bd41, Mathematica Policy Research.
    10. Andrabi, Tahir & Das, Jishnu & Khwaja, Asim Ijaz, 2006. "A dime a day : the possibilities and limits of private schooling in Pakistan," Policy Research Working Paper Series 4066, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dahal,Mahesh & Nguyen,Quynh T., 2014. "Private non-state sector engagement in the provision of educational services at the primary and secondary levels in South Asia : an analytical review of its role in school enrollment and student achie," Policy Research Working Paper Series 6899, The World Bank.
    2. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja, 2015. "Delivering education: a pragmatic framework for improving education in low-income countries," Chapters, in: Pauline Dixon & Steve Humble & Chris Counihan (ed.), Handbook of International Development and Education, chapter 6, pages 85-130, Edward Elgar Publishing.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja, 2017. "Report Cards: The Impact of Providing School and Child Test Scores on Educational Markets," American Economic Review, American Economic Association, vol. 107(6), pages 1535-1563, June.
    2. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja & Tristan Zajonc, 2011. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 29-54, July.
    3. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    4. Quynh T. Nguyen & Dhushyanth Raju, 2015. "Private School Participation in Pakistan," Lahore Journal of Economics, Department of Economics, The Lahore School of Economics, vol. 20(1), pages 1-46, Jan-June.
    5. Jacobus Cilliers & Isaac M. Mbiti & Andrew Zeitlin, 2021. "Can Public Rankings Improve School Performance?: Evidence from a Nationwide Reform in Tanzania," Journal of Human Resources, University of Wisconsin Press, vol. 56(3), pages 655-685.
    6. Jonah Rockoff & Lesley J. Turner, 2010. "Short-Run Impacts of Accountability on School Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 2(4), pages 119-147, November.
    7. Koohyun Kwon & Soonwoo Kwon, 2020. "Inference in Regression Discontinuity Designs under Monotonicity," Papers 2011.14216, arXiv.org.
    8. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    9. Ana Balcao Reis & Carmo Seabra & Luis C. Nunes, 2012. "Ranking schools: a step toward increased accountability or a mere discriminatory practice?," Nova SBE Working Paper Series wp567, Universidade Nova de Lisboa, Nova School of Business and Economics.
    10. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    11. Kejia Hu & Sunil Chopra & Yuche Chen, 2021. "The Effect of Tightening Standards on Automakers’ Non‐compliance," Production and Operations Management, Production and Operations Management Society, vol. 30(9), pages 3094-3115, September.
    12. Seunghoon Han & Hosung Sohn, 2020. "Impact of the Simultaneous Use of the Stigmatization and Categorical School Funding Policy on the Test and Post-Secondary Outcomes of Lower-Achieving Students," Korean Economic Review, Korean Economic Association, vol. 36, pages 319-352.
    13. Marine de Talance, 2017. "Quality Perceptions and School Choice in Rural Pakistan," Working Papers hal-01663029, HAL.
    14. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    15. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    16. Friesen, Jane & Harris, Benjamin Cerf & Woodcock, Simon, 2013. "Open Enrolment and Student Achievement," CLSSRN working papers clsrn_admin-2013-46, Vancouver School of Economics, revised 22 Mar 2014.
    17. Dirk Van de gaer & Joost Vandenbossche & José Luis Figueroa, 2014. "Children's Health Opportunities and Project Evaluation: Mexico's Oportunidades Program," The World Bank Economic Review, World Bank, vol. 28(2), pages 282-310.
    18. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    19. Duc Khuong Nguyen & Nikolas Topaloglou & Thomas Walther, 2020. "Asset Classes and Portfolio Diversification: Evidence from a Stochastic Spanning Approach," Working Papers 2020-009, Department of Research, Ipag Business School.
    20. Michael Hurwitz & Jonathan Smith, 2018. "Student Responsiveness To Earnings Data In The College Scorecard," Economic Inquiry, Western Economic Association International, vol. 56(2), pages 1220-1243, April.

    More about this item

    Keywords

    Tertiary Education; Education For All; Secondary Education; Teaching and Learning; Primary Education;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:5465. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.