IDEAS home Printed from https://ideas.repec.org/p/tor/tecipa/tecipa-696.html
   My bibliography  Save this paper

A Quantitative Framework for Analyzing the Distributional Effects of Incentive Schemes

Author

Listed:
  • Hugh Macartney
  • Robert McMillan
  • Uros Petronijevic

Abstract

This paper develops the first quantitative framework for analyzing distributional effects of incentive schemes in public education. The analysis is built around a hump-shaped effort function, estimated semi-parametrically using exogenous incentive variation and rich administrative data. We identify key primitives that rationalize this effort function by estimating a flexible teacher effort-choice model. Both the model and parameter estimates are necessary components in our counterfactual framework for tracing the effects of alternative accountability systems on the entire test score distribution, with effort adjusting endogenously. We find widespread schemes that set a fixed target for all students give rise to a steep performance-inequality tradeoff. Further, counterfactual incentive policies can outperform existing schemes for the same cost -- reducing the black-white test score gap by 7% (via student-specific bonuses), and lowering test-score inequality across students by 90% (via student-specific targets). Our quantitative approach opens up new possibilities for incentive design in practice.

Suggested Citation

  • Hugh Macartney & Robert McMillan & Uros Petronijevic, 2021. "A Quantitative Framework for Analyzing the Distributional Effects of Incentive Schemes," Working Papers tecipa-696, University of Toronto, Department of Economics.
  • Handle: RePEc:tor:tecipa:tecipa-696
    as

    Download full text from publisher

    File URL: https://www.economics.utoronto.ca/public/workingPapers/tecipa-696.pdf
    File Function: Main Text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Burgess, Simon & Propper, Carol & Wilson, Deborah & Slater, Helen, 2005. "Who wins and who loses from school accountability? The distribution of educational gain in English secondary schools," CEPR Discussion Papers 5248, C.E.P.R. Discussion Papers.
    2. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2005. "Social Preferences and the Response to Incentives: Evidence from Personnel Data," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(3), pages 917-962.
    3. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    4. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2007. "Incentives for Managers and Inequality among Workers: Evidence from a Firm-Level Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(2), pages 729-773.
    5. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    6. Julie Berry Cullen & Randall Reback, 2006. "Tinkering Toward Accolades: School Gaming Under a Performance Accountability System," NBER Working Papers 12286, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Evan Riehl & Meredith Welch, 2023. "Accountability, Test Prep Incentives, and the Design of Math and English Exams," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 60-96, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hugh Macartney & Robert McMillan & Uros Petronijevic, 2015. "Incentive Design in Education: An Empirical Analysis," NBER Working Papers 21835, National Bureau of Economic Research, Inc.
    2. Marta De Philippis, 2021. "Multi-Task Agents and Incentives: The Case of Teaching and Research for University Professors," The Economic Journal, Royal Economic Society, vol. 131(636), pages 1643-1681.
    3. List, John A. & Rasul, Imran, 2011. "Field Experiments in Labor Economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 2, pages 103-228, Elsevier.
    4. Blanco, M. & Dalton, P.S. & Vargas, J.F., 2013. "Does the Unemployement Benefit Institution Affect the Productivity of Workers? Evidence from a Field Experiment," Other publications TiSEM ba37e033-06ab-4fc3-b56e-9, Tilburg University, School of Economics and Management.
    5. Belot, Michèle & James, Jonathan, 2014. "A new perspective on the issue of selection bias in randomized controlled field experiments," Economics Letters, Elsevier, vol. 124(3), pages 326-328.
    6. Börsch-Supan, Axel & Weiss, Matthias, 2016. "Productivity and age: Evidence from work teams at the assembly line," The Journal of the Economics of Ageing, Elsevier, vol. 7(C), pages 30-42.
    7. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    8. Bassi, Vittorio & Nyshadham, Anant & Tamayo, Jorge & Adhvaryu, Achyuta, 2020. "No Line Left Behind: Assortative Matching Inside the Firm," CEPR Discussion Papers 14554, C.E.P.R. Discussion Papers.
    9. Seth Gershenson, 2016. "Performance Standards and Employee Effort: Evidence From Teacher Absences," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(3), pages 615-638, June.
    10. Aucejo, Esteban & Romano, Teresa & Taylor, Eric S., 2019. "Does evaluation distort teacher effort and decisions? Quasi-experimental evidence from a policy of retesting students," LSE Research Online Documents on Economics 102689, London School of Economics and Political Science, LSE Library.
    11. Simon Burgess & Carol Propper & Marisa Ratto & Emma Tominey, 2017. "Incentives in the Public Sector: Evidence from a Government Agency," Economic Journal, Royal Economic Society, vol. 127(605), pages 117-141, October.
    12. Carneiro, Pedro & Cruz Aguayo, Yyannu & Salvati, Francesca & Schady, Norbert, 2023. "The Effect of Classroom Rank on Learning throughout Elementary School: Experimental Evidence from Ecuador," IZA Discussion Papers 16384, Institute of Labor Economics (IZA).
    13. Christian Dustmann & Albrecht Glitz & Uta Schönberg & Herbert Brücker, 2016. "Referral-based Job Search Networks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(2), pages 514-546.
    14. Dennis Epple & Richard E. Romano & Miguel Urquiola, 2017. "School Vouchers: A Survey of the Economics Literature," Journal of Economic Literature, American Economic Association, vol. 55(2), pages 441-492, June.
    15. Jason J Sandvik & Richard E Saouma & Nathan T Seegert & Christopher T Stanton, 2020. "Workplace Knowledge Flows," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1635-1680.
    16. Broszeit Sandra & Laible Marie-Christine & Görg Holger & Fritsch Ursula, 2019. "Management Practices and Productivity in Germany," German Economic Review, De Gruyter, vol. 20(4), pages 657-705, December.
    17. Elise Huillery & Juliette Seban, 2015. "Financial Incentives are Counterproductive in Non-Profit Sectors: Evidence from a Health Experiment," Working Papers hal-01164460, HAL.
    18. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    19. Bryson, Alex & Buraimo, Babatunde & Simmons, Rob, 2011. "Do salaries improve worker performance?," Labour Economics, Elsevier, vol. 18(4), pages 424-433, August.
    20. Elise Huillery & Juliette Seban, 2015. "Financial Incentives are Counterproductive in Non-Profit Sectors: Evidence from a Health Experiment," SciencePo Working papers Main hal-01164460, HAL.

    More about this item

    Keywords

    Incentives; Effort; Accountability Scheme; Education Production; Test Score Distribution; Inequality; Conditional Average Treatment Effect; Semi-Parametric; Counterfactual; Education Reform;
    All these keywords.

    JEL classification:

    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • J33 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Compensation Packages; Payment Methods
    • M52 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Compensation and Compensation Methods and Their Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tor:tecipa:tecipa-696. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePEc Maintainer (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.