IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/102689.html

Does evaluation distort teacher effort and decisions? Quasi-experimental evidence from a policy of retesting students

Author

Listed:
  • Aucejo, Esteban
  • Romano, Teresa
  • Taylor, Eric S.

Abstract

Performance evaluation may change employee effort and decisions in unintended ways, for example, in multitask jobs where the evaluation measure captures only a subset of (differentially weights) the job tasks. We show evidence of this multitask distortion in schools, with teachers allocating effort across students (tasks). Teachers are evaluated based on student test scores; students who fail the test are retested 2-3 weeks later; and only the higher of the two scores is used in the teachers’ evaluations. This retesting feature creates a sharp difference in the returns to teacher effort directed at failing versus passing students, even though both barely failing and barely passing students have arguably equal educational claim on (returns to) teacher effort. Using RD methods, we show that students who barely fail the end of school-year math test, and are then retested, score higher one year later (+1) compared to those who barely pass. This difference in scores occurs during the four years of the retest policy, but not in the years before or after. We find no evidence that the results arise from retesting per se, or from changes in students’ own behavior alone. The results suggest teachers give more effort to some students (tasks) simply because of the evaluation system incentives.

Suggested Citation

  • Aucejo, Esteban & Romano, Teresa & Taylor, Eric S., 2019. "Does evaluation distort teacher effort and decisions? Quasi-experimental evidence from a policy of retesting students," LSE Research Online Documents on Economics 102689, London School of Economics and Political Science, LSE Library.
  • Handle: RePEc:ehl:lserod:102689
    as

    Download full text from publisher

    File URL: https://researchonline.lse.ac.uk/id/eprint/102689/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Burgess, Simon & Propper, Carol & Wilson, Deborah & Slater, Helen, 2005. "Who wins and who loses from school accountability? The distribution of educational gain in English secondary schools," CEPR Discussion Papers 5248, Centre for Economic Policy Research.
    2. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    3. Thomas S. Dee & Brian Jacob, 2011. "The impact of no Child Left Behind on student achievement," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 418-446, June.
    4. Aucejo, Esteban M. & Romano, Teresa Foy, 2016. "Assessing the effect of school days and absences on test score performance," Economics of Education Review, Elsevier, vol. 55(C), pages 70-87.
    5. Randall Reback & Julie Berry Cullen, 2006. "Tinkering toward accolades: School gaming under a performance accountability system," Working Papers 0601, Barnard College, Department of Economics.
    6. Baker, George P, 1992. "Incentive Contracts and Performance Measurement," Journal of Political Economy, University of Chicago Press, vol. 100(3), pages 598-614, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ng, Kevin, 2024. "The effects of teacher tenure on productivity and selection," Economics of Education Review, Elsevier, vol. 101(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David J. Deming & Sarah Cohodes & Jennifer Jennings & Christopher Jencks, 2016. "School Accountability, Postsecondary Attainment, and Earnings," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 848-862, December.
    2. Will Dobbie & Roland G. Fryer, 2020. "Charter Schools and Labor Market Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 38(4), pages 915-957.
    3. Will S. Dobbie & Roland G. Fryer, Jr, 2016. "Charter Schools and Labor Market Outcomes," NBER Working Papers 22502, National Bureau of Economic Research, Inc.
    4. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    5. Liu, Jing & Lee, Monica & Gershenson, Seth, 2021. "The short- and long-run impacts of secondary school absences," Journal of Public Economics, Elsevier, vol. 199(C).
    6. Thompson, Paul N., 2021. "Is four less than five? Effects of four-day school weeks on student achievement in Oregon," Journal of Public Economics, Elsevier, vol. 193(C).
    7. Hugh Macartney, 2014. "The Dynamic Effects of Educational Accountability," NBER Working Papers 19915, National Bureau of Economic Research, Inc.
    8. Silva, Olmo, 2009. "Some Remarks on the Effectiveness of Primary Education Interventions," IZA Policy Papers 5, Institute of Labor Economics (IZA).
    9. repec:udt:wpecon:wp_gob_2020_04 is not listed on IDEAS
    10. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    11. Patricia M. Anderson & Kristin F. Butcher & Diane Whitmore Schanzenbach, 2017. "Adequate (or Adipose?) Yearly Progress: Assessing the Effect of “No Child Left Behind” on Children's Obesity," Education Finance and Policy, MIT Press, vol. 12(1), pages 54-76, Winter.
    12. Gregg, John J. & Lavertu, Stéphane, 2023. "Test-based accountability and educational equity: Breaking through local district politics?," Economics of Education Review, Elsevier, vol. 97(C).
    13. Jo Blanden & Matthias Doepke & Jan Stuhler, 2022. "Education inequality," CEP Discussion Papers dp1849, Centre for Economic Performance, LSE.
    14. Bokhari, Farasat A.S. & Schneider, Helen, 2011. "School accountability laws and the consumption of psychostimulants," Journal of Health Economics, Elsevier, vol. 30(2), pages 355-372, March.
    15. Brian Jacob & Jesse Rothstein, 2016. "The Measurement of Student Ability in Modern Assessment Systems," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 85-108, Summer.
    16. Kelman, Steven & Friedman, John N., 2007. "Performance Improvement and Performance Dysfunction: An Empirical Examination of Impacts of the Emergency Room Wait-Time Target in the English National Health Service," Working Paper Series rwp07-034, Harvard University, John F. Kennedy School of Government.
    17. Deborah Wilson & Anete Piebalga, 2008. "Accurate performance measure but meaningless ranking exercise? An analysis of the English school league tables," The Centre for Market and Public Organisation 07/176, The Centre for Market and Public Organisation, University of Bristol, UK.
    18. Hugh Macartney, 2016. "The Dynamic Effects of Educational Accountability," Journal of Labor Economics, University of Chicago Press, vol. 34(1), pages 1-28.
    19. Hugh Macartney & Robert McMillan & Uros Petronijevic, 2015. "Incentive Design in Education: An Empirical Analysis," NBER Working Papers 21835, National Bureau of Economic Research, Inc.
    20. Christa Deneault & Evan Riehl, 2025. "Should States Reduce Teacher Licensing Requirements? Evidence from the Rise of For-Profit Training Programs in Texas," NBER Working Papers 34232, National Bureau of Economic Research, Inc.
    21. Julie Berry Cullen & Eric A. Hanushek & Gregory Phelan & Steven G. Rivkin, 2024. "Performance Information and Personnel Decisions in the Public Sector: The Case of School Principals," Journal of Human Resources, University of Wisconsin Press, vol. 59(1), pages 109-140.

    More about this item

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • M5 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:102689. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.