IDEAS home Printed from https://ideas.repec.org/p/udt/wpgobi/201904.html
   My bibliography  Save this paper

Is the Remedy Worse Than the Disease? The Impact of Teacher Remediation on Teacher and Student Performance in Chile

Author

Listed:
  • María Lombardi

Abstract

I study the impact of remedial training for low-performing teachers in Chile. Taking advantage of the fact that assignment to remediation is mainly based on teacher evaluation scores, I use a fuzzy regression discontinuity design and find that teachers barely assigned to remediation improve their pedagogical practices as measured by their next evaluation scores. While there is suggestive evidence that these teachers’ students obtain higher standardized test scores after the training is complete, this result is not robust, and the suggestive positive impact disappears after one year. I also find that during the year of their teacher’s reevaluation, the students of teachers assigned to remedial training obtain significantly lower test scores. Teachers assigned to remediation report lower prestige and job satisfaction, suggesting that the stigma of being labeled as a low performer leads teachers to put more effort into preparing their teaching evaluations, causing a temporary drop in student learning.

Suggested Citation

  • María Lombardi, 2019. "Is the Remedy Worse Than the Disease? The Impact of Teacher Remediation on Teacher and Student Performance in Chile," School of Government Working Papers 201904, Universidad Torcuato Di Tella.
  • Handle: RePEc:udt:wpgobi:201904
    as

    Download full text from publisher

    File URL: https://www.utdt.edu/download.php?fname=_157927779471146200.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    2. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    3. Brian A. Jacob & Lars Lefgren, 2004. "The Impact of Teacher Training on Student Achievement: Quasi-Experimental Evidence from School Reform Efforts in Chicago," Journal of Human Resources, University of Wisconsin Press, vol. 39(1).
    4. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    5. Anna Popova & David K Evans & Mary E Breeding & Violeta Arancibia, 2022. "Teacher Professional Development around the World: The Gap between Evidence and Practice [Training to Teach Science: Experimental Evidence from Argentina]," The World Bank Research Observer, World Bank, vol. 37(1), pages 107-136.
    6. George Baker, 2002. "Distortion and Risk in Optimal Incentive Contracts," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 728-751.
    7. Baker, George P, 1992. "Incentive Contracts and Performance Measurement," Journal of Political Economy, University of Chicago Press, vol. 100(3), pages 598-614, June.
    8. Jere R. Behrman & Susan W. Parker & Petra E. Todd & Kenneth I. Wolpin, 2015. "Aligning Learning Incentives of Students and Teachers: Results from a Social Experiment in Mexican High Schools," Journal of Political Economy, University of Chicago Press, vol. 123(2), pages 325-364.
    9. Alejandra Mizala & Pilar Romaguera, 2000. "School Performance and Choice: The Chilean Experience," Journal of Human Resources, University of Wisconsin Press, vol. 35(2), pages 392-417.
    10. Karthik Muralidharan & Venkatesh Sundararaman, 2010. "The Impact of Diagnostic Feedback to Teachers on Student Learning: Experimental Evidence from India," Economic Journal, Royal Economic Society, vol. 120(546), pages 187-203, August.
    11. Paul Glewwe & Nauman Ilias & Michael Kremer, 2010. "Teacher Incentives," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 205-227, July.
    12. Donald Boyd & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2005. "Explaining the Short Careers of High-Achieving Teachers in Schools with Low-Performing Students," American Economic Review, American Economic Association, vol. 95(2), pages 166-171, May.
    13. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2011. "Identifying Effective Classroom Practices Using Student Achievement Data," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 587-613.
    14. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    15. Matthew A. Kraft, 2019. "Teacher Effects on Complex Cognitive Skills and Social-Emotional Competencies," Journal of Human Resources, University of Wisconsin Press, vol. 54(1), pages 1-36.
    16. Cory Koedel & Jiaxi Li & Matthew G. Springer & Li Tan, 2016. "The Impact of Performance Ratings on Job Satisfaction for Public School Teachers," Working Papers 1617, Department of Economics, University of Missouri.
    17. Eric S. Taylor & John H. Tyler, 2012. "The Effect of Evaluation on Teacher Performance," American Economic Review, American Economic Association, vol. 102(7), pages 3628-3651, December.
    18. Barbara Bruns & Javier Luque, 2015. "Great Teachers : How to Raise Student Learning in Latin America and the Caribbean," World Bank Publications - Books, The World Bank Group, number 20488, December.
    19. Maria Carolina da Silva Leme & Andre Portela & Vladimir Ponczek & PaulaLouzano, 2011. "The Impact ofStructured Teaching Methods on the Quality of Education," Anais do XXXVII Encontro Nacional de Economia [Proceedings of the 37th Brazilian Economics Meeting] 202, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics].
    20. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    21. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    22. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    23. Tessa Bold & Deon Filmer & Gayle Martin & Ezequiel Molina & Brian Stacy & Christophe Rockmore & Jakob Svensson & Waly Wane, 2017. "Enrollment without Learning: Teacher Effort, Knowledge, and Skill in Primary Schools in Africa," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 185-204, Fall.
    24. Leme, Maria Carolina & Louzano, Paula & Ponczek, Vladimir & Souza, André Portela, 2012. "The impact of structured teaching methods on the quality of education in Brazil," Economics of Education Review, Elsevier, vol. 31(5), pages 850-860.
    25. Matias D. Cattaneo & Nicolas Idrobo & Rocio Titiunik, 2019. "A Practical Introduction to Regression Discontinuity Designs: Foundations," Papers 1911.09511, arXiv.org.
    26. Scafidi, Benjamin & Sjoquist, David L. & Stinebrickner, Todd R., 2007. "Race, poverty, and teacher mobility," Economics of Education Review, Elsevier, vol. 26(2), pages 145-159, April.
    27. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    28. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    29. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    30. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    31. De Hoyos Navarro,Rafael E. & Ganimian,Alejandro Jorge & Holland,Peter Anthony, 2017. "Teaching with the test : experimental evidence on diagnostic feedback and capacity building for public schools in Argentina," Policy Research Working Paper Series 8261, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. María Lombardi, 2019. "Is the Remedy Worse Than the Disease? The Impact of Teacher Remediation on Teacher and Student Performance in Chile," School of Government Working Papers wp_gob_2019_4, Universidad Torcuato Di Tella.
    2. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    3. Derek Neal, 2011. "The Design of Performance Pay in Education," NBER Working Papers 16710, National Bureau of Economic Research, Inc.
    4. Barrera-Osorio, Felipe & Raju, Dhushyanth, 2017. "Teacher performance pay: Experimental evidence from Pakistan," Journal of Public Economics, Elsevier, vol. 148(C), pages 75-91.
    5. Emiliana Vegas & Ilana Umansky, 2005. "Improving Teaching and Learning through Effective Incentives : What Can We Learn from Education Reforms in Latin America?," World Bank Publications - Reports 8694, The World Bank Group.
    6. Marc Steeg & Sander Gerritsen, 2016. "Teacher Evaluations and Pupil Achievement Gains: Evidence from Classroom Observations," De Economist, Springer, vol. 164(4), pages 419-443, December.
    7. Jacob, Brian A. & Rockoff, Jonah E. & Taylor, Eric S. & Lindy, Benjamin & Rosen, Rachel, 2018. "Teacher applicant hiring and teacher performance: Evidence from DC public schools," Journal of Public Economics, Elsevier, vol. 166(C), pages 81-97.
    8. Thijssen, Maximiliaan W.P. & Rege, Mari & Solheim, Oddny J., 2022. "Teacher relationship skills and student learning," Economics of Education Review, Elsevier, vol. 89(C).
    9. Bellés Obrero, Cristina & Lombardi, María, 2019. "Teacher Performance Pay and Student Learning: Evidence from a Nationwide Program in Peru," IZA Discussion Papers 12600, Institute of Labor Economics (IZA).
    10. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    11. Roland G. Fryer, 2013. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 373-407.
    12. Vegas, E & Ganimian, A. J., 2013. "Theory and Evidence on Teacher Policies in Developed and Developing Countries," Working Paper 104291, Harvard University OpenScholar.
    13. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    14. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    15. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    16. Simon Briole, 2019. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices in the US," Working Papers halshs-01993616, HAL.
    17. Liebowitz, David D., 2021. "Teacher evaluation for accountability and growth: Should policy treat them as complements or substitutes?," Labour Economics, Elsevier, vol. 71(C).
    18. Roland G. Fryer, 2011. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," NBER Working Papers 16850, National Bureau of Economic Research, Inc.
    19. Cristina Bellés-Obrero & María Lombardi, 2020. "Teacher Performance Pay and Student Learning: Evidence from a Nationwide Program in Peru," Department of Economics Working Papers wp_gob_2020_04, Universidad Torcuato Di Tella.
    20. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).

    More about this item

    Keywords

    education; teachers; training; Chile;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • M53 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Training

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:udt:wpgobi:201904. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Fiorela Navarro Duymovich (email available below). General contact details of provider: https://edirc.repec.org/data/geutdar.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.