IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_6185.html
   My bibliography  Save this paper

The Compositional Effect of Rigorous Teacher Evaluation on Workforce Quality

Author

Listed:
  • Julie Berry Cullen
  • Cory Koedel
  • Eric Parsons

Abstract

Improving public sector workforce quality is challenging in sectors such as education where worker productivity is difficult to assess and manager incentives are muted by political and bureaucratic constraints. In this paper, we study how providing information to principals about teacher effectiveness and encouraging them to use the information in personnel decisions affects the composition of teacher turnovers. Our setting is the Houston Independent School District, which recently implemented a rigorous teacher evaluation system. Prior to the new system teacher effectiveness was negatively correlated with district exit and we show that the policy significantly strengthened this relationship, primarily by increasing the relative likelihood of exit for teachers in the bottom quintile of the quality distribution. Low-performing teachers working in low-achieving schools were especially likely to leave. However, despite the success, the implied change to the quality of the workforce overall is too small to have a detectable impact on student achievement.

Suggested Citation

  • Julie Berry Cullen & Cory Koedel & Eric Parsons, 2016. "The Compositional Effect of Rigorous Teacher Evaluation on Workforce Quality," CESifo Working Paper Series 6185, CESifo.
  • Handle: RePEc:ces:ceswps:_6185
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp6185.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 798-812, August.
    2. David Blazar, 2018. "Validating Teacher Effects on Students’ Attitudes and Behaviors: Evidence from Random Assignment of Teachers to Students," Education Finance and Policy, MIT Press, vol. 13(3), pages 281-309, Summer.
    3. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    4. David Greenberg & John McCall, 1974. "Teacher Mobility and Allocation," Journal of Human Resources, University of Wisconsin Press, vol. 9(4), pages 480-502.
    5. Thomas S. Dee & James Wyckoff, 2015. "Incentives, Selection, and Teacher Performance: Evidence from IMPACT," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(2), pages 267-297, March.
    6. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    7. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    8. Backes, Ben & Cowan, James & Goldhaber, Dan & Koedel, Cory & Miller, Luke C. & Xu, Zeyu, 2018. "The common core conundrum: To what extent should we worry that changes to assessments will affect test-based measures of teacher performance?," Economics of Education Review, Elsevier, vol. 62(C), pages 48-65.
    9. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    10. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    11. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2011. "Identifying Effective Classroom Practices Using Student Achievement Data," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 587-613.
    12. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    13. Michael Bates, 2016. "Public and Private Learning in the Market for Teachers: Evidence from the Adoption of Value-Added Measures," Working Papers 201616, University of California at Riverside, Department of Economics.
    14. Lauren Sartain & Matthew P. Steinberg, 2016. "Teachers’ Labor Market Responses to Performance Evaluation Reform: Experimental Evidence from Chicago Public Schools," Journal of Human Resources, University of Wisconsin Press, vol. 51(3), pages 615-655.
    15. Brian A. Jacob & Lars Lefgren, 2008. "Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education," Journal of Labor Economics, University of Chicago Press, vol. 26(1), pages 101-136.
    16. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25, pages 95-135.
    17. repec:hrv:faseco:30749073 is not listed on IDEAS
    18. C. Kirabo Jackson, 2018. "What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2072-2107.
    19. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    20. Matthew A. Kraft, 2019. "Teacher Effects on Complex Cognitive Skills and Social-Emotional Competencies," Journal of Human Resources, University of Wisconsin Press, vol. 54(1), pages 1-36.
    21. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    22. Scott A. Imberman & Michael F. Lovenheim, 2015. "Incentive Strength and Teacher Productivity: Evidence from a Group-Based Teacher Incentive Pay System," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 364-386, May.
    23. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 1, number 1, June.
    24. Markus Nagler & Marc Piopiunik & Martin R. West, 2020. "Weak Markets, Strong Teachers: Recession at Career Start and Teacher Effectiveness," Journal of Labor Economics, University of Chicago Press, vol. 38(2), pages 453-500.
    25. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 2, number 2, June.
    26. Jason A. Grissom & Michelle Reininger, 2012. "Who Comes Back? A Longitudinal Analysis of the Reentry Behavior of Exiting Teachers," Education Finance and Policy, MIT Press, vol. 7(4), pages 425-454, September.
    27. Brehm, Margaret & Imberman, Scott A. & Lovenheim, Michael F., 2017. "Achievement effects of individual performance incentives in a teacher merit pay tournament," Labour Economics, Elsevier, vol. 44(C), pages 133-150.
    28. repec:hrv:faseco:30749606 is not listed on IDEAS
    29. Dale Ballou & William Sanders & Paul Wright, 2004. "Controlling for Student Background in Value-Added Assessment of Teachers," Journal of Educational and Behavioral Statistics, , vol. 29(1), pages 37-65, March.
    30. Melinda Adnot & Thomas Dee & Veronica Katz & James Wyckoff, 2016. "Teacher Turnover, Teacher Quality, and Student Achievement in DCPS," NBER Working Papers 21922, National Bureau of Economic Research, Inc.
    31. Gregory F. Branch & Eric A. Hanushek & Steven G. Rivkin, 2012. "Estimating the Effect of Leaders on Public Sector Productivity: The Case of School Principals," NBER Working Papers 17803, National Bureau of Economic Research, Inc.
    32. Kristin F. Butcher & Patrick J. McEwan & Akila Weerapana, 2014. "The Effects of an Anti-grade-Inflation Policy at Wellesley College," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 189-204, Summer.
    33. Andrew Bacher-Hicks & Thomas J. Kane & Douglas O. Staiger, 2014. "Validating Teacher Effect Estimates Using Changes in Teacher Assignments in Los Angeles," NBER Working Papers 20657, National Bureau of Economic Research, Inc.
    34. Thomas Ahn & Jacob L. Vigdor, 2014. "When Incentives Matter Too Much: Explaining Significant Responses to Irrelevant Information," NBER Working Papers 20321, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bergman, Peter & Hill, Matthew J., 2018. "The effects of making performance information public: Regression discontinuity evidence from Los Angeles teachers," Economics of Education Review, Elsevier, vol. 66(C), pages 104-113.
    2. Eric Parsons & Cory Koedel & Li Tan, 2018. "Accounting for Student Disadvantage in Value-Added Models," Working Papers 1813, Department of Economics, University of Missouri.
    3. Kraft, Matthew A. & Brunner, Eric J. & Dougherty, Shaun M. & Schwegman, David J., 2020. "Teacher accountability reforms and the supply and quality of new teachers," Journal of Public Economics, Elsevier, vol. 188(C).
    4. Cory Koedel & Jiaxi Li & Matthew G. Springer & Li Tan, 2018. "Teacher Performance Ratings and Professional Improvement," Working Papers 1808, Department of Economics, University of Missouri.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Julie Berry Cullen & Cory Koedel & Eric Parsons, 2021. "The Compositional Effect of Rigorous Teacher Evaluation on Workforce Quality," Education Finance and Policy, MIT Press, vol. 16(1), pages 7-41, Winter.
    2. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    3. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    4. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    5. Marc Steeg & Sander Gerritsen, 2016. "Teacher Evaluations and Pupil Achievement Gains: Evidence from Classroom Observations," De Economist, Springer, vol. 164(4), pages 419-443, December.
    6. Jacob, Brian A. & Rockoff, Jonah E. & Taylor, Eric S. & Lindy, Benjamin & Rosen, Rachel, 2018. "Teacher applicant hiring and teacher performance: Evidence from DC public schools," Journal of Public Economics, Elsevier, vol. 166(C), pages 81-97.
    7. Brian Jacob & Jonah E. Rockoff & Eric S. Taylor & Benjamin Lindy & Rachel Rosen, 2016. "Teacher Applicant Hiring and Teacher Performance: Evidence from DC Public Schools," NBER Working Papers 22054, National Bureau of Economic Research, Inc.
    8. Pope, Nolan G., 2019. "The effect of teacher ratings on teacher performance," Journal of Public Economics, Elsevier, vol. 172(C), pages 84-110.
    9. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    10. Sean Corcoran & Dan Goldhaber, 2013. "Value Added and Its Uses: Where You Stand Depends on Where You Sit," Education Finance and Policy, MIT Press, vol. 8(3), pages 418-434, July.
    11. Cory Koedel & Eric Parsons & Michael Podgursky & Mark Ehlert, 2015. "Teacher Preparation Programs and Teacher Quality: Are There Real Differences Across Programs?," Education Finance and Policy, MIT Press, vol. 10(4), pages 508-534, October.
    12. Simon Briole, 2019. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices in the US," Working Papers halshs-01993616, HAL.
    13. Cory Koedel & Jiaxi Li & Matthew G. Springer & Li Tan, 2016. "The Impact of Performance Ratings on Job Satisfaction for Public School Teachers," Working Papers 1617, Department of Economics, University of Missouri.
    14. Dan Goldhaber & Cyrus Grout & Nick Huntington-Klein, 2017. "Screen Twice, Cut Once: Assessing the Predictive Validity of Applicant Selection Tools," Education Finance and Policy, MIT Press, vol. 12(2), pages 197-223, Spring.
    15. José María Cabrera & Dinand Webbink, 2020. "Do Higher Salaries Yield Better Teachers and Better Student Outcomes?," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1194-1221.
    16. Alexis Le Chapelain, 2014. "Market for Education and Student Achievement," Sciences Po publications info:hdl:2441/1jgbspo1909, Sciences Po.
    17. Backes, Ben & Cowan, James & Goldhaber, Dan & Koedel, Cory & Miller, Luke C. & Xu, Zeyu, 2018. "The common core conundrum: To what extent should we worry that changes to assessments will affect test-based measures of teacher performance?," Economics of Education Review, Elsevier, vol. 62(C), pages 48-65.
    18. Richard Murphy & Felix Weinhardt & Gill Wyness, 2020. "Who Teaches the Teachers? A RCT of Peer-to-Peer Observation and Feedback in 181 Schools," CESifo Working Paper Series 8221, CESifo.
    19. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    20. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.

    More about this item

    Keywords

    teacher labor market; public sector performance evaluation;

    JEL classification:

    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • J45 - Labor and Demographic Economics - - Particular Labor Markets - - - Public Sector Labor Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_6185. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Klaus Wohlrabe). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.