IDEAS home Printed from https://ideas.repec.org/p/umc/wpaper/1402.html
   My bibliography  Save this paper

The Efficiency Implications of Using Proportional Evaluations to Shape the Teaching Workforce

Author

Abstract

We examine the efficiency implications of imposing proportionality in teacher evaluation systems. Proportional evaluations force comparisons to be between equally-circumstanced teachers. We contrast proportional evaluations with global evaluations, which compare teachers to each other regardless of teaching circumstance. We consider a policy where administrators use the ratings from the evaluation system to help shape the teaching workforce, and define efficiency in terms of student achievement. Our analysis indicates that proportionality can be imposed in teacher evaluation systems without efficiency costs under a wide range of evaluation and estimation conditions. Proportionality is efficiency-enhancing in some cases. These findings are notable given that proportional teacher evaluations offer a number of other policy benefits.

Suggested Citation

  • Cory Koedel & Jiaxi Li, 2014. "The Efficiency Implications of Using Proportional Evaluations to Shape the Teaching Workforce," Working Papers 1402, Department of Economics, University of Missouri, revised 16 Mar 2015.
    • Handle: RePEc:umc:wpaper:1402
    as

    Download full text from publisher

    File URL: https://drive.google.com/file/d/1F3hDgKtA5HTrV4yBuW1rgD5lNHQYs0la/view?usp=sharing
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thomas S. Dee, 2004. "Teachers, Race, and Student Achievement in a Randomized Experiment," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 195-210, February.
    2. Charles T. Clotfelter & Elizabeth J. Glennie & Helen F. Ladd & Jacob L. Vigdor, 2008. "Teacher Bonuses and Teacher Retention in Low-Performing Schools," Public Finance Review, , vol. 36(1), pages 63-87, January.
    3. Eric Isenberg & Jeffrey Max & Philip Gleason & Liz Potamites & Robert Santillano & Heinrich Hock & Michael Hansen, "undated". "Access to Effective Teaching for Disadvantaged Students (Interim Report)," Mathematica Policy Research Reports ad54d58020e54294b0ab88ad0, Mathematica Policy Research.
    4. Cory Koedel & Jason A. Grissom & Shawn Ni & Michael Podgursky, 2011. "Pension-Induced Rigidities in the Labor Market for School Leaders," Working Papers 1115, Department of Economics, University of Missouri.
    5. Gadi Barlevy & Derek Neal, 2012. "Pay for Percentile," American Economic Review, American Economic Association, vol. 102(5), pages 1805-1831, August.
    6. Cory Koedel & Mark Ehlert & Eric Parsons & Michael Podgursky, 2012. "Selecting Growth Measures for School and Teacher Evaluations," Working Papers 1210, Department of Economics, University of Missouri.
    7. Andrew Schotter & Keith Weigelt, 1992. "Asymmetric Tournaments, Equal Opportunity Laws, and Affirmative Action: Some Experimental Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(2), pages 511-539.
    8. Thomas S. Dee & James Wyckoff, 2015. "Incentives, Selection, and Teacher Performance: Evidence from IMPACT," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(2), pages 267-297, March.
    9. Li Feng & Tim R. Sass, 2017. "Teacher Quality and Teacher Mobility," Education Finance and Policy, MIT Press, vol. 12(3), pages 396-418, Summer.
    10. repec:mpr:mprres:7330 is not listed on IDEAS
    11. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    12. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    13. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    14. Donald Boyd & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2012. "Measuring Test Measurement Error: A General Approach," NBER Working Papers 18010, National Bureau of Economic Research, Inc.
    15. Daniel F. McCaffrey & Tim R. Sass & J. R. Lockwood & Kata Mihaly, 2009. "The Intertemporal Variability of Teacher Effect Estimates," Education Finance and Policy, MIT Press, vol. 4(4), pages 572-606, October.
    16. Matthew Ronfeldt & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2011. "How Teacher Turnover Harms Student Achievement," NBER Working Papers 17176, National Bureau of Economic Research, Inc.
    17. repec:mpr:mprres:7943 is not listed on IDEAS
    18. repec:mpr:mprres:7333 is not listed on IDEAS
    19. Sass, Tim R. & Semykina, Anastasia & Harris, Douglas N., 2014. "Value-added models and the measurement of teacher productivity," Economics of Education Review, Elsevier, vol. 38(C), pages 9-23.
    20. Cory Koedel & Julian R. Betts, 2011. "Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique," Education Finance and Policy, MIT Press, vol. 6(1), pages 18-42, January.
    21. Cory Koedel & Julian Betts, 2007. "Re-Examining the Role of Teacher Quality In the Educational Production Function," Working Papers 0708, Department of Economics, University of Missouri.
    22. Dan Goldhaber & Duncan Chaplin, "undated". "Assessing the Rothstein Test: Does It Really Show Teacher Value-Added Models Are Biased?," Mathematica Policy Research Reports 77f489fc94a34a0e96a42c419, Mathematica Policy Research.
    23. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    24. Stephen W. Raudenbush & JDouglas Willms, 1995. "The Estimation of School Effects," Journal of Educational and Behavioral Statistics, , vol. 20(4), pages 307-335, December.
    25. Sass, Tim R. & Hannaway, Jane & Xu, Zeyu & Figlio, David N. & Feng, Li, 2012. "Value added of teachers in high-poverty schools and lower poverty schools," Journal of Urban Economics, Elsevier, vol. 72(2), pages 104-122.
    26. Eric Isenberg & Jeffrey Max & Philip Gleason & Liz Potamites & Robert Santillano & Heinrich Hock & Michael Hansen, "undated". "Access to Effective Teaching for Disadvantaged Students (In Focus Brief)," Mathematica Policy Research Reports 12ee9a28e7b341039dae2f013, Mathematica Policy Research.
    27. Peter Z. Schochet & Hanley S. Chiang, "undated". "What Are Error Rates for Classifying Teacher and School Performance Using Value-Added Models?," Mathematica Policy Research Reports 8cc459dd9c574c3d832ed4182, Mathematica Policy Research.
    28. Erikson Arcaira & Stephen Coleman & Jaclyn MacFarlane & Andrea Palmiter & Brenda Turnbull & Beatrice Birman & Erin Dunlop & Jane Hannaway & Umut Ozek & Steve Glazerman & Elias Walsh & Michael Feuer & , 2013. "Evaluation of the DC Public Education Reform Amendment Act (PERAA): School Year 2011-2012," Mathematica Policy Research Reports 0b4f8c9608a84c889792bb228, Mathematica Policy Research.
    29. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    30. Dan Goldhaber & Duncan Dunbar Chaplin, "undated". "Assessing the "Rothstein Falsification Test": Does It Really Show Teacher Value-Added Models Are Biased?," Mathematica Policy Research Reports 93f34c834817419a9efccecdf, Mathematica Policy Research.
    31. Jason A. Grissom & Lael R. Keiser, 2011. "A supervisor like me: Race, representation, and the satisfaction and turnover decisions of public sector employees," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 557-580, June.
    32. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2011. "The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood," NBER Working Papers 17699, National Bureau of Economic Research, Inc.
    33. repec:mpr:mprres:7942 is not listed on IDEAS
    34. Donald Boyd & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2005. "The draw of home: How teachers' preferences for proximity disadvantage urban schools," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(1), pages 113-132.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cory Koedel & Mark Ehlert & Eric Parsons & Michael Podgursky, 2012. "Selecting Growth Measures for School and Teacher Evaluations," Working Papers 1210, Department of Economics, University of Missouri.
    2. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    3. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    4. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    5. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    6. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    7. Backes, Ben & Cowan, James & Goldhaber, Dan & Koedel, Cory & Miller, Luke C. & Xu, Zeyu, 2018. "The common core conundrum: To what extent should we worry that changes to assessments will affect test-based measures of teacher performance?," Economics of Education Review, Elsevier, vol. 62(C), pages 48-65.
    8. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    9. Jeffrey Max & Steven Glazerman, 2014. "Do Disadvantaged Students Get Less Effective Teaching? Key Findings from Recent Institute of Education Sciences Studies (Evaluation Brief)," Mathematica Policy Research Reports a7da30900bb047038d31acd56, Mathematica Policy Research.
    10. Cory Koedel & Eric Parsons & Michael Podgursky & Mark Ehlert, 2015. "Teacher Preparation Programs and Teacher Quality: Are There Real Differences Across Programs?," Education Finance and Policy, MIT Press, vol. 10(4), pages 508-534, October.
    11. Eric Parsons & Cory Koedel & Li Tan, 2019. "Accounting for Student Disadvantage in Value-Added Models," Journal of Educational and Behavioral Statistics, , vol. 44(2), pages 144-179, April.
    12. Harris, Douglas N. & Sass, Tim R., 2014. "Skills, productivity and the evaluation of teacher performance," Economics of Education Review, Elsevier, vol. 40(C), pages 183-204.
    13. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.
    14. repec:mpr:mprres:8000 is not listed on IDEAS
    15. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    16. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.
    17. Goldhaber, Dan & Cowan, James & Walch, Joe, 2013. "Is a good elementary teacher always good? Assessing teacher performance estimates across subjects," Economics of Education Review, Elsevier, vol. 36(C), pages 216-228.
    18. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    19. Nirav Mehta, 2014. "Targeting the Wrong Teachers: Estimating Teacher Quality for Use in Accountability Regimes," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20143, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
    20. Li Feng & Tim R. Sass, 2017. "Teacher Quality and Teacher Mobility," Education Finance and Policy, MIT Press, vol. 12(3), pages 396-418, Summer.
    21. Eric Isenberg & Jeffrey Max & Philip Gleason & Matthew Johnson & Jonah Deutsch & Michael Hansen, "undated". "Do Low-Income Students Have Equal Access to Effective Teachers? Evidence from 26 Districts (Final Report)," Mathematica Policy Research Reports ce9ae6b49ff34e388113f31ca, Mathematica Policy Research.

    More about this item

    Keywords

    teacher evaluation; evaluation systems; proportional evaluations; value-added;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:umc:wpaper:1402. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chao Gu (email available below). General contact details of provider: https://edirc.repec.org/data/edumous.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.