IDEAS home Printed from https://ideas.repec.org/a/wly/jpamgt/v34y2015i1p32-58.html
   My bibliography  Save this article

How do Principals Assign Students to Teachers? Finding Evidence in Administrative Data and the Implications for Value Added

Author

Listed:
  • Steven Dieterle
  • Cassandra M. Guarino
  • Mark D. Reckase
  • Jeffrey M. Wooldridge

Abstract

The federal government's Race to the Top competition has promoted the adoption of test‐based value‐added measures (VAMs) of performance as a component of teacher evaluations throughout many states, but the validity of these measures has been controversial among researchers and widely contested by teachers’ unions. A key concern is the extent to which nonrandom sorting of students to teachers may bias the results and lead to a misclassification of teachers as high or low performing. In light of potential for bias, it is important to assess the extent to which evidence of sorting can be found in the large administrative data sets used for VAM estimation. Using a large longitudinal data set from an anonymous state, we find evidence that a nontrivial amount of sorting exists—particularly sorting based on prior test scores—and that the extent of sorting varies considerably across schools, a fact obscured by the types of aggregate sorting indices developed in prior research. We also find that VAM estimation is sensitive to the presence of nonrandom sorting. There is less agreement across estimation approaches regarding a particular teacher's rank in the distribution of estimated effectiveness when schools engage in sorting.

Suggested Citation

  • Steven Dieterle & Cassandra M. Guarino & Mark D. Reckase & Jeffrey M. Wooldridge, 2015. "How do Principals Assign Students to Teachers? Finding Evidence in Administrative Data and the Implications for Value Added," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(1), pages 32-58, January.
  • Handle: RePEc:wly:jpamgt:v:34:y:2015:i:1:p:32-58
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/pam.21781
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Buddin, Richard, 2011. "Measuring teacher and school effectiveness at improving student achievement in Los Angeles elementary schools," MPRA Paper 31963, University Library of Munich, Germany.
    2. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    3. Sass, Tim R. & Semykina, Anastasia & Harris, Douglas N., 2014. "Value-added models and the measurement of teacher productivity," Economics of Education Review, Elsevier, vol. 38(C), pages 9-23.
    4. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    5. Laura M. Argys & Daniel I. Rees & Dominic J. Brewer, 1996. "Detracking America's schools: Equity at zero cost?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 15(4), pages 623-645.
    6. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, Oxford University Press, vol. 125(1), pages 175-214.
    7. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    8. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    9. Eric A. Hanushek, 1979. "Conceptual and Empirical Issues in the Estimation of Educational Production Functions," Journal of Human Resources, University of Wisconsin Press, vol. 14(3), pages 351-388.
    10. Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages 3-33, February.
    11. C. Kirabo Jackson, 2009. "Student Demographics, Teacher Sorting, and Teacher Quality: Evidence from the End of School Desegregation," Journal of Labor Economics, University of Chicago Press, vol. 27(2), pages 213-256, April.
    12. McFadden, Daniel, 1974. "The measurement of urban travel demand," Journal of Public Economics, Elsevier, vol. 3(4), pages 303-328, November.
    13. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    14. Hanushek, Eric A, 1986. "The Economics of Schooling: Production and Efficiency in Public Schools," Journal of Economic Literature, American Economic Association, vol. 24(3), pages 1141-1177, September.
    15. Cassandra M. Guarino & Michelle Maxfield & Mark D. Reckase & Paul N. Thompson & Jeffrey M. Wooldridge, 2015. "An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures," Journal of Educational and Behavioral Statistics, , vol. 40(2), pages 190-222, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    2. Gershenson, Seth, 2016. "Should Value-Added Models Control for Student Absences?," IZA Discussion Papers 9978, Institute of Labor Economics (IZA).
    3. Ajzenman, Nicolás & Bertoni, Eleonora & Elacqua, Gregory & Marotta, Luana & Méndez, Carolina, 2020. "Altruism or Money?: Reducing Teacher Sorting Using Behavioral Strategies in Peru," IDB Publications (Working Papers) 10576, Inter-American Development Bank.
    4. J. R. Lockwood & D. McCaffrey, 2020. "Using hidden information and performance level boundaries to study student–teacher assignments: implications for estimating teacher causal effects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1333-1362, October.
    5. Christopher Belfield & Imran Rasul, 2020. "Cognitive and Non‐Cognitive Impacts of High‐Ability Peers in Early Years," Fiscal Studies, John Wiley & Sons, vol. 41(1), pages 65-100, March.
    6. Ali Protik & Steven Glazerman & Julie Bruch & Bing-ru Teh, 2015. "Staffing a Low-Performing School: Behavioral Responses to Selective Teacher Transfer Incentives," Education Finance and Policy, MIT Press, vol. 10(4), pages 573-610, October.
    7. Seth Gershenson & Cassandra M. D. Hart & Joshua Hyman & Constance A. Lindsay & Nicholas W. Papageorge, 2022. "The Long-Run Impacts of Same-Race Teachers," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 300-342, November.
    8. Dieterle, Steven G., 2015. "Class-size reduction policies and the quality of entering teachers," Labour Economics, Elsevier, vol. 36(C), pages 35-47.
    9. Ajzenman, Nicolás & Elacqua, Gregory & Marotta, Luana & Westh Olsen, Anne Sofie, 2021. "Order Effects and Employment Decisions: Experimental Evidence from a Nationwide Program," IDB Publications (Working Papers) 11541, Inter-American Development Bank.
    10. Cassandra M. Guarino & Mark D. Reckase & Jeffrey M. Woolrdige, 2014. "Can Value-Added Measures of Teacher Performance Be Trusted?," Education Finance and Policy, MIT Press, vol. 10(1), pages 117-156, November.
    11. Huang, Wei & Li, Teng & Pan, Yinghao & Ren, Jinyang, 2023. "Teacher characteristics and student performance: Evidence from random teacher-student assignments in China," Journal of Economic Behavior & Organization, Elsevier, vol. 214(C), pages 747-781.
    12. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    13. Vosters, Kelly N. & Guarino, Cassandra M. & Wooldridge, Jeffrey M., 2018. "Understanding and evaluating the SAS® EVAAS® Univariate Response Model (URM) for measuring teacher effectiveness," Economics of Education Review, Elsevier, vol. 66(C), pages 191-205.
    14. David Card & Laura Giuliano, 2016. "Can Tracking Raise the Test Scores of High-Ability Minority Students?," American Economic Review, American Economic Association, vol. 106(10), pages 2783-2816, October.
    15. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    16. Guarino, Cassandra M. & Reckase, Mark D. & Stacy, Brian & Wooldridge, Jeffrey M., 2014. "A Comparison of Growth Percentile and Value-Added Models of Teacher Performance," IZA Discussion Papers 7973, Institute of Labor Economics (IZA).
    17. Steven Dieterle, 2013. "Development Class-size Reduction Policies and the Quality of Entering Teachers," Edinburgh School of Economics Discussion Paper Series 224, Edinburgh School of Economics, University of Edinburgh.
    18. David Card & A. Abigail Payne, 2021. "High School Choices And The Gender Gap In Stem," Economic Inquiry, Western Economic Association International, vol. 59(1), pages 9-28, January.
    19. Roberto V. Penaloza & Mark Berends, 2022. "The Mechanics of Treatment-effect Estimate Bias for Nonexperimental Data," Sociological Methods & Research, , vol. 51(1), pages 165-202, February.
    20. Hermann, Zoltán & Horváth, Hedvig, 2022. "Tanári eredményesség és tanár-diák összepárosítás az általános iskolákban. Empirikus mintázatok három magyarországi tankerület adatai alapján [Teacher effectiveness and teacher-student matching in ," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(11), pages 1377-1406.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cassandra M. Guarino & Mark D. Reckase & Jeffrey M. Woolrdige, 2014. "Can Value-Added Measures of Teacher Performance Be Trusted?," Education Finance and Policy, MIT Press, vol. 10(1), pages 117-156, November.
    2. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    3. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    4. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    5. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    6. Guarino, Cassandra M. & Reckase, Mark D. & Stacy, Brian & Wooldridge, Jeffrey M., 2014. "A Comparison of Growth Percentile and Value-Added Models of Teacher Performance," IZA Discussion Papers 7973, Institute of Labor Economics (IZA).
    7. Vosters, Kelly N. & Guarino, Cassandra M. & Wooldridge, Jeffrey M., 2018. "Understanding and evaluating the SAS® EVAAS® Univariate Response Model (URM) for measuring teacher effectiveness," Economics of Education Review, Elsevier, vol. 66(C), pages 191-205.
    8. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    9. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    10. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.
    11. Richard K. Mansfield, 2015. "Teacher Quality and Student Inequality," Journal of Labor Economics, University of Chicago Press, vol. 33(3), pages 751-788.
    12. Nirav Mehta, 2014. "Targeting the Wrong Teachers: Estimating Teacher Quality for Use in Accountability Regimes," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20143, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
    13. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7), pages 798-812.
    14. Eric Parsons & Cory Koedel & Li Tan, 2019. "Accounting for Student Disadvantage in Value-Added Models," Journal of Educational and Behavioral Statistics, , vol. 44(2), pages 144-179, April.
    15. David Blazar, 2018. "Validating Teacher Effects on Students’ Attitudes and Behaviors: Evidence from Random Assignment of Teachers to Students," Education Finance and Policy, MIT Press, vol. 13(3), pages 281-309, Summer.
    16. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    17. Condie, Scott & Lefgren, Lars & Sims, David, 2014. "Teacher heterogeneity, value-added and education policy," Economics of Education Review, Elsevier, vol. 40(C), pages 76-92.
    18. Sass, Tim R. & Semykina, Anastasia & Harris, Douglas N., 2014. "Value-added models and the measurement of teacher productivity," Economics of Education Review, Elsevier, vol. 38(C), pages 9-23.
    19. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    20. Lindsay Fox, 2016. "Playing to Teachers’ Strengths: Using Multiple Measures of Teacher Effectiveness to Improve Teacher Assignments," Education Finance and Policy, MIT Press, vol. 11(1), pages 70-96, Winter.

    More about this item

    JEL classification:

    • I0 - Health, Education, and Welfare - - General
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General
    • J08 - Labor and Demographic Economics - - General - - - Labor Economics Policies
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J44 - Labor and Demographic Economics - - Particular Labor Markets - - - Professional Labor Markets and Occupations
    • J45 - Labor and Demographic Economics - - Particular Labor Markets - - - Public Sector Labor Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jpamgt:v:34:y:2015:i:1:p:32-58. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/journal/34787/home .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.