IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp9978.html
   My bibliography  Save this paper

Should Value-Added Models Control for Student Absences?

Author

Listed:
  • Gershenson, Seth

    (American University)

Abstract

Whether or not value-added models should control for contemporaneous student absences is theoretically ambiguous, as such absences are only partly outside of teachers' control. Teachers often feel strongly that value-added models should account for student attendance, and many districts' value-added models condition on lagged student absences as a result. Using matched teacher-student administrative data from a state-wide longitudinal data system, this note investigates the practical importance of this modeling decision for value-added measures of teacher effectiveness (VAMs). This is done by comparing VAM-based rankings of teacher effectiveness generated by value-added models that either control for current absences, control for lagged absences, or exclude student absences altogether. Regardless of how between-school differences are accounted for, VAM-based rankings of teacher effectiveness are insensitive to how, and whether, student absences enter the value-added model's conditioning set. Spearman Rank Correlations are always larger than 0.99 for both math and reading VAMs, suggesting that whether or not value-added models control for annual student absences is a relatively unimportant modeling decision, at least in the context of self-contained primary school classroom teachers. These results are consistent with recent research suggesting that simply conditioning on lagged achievement yields approximately unbiased VAMs. Moreover, these findings suggest that controlling for student absences in teacher evaluation systems' value-added models is a relatively inexpensive way to increase teacher buy-in.

Suggested Citation

  • Gershenson, Seth, 2016. "Should Value-Added Models Control for Student Absences?," IZA Discussion Papers 9978, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp9978
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp9978.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Aucejo, Esteban M. & Romano, Teresa Foy, 2016. "Assessing the effect of school days and absences on test score performance," Economics of Education Review, Elsevier, vol. 55(C), pages 70-87.
    2. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    3. Sass, Tim R. & Semykina, Anastasia & Harris, Douglas N., 2014. "Value-added models and the measurement of teacher productivity," Economics of Education Review, Elsevier, vol. 38(C), pages 9-23.
    4. Cassandra M. Guarino & Mark D. Reckase & Jeffrey M. Woolrdige, 2014. "Can Value-Added Measures of Teacher Performance Be Trusted?," Education Finance and Policy, MIT Press, vol. 10(1), pages 117-156, November.
    5. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    6. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    7. repec:mpr:mprres:7916 is not listed on IDEAS
    8. Joshua Goodman, 2014. "Flaking Out: Student Absences and Snow Days as Disruptions of Instructional Time," NBER Working Papers 20221, National Bureau of Economic Research, Inc.
    9. Eric Isenberg & Elias Walsh, 2014. "Measuring Teacher Value Added in DC, 2012-2013 School Year," Mathematica Policy Research Reports b319ed849495477791cef8b8c, Mathematica Policy Research.
    10. Steven Dieterle & Cassandra M. Guarino & Mark D. Reckase & Jeffrey M. Wooldridge, 2015. "How do Principals Assign Students to Teachers? Finding Evidence in Administrative Data and the Implications for Value Added," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(1), pages 32-58, January.
    11. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    12. Guarino, Cassandra M. & Reckase, Mark D. & Stacy, Brian & Wooldridge, Jeffrey M., 2014. "Evaluating Specification Tests in the Context of Value-Added Estimation," IZA Discussion Papers 7974, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Seth Gershenson & Alison Jacknowitz & Andrew Brannegan, 2017. "Are Student Absences Worth the Worry in U.S. Primary Schools?," Education Finance and Policy, MIT Press, vol. 12(2), pages 137-165, Spring.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Seth Gershenson & Alison Jacknowitz & Andrew Brannegan, 2017. "Are Student Absences Worth the Worry in U.S. Primary Schools?," Education Finance and Policy, MIT Press, vol. 12(2), pages 137-165, Spring.
    2. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    3. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    4. Seth Gershenson & Diane Whitmore Schanzenbach, 2016. "Linking Teacher Quality, Student Attendance, and Student Achievement," Education Finance and Policy, MIT Press, vol. 11(2), pages 125-149, Spring.
    5. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    6. Gershenson, Seth & Holt, Stephen B. & Papageorge, Nicholas W., 2015. "Who Believes in Me? The Effect of Student-Teacher Demographic Match on Teacher Expectations," IZA Discussion Papers 9202, Institute of Labor Economics (IZA).
    7. Liu, Jing & Lee, Monica & Gershenson, Seth, 2019. "The Short- and Long-Run Impacts of Secondary School Absences," IZA Discussion Papers 12613, Institute of Labor Economics (IZA).
    8. Vosters, Kelly N. & Guarino, Cassandra M. & Wooldridge, Jeffrey M., 2018. "Understanding and evaluating the SAS® EVAAS® Univariate Response Model (URM) for measuring teacher effectiveness," Economics of Education Review, Elsevier, vol. 66(C), pages 191-205.
    9. Seth Gershenson, 2016. "Performance Standards and Employee Effort: Evidence From Teacher Absences," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(3), pages 615-638, June.
    10. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    11. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    12. Eric Parsons & Cory Koedel & Li Tan, 2019. "Accounting for Student Disadvantage in Value-Added Models," Journal of Educational and Behavioral Statistics, , vol. 44(2), pages 144-179, April.
    13. Matthew A. Kraft, 2015. "Teacher Layoffs, Teacher Quality, and Student Achievement: Evidence from a Discretionary Layoff Policy," Education Finance and Policy, MIT Press, vol. 10(4), pages 467-507, October.
    14. Roberto V. Penaloza & Mark Berends, 2022. "The Mechanics of Treatment-effect Estimate Bias for Nonexperimental Data," Sociological Methods & Research, , vol. 51(1), pages 165-202, February.
    15. Andrew McEachin & Allison Atteberry, 2017. "The Impact of Summer Learning Loss on Measures of School Performance," Education Finance and Policy, MIT Press, vol. 12(4), pages 468-491, Fall.
    16. Backes, Ben & Cowan, James & Goldhaber, Dan & Koedel, Cory & Miller, Luke C. & Xu, Zeyu, 2018. "The common core conundrum: To what extent should we worry that changes to assessments will affect test-based measures of teacher performance?," Economics of Education Review, Elsevier, vol. 62(C), pages 48-65.
    17. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    18. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    19. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    20. Liu, Jing & Lee, Monica & Gershenson, Seth, 2021. "The short- and long-run impacts of secondary school absences," Journal of Public Economics, Elsevier, vol. 199(C).

    More about this item

    Keywords

    teacher effectiveness; value added models; student absences; teacher evaluation;
    All these keywords.

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp9978. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.