IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19423.html
   My bibliography  Save this paper

Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates

Author

Listed:
  • Raj Chetty
  • John N. Friedman
  • Jonah E. Rockoff

Abstract

Are teachersʼ impacts on studentsʼ test scores ("value-added") a good measure of their quality? One reason this question has sparked debate is disagreement about whether value-added (VA) measures provide unbiased estimates of teachersʼ causal impacts on student achievement. We test for bias in VA using previously unobserved parent characteristics and a quasi-experimental design based on changes in teaching staff. Using school district and tax records for more than one million children, we find that VA models which control for a studentʼs prior test scores exhibit little bias in forecasting teachersʼ impacts on student achievement.

Suggested Citation

  • Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2013. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," NBER Working Papers 19423, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:19423
    Note: CH ED LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19423.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    2. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, Oxford University Press, vol. 126(4), pages 1593-1660.
    3. Jesse Rothstein, 2009. "Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables," Education Finance and Policy, MIT Press, vol. 4(4), pages 537-571, October.
    4. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    5. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2011. "The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood," NBER Working Papers 17699, National Bureau of Economic Research, Inc.
    6. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    7. repec:hrv:faseco:30749606 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    2. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    3. repec:hrv:faseco:30749073 is not listed on IDEAS
    4. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    5. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    6. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    7. Goldhaber, Dan & Cowan, James & Walch, Joe, 2013. "Is a good elementary teacher always good? Assessing teacher performance estimates across subjects," Economics of Education Review, Elsevier, vol. 36(C), pages 216-228.
    8. Andrew Agopsowicz & Chris Robinson & Ralph Stinebrickner & Todd Stinebrickner, 2020. "Careers and Mismatch for College Graduates: College and Noncollege Jobs," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1194-1221.
    9. Jose Maria Cabrera & Dinand Webbink, 2020. "Do Higher Salaries Yield Better Teachers and Better Student Outcomes?," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1222-1257.
    10. Cory Koedel & Mark Ehlert & Eric Parsons & Michael Podgursky, 2012. "Selecting Growth Measures for School and Teacher Evaluations," Working Papers 1210, Department of Economics, University of Missouri.
    11. Araujo P., Maria Daniela & Quis, Johanna Sophie, 2021. "Parents can tell! Evidence on classroom quality differences in German primary schools," BERG Working Paper Series 172, Bamberg University, Bamberg Economic Research Group.
    12. Araujo P., María Daniela & Quis, Johanna Sophie, 2021. "Teacher Effects in Germany: Evidence from Elementary School," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242457, Verein für Socialpolitik / German Economic Association.
    13. Jeffrey Max & Steven Glazerman, 2014. "Do Disadvantaged Students Get Less Effective Teaching? Key Findings from Recent Institute of Education Sciences Studies (Evaluation Brief)," Mathematica Policy Research Reports a7da30900bb047038d31acd56, Mathematica Policy Research.
    14. Goldhaber, Dan & Krieg, John & Theobald, Roddy, 2020. "Effective like me? Does having a more productive mentor improve the productivity of mentees?," Labour Economics, Elsevier, vol. 63(C).
    15. C. Kirabo Jackson, 2012. "Non-Cognitive Ability, Test Scores, and Teacher Quality: Evidence from 9th Grade Teachers in North Carolina," NBER Working Papers 18624, National Bureau of Economic Research, Inc.
    16. repec:mpr:mprres:8000 is not listed on IDEAS
    17. Dinand Webbink & José María Cabrera, 2016. "Do higher salaries yield better teachers and better student outcomes?," Documentos de Trabajo/Working Papers 1604, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
    18. Sean Corcoran & Dan Goldhaber, 2013. "Value Added and Its Uses: Where You Stand Depends on Where You Sit," Education Finance and Policy, MIT Press, vol. 8(3), pages 418-434, July.
    19. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    20. David Blazar, 2018. "Validating Teacher Effects on Students’ Attitudes and Behaviors: Evidence from Random Assignment of Teachers to Students," Education Finance and Policy, MIT Press, vol. 13(3), pages 281-309, Summer.
    21. Horoi, Irina & Ost, Ben, 2015. "Disruptive peers and the estimation of teacher value added," Economics of Education Review, Elsevier, vol. 49(C), pages 180-192.
    22. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2011. "The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood," NBER Working Papers 17699, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • H0 - Public Economics - - General
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19423. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.