IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/32671.html
   My bibliography  Save this paper

Alternative Measures of Teachers’ Value Added and Impact on Short and Long-Term Outcomes: Evidence From Random Assignment

Author

Listed:
  • Victor Lavy
  • Rigissa Megalokonomou

Abstract

A recent critique of using teachers’ test score value-added (TVA) is that teacher quality is multifaceted; some teachers are effective in raising test scores, others are effective in improving long-term outcomes. This paper exploits an institutional setting where high school teachers are randomly assigned to classes to compute multiple long-run TVA measures based on university schooling outcomes and high school behavior. We find substantial correlations between test scores and long-run TVA but zero correlations between these two TVA measures and behavior TVA. We find that short-term test-score TVA and long-run TVA are highly correlated and equally good predictors of long-term outcomes.

Suggested Citation

  • Victor Lavy & Rigissa Megalokonomou, 2024. "Alternative Measures of Teachers’ Value Added and Impact on Short and Long-Term Outcomes: Evidence From Random Assignment," NBER Working Papers 32671, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:32671
    Note: CH DEV ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w32671.pdf
    Download Restriction: Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html. Free access is also available to older working papers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Terrier, Camille, 2020. "Boys lag behind: How teachers’ gender biases affect student achievement," Economics of Education Review, Elsevier, vol. 77(C).
    2. Jan Feld & Nicolás Salamanca & Ulf Zölitz, 2020. "Are Professors Worth It? The Value-Added and Costs of Tutorial Instructors," Journal of Human Resources, University of Wisconsin Press, vol. 55(3), pages 836-863.
    3. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    4. Quamrul Ashraf & Oded Galor, 2008. "Human Genetic Diversity and Comparative Economic Development," 2008 Meeting Papers 617, Society for Economic Dynamics.
    5. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    6. Lavy, Victor & Sand, Edith, 2018. "On the origins of gender gaps in human capital: Short- and long-term consequences of teachers' biases," Journal of Public Economics, Elsevier, vol. 167(C), pages 263-279.
    7. C. Kirabo Jackson, 2014. "Teacher Quality at the High School Level: The Importance of Accounting for Tracks," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 645-684.
    8. Josh Kinsler, 2012. "Assessing Rothstein's critique of teacher value‐added models," Quantitative Economics, Econometric Society, vol. 3(2), pages 333-362, July.
    9. Christiana Hilmer & Michael Hilmer, 2010. "Are There Gender Differences in the Job Mobility Patterns of Academic Economists?," American Economic Review, American Economic Association, vol. 100(2), pages 353-357, May.
    10. Koedel, Cory, 2008. "Teacher quality and dropout outcomes in a large, urban school district," Journal of Urban Economics, Elsevier, vol. 64(3), pages 560-572, November.
    11. Quamrul Ashraf & Oded Galor, 2013. "The 'Out of Africa' Hypothesis, Human Genetic Diversity, and Comparative Economic Development," American Economic Review, American Economic Association, vol. 103(1), pages 1-46, February.
    12. Evan K. Rose & Jonathan T. Schellenberg & Yotam Shem-Tov, 2022. "The Effects of Teacher Quality on Adult Criminal Justice Contact," NBER Working Papers 30274, National Bureau of Economic Research, Inc.
    13. Matthew A. Kraft, 2019. "Teacher Effects on Complex Cognitive Skills and Social-Emotional Competencies," Journal of Human Resources, University of Wisconsin Press, vol. 54(1), pages 1-36.
    14. Richard J. Murnane & John B. Willett & Yves Duhaldeborde & John H. Tyler, 2000. "How important are the cognitive skills of teenagers in predicting subsequent earnings?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(4), pages 547-568.
    15. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    16. Shin-Kap Han & Phyllis Moen, 1999. "Work and Family Over Time: A Life Course Approach," The ANNALS of the American Academy of Political and Social Science, , vol. 562(1), pages 98-110, March.
    17. Aspasia Bizopoulou & Rigissa Megalokonomou & Stefania Simion, 2022. "Do Second Chances Pay Off?," Bristol Economics Discussion Papers 22/762, School of Economics, University of Bristol, UK.
    18. Victor Lavy, 2015. "Do Differences in Schools' Instruction Time Explain International Achievement Gaps? Evidence from Developed and Developing Countries," Economic Journal, Royal Economic Society, vol. 125(588), pages 397-424, November.
    19. Natalie Bau & Jishnu Das, 2020. "Teacher Value Added in a Low-Income Country," American Economic Journal: Economic Policy, American Economic Association, vol. 12(1), pages 62-96, February.
    20. Michael Dinerstein & Rigissa Megalokonomou & Constantine Yannelis, 2022. "Human Capital Depreciation and Returns to Experience," American Economic Review, American Economic Association, vol. 112(11), pages 3725-3762, November.
    21. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    22. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    23. Sass, Tim R. & Hannaway, Jane & Xu, Zeyu & Figlio, David N. & Feng, Li, 2012. "Value added of teachers in high-poverty schools and lower poverty schools," Journal of Urban Economics, Elsevier, vol. 72(2), pages 104-122.
    24. Jesse Rothstein, 2017. "Measuring the Impacts of Teachers: Comment," American Economic Review, American Economic Association, vol. 107(6), pages 1656-1684, June.
    25. Victor Lavy, 2013. "Gender Differences in Market Competitiveness in a Real Workplace: Evidence from Performance‐based Pay Tournaments among Teachers," Economic Journal, Royal Economic Society, vol. 123(569), pages 540-573, June.
    26. Cory Koedel & Julian R. Betts, 2011. "Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique," Education Finance and Policy, MIT Press, vol. 6(1), pages 18-42, January.
    27. Michael Gilraine & Nolan G. Pope, 2021. "Making Teaching Last: Long-Run Value-Added," NBER Working Papers 29555, National Bureau of Economic Research, Inc.
    28. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    29. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    30. Victor Lavy & Rigissa Megalokonomou, 2024. "The Short- and the Long-Run Impact of Gender-Biased Teachers," American Economic Journal: Applied Economics, American Economic Association, vol. 16(2), pages 176-218, April.
    31. Pagan, Adrian, 1984. "Econometric Issues in the Analysis of Regressions with Generated Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 25(1), pages 221-247, February.
    32. C. Kirabo Jackson, 2018. "What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2072-2107.
    33. repec:mpr:mprres:7762 is not listed on IDEAS
    34. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    35. Victor Lavy, 2020. "Expanding School Resources and Increasing Time on Task: Effects on Students’ Academic and Noncognitive Outcomes," Journal of the European Economic Association, European Economic Association, vol. 18(1), pages 232-265.
    36. Loprest, Pamela J, 1992. "Gender Differences in Wage Growth and Job Mobility," American Economic Review, American Economic Association, vol. 82(2), pages 526-532, May.
    37. Nathan Petek & Nolan G. Pope, 2023. "The Multidimensional Impact of Teachers on Students," Journal of Political Economy, University of Chicago Press, vol. 131(4), pages 1057-1107.
    38. Kristen Keith & Abagail McWilliams, 1995. "The Wage Effects of Cumulative Job Mobility," ILR Review, Cornell University, ILR School, vol. 49(1), pages 121-137, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    2. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    3. Rakshit, Sonali & Sahoo, Soham, 2023. "Biased teachers and gender gap in learning outcomes: Evidence from India," Journal of Development Economics, Elsevier, vol. 161(C).
    4. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    5. Eric Parsons & Cory Koedel & Li Tan, 2019. "Accounting for Student Disadvantage in Value-Added Models," Journal of Educational and Behavioral Statistics, , vol. 44(2), pages 144-179, April.
    6. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    7. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    8. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    9. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    10. Huang, Wei & Li, Teng & Pan, Yinghao & Ren, Jinyang, 2023. "Teacher characteristics and student performance: Evidence from random teacher-student assignments in China," Journal of Economic Behavior & Organization, Elsevier, vol. 214(C), pages 747-781.
    11. Hermann, Zoltán & Horváth, Hedvig, 2022. "Tanári eredményesség és tanár-diák összepárosítás az általános iskolákban. Empirikus mintázatok három magyarországi tankerület adatai alapján [Teacher effectiveness and teacher-student matching in ," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(11), pages 1377-1406.
    12. Cory Koedel & Mark Ehlert & Eric Parsons & Michael Podgursky, 2012. "Selecting Growth Measures for School and Teacher Evaluations," Working Papers 1210, Department of Economics, University of Missouri.
    13. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    14. Marianne Bitler & Sean Corcoran & Thurston Domina & Emily Penner, 2019. "Teacher Effects on Student Achievement and Height: A Cautionary Tale," NBER Working Papers 26480, National Bureau of Economic Research, Inc.
    15. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    16. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    17. Tanaka, Ryuichi & Bessho, Shun-ichiro & Kawamura, Akira & Noguchi, Haruko & Ushijima, Koichi, 2020. "Determinants of Teacher Value-Added in Public Primary Schools: Evidence from Administrative Panel Data," IZA Discussion Papers 13146, Institute of Labor Economics (IZA).
    18. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    19. Jian Zhang & Songqing Jin & Wei Si, 2020. "Incentivising teachers? Evaluating the incentive effect of China’s teacher performance‐based compensation reform in rural China," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 64(1), pages 171-188, January.
    20. Eric S. Taylor & John H. Tyler, 2011. "The Effect of Evaluation on Performance: Evidence from Longitudinal Student Achievement Data of Mid-career Teachers," NBER Working Papers 16877, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:32671. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.