IDEAS home Printed from https://ideas.repec.org/p/umc/wpaper/1501.html
   My bibliography  Save this paper

Value-Added Modeling: A Review

Author

Abstract

This article reviews the literature on teacher value-added. Although value-added models have been used to measure the contributions of numerous inputs to educational production, their application toward identifying the contributions of individual teachers has been particularly contentious. Our review covers articles on topics ranging from technical aspects of model design to the role that value-added can play in informing teacher evaluations in practice, highlighting areas of consensus and disagreement in the literature. Although a broad spectrum of views is reflected in available research, along a number of important dimensions the literature is converging on a widely-accepted set of facts.

Suggested Citation

  • Cory Koedel & Kata Mihaly & Jonah E. Rockoff, 2015. "Value-Added Modeling: A Review," Working Papers 1501, Department of Economics, University of Missouri.
  • Handle: RePEc:umc:wpaper:1501
    as

    Download full text from publisher

    File URL: https://economics.missouri.edu/working-papers/2015/wp1501_koedel.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, Oxford University Press, vol. 125(1), pages 175-214.
    3. David Deming, 2009. "Early Childhood Intervention and Life-Cycle Skill Development: Evidence from Head Start," American Economic Journal: Applied Economics, American Economic Association, vol. 1(3), pages 111-134, July.
    4. Steven Glazerman & Susanna Loeb & Dan Goldhaber & Douglas Staiger & Stephen Raudenbush & Grover Whitehurst, 2010. "Evaluating Teachers: The Important Role of Value-Added," Mathematica Policy Research Reports 503e125ed5244bb39586aafe1, Mathematica Policy Research.
    5. Marcus A. Winters & Joshua M. Cowen, 2013. "Would a Value‐Added System of Retention Improve the Distribution of Teacher Quality? A Simulation of Alternative Policies," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(3), pages 634-654, June.
    6. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja & Tristan Zajonc, 2011. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 29-54, July.
    7. C. Kirabo Jackson, 2013. "Match Quality, Worker Productivity, and Worker Mobility: Direct Evidence from Teachers," The Review of Economics and Statistics, MIT Press, vol. 95(4), pages 1096-1116, October.
    8. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 798-812, August.
    9. Meghir, Costas & Rivkin, Steven, 2011. "Econometric Methods for Research in Education," Handbook of the Economics of Education, Elsevier.
    10. Rockoff, Jonah E. & Speroni, Cecilia, 2011. "Subjective and objective evaluations of teacher effectiveness: Evidence from New York City," Labour Economics, Elsevier, vol. 18(5), pages 687-696, October.
    11. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    12. Thomas J. Kane & Douglas O. Staiger, 2002. "The Promise and Pitfalls of Using Imprecise School Accountability Measures," Journal of Economic Perspectives, American Economic Association, vol. 16(4), pages 91-114, Fall.
    13. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, Oxford University Press, vol. 126(4), pages 1593-1660.
    14. repec:mpr:mprres:7937 is not listed on IDEAS
    15. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    16. Jesse Rothstein, 2009. "Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables," Education Finance and Policy, MIT Press, vol. 4(4), pages 537-571, October.
    17. Mariesa Herrmann & Elias Walsh & Eric Isenberg & Alexandra Resch, 2013. "Shrinkage of Value-Added Estimates and Characteristics of Students with Hard-to-Predict Achievement Levels," Mathematica Policy Research Reports 2b140369be0242ac83eeb5b0a, Mathematica Policy Research.
    18. Peter Z. Schochet & Hanley S. Chiang, 2013. "What Are Error Rates for Classifying Teacher and School Performance Using Value-Added Models?," Journal of Educational and Behavioral Statistics, , vol. 38(2), pages 142-171, April.
    19. Daniel F. McCaffrey & Tim R. Sass & J. R. Lockwood & Kata Mihaly, 2009. "The Intertemporal Variability of Teacher Effect Estimates," Education Finance and Policy, MIT Press, vol. 4(4), pages 572-606, October.
    20. Sass, Tim R. & Semykina, Anastasia & Harris, Douglas N., 2014. "Value-added models and the measurement of teacher productivity," Economics of Education Review, Elsevier, vol. 38(C), pages 9-23.
    21. Eric A. Hanushek, 1979. "Conceptual and Empirical Issues in the Estimation of Educational Production Functions," Journal of Human Resources, University of Wisconsin Press, vol. 14(3), pages 351-388.
    22. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25, pages 95-135.
    23. repec:hrv:faseco:30749073 is not listed on IDEAS
    24. C. Kirabo Jackson, 2014. "Teacher Quality at the High School Level: The Importance of Accounting for Tracks," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 645-684.
    25. Eric A. Hanushek & Ludger Woessmann, 2008. "The Role of Cognitive Skills in Economic Development," Journal of Economic Literature, American Economic Association, vol. 46(3), pages 607-668, September.
    26. Gadi Barlevy & Derek Neal, 2012. "Pay for Percentile," American Economic Review, American Economic Association, vol. 102(5), pages 1805-1831, August.
    27. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    28. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    29. David J. Deming, 2014. "Using School Choice Lotteries to Test Measures of School Effectiveness," American Economic Review, American Economic Association, vol. 104(5), pages 406-411, May.
    30. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    31. Sass, Tim R. & Hannaway, Jane & Xu, Zeyu & Figlio, David N. & Feng, Li, 2012. "Value added of teachers in high-poverty schools and lower poverty schools," Journal of Urban Economics, Elsevier, vol. 72(2), pages 104-122.
    32. Kata Mihaly & Daniel McCaffrey & Tim R. Sass & J. R. Lockwood, 2013. "Where You Come From or Where You Go? Distinguishing Between School Quality and the Effectiveness of Teacher Preparation Program Graduates," Education Finance and Policy, MIT Press, vol. 8(4), pages 459-493, October.
    33. Janet Currie & Duncan Thomas, 2000. "School Quality and the Longer-Term Effects of Head Start," Journal of Human Resources, University of Wisconsin Press, vol. 35(4), pages 755-774.
    34. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    35. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    36. Goldhaber, Dan & Cowan, James & Walch, Joe, 2013. "Is a good elementary teacher always good? Assessing teacher performance estimates across subjects," Economics of Education Review, Elsevier, vol. 36(C), pages 216-228.
    37. repec:mpr:mprres:7748 is not listed on IDEAS
    38. Josh Kinsler, 2012. "Assessing Rothstein's critique of teacher value‐added models," Quantitative Economics, Econometric Society, vol. 3(2), pages 333-362, July.
    39. Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages 3-33, February.
    40. Koedel, Cory, 2009. "An empirical analysis of teacher spillover effects in secondary school," Economics of Education Review, Elsevier, vol. 28(6), pages 682-692, December.
    41. Christopher Jepsen & Steven Rivkin, 2009. "Class Size Reduction and Student Achievement: The Potential Tradeoff between Teacher Quality and Class Size," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    42. repec:mpr:mprres:7762 is not listed on IDEAS
    43. repec:hrv:faseco:30749606 is not listed on IDEAS
    44. Krueger, Alan B & Whitmore, Diane M, 2001. "The Effect of Attending a Small Class in the Early Grades on College-Test Taking and Middle School Test Results: Evidence from Project STAR," Economic Journal, Royal Economic Society, vol. 111(468), pages 1-28, January.
    45. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    46. Matthew Johnson & Stephen Lipscomb & Brian Gill & Kevin Booker & Julie Bruch, 2012. "Value-Added Models for the Pittsburgh Public Schools," Mathematica Policy Research Reports 1a314c80952d49a1a52924599, Mathematica Policy Research.
    47. J. R. Lockwood & Daniel F. McCaffrey, 2014. "Correcting for Test Score Measurement Error in ANCOVA Models for Estimating Treatment Effects," Journal of Educational and Behavioral Statistics, , vol. 39(1), pages 22-52, February.
    48. Cory Koedel & Julian R. Betts, 2011. "Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique," Education Finance and Policy, MIT Press, vol. 6(1), pages 18-42, January.
    49. Harris, Douglas N. & Sass, Tim R., 2014. "Skills, productivity and the evaluation of teacher performance," Economics of Education Review, Elsevier, vol. 40(C), pages 183-204.
    50. Donald Boyd & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2013. "Measuring Test Measurement Error," Journal of Educational and Behavioral Statistics, , vol. 38(6), pages 629-663, December.
    51. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    52. Koedel, Cory, 2008. "Teacher quality and dropout outcomes in a large, urban school district," Journal of Urban Economics, Elsevier, vol. 64(3), pages 560-572, November.
    53. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    54. repec:mpr:mprres:7938 is not listed on IDEAS
    55. Dan Goldhaber & Roddy Theobald, 2013. "Managing the Teacher Workforce in Austere Times: The Determinants and Implications of Teacher Layoffs," Education Finance and Policy, MIT Press, vol. 8(4), pages 494-527, October.
    56. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2011. "Identifying Effective Classroom Practices Using Student Achievement Data," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 587-613.
    57. repec:mpr:mprres:6829 is not listed on IDEAS
    58. Brian A. Jacob & Lars Lefgren, 2008. "Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education," Journal of Labor Economics, University of Chicago Press, vol. 26, pages 101-136.
    59. Steven Glazerman & Ali Protik & Bing-ru Teh & Julie Bruch & Jeffrey Max, 2013. "Transfer Incentives for High-Performing Teachers: Final Results from a Multisite Randomized Experiment," Mathematica Policy Research Reports 4269bc8810414c8a8f64d3c36, Mathematica Policy Research.
    60. Yoram Ben-Porath, 1967. "The Production of Human Capital and the Life Cycle of Earnings," Journal of Political Economy, University of Chicago Press, vol. 75, pages 352-352.
    61. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    62. Jun Ishii & Steven G. Rivkin, 2009. "Impediments to the Estimation of Teacher Value Added," Education Finance and Policy, MIT Press, vol. 4(4), pages 520-536, October.
    63. Kata Mihaly & Daniel F. McCaffrey & J. R. Lockwood & Tim R. Sass, 2010. "Centering and reference groups for estimates of fixed effects: Modifications to felsdvreg," Stata Journal, StataCorp LP, vol. 10(1), pages 82-103, March.
    64. repec:mpr:mprres:7439 is not listed on IDEAS
    65. Eric S. Taylor & John H. Tyler, 2012. "The Effect of Evaluation on Teacher Performance," American Economic Review, American Economic Association, vol. 102(7), pages 3628-3651, December.
    66. Richard J. Murnane & John B. Willett & Yves Duhaldeborde & John H. Tyler, 2000. "How important are the cognitive skills of teenagers in predicting subsequent earnings?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(4), pages 547-568.
    67. Donald Boyd & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2011. "Teacher Layoffs: An Empirical Illustration of Seniority versus Measures of Effectiveness," Education Finance and Policy, MIT Press, vol. 6(3), pages 439-454, July.
    68. Condie, Scott & Lefgren, Lars & Sims, David, 2014. "Teacher heterogeneity, value-added and education policy," Economics of Education Review, Elsevier, vol. 40(C), pages 76-92.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chris Ryan, 2017. "Secondary School Teacher Effects on Student Achievement in Australian Schools," Melbourne Institute Working Paper Series wp2017n11, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    2. Dan Goldhaber & Cyrus Grout & Nick Huntington-Klein, 2017. "Screen Twice, Cut Once: Assessing the Predictive Validity of Applicant Selection Tools," Education Finance and Policy, MIT Press, vol. 12(2), pages 197-223, Spring.
    3. Rajeev Darolia & Cory Koedel, 2016. "High Schools and Students’ Initial Colleges and Majors," Working Papers WP16-09, Department of Economics, University of Missouri, revised Apr 2017.
    4. Akyol, Pelin & Krishna, Kala, 2017. "Preferences, selection, and value added: A structural approach," European Economic Review, Elsevier, vol. 91(C), pages 89-117.
    5. repec:eee:juecon:v:100:y:2017:i:c:p:54-64 is not listed on IDEAS
    6. von Hippel, Paul T. & Bellows, Laura & Osborne, Cynthia & Lincove, Jane Arnold & Mills, Nick, 2016. "Teacher quality differences between teacher preparation programs: How big? How reliable? Which programs are different?," Economics of Education Review, Elsevier, vol. 53(C), pages 31-45.
    7. repec:bla:jorssa:v:180:y:2017:i:1:p:315-340 is not listed on IDEAS
    8. Matthew Skellern, 2017. "The Hospital as a Multi-Product Firm: The Effect of Hospital Competition on Value-Added Indicators of Clinical Quality," CEP Discussion Papers dp1484, Centre for Economic Performance, LSE.
    9. repec:eee:injoed:v:60:y:2018:i:c:p:33-50 is not listed on IDEAS
    10. Ruth Maria Schüler, 2016. "Educational inputs and economic development in end-of-nineteenth-century Prussia," ifo Working Paper Series 227, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    11. Julian R. Betts & Youjin Hahn & Andrew C. Zau, 2015. "Can Testing Improve Student Learning? An Evaluation of the Mathematics Diagnostic Testing Project," Monash Economics Working Papers 31-15, Monash University, Department of Economics.

    More about this item

    Keywords

    Value-added models; VAM; teacher evaluation; education production;

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • J45 - Labor and Demographic Economics - - Particular Labor Markets - - - Public Sector Labor Markets
    • M52 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Compensation and Compensation Methods and Their Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:umc:wpaper:1501. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Valerie Kulp). General contact details of provider: http://edirc.repec.org/data/edumous.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.