IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/14778.html
   My bibliography  Save this paper

Value-Added to What? How a Ceiling in the Testing Instrument Influences Value-Added Estimation

Author

Listed:
  • Cory Koedel
  • Julian Betts

Abstract

Value-added measures of teacher quality may be sensitive to the quantitative properties of the student tests upon which they are based. This paper focuses on the sensitivity of value-added to test-score-ceiling effects. Test-score ceilings are increasingly common in testing instruments across the country as education policy continues to emphasize proficiency-based reform. Encouragingly, we show that over a wide range of test-score-ceiling severity, teachers' value-added estimates are only negligibly influenced by ceiling effects. However, as ceiling conditions approach those found in minimum-competency testing environments, value-added results are significantly altered. We suggest a simple statistical check for ceiling effects.

Suggested Citation

  • Cory Koedel & Julian Betts, 2009. "Value-Added to What? How a Ceiling in the Testing Instrument Influences Value-Added Estimation," NBER Working Papers 14778, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:14778
    Note: ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w14778.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thomas J. Kane & Douglas O. Staiger, 2002. "The Promise and Pitfalls of Using Imprecise School Accountability Measures," Journal of Economic Perspectives, American Economic Association, vol. 16(4), pages 91-114, Fall.
    2. Sass, Tim R. & Semykina, Anastasia & Harris, Douglas N., 2014. "Value-added models and the measurement of teacher productivity," Economics of Education Review, Elsevier, vol. 38(C), pages 9-23.
    3. Arabmazar, Abbas & Schmidt, Peter, 1981. "Further evidence on the robustness of the Tobit estimator to heteroskedasticity," Journal of Econometrics, Elsevier, vol. 17(2), pages 253-258, November.
    4. Gorgens, Tue & Horowitz, Joel L., 1999. "Semiparametric estimation of a censored regression model with an unknown transformation of the dependent variable," Journal of Econometrics, Elsevier, vol. 90(2), pages 155-191, June.
    5. Songnian Chen, 2002. "Rank Estimation of Transformation Models," Econometrica, Econometric Society, vol. 70(4), pages 1683-1697, July.
    6. Eric A. Hanushek & John F. Kain & Daniel M. O'Brien & Steven G. Rivkin, 2005. "The Market for Teacher Quality," NBER Working Papers 11154, National Bureau of Economic Research, Inc.
    7. Richard T. Carson & Yixiao Sun, 2007. "The Tobit model with a non-zero threshold," Econometrics Journal, Royal Economic Society, vol. 10(3), pages 488-502, November.
    8. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    9. repec:pri:edures:25ers.pdf is not listed on IDEAS
    10. Koedel, Cory, 2009. "An empirical analysis of teacher spillover effects in secondary school," Economics of Education Review, Elsevier, vol. 28(6), pages 682-692, December.
    11. Michael J. Podgursky & Matthew G. Springer, 2007. "Teacher performance pay: A review," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(4), pages 909-950.
    12. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    13. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    14. Cory Koedel & Julian Betts, 2007. "Re-Examining the Role of Teacher Quality In the Educational Production Function," Working Papers 0708, Department of Economics, University of Missouri.
    15. Charles Brown & Robert Moffitt, 1983. "The Effect of Ignoring Heteroscedasticity on Estimates of the Tobit Model," NBER Technical Working Papers 0027, National Bureau of Economic Research, Inc.
    16. Hurd, Michael, 1979. "Estimation in truncated samples when there is heteroscedasticity," Journal of Econometrics, Elsevier, vol. 11(2-3), pages 247-258.
    17. John Yinger (ed.), 2004. "Helping Children Left Behind: State Aid and the Pursuit of Educational Equity," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262240467, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cory Koedel & Julian R. Betts, 2011. "Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique," Education Finance and Policy, MIT Press, vol. 6(1), pages 18-42, January.
    2. Koedel, Cory, 2009. "An empirical analysis of teacher spillover effects in secondary school," Economics of Education Review, Elsevier, vol. 28(6), pages 682-692, December.
    3. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    4. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    5. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    6. Peter Z. Schochet & Hanley S. Chiang, 2013. "What Are Error Rates for Classifying Teacher and School Performance Using Value-Added Models?," Journal of Educational and Behavioral Statistics, , vol. 38(2), pages 142-171, April.
    7. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    8. Cook, Jason B. & Mansfield, Richard K., 2016. "Task-specific experience and task-specific talent: Decomposing the productivity of high school teachers," Journal of Public Economics, Elsevier, vol. 140(C), pages 51-72.
    9. Lindsay Fox, 2016. "Playing to Teachers’ Strengths: Using Multiple Measures of Teacher Effectiveness to Improve Teacher Assignments," Education Finance and Policy, MIT Press, vol. 11(1), pages 70-96, Winter.
    10. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    11. Cory Koedel & Julian Betts, 2007. "Re-Examining the Role of Teacher Quality In the Educational Production Function," Working Papers 0708, Department of Economics, University of Missouri.
    12. repec:pri:cepsud:159rothstein is not listed on IDEAS
    13. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7), pages 798-812.
    14. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    15. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    16. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    17. Cory Koedel & Julian Betts, 2007. "Teacher Quality and Educational Production in Secondary School," Working Papers 0707, Department of Economics, University of Missouri.
    18. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    19. Condie, Scott & Lefgren, Lars & Sims, David, 2014. "Teacher heterogeneity, value-added and education policy," Economics of Education Review, Elsevier, vol. 40(C), pages 76-92.
    20. Jesse Rothstein, 2007. "Do Value-Added Models Add Value? Tracking, Fixed Effects, and Causal Inference," Working Papers 1036, Princeton University, Department of Economics, Center for Economic Policy Studies..
    21. C. Kirabo Jackson, 2013. "Match Quality, Worker Productivity, and Worker Mobility: Direct Evidence from Teachers," The Review of Economics and Statistics, MIT Press, vol. 95(4), pages 1096-1116, October.

    More about this item

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • J08 - Labor and Demographic Economics - - General - - - Labor Economics Policies
    • J33 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Compensation Packages; Payment Methods
    • J45 - Labor and Demographic Economics - - Particular Labor Markets - - - Public Sector Labor Markets

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:14778. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.