IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/18568.html
   My bibliography  Save this paper

Using Student Test Scores to Measure Principal Performance

Author

Listed:
  • Jason A. Grissom
  • Demetra Kalogrides
  • Susanna Loeb

Abstract

Expansion of the use of student test score data to measure teacher performance has fueled recent policy interest in using those data to measure the effects of school administrators as well. However, little research has considered the capacity of student performance data to uncover principal effects. Filling this gap, this article identifies multiple conceptual approaches for capturing the contributions of principals to student test score growth, develops empirical models to reflect these approaches, examines the properties of these models, and compares the results of the models empirically using data from a large urban school district. The paper then assesses the degree to which the estimates from each model are consistent with measures of principal performance that come from sources other than student test scores, such as school district evaluations. The results show that choice of model is substantively important for assessment. While some models identify principal effects as large as 0.15 standard deviations in math and 0.11 in reading, others find effects as low as 0.02 in both subjects for the same principals. We also find that the most conceptually unappealing models, which over-attribute school effects to principals, align more closely with non-test measures than do approaches that more convincingly separate the effect of the principal from the effects of other school inputs.

Suggested Citation

  • Jason A. Grissom & Demetra Kalogrides & Susanna Loeb, 2012. "Using Student Test Scores to Measure Principal Performance," NBER Working Papers 18568, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:18568
    Note: ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w18568.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Eberts, Randall W. & Stone, Joe A., 1988. "Student achievement in public schools: Do principals make a difference?," Economics of Education Review, Elsevier, vol. 7(3), pages 291-299, June.
    2. repec:pri:cepsud:170rothstein is not listed on IDEAS
    3. Thomas J. Kane & Douglas O. Staiger, 2002. "The Promise and Pitfalls of Using Imprecise School Accountability Measures," Journal of Economic Perspectives, American Economic Association, vol. 16(4), pages 91-114, Fall.
    4. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    5. Jesse Rothstein, 2009. "Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables," Education Finance and Policy, MIT Press, vol. 4(4), pages 537-571, October.
    6. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    7. Elizabeth Dhuey & Justin Smith, 2014. "How important are school principals in the production of student achievement?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(2), pages 634-663, May.
    8. Brian A. Jacob & Lars Lefgren, 2008. "Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education," Journal of Labor Economics, University of Chicago Press, vol. 26(1), pages 101-136.
    9. Daniel M. Koretz, 2002. "Limitations in the Use of Achievement Tests as Measures of Educators' Productivity," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 752-777.
    10. Brewer, Dominic J., 1993. "Principals and student outcomes: Evidence from U.S. high schools," Economics of Education Review, Elsevier, vol. 12(4), pages 281-292, December.
    11. Brian A. Jacob & Lars Lefgren & David P. Sims, 2010. "The Persistence of Teacher-Induced Learning," Journal of Human Resources, University of Wisconsin Press, vol. 45(4), pages 915-943.
    12. Donald Boyd & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2012. "Measuring Test Measurement Error: A General Approach," NBER Working Papers 18010, National Bureau of Economic Research, Inc.
    13. repec:mpr:mprres:6941 is not listed on IDEAS
    14. Gregory F. Branch & Eric A. Hanushek & Steven G. Rivkin, 2012. "Estimating the Effect of Leaders on Public Sector Productivity: The Case of School Principals," NBER Working Papers 17803, National Bureau of Economic Research, Inc.
    15. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    16. Coelli, Michael & Green, David A., 2012. "Leadership effects: school principals and student outcomes," Economics of Education Review, Elsevier, vol. 31(1), pages 92-109.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Moira McCullough & Stephen Lipscomb & Hanley Chiang & Brian Gill & Irina Cheban, "undated". "Measuring School Leaders' Effectiveness: Final Report from a Multiyear Pilot of Pennsylvania's Framework for Leadership," Mathematica Policy Research Reports afa7e4c19e4140f3b17422e99, Mathematica Policy Research.
    2. Camanho, Ana S. & Varriale, Luisa & Barbosa, Flávia & Sobral, Thiago, 2021. "Performance assessment of upper secondary schools in Italian regions using a circular pseudo-Malmquist index," European Journal of Operational Research, Elsevier, vol. 289(3), pages 1188-1208.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elizabeth Dhuey & Justin Smith, 2014. "How important are school principals in the production of student achievement?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(2), pages 634-663, May.
    2. Mike Helal & Michael Coelli, 2016. "How Principals Affect Schools," Melbourne Institute Working Paper Series wp2016n18, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    3. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    4. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    5. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    6. repec:mpr:mprres:7587 is not listed on IDEAS
    7. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    8. Elizabeth Dhuey & Justin Smith, 2018. "How school principals influence student learning," Empirical Economics, Springer, vol. 54(2), pages 851-882, March.
    9. Sean Corcoran & Dan Goldhaber, 2013. "Value Added and Its Uses: Where You Stand Depends on Where You Sit," Education Finance and Policy, MIT Press, vol. 8(3), pages 418-434, July.
    10. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2014. "Is School Value Added Indicative of Principal Quality?," Mathematica Policy Research Reports a11ab111ac3a497885e0a736f, Mathematica Policy Research.
    11. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2016. "Is School Value Added Indicative of Principal Quality?," Education Finance and Policy, MIT Press, vol. 11(3), pages 283-309, Summer.
    12. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    13. Ingo E. Isphording & Ulf Zölitz, 2020. "The value of a peer," ECON - Working Papers 342, Department of Economics - University of Zurich.
    14. Stephen Lipscomb & Hanley Chiang & Brian Gill, "undated". "Value-Added Estimates for Phase 1 of the Pennsylvania Teacher and Principal Evaluation Pilot," Mathematica Policy Research Reports 88151979a8a6469582f1bce32, Mathematica Policy Research.
    15. Rockoff, Jonah E. & Speroni, Cecilia, 2011. "Subjective and objective evaluations of teacher effectiveness: Evidence from New York City," Labour Economics, Elsevier, vol. 18(5), pages 687-696, October.
    16. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    17. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    18. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    19. Goldhaber, Dan & Cowan, James & Walch, Joe, 2013. "Is a good elementary teacher always good? Assessing teacher performance estimates across subjects," Economics of Education Review, Elsevier, vol. 36(C), pages 216-228.
    20. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    21. Mueller, Steffen, 2013. "Teacher experience and the class size effect — Experimental evidence," Journal of Public Economics, Elsevier, vol. 98(C), pages 44-52.

    More about this item

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:18568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.