IDEAS home Printed from https://ideas.repec.org/a/tpr/edfpol/v11y2016i3p283-309.html
   My bibliography  Save this article

Is School Value Added Indicative of Principal Quality?

Author

Listed:
  • Hanley Chiang

    (Mathematica Policy Research Cambridge, MA)

  • Stephen Lipscomb

    (Mathematica Policy Research Cambridge, MA)

  • Brian Gill

    (Mathematica Policy Research Cambridge, MA)

Abstract

States across the country are developing systems for evaluating school principals on the basis of student achievement growth. A common approach is to hold principals accountable for the value added of their schools—that is, schools’ contributions to student achievement growth. In theory, school value added can reflect not only principals’ effectiveness but also other school-specific influences on student achievement growth that are outside of principals’ control. In this paper, we isolate principals’ effects on student achievement growth and examine the extent to which school value added captures the effects that principals persistently demonstrate. Using longitudinal data on the math and reading outcomes of fourth- through eighth-grade students in Pennsylvania, our findings indicate that school value added provides very poor information for revealing principals’ persistent levels of effectiveness.

Suggested Citation

  • Hanley Chiang & Stephen Lipscomb & Brian Gill, 2016. "Is School Value Added Indicative of Principal Quality?," Education Finance and Policy, MIT Press, vol. 11(3), pages 283-309, Summer.
  • Handle: RePEc:tpr:edfpol:v:11:y:2016:i:3:p:283-309
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/EDFP_a_00184
    Download Restriction: Access to PDF is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. repec:mpr:mprres:7453 is not listed on IDEAS
    3. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    4. Elizabeth Dhuey & Justin Smith, 2018. "How school principals influence student learning," Empirical Economics, Springer, vol. 54(2), pages 851-882, March.
    5. Daniel F. McCaffrey & Tim R. Sass & J. R. Lockwood & Kata Mihaly, 2009. "The Intertemporal Variability of Teacher Effect Estimates," Education Finance and Policy, MIT Press, vol. 4(4), pages 572-606, October.
    6. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    7. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    8. Susanna Loeb & Demetra Kalogrides & Tara Béteille, 2012. "Effective Schools: Teacher Hiring, Assignment, Development, and Retention," Education Finance and Policy, MIT Press, vol. 7(3), pages 269-304, July.
    9. repec:mpr:mprres:7445 is not listed on IDEAS
    10. Elizabeth Dhuey & Justin Smith, 2014. "How important are school principals in the production of student achievement?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(2), pages 634-663, May.
    11. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, Oxford University Press, vol. 125(1), pages 175-214.
    12. David J. Deming, 2014. "Using School Choice Lotteries to Test Measures of School Effectiveness," American Economic Review, American Economic Association, vol. 104(5), pages 406-411, May.
    13. Brian A. Jacob & Lars Lefgren, 2008. "Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education," Journal of Labor Economics, University of Chicago Press, vol. 26(1), pages 101-136.
    14. Ladd, Helen F. & Walsh, Randall P., 2002. "Implementing value-added measures of school effectiveness: getting the incentives right," Economics of Education Review, Elsevier, vol. 21(1), pages 1-17, February.
    15. Brian A. Jacob & Lars Lefgren, 2005. "Principals as Agents: Subjective Performance Measurement in Education," NBER Working Papers 11463, National Bureau of Economic Research, Inc.
    16. Dan Goldhaber & Michael Hansen, 2010. "Using Performance on the Job to Inform Teacher Tenure Decisions," American Economic Review, American Economic Association, vol. 100(2), pages 250-255, May.
    17. Gregory F. Branch & Eric A. Hanushek & Steven G. Rivkin, 2012. "Estimating the Effect of Leaders on Public Sector Productivity: The Case of School Principals," NBER Working Papers 17803, National Bureau of Economic Research, Inc.
    18. repec:mpr:mprres:7454 is not listed on IDEAS
    19. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    20. repec:mpr:mprres:6829 is not listed on IDEAS
    21. Stephen Lipscomb & Hanley Chiang & Brian Gill, "undated". "Value-Added Estimates for Phase 1 of the Pennsylvania Teacher and Principal Evaluation Pilot," Mathematica Policy Research Reports dacd1fdea4354222868fb2fef, Mathematica Policy Research.
    22. Coelli, Michael & Green, David A., 2012. "Leadership effects: school principals and student outcomes," Economics of Education Review, Elsevier, vol. 31(1), pages 92-109.
    23. Stephen Lipscomb & Hanley Chiang & Brian Gill, "undated". "Value-Added Estimates for Phase 1 of the Pennsylvania Teacher and Principal Evaluation Pilot," Mathematica Policy Research Reports 88151979a8a6469582f1bce32, Mathematica Policy Research.
    24. Jacob, Brian A. & Lefgren, Lars, 2005. "Principals as Agents: Subjective Performance Measures in Education," Working Paper Series rwp05-040, Harvard University, John F. Kennedy School of Government.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Elizabeth Dhuey & Justin Smith, 2018. "How school principals influence student learning," Empirical Economics, Springer, vol. 54(2), pages 851-882, March.
    2. Wills, Gabrielle, 2016. "Principal leadership changes and their consequences for school performance in South Africa," International Journal of Educational Development, Elsevier, vol. 51(C), pages 108-124.
    3. Ingo E. Isphording & Ulf Zölitz, 2020. "The value of a peer," ECON - Working Papers 342, Department of Economics - University of Zurich.
    4. Brian Gill, 2022. "What Should The Future Of Educational Accountability Look Like?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1232-1239, September.
    5. Whitney Kozakowski & Brian Gill & Menbere Shiferaw, "undated". "Exploring the Potential Role of Staff Surveys in School Leader Evaluation," Mathematica Policy Research Reports fa18eaf8a4de4ee8a439e81a4, Mathematica Policy Research.
    6. Jason A. Grissom & Brendan Bartanen, 2019. "Principal Effectiveness and Principal Turnover," Education Finance and Policy, MIT Press, vol. 14(3), pages 355-382, Summer.
    7. Moira McCullough & Stephen Lipscomb & Hanley Chiang & Brian Gill, "undated". "Do Principals' Professional Practice Ratings Reflect Their Contributions to Student Achievement? Evidence from Pennsylvania's Framework for Leadership," Mathematica Policy Research Reports 23864abe140c4b658d1ba88d4, Mathematica Policy Research.
    8. Elias Walsh & Dallas Dotter, 2020. "The Impact on Student Achievement of Replacing Principals in District of Columbia Public Schools," Education Finance and Policy, MIT Press, vol. 15(3), pages 518-542, Summer.
    9. Bartanen, Brendan & Husain, Aliza N., 2022. "Connected networks in principal value-added models," Economics of Education Review, Elsevier, vol. 90(C).
    10. Susanna Loeb & Michael S. Christian & Heather Hough & Robert H. Meyer & Andrew B. Rice & Martin R. West, 2019. "School Differences in Social–Emotional Learning Gains: Findings From the First Large-Scale Panel Survey of Students," Journal of Educational and Behavioral Statistics, , vol. 44(5), pages 507-542, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2014. "Is School Value Added Indicative of Principal Quality?," Mathematica Policy Research Reports a11ab111ac3a497885e0a736f, Mathematica Policy Research.
    2. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    3. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    4. repec:mpr:mprres:7587 is not listed on IDEAS
    5. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    6. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    7. Moira McCullough & Stephen Lipscomb & Hanley Chiang & Brian Gill, "undated". "Do Principals' Professional Practice Ratings Reflect Their Contributions to Student Achievement? Evidence from Pennsylvania's Framework for Leadership," Mathematica Policy Research Reports 23864abe140c4b658d1ba88d4, Mathematica Policy Research.
    8. Sean Corcoran & Dan Goldhaber, 2013. "Value Added and Its Uses: Where You Stand Depends on Where You Sit," Education Finance and Policy, MIT Press, vol. 8(3), pages 418-434, July.
    9. David Blazar, 2018. "Validating Teacher Effects on Students’ Attitudes and Behaviors: Evidence from Random Assignment of Teachers to Students," Education Finance and Policy, MIT Press, vol. 13(3), pages 281-309, Summer.
    10. Mike Helal & Michael Coelli, 2016. "How Principals Affect Schools," Melbourne Institute Working Paper Series wp2016n18, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    11. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," GLO Discussion Paper Series 231, Global Labor Organization (GLO).
    12. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    13. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    14. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    15. Eric Parsons & Cory Koedel & Li Tan, 2019. "Accounting for Student Disadvantage in Value-Added Models," Journal of Educational and Behavioral Statistics, , vol. 44(2), pages 144-179, April.
    16. Goldhaber, Dan & Cowan, James & Walch, Joe, 2013. "Is a good elementary teacher always good? Assessing teacher performance estimates across subjects," Economics of Education Review, Elsevier, vol. 36(C), pages 216-228.
    17. Elizabeth Dhuey & Justin Smith, 2014. "How important are school principals in the production of student achievement?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(2), pages 634-663, May.
    18. Seth Gershenson & Diane Whitmore Schanzenbach, 2016. "Linking Teacher Quality, Student Attendance, and Student Achievement," Education Finance and Policy, MIT Press, vol. 11(2), pages 125-149, Spring.
    19. Jenifer Ruiz-Valenzuela & Camille Terrier & Clémentine Van Effenterre, 2017. "Effectiveness of CEOs in the public sector: evidence from further education institutions," CVER Briefing Notes 005, Centre for Vocational Education Research.
    20. Ingo E. Isphording & Ulf Zölitz, 2020. "The value of a peer," ECON - Working Papers 342, Department of Economics - University of Zurich.
    21. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:edfpol:v:11:y:2016:i:3:p:283-309. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelly McDougall (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.