IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/11463.html
   My bibliography  Save this paper

Principals as Agents: Subjective Performance Measurement in Education

Author

Listed:
  • Brian A. Jacob
  • Lars Lefgren

Abstract

In this paper, we compare subjective principal assessments of teachers to the traditional determinants of teacher compensation ¡V education and experience ¡V and another potential compensation mechanism -- value-added measures of teacher effectiveness based on student achievement gains. We find that subjective principal assessments of teachers predict future student achievement significantly better than teacher experience, education or actual compensation, though not as well as value-added teacher quality measures. In particular, principals appear quite good at identifying those teachers who produce the largest and smallest standardized achievement gains in their schools, but have far less ability to distinguish between teachers in the middle of this distribution and systematically discriminate against male and untenured faculty. Moreover, we find that a principal¡'s overall rating of a teacher is a substantially better predictor of future parent requests for that teacher than either the teacher¡'s experience, education and current compensation or the teacher¡'s value-added achievement measure. These findings not only inform education policy, but also shed light on subjective performance assessment more generally.

Suggested Citation

  • Brian A. Jacob & Lars Lefgren, 2005. "Principals as Agents: Subjective Performance Measurement in Education," NBER Working Papers 11463, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:11463
    Note: CH ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w11463.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    2. Eric A. Hanushek & John F. Kain & Steven G. Rivkin & Daniel M. O'Brien, 2005. "The Market for Teacher Quality," Discussion Papers 04-025, Stanford Institute for Economic Policy Research.
    3. David N. Figlio & Maurice E. Lucas, 2000. "What's in a Grade? School Report Cards and House Prices," NBER Working Papers 8019, National Bureau of Economic Research, Inc.
    4. Jacob, Brian A. & Lefgren, Lars, 2005. "What Do Parents Value in Education? An Investigation of Parents' Revealed Preferences for Teachers," Working Paper Series rwp05-043, Harvard University, John F. Kennedy School of Government.
    5. Hanushek, Eric A, 1992. "The Trade-Off between Child Quantity and Quality," Journal of Political Economy, University of Chicago Press, vol. 100(1), pages 84-117, February.
    6. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    7. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    8. Brian A. Jacob & Lars Lefgren, 2007. "What Do Parents Value in Education? An Empirical Investigation of Parents' Revealed Preferences for Teachers," The Quarterly Journal of Economics, Oxford University Press, vol. 122(4), pages 1603-1637.
    9. Daniel G. Sullivan, 2001. "A note on the estimation of linear regression models with Heteroskedastic measurement errors," Working Paper Series WP-01-23, Federal Reserve Bank of Chicago.
    10. Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages 3-33, February.
    11. Hanushek, Eric A, 1986. "The Economics of Schooling: Production and Efficiency in Public Schools," Journal of Economic Literature, American Economic Association, vol. 24(3), pages 1141-1177, September.
    12. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    13. Moulton, Brent R, 1990. "An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Unit," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 334-338, May.
    14. Hanushek, E.A.omson, W., 1996. "Assessing the Effects of School Resources on Student Performance : An Update," RCER Working Papers 424, University of Rochester - Center for Economic Research (RCER).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brian A. Jacob & Lars Lefgren, 2007. "What Do Parents Value in Education? An Empirical Investigation of Parents' Revealed Preferences for Teachers," The Quarterly Journal of Economics, Oxford University Press, vol. 122(4), pages 1603-1637.
    2. Douglas Harris & Tim R. Sass, 2006. "The Effects of Teacher Training on Teacher Value Added," Working Papers wp_2006_03_01, Department of Economics, Florida State University.
    3. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    4. Emiliana Vegas & Ilana Umansky, 2005. "Improving Teaching and Learning through Effective Incentives : What Can We Learn from Education Reforms in Latin America?," World Bank Publications - Reports 8694, The World Bank Group.
    5. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2007. "How and Why do Teacher Credentials Matter for Student Achievement?," NBER Working Papers 12828, National Bureau of Economic Research, Inc.
    6. Andrabi, Tahir & Das, Jishnu & Khwaja, Asim Ijaz & Zajonc, Tristan, 2009. "Here Today, Gone Tomorrow? Examining the Extent and Implications of Low Persistence in Child Learning," Working Paper Series rwp09-001, Harvard University, John F. Kennedy School of Government.
    7. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    8. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja & Tristan Zajonc, 2011. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 29-54, July.
    9. Sander Gerritsen & Erik Plug & Dinand Webbink, 2014. "Teacher quality and student achievement: Evidence from a Dutch sample of twins," CPB Discussion Paper 294, CPB Netherlands Bureau for Economic Policy Analysis.
    10. Derek Neal, 2011. "The Design of Performance Pay in Education," NBER Working Papers 16710, National Bureau of Economic Research, Inc.
    11. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    12. Pierre Lefebvre & Philip Merrigan & Matthieu Verstraete, 2008. "The Effects of School Quality and Family Functioning on Youth Math Scores: a Canadian Longitudinal Analysis," Cahiers de recherche 0822, CIRPEE.
    13. Eric A. Hanushek, 2008. "Incentives for Efficiency and Equity in the School System," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(s1), pages 5-27, May.
    14. Sander Gerritsen & Erik Plug & Dinand Webbink, 2014. "Teacher quality and student achievement: Evidence from a Dutch sample of twins," CPB Discussion Paper 294.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    15. Martin Schlotter & Guido Schwerdt & Ludger Woessmann, 2011. "Econometric methods for causal evaluation of education policies and practices: a non-technical guide," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 109-137.
    16. Bourdon, Jean & Frölich, Markus & Michaelowa, Katharina, 2007. "Teacher Shortages, Teacher Contracts and their Impact on Education in Africa," IZA Discussion Papers 2844, Institute of Labor Economics (IZA).
    17. David Brasington & Don Haurin, 2005. "Capitalization of Parent, School, and Peer Group Components of School Quality into House Price," Departmental Working Papers 2005-04, Department of Economics, Louisiana State University.
    18. Helen F. Ladd & Lucy C. Sorensen, 2017. "Returns to Teacher Experience: Student Achievement and Motivation in Middle School," Education Finance and Policy, MIT Press, vol. 12(2), pages 241-279, Spring.
    19. Jesse Rothstein, 2007. "Do Value-Added Models Add Value? Tracking, Fixed Effects, and Causal Inference," Working Papers 1036, Princeton University, Department of Economics, Center for Economic Policy Studies..
    20. Barankay, Iwan & Lockwood, Ben, 2007. "Decentralization and the productive efficiency of government: Evidence from Swiss cantons," Journal of Public Economics, Elsevier, vol. 91(5-6), pages 1197-1218, June.

    More about this item

    JEL classification:

    • I0 - Health, Education, and Welfare - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:11463. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.