IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19096.html
   My bibliography  Save this paper

Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness

Author

Listed:
  • Allison Atteberry
  • Susanna Loeb
  • James Wyckoff

Abstract

Educational policymakers struggle to find ways to improve the quality of the teacher workforce. The early career period represents a unique opportunity to identify struggling teachers, examine the likelihood of future improvement, and make strategic pre-tenure investments in improvement as well as dismissals to increase teaching quality. To date, only a little is known about the dynamics of teacher performance in the first five years. This paper asks how much teachers vary in performance improvement during their first five years of teaching and to what extent initial job performance predicts later performance. We find that, on average, initial performance is quite predictive of future performance, far more so than typically measured teacher characteristics. Predictions are particularly powerful at the extremes. We employ these predictions to explore the likelihood of personnel actions that inappropriately distinguish performance when such predictions are mistaken as well as the much less discussed costs of failure to distinguish performance when meaningful differences exist. The results have important consequences for improving the quality of the teacher workforce.

Suggested Citation

  • Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:19096
    Note: ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19096.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 798-812, August.
    3. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    4. Thomas J. Kane & Douglas O. Staiger, 2002. "The Promise and Pitfalls of Using Imprecise School Accountability Measures," Journal of Economic Perspectives, American Economic Association, vol. 16(4), pages 91-114, Fall.
    5. Daniel F. McCaffrey & Tim R. Sass & J. R. Lockwood & Kata Mihaly, 2009. "The Intertemporal Variability of Teacher Effect Estimates," Education Finance and Policy, MIT Press, vol. 4(4), pages 572-606, October.
    6. Eric A. Hanushek & John F. Kain & Steven G. Rivkin & Daniel M. O'Brien, 2005. "The Market for Teacher Quality," Discussion Papers 04-025, Stanford Institute for Economic Policy Research.
    7. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    8. Dan Goldhaber & Betheny Gross & Daniel Player, 2011. "Teacher career paths, teacher quality, and persistence in the classroom: Are public schools keeping their best?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(1), pages 57-87, December.
    9. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    10. Eric S. Taylor & John H. Tyler, 2011. "The Effect of Evaluation on Performance: Evidence from Longitudinal Student Achievement Data of Mid-career Teachers," NBER Working Papers 16877, National Bureau of Economic Research, Inc.
    11. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2011. "The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood," NBER Working Papers 17699, National Bureau of Economic Research, Inc.
    12. Cory Koedel & Julian R. Betts, 2011. "Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique," Education Finance and Policy, MIT Press, vol. 6(1), pages 18-42, January.
    13. Donald Boyd & Hamilton Lankford & Susanna Loeb & Jonah Rockoff & James Wyckoff, 2008. "The narrowing gap in New York City teacher qualifications and its implications for student achievement in high-poverty schools," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 27(4), pages 793-818.
    14. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    15. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2011. "Identifying Effective Classroom Practices Using Student Achievement Data," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 587-613.
    16. Brian A. Jacob & Lars Lefgren, 2008. "Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education," Journal of Labor Economics, University of Chicago Press, vol. 26(1), pages 101-136.
    17. Cory Koedel & Julian Betts, 2007. "Re-Examining the Role of Teacher Quality In the Educational Production Function," Working Papers 0708, Department of Economics, University of Missouri.
    18. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    19. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2010. "Teacher Credentials and Student Achievement in High School: A Cross-Subject Analysis with Student Fixed Effects," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
    20. Clotfelter, Charles T. & Ladd, Helen F. & Vigdor, Jacob L., 2007. "Teacher credentials and student achievement: Longitudinal analysis with student fixed effects," Economics of Education Review, Elsevier, vol. 26(6), pages 673-682, December.
    21. repec:mpr:mprres:6857 is not listed on IDEAS
    22. Pam Grossman & Susanna Loeb & Julia Cohen & Karen Hammerness & James Wyckoff & Donald Boyd & Hamilton Lankford, 2010. "Measure for Measure: The relationship between measures of instructional practice in middle school English Language Arts and teachers' value-added scores," NBER Working Papers 16015, National Bureau of Economic Research, Inc.
    23. Don Boyd & Hamp Lankford & Susanna Loeb & Matthew Ronfeldt & Jim Wyckoff, 2011. "The role of teacher quality in retention and hiring: Using applications to transfer to uncover preferences of teachers and schools," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(1), pages 88-110, December.
    24. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2010. "Identifying Effective Classroom Practices Using Student Achievement Data," NBER Working Papers 15803, National Bureau of Economic Research, Inc.
    25. Richard J. Murnane & Barbara R. Phillips, 1981. "What Do Effective Teachers of Inner-City Children have in Common?," Mathematica Policy Research Reports b0614b2fa4ae4eae82cec19fb, Mathematica Policy Research.
    26. Hanushek, Eric, 1971. "Teacher Characteristics and Gains in Student Achievement: Estimation Using Micro Data," American Economic Review, American Economic Association, vol. 61(2), pages 280-288, May.
    27. Eric Hanushek & Steven Rivkin, "undated". "Constrained Job Matching: Does Teacher Job Search Harm Disadvantaged Urban Schools?," Discussion Papers 09-011, Stanford Institute for Economic Policy Research.
    28. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    29. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Thomas S. Dee & James Wyckoff, 2015. "Incentives, Selection, and Teacher Performance: Evidence from IMPACT," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(2), pages 267-297, March.
    2. Rebecca Allen & Jay Allnutt, 2013. "Matched panel data estimates of the impact of Teach First on school and departmental performance," DoQSS Working Papers 13-11, Quantitative Social Science - UCL Social Research Institute, University College London.
    3. Cook, Jason B. & Mansfield, Richard K., 2016. "Task-specific experience and task-specific talent: Decomposing the productivity of high school teachers," Journal of Public Economics, Elsevier, vol. 140(C), pages 51-72.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    2. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    3. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    4. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    5. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    6. Harris, Douglas N. & Sass, Tim R., 2014. "Skills, productivity and the evaluation of teacher performance," Economics of Education Review, Elsevier, vol. 40(C), pages 183-204.
    7. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    8. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    9. Robert G. Valletta & K. Jody Hoff & Jane S. Lopus, 2014. "Lost In Translation? Teacher Training And Outcomes In High School Economics Classes," Contemporary Economic Policy, Western Economic Association International, vol. 32(4), pages 695-709, October.
    10. Sean Corcoran & Dan Goldhaber, 2013. "Value Added and Its Uses: Where You Stand Depends on Where You Sit," Education Finance and Policy, MIT Press, vol. 8(3), pages 418-434, July.
    11. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    12. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    13. Goldhaber, Dan & Cowan, James & Walch, Joe, 2013. "Is a good elementary teacher always good? Assessing teacher performance estimates across subjects," Economics of Education Review, Elsevier, vol. 36(C), pages 216-228.
    14. Peter Z. Schochet & Hanley S. Chiang, 2013. "What Are Error Rates for Classifying Teacher and School Performance Using Value-Added Models?," Journal of Educational and Behavioral Statistics, , vol. 38(2), pages 142-171, April.
    15. Wiswall, Matthew, 2013. "The dynamics of teacher quality," Journal of Public Economics, Elsevier, vol. 100(C), pages 61-78.
    16. Daniel Santín & Gabriela Sicilia, 2018. "Using DEA for measuring teachers’ performance and the impact on students’ outcomes: evidence for Spain," Journal of Productivity Analysis, Springer, vol. 49(1), pages 1-15, February.
    17. Eric Hanushek & Steven Rivkin, "undated". "Constrained Job Matching: Does Teacher Job Search Harm Disadvantaged Urban Schools?," Discussion Papers 09-011, Stanford Institute for Economic Policy Research.
    18. Li Feng & Tim R. Sass, 2017. "Teacher Quality and Teacher Mobility," Education Finance and Policy, MIT Press, vol. 12(3), pages 396-418, Summer.
    19. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    20. Helen F. Ladd & Lucy C. Sorensen, 2017. "Returns to Teacher Experience: Student Achievement and Motivation in Middle School," Education Finance and Policy, MIT Press, vol. 12(2), pages 241-279, Spring.

    More about this item

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19096. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.