IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22054.html
   My bibliography  Save this paper

Teacher Applicant Hiring and Teacher Performance: Evidence from DC Public Schools

Author

Listed:
  • Brian Jacob
  • Jonah E. Rockoff
  • Eric S. Taylor
  • Benjamin Lindy
  • Rachel Rosen

Abstract

Selecting more effective teachers among job applicants during the hiring process could be a highly cost-effective means of improving educational quality, but there is little research that links information gathered during the hiring process to subsequent teacher performance. We study the relationship among applicant characteristics, hiring outcomes, and teacher performance in the Washington DC Public Schools (DCPS). We take advantage of detailed data on a multi-stage application process, which includes written assessments, a personal interview, and sample lessons, as well as the annual evaluations of all DCPS teachers, based on multiple criteria. We identify a number of background characteristics (e.g., undergraduate GPA) as well as screening measures (e.g., applicant performance on a mock teaching lesson) that strongly predict teacher effectiveness. Interestingly, we find that these measures are only weakly, if at all, associated with the likelihood of being hired, suggesting considerable scope for improving teacher quality through the hiring process.

Suggested Citation

  • Brian Jacob & Jonah E. Rockoff & Eric S. Taylor & Benjamin Lindy & Rachel Rosen, 2016. "Teacher Applicant Hiring and Teacher Performance: Evidence from DC Public Schools," NBER Working Papers 22054, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22054
    Note: ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22054.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    2. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    3. Eric A. Hanushek & EJohn F. Kain & Steven G. Rivkin, 2004. "Why Public Schools Lose Teachers," Journal of Human Resources, University of Wisconsin Press, vol. 39(2).
    4. Jonah E. Rockoff & Cecilia Speroni, 2010. "Subjective and Objective Evaluations of Teacher Effectiveness," American Economic Review, American Economic Association, vol. 100(2), pages 261-266, May.
    5. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 798-812, August.
    6. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    7. Tom Ahn, 2013. "The Missing Link: Estimating the Impact of Incentives on Teacher Effort and Instructional Effectiveness Using Teacher Accountability Legislation Data," Journal of Human Capital, University of Chicago Press, vol. 7(3), pages 230-273.
    8. Burks, Stephen V. & Cowgill, Bo & Hoffman, Mitchell & Housman, Michael, 2013. "The Value of Hiring through Referrals," IZA Discussion Papers 7382, Institute of Labor Economics (IZA).
    9. Don Boyd & Hamp Lankford & Susanna Loeb & Matthew Ronfeldt & Jim Wyckoff, 2011. "The role of teacher quality in retention and hiring: Using applications to transfer to uncover preferences of teachers and schools," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(1), pages 88-110, December.
    10. Clotfelter, Charles & Glennie, Elizabeth & Ladd, Helen & Vigdor, Jacob, 2008. "Would higher salaries keep teachers in high-poverty schools? Evidence from a policy intervention in North Carolina," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1352-1370, June.
    11. Ian M. Schmutte, 2015. "Job Referral Networks and the Determination of Earnings in Local Labor Markets," Journal of Labor Economics, University of Chicago Press, vol. 33(1), pages 1-32.
    12. Dan Goldhaber & Cyrus Grout & Nick Huntington-Klein, 2017. "Screen Twice, Cut Once: Assessing the Predictive Validity of Applicant Selection Tools," Education Finance and Policy, MIT Press, vol. 12(2), pages 197-223, Spring.
    13. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    14. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    15. Ben Ost, 2014. "How Do Teachers Improve? The Relative Importance of Specific and General Human Capital," American Economic Journal: Applied Economics, American Economic Association, vol. 6(2), pages 127-151, April.
    16. C. Kirabo Jackson, 2014. "Teacher Quality at the High School Level: The Importance of Accounting for Tracks," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 645-684.
    17. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    18. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    19. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    20. Schacter, John & Thum, Yeow Meng, 2004. "Paying for high- and low-quality teaching," Economics of Education Review, Elsevier, vol. 23(4), pages 411-430, August.
    21. Jacob, Brian A. & Walsh, Elias, 2011. "What's in a rating?," Economics of Education Review, Elsevier, vol. 30(3), pages 434-448, June.
    22. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    23. Stephen V. Burks & Bo Cowgill & Mitchell Hoffman & Michael Housman, 2015. "The Value of Hiring through Employee Referrals," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(2), pages 805-839.
    24. Stephen L. Jacobson, 1989. "The Effects of Pay Incentives on Teacher Absenteeism," Journal of Human Resources, University of Wisconsin Press, vol. 24(2), pages 280-286.
    25. C. Kirabo Jackson, 2009. "Student Demographics, Teacher Sorting, and Teacher Quality: Evidence from the End of School Desegregation," Journal of Labor Economics, University of Chicago Press, vol. 27(2), pages 213-256, April.
    26. Jonah E. Rockoff & Brian A. Jacob & Thomas J. Kane & Douglas O. Staiger, 2011. "Can You Recognize an Effective Teacher When You Recruit One?," Education Finance and Policy, MIT Press, vol. 6(1), pages 43-74, January.
    27. Scafidi, Benjamin & Sjoquist, David L. & Stinebrickner, Todd R., 2007. "Race, poverty, and teacher mobility," Economics of Education Review, Elsevier, vol. 26(2), pages 145-159, April.
    28. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    29. Oyer, Paul & Schaefer, Scott, 2011. "Personnel Economics: Hiring and Incentives," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 20, pages 1769-1823, Elsevier.
    30. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    31. Thomas S. Dee & James Wyckoff, 2015. "Incentives, Selection, and Teacher Performance: Evidence from IMPACT," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(2), pages 267-297, March.
    32. Dan Goldhaber & Roddy Theobald, 2013. "Managing the Teacher Workforce in Austere Times: The Determinants and Implications of Teacher Layoffs," Education Finance and Policy, MIT Press, vol. 8(4), pages 494-527, October.
    33. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2011. "Identifying Effective Classroom Practices Using Student Achievement Data," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 587-613.
    34. Dolton, Peter J & van der Klaauw, Wilbert, 1995. "Leaving Teaching in the UK: A Duration Analysis," Economic Journal, Royal Economic Society, vol. 105(429), pages 431-444, March.
    35. Peter Dolton & Wilbert van der Klaauw, 1999. "The Turnover of Teachers: A Competing Risks Explanation," The Review of Economics and Statistics, MIT Press, vol. 81(3), pages 543-550, August.
    36. Dale Ballou, 1996. "Do Public Schools Hire the Best Applicants?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 111(1), pages 97-133.
    37. Jennifer King Rice, 2013. "Learning from Experience? Evidence on the Impact and Distribution of Teacher Experience and the Implications for Teacher Policy," Education Finance and Policy, MIT Press, vol. 8(3), pages 332-348, July.
    38. Melinda Adnot & Thomas Dee & Veronica Katz & James Wyckoff, 2016. "Teacher Turnover, Teacher Quality, and Student Achievement in DCPS," NBER Working Papers 21922, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Murphy, Richard & Weinhardt, Felix & Wyness, Gill, 2021. "Who teaches the teachers? A RCT of peer-to-peer observation and feedback in 181 schools," Economics of Education Review, Elsevier, vol. 82(C).
    2. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    3. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    4. Grönqvist, Erik & Vlachos, Jonas, 2016. "One size fits all? The effects of teachers' cognitive and social abilities on student achievement," Labour Economics, Elsevier, vol. 42(C), pages 138-150.
    5. Fraenkel, Rebecca Cannon, 2022. "Local labor markets and job match quality: Teachers," Labour Economics, Elsevier, vol. 78(C).
    6. Jonathan M.V. Davis, 2017. "The Short and Long Run Impacts of Centralized Clearinghouses: Evidence from Matching Teach For America Teachers to Schools," 2017 Papers pda791, Job Market Papers.
    7. Asma Benhenda, 2018. "Teacher Screening, On the Job Evaluations and Performancee," DoQSS Working Papers 18-06, Quantitative Social Science - UCL Social Research Institute, University College London.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jacob, Brian A. & Rockoff, Jonah E. & Taylor, Eric S. & Lindy, Benjamin & Rosen, Rachel, 2018. "Teacher applicant hiring and teacher performance: Evidence from DC public schools," Journal of Public Economics, Elsevier, vol. 166(C), pages 81-97.
    2. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    3. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    4. Michael Bates & Michael Dinerstein & Andrew C. Johnston & Isaac Sorkin, 2022. "Teacher Labor Market Equilibrium and Student Achievement," CESifo Working Paper Series 9551, CESifo.
    5. Johnston, Andrew C., 2021. "Preferences, Selection, and the Structure of Teacher Pay," IZA Discussion Papers 14831, Institute of Labor Economics (IZA).
    6. Dan Goldhaber & Cyrus Grout & Nick Huntington-Klein, 2017. "Screen Twice, Cut Once: Assessing the Predictive Validity of Applicant Selection Tools," Education Finance and Policy, MIT Press, vol. 12(2), pages 197-223, Spring.
    7. Andrew Agopsowicz & Chris Robinson & Ralph Stinebrickner & Todd Stinebrickner, 2020. "Careers and Mismatch for College Graduates: College and Noncollege Jobs," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1194-1221.
    8. Jose Maria Cabrera & Dinand Webbink, 2020. "Do Higher Salaries Yield Better Teachers and Better Student Outcomes?," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1222-1257.
    9. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    10. Dhushyanth Raju, 2017. "Public School Teacher Management in Sri Lanka," South Asia Economic Journal, Institute of Policy Studies of Sri Lanka, vol. 18(1), pages 39-63, March.
    11. Dinand Webbink & José María Cabrera, 2016. "Do higher salaries yield better teachers and better student outcomes?," Documentos de Trabajo/Working Papers 1604, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
    12. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    13. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    14. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    15. Melinda Adnot & Thomas Dee & Veronica Katz & James Wyckoff, 2016. "Teacher Turnover, Teacher Quality, and Student Achievement in DCPS," NBER Working Papers 21922, National Bureau of Economic Research, Inc.
    16. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    17. Julie Berry Cullen & Cory Koedel & Eric Parsons, 2021. "The Compositional Effect of Rigorous Teacher Evaluation on Workforce Quality," Education Finance and Policy, MIT Press, vol. 16(1), pages 7-41, Winter.
    18. Jessalynn James & Matthew A. Kraft & John P. Papay, 2023. "Local supply, temporal dynamics, and unrealized potential in teacher hiring," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(4), pages 1010-1044, September.
    19. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    20. Li Feng & Tim R. Sass, 2017. "Teacher Quality and Teacher Mobility," Education Finance and Policy, MIT Press, vol. 12(3), pages 396-418, Summer.

    More about this item

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • J2 - Labor and Demographic Economics - - Demand and Supply of Labor
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22054. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.