IDEAS home Printed from https://ideas.repec.org/a/kap/jproda/v49y2018i1d10.1007_s11123-017-0517-3.html
   My bibliography  Save this article

Using DEA for measuring teachers’ performance and the impact on students’ outcomes: evidence for Spain

Author

Listed:
  • Daniel Santín

    (Complutense University of Madrid)

  • Gabriela Sicilia

    (Universidad Autónoma de Madrid)

Abstract

This research contributes to the ongoing debate about differences in teachers’ performance. We introduce a new methodology that combines production frontier and impact evaluation insights that allows using DEA as an identification strategy of a treatment with high and low quality teachers within schools to assess their performance. We use a unique database of primary schools in Spain that, for every school, supplies information on two classrooms at 4th grade where students and teachers were randomly assigned into the two classrooms. We find considerable differences in teachers’ efficiency across schools with significant effects on students’ achievement. In line with previous findings, we find that neither teacher experience nor academic training explains teachers’ efficiency. Conversely, being a female teacher, having worked five or more years in the same school or having smaller class sizes positively affects the performance of teachers.

Suggested Citation

  • Daniel Santín & Gabriela Sicilia, 2018. "Using DEA for measuring teachers’ performance and the impact on students’ outcomes: evidence for Spain," Journal of Productivity Analysis, Springer, vol. 49(1), pages 1-15, February.
  • Handle: RePEc:kap:jproda:v:49:y:2018:i:1:d:10.1007_s11123-017-0517-3
    DOI: 10.1007/s11123-017-0517-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11123-017-0517-3
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11123-017-0517-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Eric Hanushek & Ludger Woessmann, 2012. "Do better schools lead to more growth? Cognitive skills, economic outcomes, and causation," Journal of Economic Growth, Springer, vol. 17(4), pages 267-321, December.
    2. Hoxby, Caroline M., 1999. "The productivity of schools and other local public goods producers," Journal of Public Economics, Elsevier, vol. 74(1), pages 1-30, October.
    3. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    4. Peyrache, Antonio & Coelli, Tim, 2009. "Testing procedures for detection of linear dependencies in efficiency models," European Journal of Operational Research, Elsevier, vol. 198(2), pages 647-654, October.
    5. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 1, number 1, June.
    6. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    7. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2011. "The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood," NBER Working Papers 17699, National Bureau of Economic Research, Inc.
    8. Martin Schlotter & Guido Schwerdt & Ludger Woessmann, 2011. "Econometric methods for causal evaluation of education policies and practices: a non-technical guide," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 109-137.
    9. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    10. Helen Slater & Neil M. Davies & Simon Burgess, 2012. "Do Teachers Matter? Measuring the Variation in Teacher Effectiveness in England," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(5), pages 629-645, October.
    11. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2010. "Teacher Credentials and Student Achievement in High School: A Cross-Subject Analysis with Student Fixed Effects," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
    12. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    13. Caroline M. Hoxby, 2000. "The Effects of Class Size on Student Achievement: New Evidence from Population Variation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(4), pages 1239-1285.
    14. Eric A. Hanushek, 1979. "Conceptual and Empirical Issues in the Estimation of Educational Production Functions," Journal of Human Resources, University of Wisconsin Press, vol. 14(3), pages 351-388.
    15. Thomas S. Dee, 2005. "A Teacher Like Me: Does Race, Ethnicity, or Gender Matter?," American Economic Review, American Economic Association, vol. 95(2), pages 158-165, May.
    16. Joshua D. Angrist & Victor Lavy & Jetson Leder-Luis & Adi Shany, 2019. "Maimonides' Rule Redux," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 309-324, December.
    17. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    18. James Heckman & Tim Kautz, 2013. "Fostering and Measuring Skills: Interventions That Improve Character and Cognition," Working Papers 2013-019, Human Capital and Economic Opportunity Working Group.
    19. Eric A. Hanushek, 2003. "The Failure of Input-Based Schooling Policies," Economic Journal, Royal Economic Society, vol. 113(485), pages 64-98, February.
    20. Bruce Sacerdote, 2001. "Peer Effects with Random Assignment: Results for Dartmouth Roommates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 681-704.
    21. Angel De la Fuente, 2011. "Human capital and productivity," Working Papers 1103, BBVA Bank, Economic Research Department.
    22. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    23. José M. Cordero & Víctor Cristóbal & Daniel Santín, 2018. "Causal Inference On Education Policies: A Survey Of Empirical Studies Using Pisa, Timss And Pirls," Journal of Economic Surveys, Wiley Blackwell, vol. 32(3), pages 878-915, July.
    24. Bietenbeck, Jan, 2014. "Teaching practices and cognitive skills," Labour Economics, Elsevier, vol. 30(C), pages 143-153.
    25. Dinand Webbink, 2005. "Causal Effects in Education," Journal of Economic Surveys, Wiley Blackwell, vol. 19(4), pages 535-560, September.
    26. Thomas S. Dee, 2007. "Teachers and the Gender Gaps in Student Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 42(3).
    27. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    28. Matthew M. Chingos & Kenneth A. Couch, 2013. "Class Size and Student Outcomes: Research and Policy Implications," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(2), pages 411-438, March.
    29. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    30. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    31. Thomas S. Dee & James Wyckoff, 2015. "Incentives, Selection, and Teacher Performance: Evidence from IMPACT," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(2), pages 267-297, March.
    32. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    33. Berrara, A., 1989. "The Interactive Effects Of Mother'S Schooling And Unsupplemented Breastfeeding On Child Health," Papers 572, Yale - Economic Growth Center.
    34. Caroline M. Hoxby, 1999. "The Productivity of Schools and Other Local Public Goods Providers," NBER Working Papers 6911, National Bureau of Economic Research, Inc.
    35. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 2, number 2, June.
    36. Clotfelter, Charles T. & Ladd, Helen F. & Vigdor, Jacob L., 2007. "Teacher credentials and student achievement: Longitudinal analysis with student fixed effects," Economics of Education Review, Elsevier, vol. 26(6), pages 673-682, December.
    37. Barro, Robert J & Lee, Jong Wha, 1996. "International Measures of Schooling Years and Schooling Quality," American Economic Review, American Economic Association, vol. 86(2), pages 218-223, May.
    38. Boozer, Michael & Rouse, Cecilia, 2001. "Intraschool Variation in Class Size: Patterns and Implications," Journal of Urban Economics, Elsevier, vol. 50(1), pages 163-189, July.
    39. Akerhielm, Karen, 1995. "Does class size matter?," Economics of Education Review, Elsevier, vol. 14(3), pages 229-241, September.
    40. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    41. Kristof De Witte & Chris Van Klaveren, 2014. "How are teachers teaching? A nonparametric approach," Education Economics, Taylor & Francis Journals, vol. 22(1), pages 3-23, February.
    42. Henry M. Levin, 1974. "Measuring Efficiency in Educational Production," Public Finance Review, , vol. 2(1), pages 3-24, January.
    43. Cordero, José Manuel & Santín, Daniel & Sicilia, Gabriela, 2013. "Dealing with the Endogeneity Problem in Data Envelopment Analysis," MPRA Paper 47475, University Library of Munich, Germany.
    44. Cordero, José Manuel & Santín, Daniel & Sicilia, Gabriela, 2015. "Testing the accuracy of DEA estimates under endogeneity through a Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 244(2), pages 511-518.
    45. Cooper, Samuel T. & Cohn, Elchanan, 1997. "Estimation of a frontier production function for the South Carolina educational process," Economics of Education Review, Elsevier, vol. 16(3), pages 313-327, June.
    46. Jerik Hanushek & Dennis Kimko, 2006. "Schooling, Labor-force Quality, and the Growth of Nations," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 154-193.
    47. De Witte, Kristof & Rogge, Nicky, 2011. "Accounting for exogenous influences in performance evaluations of teachers," Economics of Education Review, Elsevier, vol. 30(4), pages 641-653, August.
    48. Josep-Oriol Escardíbul & Toni Mora, 2013. "Teacher gender and student performance in mathematics. Evidence from Catalonia," Working Papers 2013/7, Institut d'Economia de Barcelona (IEB).
    49. A. Charnes & W. W. Cooper & E. Rhodes, 1981. "Evaluating Program and Managerial Efficiency: An Application of Data Envelopment Analysis to Program Follow Through," Management Science, INFORMS, vol. 27(6), pages 668-697, June.
    50. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    51. Eric A. Hanushek & Steven G. Rivkin, 2012. "The Distribution of Teacher Quality and Implications for Policy," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 131-157, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cordero, Jose M. & Polo, Cristina & Santín, Daniel & Simancas, Rosa, 2018. "Efficiency measurement and cross-country differences among schools: A robust conditional nonparametric analysis," Economic Modelling, Elsevier, vol. 74(C), pages 45-60.
    2. D’Inverno, Giovanna & Smet, Mike & De Witte, Kristof, 2021. "Impact evaluation in a multi-input multi-output setting: Evidence on the effect of additional resources for schools," European Journal of Operational Research, Elsevier, vol. 290(3), pages 1111-1124.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    2. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    3. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    4. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    5. Chris Ryan, 2017. "Secondary School Teacher Effects on Student Achievement in Australian Schools," Melbourne Institute Working Paper Series wp2017n11, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    6. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    7. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    8. Hidalgo-Cabrillana, Ana & Lopez-Mayan, Cristina, 2018. "Teaching styles and achievement: Student and teacher perspectives," Economics of Education Review, Elsevier, vol. 67(C), pages 184-206.
    9. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    10. Daniel Santín & Gabriela Sicilia, 2015. "Measuring the efficiency of public schools in Uruguay: main drivers and policy implications," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 24(1), pages 1-28, December.
    11. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    12. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    13. Eric Hanushek & Steven Rivkin, "undated". "Constrained Job Matching: Does Teacher Job Search Harm Disadvantaged Urban Schools?," Discussion Papers 09-011, Stanford Institute for Economic Policy Research.
    14. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    15. Gary Henry & Roderick Rose & Doug Lauen, 2014. "Are value-added models good enough for teacher evaluations? Assessing commonly used models with simulated and actual data," Investigaciones de Economía de la Educación volume 9, in: Adela García Aracil & Isabel Neira Gómez (ed.), Investigaciones de Economía de la Educación 9, edition 1, volume 9, chapter 20, pages 383-405, Asociación de Economía de la Educación.
    16. Eren, Ozkan & Henderson, Daniel J., 2011. "Are we wasting our children's time by giving them more homework?," Economics of Education Review, Elsevier, vol. 30(5), pages 950-961, October.
    17. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    18. Eric A. Hanushek & Marc Piopiunik & Simon Wiederhold, 2014. "International Evidence on Teacher Cognitive Skills and Student Performance," CID Working Papers 63, Center for International Development at Harvard University.
    19. Zheng, Lei & Qi, Xiang & Zhang, Chongjiu, 2023. "Can improvements in teacher quality reduce the cognitive gap between urban and rural students in China?," International Journal of Educational Development, Elsevier, vol. 100(C).
    20. Braga, Michela & Paccagnella, Marco & Pellizzari, Michele, 2014. "Evaluating students’ evaluations of professors," Economics of Education Review, Elsevier, vol. 41(C), pages 71-88.

    More about this item

    Keywords

    Teachers’ performance; Efficiency; DEA; Causal inference; Primary education;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jproda:v:49:y:2018:i:1:d:10.1007_s11123-017-0517-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.