Accounting for exogenous influences in a benevolent performance evaluation of teachers
AbstractStudents’ evaluations of teacher performance (SETs) are increasingly used by universities and colleges for teaching improvement and decision making (e.g., promotion or tenure). However, SETs are highly controversial mainly due to two issues: (1) teachers value various aspects of excellent teaching differently, and, to be fair, (2) SETs should be determined solely by the teacher’s actual performance in the classroom, not by other influences (related to the teacher, the students or the course) which are not under his or her control. To account for these two issues, this paper constructs SETs using a specially tailored version of the popular non-parametric Data Envelopment Analysis (DEA) approach. In particular, in a so-called ‘Benefit of the doubt’ model we account for different values and interpretations that teachers attach to ‘good teaching’. Within this model, we reduce the impact of measurement errors and a-typical observations, and account explicitly for heterogeneous background characteristics arising from teacher, student and course characteristics. To show the potentiality of the method, we examine teacher performance for the Hogeschool Universiteit Brussel (located in Belgium). Our findings suggest that heterogeneous background characteristics play an important role in teacher performance.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Katholieke Universiteit Leuven, Centrum voor Economische Studiën in its series Center for Economic Studies - Discussion papers with number ces09.13.
Date of creation: Jul 2009
Date of revision:
Teacher performance; Data envelopment analysis; Conditional efficiency; Education.;
Other versions of this item:
- De Witte, K. & Rogge, N., 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 15, Top Institute for Evidence Based Education Research.
- De Witte, Kristof & Rogge, Nicky, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 2009/15, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
- C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions
- I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
This paper has been announced in the following NEP Reports:
- NEP-ALL-2009-11-14 (All new papers)
- NEP-EDU-2009-11-14 (Education)
- NEP-EFF-2009-11-14 (Efficiency & Productivity)
- NEP-URE-2009-11-14 (Urban & Real Estate Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Cinzia Daraio & Léopold Simar, 2007.
"Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach,"
Journal of Productivity Analysis,
Springer, vol. 28(1), pages 13-32, October.
- Cinzia Daraio & Leopold Simar, 2005. "Conditional Nonparametric Frontier Models for Convex and Non Convex Technologies: a Unifying Approach," LEM Papers Series 2005/12, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
- Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
- Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
- Cinzia Daraio & Leopold Simar, 2003.
"Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach,"
LEM Papers Series
2003/17, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, 09.
- Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
- Rogge, Nicky, 2009. "Granting teachers the 'benefit of the doubt' in performance evaluations," Working Papers 2009/17, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
- M. Davies & J. Hirschberg & J. Lye & C. Johnston & I. McDonald, 2005.
"Systematic Influences on Teaching Evaluations : The Case for Caution,"
Department of Economics - Working Papers Series
953, The University of Melbourne.
- Martin Davies & Joe Hirschberg & Jenny Lye & Carol Johnston & Ian Mcdonald, 2007. "Systematic Influences On Teaching Evaluations: The Case For Caution ," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 18-38, 03.
- Michael A. McPherson, 2006. "Determinants of How Students Evaluate Teachers," The Journal of Economic Education, Taylor & Francis Journals, vol. 37(1), pages 3-20, January.
- Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Center for Economic Studies - Discussion papers ces0833, Katholieke Universiteit Leuven, Centrum voor Economische Studiën.
- Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research, Springer, vol. 82(1), pages 111-145, May.
- Paul Isely & Harinder Singh, 2005. "Do Higher Grades Lead to Favorable Student Evaluations?," The Journal of Economic Education, Taylor & Francis Journals, vol. 36(1), pages 29-42, January.
- Rogge, Nicky & De Witte, Kristof, 2009.
"To publish or not to publish? On the aggregation and drivers of research performance,"
2009/42, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- De Witte, K. & Rogge, N., 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Working Papers 33, Top Institute for Evidence Based Education Research.
- Rogge, Nicky, 2009. "Robust benevolent evaluations of teaching performance," Working Papers 2009/21, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Karla Vander Weyden).
If references are entirely missing, you can add them using this form.