Accounting for exogenous influences in a benevolent performance evaluation of teachers
AbstractStudentsâ€™ evaluations of teacher performance (SETs) are increasingly used by universities and colleges for teaching improvement and decision making (e.g., promotion or tenure). However, SETs are highly controversial mainly due to two issues: (1) teachers value various aspects of excellent teaching differently, and, to be fair, (2) SETs should be determined solely by the teacherâ€™s actual performance in the classroom, not by other influences (related to the teacher, the students or the course) which are not under his or her control. To account for these two issues, this paper constructs SETs using a specially tailored version of the popular non-parametric Data Envelopment Analysis (DEA) approach. In particular, in a so-called â€˜Benefit of the doubtâ€™ model we account for different values and interpretations that teachers attach to â€˜good teachingâ€™. Within this model, we reduce the impact of measurement errors and a-typical observations, and account explicitly for heterogeneous background characteristics arising from teacher, student and course characteristics. To show the potentiality of the method, we examine teacher performance for the Hogeschool Universiteit Brussel (located in Belgium). Our findings suggest that heterogeneous background characteristics play an important role in teacher performance.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Top Institute for Evidence Based Education Research in its series Working Papers with number 15.
Date of creation: 00 2009
Date of revision:
Contact details of provider:
Web page: http://www.tierweb.nl
Teacher performance; Data envelopment analysis; Conditional efficiency; Education.;
Other versions of this item:
- Kristof DE WITTE & Nicky ROGGE, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Center for Economic Studies - Discussion papers ces09.13, Katholieke Universiteit Leuven, Centrum voor Economische Studiën.
- De Witte, Kristof & Rogge, Nicky, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 2009/15, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
- C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions
- I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Cinzia Daraio & Léopold Simar, 2005.
"Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach,"
Journal of Productivity Analysis,
Springer, vol. 24(1), pages 93-121, 09.
- Cinzia Daraio & Leopold Simar, 2003. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," LEM Papers Series 2003/17, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Cinzia Daraio & Léopold Simar, 2007.
"Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach,"
Journal of Productivity Analysis,
Springer, vol. 28(1), pages 13-32, October.
- Cinzia Daraio & Leopold Simar, 2005. "Conditional Nonparametric Frontier Models for Convex and Non Convex Technologies: a Unifying Approach," LEM Papers Series 2005/12, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
- Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
- Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
- Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
- Paul Isely & Harinder Singh, 2005. "Do Higher Grades Lead to Favorable Student Evaluations?," The Journal of Economic Education, Taylor & Francis Journals, vol. 36(1), pages 29-42, January.
- Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
- Rogge, Nicky, 2009. "Granting teachers the 'benefit of the doubt' in performance evaluations," Working Papers 2009/17, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Center for Economic Studies - Discussion papers ces0833, Katholieke Universiteit Leuven, Centrum voor Economische Studiën.
- Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research, Springer, vol. 82(1), pages 111-145, May.
- M. Davies & J. Hirschberg & J. Lye & C. Johnston & I. McDonald, 2005.
"Systematic Influences on Teaching Evaluations : The Case for Caution,"
Department of Economics - Working Papers Series
953, The University of Melbourne.
- Martin Davies & Joe Hirschberg & Jenny Lye & Carol Johnston & Ian Mcdonald, 2007. "Systematic Influences On Teaching Evaluations: The Case For Caution ," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 18-38, 03.
- Rogge, Nicky & De Witte, Kristof, 2009.
"To publish or not to publish? On the aggregation and drivers of research performance,"
2009/42, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- De Witte, K. & Rogge, N., 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Working Papers 33, Top Institute for Evidence Based Education Research.
- Rogge, Nicky, 2009. "Robust benevolent evaluations of teaching performance," Working Papers 2009/21, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jessica Segal) The email address of this maintainer does not seem to be valid anymore. Please ask Jessica Segal to update the entry or send us the correct address.
If references are entirely missing, you can add them using this form.