Granting teachers the 'benefit of the doubt' in performance evaluations
AbstractStudents' evaluations of teacher performance (SETs) are increasingly used by universities. However, in their current format SET-scores are controversial mainly due to two issues: (1) questionnaire items are relegated to the status of being of equal importance, and (2) the feedback to the teachers is rather vague and limited. This paper proposes a tailored version of Data Envelopment Analysis to construct SET-scores. One part of this methods appeal stems from overcoming the two aforementioned criticisms. In particular, DEA accounts for different values and interpretations that teachers attach to 'good teaching' and teacher performances are put into a relative perspective to be optimally evaluated. Second, if available, expert opinion on the relative importance of teaching aspects can be easily incorporated into the evaluation. The identification of teachers' relative strengths and weaknesses is a third advantage. The method is illustrated using data collected at the Hogeschool Universiteit Brussel.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Hogeschool-Universiteit Brussel, Faculteit Economie en Management in its series Working Papers with number 2009/17.
Length: 38 page
Date of creation: Jul 2009
Date of revision:
student evaluations of teaching; Data Envelopment Analysis; higher education; Benefit of the doubt; weight restrictions;
Find related papers by JEL classification:
- C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
- C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
- I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
- Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Center for Economic Studies - Discussion papers ces0833, Katholieke Universiteit Leuven, Centrum voor Economische Studiën.
- Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
- Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
- Cinzia Daraio & Léopold Simar, 2007.
"Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach,"
Journal of Productivity Analysis,
Springer, vol. 28(1), pages 13-32, October.
- Cinzia Daraio & Leopold Simar, 2005. "Conditional Nonparametric Frontier Models for Convex and Non Convex Technologies: a Unifying Approach," LEM Papers Series 2005/12, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
- Cinzia Daraio & Leopold Simar, 2003.
"Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach,"
LEM Papers Series
2003/17, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, 09.
- Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research, Springer, vol. 82(1), pages 111-145, May.
- Langbein, Laura, 2008. "Management by results: Student evaluation of faculty teaching and the mis-measurement of performance," Economics of Education Review, Elsevier, vol. 27(4), pages 417-428, August.
- Laurens Cherchye & & Timo Kuosmanen, 2002.
"Benchmarking Sustainable Development: A Synthetic Meta-index Approach,"
0210001, EconWPA, revised 08 Oct 2002.
- Cherchye, Laurens & Kuosmanen, Timo, 2004. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Working Paper Series UNU-WIDER Research Paper , World Institute for Development Economic Research (UNU-WIDER).
- Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
- De Witte, Kristof & Rogge, Nicky, 2009.
"Accounting for exogenous influences in a benevolent performance evaluation of teachers,"
2009/15, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- Kristof DE WITTE & Nicky ROGGE, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Center for Economic Studies - Discussion papers ces09.13, Katholieke Universiteit Leuven, Centrum voor Economische Studiën.
- De Witte, K. & Rogge, N., 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 15, Top Institute for Evidence Based Education Research.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sabine Janssens).
If references are entirely missing, you can add them using this form.