Granting teachers the 'benefit of the doubt' in performance evaluations
AbstractStudents' evaluations of teacher performance (SETs) are increasingly used by universities. However, in their current format SET-scores are controversial mainly due to two issues: (1) questionnaire items are relegated to the status of being of equal importance, and (2) the feedback to the teachers is rather vague and limited. This paper proposes a tailored version of Data Envelopment Analysis to construct SET-scores. One part of this methods appeal stems from overcoming the two aforementioned criticisms. In particular, DEA accounts for different values and interpretations that teachers attach to 'good teaching' and teacher performances are put into a relative perspective to be optimally evaluated. Second, if available, expert opinion on the relative importance of teaching aspects can be easily incorporated into the evaluation. The identification of teachers' relative strengths and weaknesses is a third advantage. The method is illustrated using data collected at the Hogeschool Universiteit Brussel.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Hogeschool-Universiteit Brussel, Faculteit Economie en Management in its series Working Papers with number 2009/17.
Length: 38 page
Date of creation: Jul 2009
Date of revision:
student evaluations of teaching; Data Envelopment Analysis; higher education; Benefit of the doubt; weight restrictions;
Find related papers by JEL classification:
- C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
- C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
- I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
- Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research, Springer, vol. 82(1), pages 111-145, May.
- Langbein, Laura, 2008. "Management by results: Student evaluation of faculty teaching and the mis-measurement of performance," Economics of Education Review, Elsevier, vol. 27(4), pages 417-428, August.
- Cinzia Daraio & Leopold Simar, 2005.
"Conditional Nonparametric Frontier Models for Convex and Non Convex Technologies: a Unifying Approach,"
LEM Papers Series
2005/12, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
- Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
- Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
- Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
- Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Center for Economic Studies - Discussion papers ces0833, Katholieke Universiteit Leuven, Centrum voor Economische Studiën.
- Laurens Cherchye & & Timo Kuosmanen, 2002.
"Benchmarking Sustainable Development: A Synthetic Meta-index Approach,"
0210001, EconWPA, revised 08 Oct 2002.
- Cherchye, Laurens & Kuosmanen, Timo, 2004. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Working Paper Series UNU-WIDER Research Paper , World Institute for Development Economic Research (UNU-WIDER).
- Cinzia Daraio & Leopold Simar, 2003.
"Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach,"
LEM Papers Series
2003/17, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, 09.
- Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
- De Witte, K. & Rogge, N., 2009.
"Accounting for exogenous influences in a benevolent performance evaluation of teachers,"
15, Top Institute for Evidence Based Education Research.
- Kristof DE WITTE & Nicky ROGGE, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Center for Economic Studies - Discussion papers ces09.13, Katholieke Universiteit Leuven, Centrum voor Economische Studiën.
- De Witte, Kristof & Rogge, Nicky, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 2009/15, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sabine Janssens).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.