IDEAS home Printed from https://ideas.repec.org/p/hub/wpecon/200917.html
   My bibliography  Save this paper

Granting teachers the 'benefit of the doubt' in performance evaluations

Author

Listed:
  • Rogge, Nicky

    (Hogeschool-Universiteit Brussel (HUB), Belgium)

Abstract

Students' evaluations of teacher performance (SETs) are increasingly used by universities. However, in their current format SET-scores are controversial mainly due to two issues: (1) questionnaire items are relegated to the status of being of equal importance, and (2) the feedback to the teachers is rather vague and limited. This paper proposes a tailored version of Data Envelopment Analysis to construct SET-scores. One part of this methods appeal stems from overcoming the two aforementioned criticisms. In particular, DEA accounts for different values and interpretations that teachers attach to 'good teaching' and teacher performances are put into a relative perspective to be optimally evaluated. Second, if available, expert opinion on the relative importance of teaching aspects can be easily incorporated into the evaluation. The identification of teachers' relative strengths and weaknesses is a third advantage. The method is illustrated using data collected at the Hogeschool Universiteit Brussel.

Suggested Citation

  • Rogge, Nicky, 2009. "Granting teachers the 'benefit of the doubt' in performance evaluations," Working Papers 2009/17, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
  • Handle: RePEc:hub:wpecon:200917
    as

    Download full text from publisher

    File URL: https://lirias.hubrussel.be/bitstream/123456789/2491/1/09HRP17.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Working Papers of Department of Economics, Leuven ces0833, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    2. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    3. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    4. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    5. Laurens Cherchye & & Timo Kuosmanen, 2002. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Others 0210001, University Library of Munich, Germany, revised 04 Dec 2002.
    6. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    7. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    8. Langbein, Laura, 2008. "Management by results: Student evaluation of faculty teaching and the mis-measurement of performance," Economics of Education Review, Elsevier, vol. 27(4), pages 417-428, August.
    9. Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
    10. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    11. C Kao & H-T Hung, 2005. "Data envelopment analysis with common weights: the compromise solution approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(10), pages 1196-1203, October.
    12. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. De Witte, K. & Rogge, N., 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 15, Top Institute for Evidence Based Education Research.
    2. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    2. Rogge, Nicky, 2009. "Robust benevolent evaluations of teaching performance," Working Papers 2009/21, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    3. De Witte, Kristof & Rogge, Nicky, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 2009/15, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    4. De Witte, Kristof & Rogge, Nicky, 2011. "Accounting for exogenous influences in performance evaluations of teachers," Economics of Education Review, Elsevier, vol. 30(4), pages 641-653, August.
    5. Fusco, Elisa & Vidoli, Francesco & Sahoo, Biresh K., 2018. "Spatial heterogeneity in composite indicator: A methodological proposal," Omega, Elsevier, vol. 77(C), pages 1-14.
    6. Jesús Peiró-Palomino & Andrés J. Picazo-Tadeo, 2018. "Assessing well-being in European regions. Does government quality matter?," Working Papers 2018/06, Economics Department, Universitat Jaume I, Castellón (Spain).
    7. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.
    8. Jorge Guardiola & Andrés J. Picazo-Tadeo, 2013. "Weighting life domains with Data Envelopment Analysis," Working Papers 1311, Department of Applied Economics II, Universidad de Valencia.
    9. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    10. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    11. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    12. Fusco, Elisa & Maggi, Bernardo & Rizzuto, Livia, 2022. "Alternative indicators for the evaluation of renewables in Europe: An efficiency approach," Renewable Energy, Elsevier, vol. 190(C), pages 48-65.
    13. Jorge Guardiola & Andrés Picazo-Tadeo, 2014. "Building Weighted-Domain Composite Indices of Life Satisfaction with Data Envelopment Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(1), pages 257-274, May.
    14. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    15. Eni Dardha & Nicky Rogge, 2020. "How's Life in Your Region? Measuring Regional Material Living Conditions, Quality of Life and Subjective Well-Being in OECD Countries Using a Robust, Conditional Benefit-of-the-Doubt Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 151(3), pages 1015-1073, October.
    16. Oliveira, Renata & Zanella, Andreia & Camanho, Ana S., 2019. "The assessment of corporate social responsibility: The construction of an industry ranking and identification of potential for improvement," European Journal of Operational Research, Elsevier, vol. 278(2), pages 498-513.
    17. Tourinho, Marco & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2022. "Performance assessment of water services in Brazilian municipalities: An integrated view of efficiency and access," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    18. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    19. Kortelainen, Mika, 2008. "Dynamic environmental performance analysis: A Malmquist index approach," Ecological Economics, Elsevier, vol. 64(4), pages 701-715, February.
    20. Cordero, José Manuel & Alonso-Morán, Edurne & Nuño-Solinis, Roberto & Orueta, Juan F. & Arce, Regina Sauto, 2015. "Efficiency assessment of primary care providers: A conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 240(1), pages 235-244.

    More about this item

    Keywords

    student evaluations of teaching; Data Envelopment Analysis; higher education; Benefit of the doubt; weight restrictions;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hub:wpecon:200917. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sabine Janssens (email available below). General contact details of provider: https://edirc.repec.org/data/emhubbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.