IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v30y2011i4p641-653.html
   My bibliography  Save this article

Accounting for exogenous influences in performance evaluations of teachers

Author

Listed:
  • De Witte, Kristof
  • Rogge, Nicky

Abstract

Students' evaluations of teacher performance (SETs) are increasingly used by universities. However, SETs are controversial mainly due to two issues: (1) teachers value various aspects of excellent teaching differently, and (2) SETs should not be determined on exogenous influences. Therefore, this paper constructs SETs using a tailored version of the non-parametric Data Envelopment Analysis approach. In particular, we account for different values and interpretations that teachers attach to 'good teaching'. Moreover, we reduce the impact of measurement errors and a-typical observations, and account explicitly for heterogeneous background characteristics arising from teacher, student and course characteristics.

Suggested Citation

  • De Witte, Kristof & Rogge, Nicky, 2011. "Accounting for exogenous influences in performance evaluations of teachers," Economics of Education Review, Elsevier, vol. 30(4), pages 641-653, August.
    • Handle: RePEc:eee:ecoedu:v:30:y:2011:i:4:p:641-653
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775711000082
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. Michael A. McPherson, 2006. "Determinants of How Students Evaluate Teachers," The Journal of Economic Education, Taylor & Francis Journals, vol. 37(1), pages 3-20, January.
    3. Martin Davies & Joe Hirschberg & Jenny Lye & Carol Johnston & Ian Mcdonald, 2007. "Systematic Influences On Teaching Evaluations: The Case For Caution," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 18-38, March.
    4. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    5. Krautmann, Anthony C. & Sander, William, 1999. "Grades and student evaluations of teachers," Economics of Education Review, Elsevier, vol. 18(1), pages 59-63, February.
    6. Waldo, Staffan, 2007. "On the use of student data in efficiency analysis--Technical efficiency in Swedish upper secondary school," Economics of Education Review, Elsevier, vol. 26(2), pages 173-185, April.
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    9. Brian A. Jacob & Lars Lefgren, 2008. "Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education," Journal of Labor Economics, University of Chicago Press, vol. 26(1), pages 101-136.
    10. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    11. Florian Hoffmann & Philip Oreopoulos, 2009. "Professor Qualities and Student Achievement," The Review of Economics and Statistics, MIT Press, vol. 91(1), pages 83-92, February.
    12. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    13. Ronald G. Ehrenberg & Liang Zhang, 2005. "Do Tenured and Tenure-Track Faculty Matter?," Journal of Human Resources, University of Wisconsin Press, vol. 40(3).
    14. Kirjavainen, Tanja & Loikkanent, Heikki A., 1998. "Efficiency differences of finnish senior secondary schools: An application of DEA and Tobit analysis," Economics of Education Review, Elsevier, vol. 17(4), pages 377-394, October.
    15. John A. Centra & Noreen B. Gaubatz, 2000. "Is There Gender Bias in Student Evaluations of Teaching?," The Journal of Higher Education, Taylor & Francis Journals, vol. 71(1), pages 17-33, January.
    16. Dundar, Halil & Lewis, Darrell R., 1995. "Departmental productivity in American universities: Economies of scale and scope," Economics of Education Review, Elsevier, vol. 14(2), pages 119-144, June.
    17. Seok-Oh Jeong & Byeong Park & Léopold Simar, 2010. "Nonparametric conditional efficiency measures: asymptotic properties," Annals of Operations Research, Springer, vol. 173(1), pages 105-122, January.
    18. Bifulco, Robert & Bretschneider, Stuart, 2001. "Estimating school efficiency: A comparison of methods using simulated data," Economics of Education Review, Elsevier, vol. 20(5), pages 417-429, October.
    19. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    20. Jonah Rockoff, 2003. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," Public Economics 0304002, University Library of Munich, Germany.
    21. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    22. Paul Isely & Harinder Singh, 2005. "Do Higher Grades Lead to Favorable Student Evaluations?," The Journal of Economic Education, Taylor & Francis Journals, vol. 36(1), pages 29-42, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. De Witte, Kristof & Rogge, Nicky, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 2009/15, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    2. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    3. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.
    4. Halkos, George & Tzeremes, Nickolaos, 2011. "A conditional full frontier modelling for analyzing environmental efficiency and economic growth," MPRA Paper 32839, University Library of Munich, Germany.
    5. Haelermans, Carla & De Witte, Kristof, 2012. "The role of innovations in secondary school performance – Evidence from a conditional efficiency model," European Journal of Operational Research, Elsevier, vol. 223(2), pages 541-549.
    6. Endre Bjoerndal & Mette Bjoerndal & Astrid Cullmann & Maria Nieswand, 2016. "Finding the Right Yardstick: Regulation under Heterogeneous Environments," Discussion Papers of DIW Berlin 1555, DIW Berlin, German Institute for Economic Research.
    7. Rogge, Nicky, 2009. "Granting teachers the 'benefit of the doubt' in performance evaluations," Working Papers 2009/17, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    8. Eni Dardha & Nicky Rogge, 2020. "How's Life in Your Region? Measuring Regional Material Living Conditions, Quality of Life and Subjective Well-Being in OECD Countries Using a Robust, Conditional Benefit-of-the-Doubt Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 151(3), pages 1015-1073, October.
    9. Halkos, George & Tzeremes, Nickolaos, 2011. "A conditional full frontier approach for investigating the Averch-Johnson effect," MPRA Paper 35491, University Library of Munich, Germany.
    10. Maarten Goos & Anna Salomons, 2017. "Measuring teaching quality in higher education: assessing selection bias in course evaluations," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(4), pages 341-364, June.
    11. Rogge, Nicky & De Jaeger, Simon, 2013. "Measuring and explaining the cost efficiency of municipal solid waste collection and processing services," Omega, Elsevier, vol. 41(4), pages 653-664.
    12. Rogge, Nicky, 2009. "Robust benevolent evaluations of teaching performance," Working Papers 2009/21, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    13. Cordero, José Manuel & Pedraja-Chaparro, Francisco & Pisaflores, Elsa C. & Polo, Cristina, 2016. "Efficiency assessment of Portuguese municipalities using a conditional nonparametric approach," MPRA Paper 70674, University Library of Munich, Germany.
    14. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    15. Halkos, George E. & Tzeremes, Nickolaos G., 2014. "Public sector transparency and countries’ environmental performance: A nonparametric analysis," Resource and Energy Economics, Elsevier, vol. 38(C), pages 19-37.
    16. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    17. Halkos, George E. & Tzeremes, Nickolaos G., 2013. "A conditional directional distance function approach for measuring regional environmental efficiency: Evidence from UK regions," European Journal of Operational Research, Elsevier, vol. 227(1), pages 182-189.
    18. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2012. "How to measure the impact of environmental factors in a nonparametric production model," European Journal of Operational Research, Elsevier, vol. 223(3), pages 818-833.
    19. Luiza Bădin & Cinzia Daraio & Léopold Simar, 2014. "Explaining inefficiency in nonparametric production models: the state of the art," Annals of Operations Research, Springer, vol. 214(1), pages 5-30, March.
    20. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:30:y:2011:i:4:p:641-653. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.