IDEAS home Printed from https://ideas.repec.org/p/aap/wpaper/061.html
   My bibliography  Save this paper

Factors Affecting the Student Evaluation of Teaching Scores: Evidence from Panel Data Estimation

Author

Listed:
  • Eduardo de Carvalho Andrade
  • Bruno Rocha

Abstract

We use a large panel data, covering 6 semesters, 496 undergraduate courses related to 101 instructors and 89 disciplines. This allows treating adequately unobserved heterogeneity. We use a random-effects model estimated with feasible generalized least squares to find the factors that affect the student evaluation of teaching (SET) scores, including time-invariant instructors’ characteristics. Our empirical findings are: (i) controlling for the instructor’s status as full-time or part-time professor, the quality of his research affects positively the SET score; (ii) participating in training programs, designed to improve the quality of teaching, did not increase the SET scores; (iii) instructors can ‘buy’ a better evaluation by inflating students’ grade; (ii) the class size affects negatively the SET score; (iv) instructors with more experience are better evaluated, but these gains reduce over time. Finally, there are no significant changes in the rankings overall when we adjust the SET score to eliminate either the possible manipulation by the instructor or the effects of variables beyond his control. Despite some dramatic changes in some instructors’ positions, they are not statistically significant.

Suggested Citation

  • Eduardo de Carvalho Andrade & Bruno Rocha, 2009. "Factors Affecting the Student Evaluation of Teaching Scores: Evidence from Panel Data Estimation," Business and Economics Working Papers 061, Unidade de Negocios e Economia, Insper.
    • Handle: RePEc:aap:wpaper:061
    as

    Download full text from publisher

    File URL: https://repositorio.insper.edu.br/handle/11224/5802
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Michael A. McPherson, 2006. "Determinants of How Students Evaluate Teachers," The Journal of Economic Education, Taylor & Francis Journals, vol. 37(1), pages 3-20, January.
    2. Paul Isely & Harinder Singh, 2005. "Do Higher Grades Lead to Favorable Student Evaluations?," The Journal of Economic Education, Taylor & Francis Journals, vol. 36(1), pages 29-42, January.
    3. Hamermesh, Daniel S. & Parker, Amy, 2005. "Beauty in the classroom: instructors' pulchritude and putative pedagogical productivity," Economics of Education Review, Elsevier, vol. 24(4), pages 369-376, August.
    4. Mason, Paul M. & Steagall, Jeffrey W. & Fabritius, Michael M., 1995. "Student evaluations of faculty: A new procedure for using aggregate measures of performance," Economics of Education Review, Elsevier, vol. 14(4), pages 403-416, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beleche, Trinidad & Fairris, David & Marks, Mindy, 2012. "Do course evaluations truly reflect student learning? Evidence from an objectively graded post-test," Economics of Education Review, Elsevier, vol. 31(5), pages 709-719.
    2. Clifford Nowell, 2007. "The Impact of Relative Grade Expectations on Student Evaluation of Teaching," International Review of Economic Education, Economics Network, University of Bristol, vol. 6(2), pages 42-56.
    3. Tin-chun Lin, 2009. "Endogenous effects of midterm grades and evaluations: a simultaneous framework," Economics Bulletin, AccessEcon, vol. 29(3), pages 1731-1742.
    4. Anne Boring, 2015. "Gender Biases in student evaluations of teachers," Documents de Travail de l'OFCE 2015-13, Observatoire Francais des Conjonctures Economiques (OFCE).
    5. repec:spo:wpmain:info:hdl:2441/1seuirq4ak9b9bouu1j29ebui7 is not listed on IDEAS
    6. repec:hal:spmain:info:hdl:2441/1seuirq4ak9b9bouu1j29ebui7 is not listed on IDEAS
    7. Mary R Hedges & Don Webber, 2012. "Using student evaluations to improve individual and department teaching qualities," Working Papers 20121205, Department of Accounting, Economics and Finance, Bristol Business School, University of the West of England, Bristol.
    8. Tin-chun Lin, 2009. "Implications of grade inflation: knowledge illusion and economic inefficiency in the knowledge market," Economics Bulletin, AccessEcon, vol. 29(3), pages 2314-2324.
    9. Rieger, Matthias & Voorvelt, Katherine, 2016. "Gender, ethnicity and teaching evaluations: Evidence from mixed teaching teamsAuthor-Name: Wagner, Natascha," Economics of Education Review, Elsevier, vol. 54(C), pages 79-94.
    10. Ewing, Andrew M., 2012. "Estimating the impact of relative expected grade on student evaluations of teachers," Economics of Education Review, Elsevier, vol. 31(1), pages 141-154.
    11. Carlos E. Carpio Ochoa & Bradi Harral & Sarahi Morales & Manuel Garcia & Marty Middleton & Amy Boren‐Alpizar, 2025. "Students' evaluations of teaching and grades in university agricultural programs: A tale of two countries," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 47(1), pages 25-48, March.
    12. R. Todd Jewell & Michael A. McPherson & Margie A. Tieslau, 2013. "Whose fault is it? Assigning blame for grade inflation in higher education," Applied Economics, Taylor & Francis Journals, vol. 45(9), pages 1185-1200, March.
    13. Wagner, N. & Rieger, M. & Voorvelt, K.J., 2016. "Gender, ethnicity and teaching evaluations : Evidence from mixed teaching teams," ISS Working Papers - General Series 617, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    14. Tin-chun Lin, 2009. "Application of a static game of complete information: economic behaviors of professors and students," Economics Bulletin, AccessEcon, vol. 29(3), pages 1678-1686.
    15. De Witte, K. & Rogge, N., 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 15, Top Institute for Evidence Based Education Research.
    16. Donghun Cho & Joonmo Cho, 2017. "Does More Accurate Knowledge of Course Grade Impact Teaching Evaluation?," Education Finance and Policy, MIT Press, vol. 12(2), pages 224-240, Spring.
    17. Horacio Matos-Díaz, 2014. "Measuring grade inflation and grade divergence accounting for student quality," Cogent Economics & Finance, Taylor & Francis Journals, vol. 2(1), pages 1-16, December.
    18. Gorry, Devon, 2017. "The impact of grade ceilings on student grades and course evaluations: Evidence from a policy change," Economics of Education Review, Elsevier, vol. 56(C), pages 133-140.
    19. Ale J. Hejase & Hussin J. Hejase & Rana S. Al Kaakour, 2014. "The Impact of Students’ Characteristics on their Perceptions of the Evaluation of Teaching Process," International Journal of Management Sciences, Research Academy of Social Sciences, vol. 4(2), pages 90-105.
    20. Maarten Goos & Anna Salomons, 2017. "Measuring teaching quality in higher education: assessing selection bias in course evaluations," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(4), pages 341-364, June.
    21. Gaviria Alejandro & Alejandro Hoyos, 2008. "Determinantes de los resultados de las evaluaciones de profesores: el caso de la Universidad de los Andes," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE, March.
    22. Bertoni, Marco & Rettore, Enrico & Rocco, Lorenzo, 2024. "If (my) 6 was (your) 9. Reporting heterogeneity in student evaluations of teaching," Labour Economics, Elsevier, vol. 89(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aap:wpaper:061. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Biblioteca Telles (email available below). General contact details of provider: https://edirc.repec.org/data/inspebr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.