This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Systematic Influences on Teaching Evaluations: The Case for Caution

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
M. Davies
J. Hirschberg
J. Lye
C. Johnston
I. McDonald

Additional information is available for the following registered author(s):

Abstract

The evaluation of teaching and learning has become an important activity in tertiary education institutions. Student surveys provide information about student perceptions and judgments of a particular subject. However, as is widely recognised, the appropriate interpretation of this data is problematic. There is a large literature, mainly for the US, on the use and usefulness of student subject evaluations. This literature has highlighted a number of ‘mitigating factors’ such as subject difficulty, discipline area, etc., that should be taken into account in interpreting the results of these questionnaires. In this paper we examine 8 years of QOT responses from an Economics Department in an Australian University which accounted for more than 79,000 student subject enrolments in 565 subjects. The purpose of this analysis is to establish how the information contained in these data can be used to interpret the responses. In particular, we determine to what extent other factors besides the instructor in charge of the subject have an impact on the raw average student evaluation scores. We find that the following characteristics of the students in these classes had an influence on the average QOT score: year level, enrolment size, the quantitative nature of the subject, the country of origin of the students, the proportion that are female, Honours status of the student, the differential in their mark from previous marks, quality of workbook, quality of textbook and the relative QOT score versus other subjects taught at the same time. However, a number of other factors proposed in the literature to be important influences were found not to be. These include the student’s fee paying status, whether they attended a public, private or catholic secondary school, which other faculty within the University they came from, and if the subject was taught in multiple sessions.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.economics.unimelb.edu.au/SITE/research/workingpapers/wp05/953.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by The University of Melbourne in its series Department of Economics - Working Papers Series with number 953.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length: 33 pages
Date of creation: 2005
Date of revision:
Handle: RePEc:mlb:wpaper:953

Contact details of provider:
Postal: Department of Economics, The University of Melbourne, 5th Floor, Economics and Commerce Building, Victoria, 3010, Australia
Phone: +61 3 8344 5289
Fax: +61 3 8344 6899
Email:
Web page: http://www.economics.unimelb.edu.au
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Colemann Leong).

Related research
Keywords:

Other versions of this item:

This paper has been announced in the following NEP Reports: References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Gokcekus, Omer, 2000. "How Do University Students Value Economics Courses? A Hedonic Approach," Applied Economics Letters, Taylor and Francis Journals, vol. 7(8), pages 493-96, August. [Downloadable!] (restricted)
  2. L. F. Jameson Boex, 2000. "Attributes of Effective Economics Instructors: An Analysis of Student Evaluations," Journal of Economic Education, Helen Dwight Reid Foundation, vol. 31(3), pages 211-227. [Downloadable!]
  3. Mason, Paul M. & Steagall, Jeffrey W. & Fabritius, Michael M., 1995. "Student evaluations of faculty: A new procedure for using aggregate measures of performance," Economics of Education Review, Elsevier, vol. 14(4), pages 403-416, December. [Downloadable!] (restricted)
  4. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-38, May. [Downloadable!] (restricted)
  5. William Bosshardt & Michael Watts, 2001. "Comparing Student and Instructor Evaluations of Teaching," Journal of Economic Education, Helen Dwight Reid Foundation, vol. 32(1), pages 3-17. [Downloadable!]
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Marco p. Tucci & Sandra Fontani & Silvia Ferrini, 2008. "L’ “R-Factor”: un nuovo modo di valutare la ricerca scientifica," Department of Economics University of Siena 527, Department of Economics, University of Siena. [Downloadable!]
Statistics
Access and download statistics

Did you know? You can use convenient plug-ins to search directly IDEAS from your browser.

This page was last updated on 2009-11-23.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.