Do instructional attributes pose multicollinearity problems? An empirical exploration
AbstractIt is commonly perceived that variables ‘measuring’ different dimensions of teaching (construed as instructional attributes) used in student evaluation of teaching (SET) questionnaires are so highly correlated that they pose a serious multicollinearity problem for quantitative analysis including regression analysis. Using nearly 12000 individual student responses to SET questionnaires and ten key dimensions of teaching and 25 courses at various undergraduate and postgraduate levels for multiple years at a large Australian university, this paper investigates whether this is indeed the case and if so under what circumstances. This paper tests this proposition first by examining variance inflation factors (VIFs), across courses, levels and over time using individual responses; and secondly by using class averages. In the first instance, the paper finds no sustainable evidence of multicollinearity. While, there were one or two isolated cases of VIFs marginally exceeding the conservative threshold of 5, in no cases did the VIFs for any of the instructional attributes come anywhere close to the high threshold value of 10. In the second instance, however, the paper finds that the attributes are highly correlated as all the VIFs exceed 10. These findings have two implications: (a) given the ordinal nature of the data ordered probit analysis using individual student responses can be employed to quantify the impact of instructional attributes on TEVAL score; (b) Data based on class averages cannot be used for probit analysis. An illustrative exercise using level 2 undergraduate courses data suggests higher TEVAL scores depend first and foremost on improving explanation, presentation, and organization of lecture materials.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Queensland University of Technology (QUT), School of Economics and Finance in its journal Economic Analysis and Policy (EAP).
Volume (Year): 40 (2010)
Issue (Month): 3 (December)
Contact details of provider:
Postal: GPO Box 2434, BRISBANE QLD 4001
Web page: http://www.journals.elsevier.com/economic-analysis-and-policy/
More information through EDIRC
Multicollinearity; variance inflation factor; instructional attributes; threshold; Australia;
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Mohammad Alauddin & Temesgen Kifle, 2014. "Does the student evaluation of teaching instrument really measure instructors teaching effectiveness? An econometric analysis of students perceptions in economics courses," Discussion Papers Series 516, School of Economics, University of Queensland, Australia.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Manuela Torgler).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.