Does the student evaluation of teaching instrument really measure instructors teaching effectiveness? An econometric analysis of students perceptions in economics courses
AbstractWhile the student evaluation of teaching (SET) has been an intensely researched area in higher education there has been little research using the individual student responses on their perceptions of instructorsâ€™ effectiveness (TEVAL) score. This research delivers a methodological breakthrough as it fills this gap by employing individual student responses from an elite Australian university and partial proportional odds model to investigate the influence of studentsâ€™ perceptions of instructional attributes included in the SET instrument and other variables on TEVAL score. The findings indicate presentation and explanation of materials, and organization of classes were key determinants of TEVAL scores. Emphasis on thinking rather than memorising was less influential. Intermediate level courses and non-English speaking background instructors received lower TEVAL scores. Elective courses and instructors below associate professor attracted higher ratings. The SET instrument currently used fails to provide a valid measure teaching quality as it does little to measure the extent of studentsâ€™ actual learning. This paper underscores the need for inclusion of variables typifying diversity of the student population such as academic performance, discipline destination, ethno-linguistic background, age, sex, indicators of studentsâ€™ effort. It raises broader implications such as subscales, inclusion of items on course contents, intellectual challenge, real world applications, and problem-solving skills.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by School of Economics, University of Queensland, Australia in its series Discussion Papers Series with number 516.
Date of creation: 07 May 2014
Date of revision:
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- J. Scott Long & Jeremy Freese, 2006. "Regression Models for Categorical Dependent Variables using Stata, 2nd Edition," Stata Press books, StataCorp LP, edition 2, number long2, March.
- David Colander, 2004.
"The Art of Teaching Economics,"
International Review of Economic Education, Economics Network, University of Bristol,
Economics Network, University of Bristol, vol. 3(1), pages 63-76.
- Babcock, Phillip & Marks, Mindy, 2010.
"The Falling Time Cost of College: Evidence from Half a Century of Time Use Data,"
University of California at Santa Barbara, Economics Working Paper Series
qt7rc9d7vz, Department of Economics, UC Santa Barbara.
- Philip Babcock & Mindy Marks, 2011. "The Falling Time Cost of College: Evidence from Half a Century of Time Use Data," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 468-478, May.
- Philip S. Babcock & Mindy Marks, 2010. "The Falling Time Cost of College: Evidence from Half a Century of Time Use Data," NBER Working Papers 15954, National Bureau of Economic Research, Inc.
- Anthony Onwuegbuzie & Larry Daniel & Kathleen Collins, 2009. "A meta-validation model for assessing the score-validity of student teaching evaluations," Quality & Quantity: International Journal of Methodology, Springer, vol. 43(2), pages 197-209, March.
- L. F. Jameson Boex, 2000. "Attributes of Effective Economics Instructors: An Analysis of Student Evaluations," The Journal of Economic Education, Taylor & Francis Journals, Taylor & Francis Journals, vol. 31(3), pages 211-227, September.
- Mohammad Alauddin & Hong Son Nghiem, 2010. "Do instructional attributes pose multicollinearity problems? An empirical exploration," Economic Analysis and Policy (EAP), Queensland University of Technology (QUT), School of Economics and Finance, vol. 40(3), pages 351-361, December.
- Akerlof, George A, 1970. "The Market for 'Lemons': Quality Uncertainty and the Market Mechanism," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 84(3), pages 488-500, August.
- William E. Becker, 2000. "Teaching Economics in the 21st Century," Journal of Economic Perspectives, American Economic Association, vol. 14(1), pages 109-119, Winter.
- R. Todd Jewell & Michael A. McPherson & Margie A. Tieslau, 2013. "Whose fault is it? Assigning blame for grade inflation in higher education," Applied Economics, Taylor & Francis Journals, Taylor & Francis Journals, vol. 45(9), pages 1185-1200, March.
- Scott E. Carrell & James E. West, 2010.
"Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors,"
Journal of Political Economy, University of Chicago Press,
University of Chicago Press, vol. 118(3), pages 409-432, 06.
- Scott E. Carrell & James E. West, 2008. "Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors," NBER Working Papers 14081, National Bureau of Economic Research, Inc.
- Sproule, Robert, 2002. "The underdetermination of instructor performance by data from the student evaluation of teaching," Economics of Education Review, Elsevier, vol. 21(3), pages 287-294, June.
- Griliches, Zvi, 1974. "Errors in Variables and Other Unobservables," Econometrica, Econometric Society, Econometric Society, vol. 42(6), pages 971-98, November.
- Mason, Paul M. & Steagall, Jeffrey W. & Fabritius, Michael M., 1995. "Student evaluations of faculty: A new procedure for using aggregate measures of performance," Economics of Education Review, Elsevier, vol. 14(4), pages 403-416, December.
- Mason, Paul M. & Steagall, Jeffrey W. & Fabritius, Michael M., 2003. "The changing quality of business education," Economics of Education Review, Elsevier, vol. 22(6), pages 603-609, December.
- Mohammad Alauddin & Clem Tisdell, 2000. "Changing Academic Environment And Teaching Of Economics At The University Level: Some Critical Issues Analysed With The Help Of Microeconomics," Economic Papers, The Economic Society of Australia, vol. 19(1), pages 1-17, 03.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Randal Anderson).
If references are entirely missing, you can add them using this form.