IDEAS home Printed from https://ideas.repec.org/p/mlb/wpaper/1187.html
   My bibliography  Save this paper

The influence of student experiences on post-graduation surveys

Author

Listed:
  • Joe Hirschberg

    (Department of Economics, University of Melbourne)

  • Jenny Lye

    (Department of Economics, University of Melbourne)

Abstract

This study attempts to establish the extent to which in-class Teaching Quality Instruments can be used to predict post-graduation survey results. It examines the responses for the Good Teaching Scale of the Course Experience Questionnaire (CEQ) administered to 10,433 students who completed their studies at a major Australian tertiary institution from 2003 to 2005 using a unique data set that matched student records and measures of class characteristics to the individual survey responses. The findings indicate that the overall degree experiences of particular students can be predicted by measures of class differences as measured by Teaching Quality Instruments and the grade distributions of the classes they completed. These factors are in addition to the effects of student’s own performance as measured by their grades, their field of study and their post-graduation experience. It was found that in-class administered Teaching Quality Instruments have an asymmetric influence on post-graduation survey results. Higher than expected Teaching Quality Instrument scores appear to have little impact, however, lower than expected results were found to have a significant negative impact on post-graduation recollections. Additionally, the grade distribution in classes taken was also found to be an important factor in explaining variation in degree satisfaction.

Suggested Citation

  • Joe Hirschberg & Jenny Lye, 2014. "The influence of student experiences on post-graduation surveys," Department of Economics - Working Papers Series 1187, The University of Melbourne.
  • Handle: RePEc:mlb:wpaper:1187
    as

    Download full text from publisher

    File URL: http://fbe.unimelb.edu.au/__data/assets/pdf_file/0004/1426117/1187HirschbergLye.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Horacio Matos-Diaz & James Ragan, 2010. "Do student evaluations of teaching depend on the distribution of expected grade?," Education Economics, Taylor & Francis Journals, vol. 18(3), pages 317-330.
    2. Iris Franz, Wan-Ju, 2010. "Grade inflation under the threat of students' nuisance: Theory and evidence," Economics of Education Review, Elsevier, vol. 29(3), pages 411-422, June.
    3. Clifford Nowell, 2007. "The Impact of Relative Grade Expectations on Student Evaluation of Teaching," International Review of Economic Education, Economics Network, University of Bristol, vol. 6(2), pages 42-56.
    4. Martin Davies & Joe Hirschberg & Jenny Lye & Carol Johnston & Ian Mcdonald, 2007. "Systematic Influences On Teaching Evaluations: The Case For Caution," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 18-38, March.
    5. Joe Hirschberg & Jenny Lye & Martin Davies & Carol Johnston, 2011. "Measuring Student Experience: Relationships between Teaching Quality Instruments (TQI) and Course Experience Questionnaire (CEQ)," Department of Economics - Working Papers Series 1134, The University of Melbourne.
    6. Martin Davies & Joe Hirschberg & Jenny Lye & Carol Johnston, 2008. "A Systematic Analysis of Quality of Teaching Surveys," Department of Economics - Working Papers Series 1050, The University of Melbourne.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Donghun Cho & Joonmo Cho, 2017. "Does More Accurate Knowledge of Course Grade Impact Teaching Evaluation?," Education Finance and Policy, MIT Press, vol. 12(2), pages 224-240, Spring.
    2. Joe Hirschberg & Jenny Lye & Martin Davies & Carol Johnston, 2011. "Measuring Student Experience: Relationships between Teaching Quality Instruments (TQI) and Course Experience Questionnaire (CEQ)," Department of Economics - Working Papers Series 1134, The University of Melbourne.
    3. Benjamin Artz & David M. Welsch, 2013. "The Effect of Student Evaluations on Academic Success," Education Finance and Policy, MIT Press, vol. 8(1), pages 100-119, January.
    4. Berezvai, Zombor & Lukáts, Gergely Dániel & Molontay, Roland, 2019. "A pénzügyi ösztönzők hatása az egyetemi oktatók osztályozási gyakorlatára [How financially rewarding student evaluation may affect grading behaviour. Evidence from a natural experiment]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(7), pages 733-750.
    5. Cho, Donghun & Baek, Wonyoung & Cho, Joonmo, 2015. "Why do good performing students highly rate their instructors? Evidence from a natural experiment," Economics of Education Review, Elsevier, vol. 49(C), pages 172-179.
    6. Beleche, Trinidad & Fairris, David & Marks, Mindy, 2012. "Do course evaluations truly reflect student learning? Evidence from an objectively graded post-test," Economics of Education Review, Elsevier, vol. 31(5), pages 709-719.
    7. repec:zbw:rwirep:0275 is not listed on IDEAS
    8. Yoav Gal & Adiv Gal, 2016. "Knowledge Bias by Utilizing the Wording on Feedback Questionnaires: A Case Study of an Israeli College," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 7(3), pages 753-770, September.
    9. De Witte, Kristof & Rogge, Nicky, 2011. "Accounting for exogenous influences in performance evaluations of teachers," Economics of Education Review, Elsevier, vol. 30(4), pages 641-653, August.
    10. Rieger, Matthias & Voorvelt, Katherine, 2016. "Gender, ethnicity and teaching evaluations: Evidence from mixed teaching teamsAuthor-Name: Wagner, Natascha," Economics of Education Review, Elsevier, vol. 54(C), pages 79-94.
    11. De Witte, K. & Rogge, N., 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 15, Top Institute for Evidence Based Education Research.
    12. Bredtmann, Julia & Crede, Carsten J. & Otten, Sebastian, 2013. "Methods for evaluating educational programs: Does Writing Center Participation affect student achievement?," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 115-123.
    13. Timothy A. Bodisco & Stuart Palmer, 2020. "Presentation and Evaluation of a New Graduate Unit of Study in Engineering Product Development," Sustainability, MDPI, Open Access Journal, vol. 12(14), pages 1-14, July.
    14. Amalia Vanacore & Maria Sole Pellegrino, 2019. "How Reliable are Students’ Evaluations of Teaching (SETs)? A Study to Test Student’s Reproducibility and Repeatability," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 146(1), pages 77-89, November.
    15. Shao-Hsun Keng, 2016. "The Effect of a Stricter Academic Dismissal Policy on Course Selection, Student Effort, and Grading Leniency," Education Finance and Policy, MIT Press, vol. 11(2), pages 203-224, Spring.
    16. Joonmo Cho & Wonyoung Baek, 2019. "Identifying Factors Affecting the Quality of Teaching in Basic Science Education: Physics, Biological Sciences, Mathematics, and Chemistry," Sustainability, MDPI, Open Access Journal, vol. 11(14), pages 1-18, July.
    17. Shao-Hsun Keng, 2018. "Tenure system and its impact on grading leniency, teaching effectiveness and student effort," Empirical Economics, Springer, vol. 55(3), pages 1207-1227, November.
    18. Yoav Gal & Adiv Gal, 2014. "Knowledge Bias: Is There a Link Between Students’ Feedback and the Grades They Expect to Get from the Lecturers They Have Evaluated? A Case Study of Israeli Colleges," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 5(3), pages 597-615, September.
    19. Wagner, N. & Rieger, M. & Voorvelt, K.J., 2016. "Gender, ethnicity and teaching evaluations : Evidence from mixed teaching teams," ISS Working Papers - General Series 617, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    20. Silvia Ferrini & Marco P. Tucci, 2011. "Evaluating Research Activity:Impact Factor vs. Research Factor," Department of Economics University of Siena 614, Department of Economics, University of Siena.
    21. Temesgen Kifle & Mohammad Alauddin, 2015. "What Determines Students’ Perceptions in Course Evaluation Rating in Higher Education? An Econometric Exploration," Discussion Papers Series 551, School of Economics, University of Queensland, Australia.

    More about this item

    Keywords

    Course Experience Questionnaire; teaching quality instruments; students’ perceptions; grade distributions; class size.;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • A22 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Undergraduate
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mlb:wpaper:1187. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/demelau.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dandapani Lokanathan (email available below). General contact details of provider: https://edirc.repec.org/data/demelau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.