IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/12844.html
   My bibliography  Save this paper

Evaluating Methods for Evaluating Instruction: The Case of Higher Education

Author

Listed:
  • Bruce A. Weinberg
  • Belton M. Fleisher
  • Masanori Hashimoto

Abstract

This paper develops an original measure of learning in higher education, based on grades in subsequent courses. Using this measure of learning, this paper shows that student evaluations are positively related to current grades but unrelated to learning once current grades are controlled. It offers evidence that the weak relationship between learning and student evaluations arises, in part, because students are unaware of how much they have learned in a course. The paper concludes with a discussion of easily-implemented, optimal methods for evaluating teaching.

Suggested Citation

  • Bruce A. Weinberg & Belton M. Fleisher & Masanori Hashimoto, 2007. "Evaluating Methods for Evaluating Instruction: The Case of Higher Education," NBER Working Papers 12844, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:12844
    Note: ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w12844.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Watts, Michael & Bosshardt, William, 1991. "How Instructors Make a Difference: Panel Data Estimates from Principles of Economic Courses," The Review of Economics and Statistics, MIT Press, vol. 73(2), pages 336-340, May.
    2. Paul W. Grimes & Meghan J. Millea & Thomas W. Woodruff, 2004. "Grades—Who's to Blame? Student Evaluation of Teaching and Locus of Control," The Journal of Economic Education, Taylor & Francis Journals, vol. 35(2), pages 129-147, April.
    3. Florian Hoffmann & Philip Oreopoulos, 2009. "Professor Qualities and Student Achievement," The Review of Economics and Statistics, MIT Press, vol. 91(1), pages 83-92, February.
    4. Krautmann, Anthony C. & Sander, William, 1999. "Grades and student evaluations of teachers," Economics of Education Review, Elsevier, vol. 18(1), pages 59-63, February.
    5. Eric Bettinger & Bridget Terry Long, 2004. "Do College Instructors Matter? The Effects of Adjuncts and Graduate Assistants on Students' Interests and Success," NBER Working Papers 10370, National Bureau of Economic Research, Inc.
    6. L. F. Jameson Boex, 2000. "Attributes of Effective Economics Instructors: An Analysis of Student Evaluations," The Journal of Economic Education, Taylor & Francis Journals, vol. 31(3), pages 211-227, September.
    7. D. F. Sheets & E. E. Topping, 2000. "Assessing the Quality of Instruction In University Economics Courses: Attrition as a Source of Self-Selection Bias in Mean Test Scores," Journal of Economic Insight, Missouri Valley Economic Association, vol. 26(2), pages 11-21.
    8. Watts, Michael & Lynch, Gerald J, 1989. "The Principles Courses Revisited," American Economic Review, American Economic Association, vol. 79(2), pages 236-241, May.
    9. William E. Becker & William Bosshardt & Michael Watts, 2012. "How Departments of Economics Evaluate Teaching," The Journal of Economic Education, Taylor & Francis Journals, vol. 43(3), pages 325-333, July.
    10. Siegfried, John J & Kennedy, Peter E, 1995. "Does Pedagogy Vary with Class Size in Introductory Economics?," American Economic Review, American Economic Association, vol. 85(2), pages 347-351, May.
    11. William Bosshardt & Michael Watts, 2001. "Comparing Student and Instructor Evaluations of Teaching," The Journal of Economic Education, Taylor & Francis Journals, vol. 32(1), pages 3-17, January.
    12. Ronald G. Ehrenberg, 2004. "Prospects in the Academic Labor Market for Economists," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 227-238, Spring.
    13. Bedard, Kelly & Kuhn, Peter, 2008. "Where class size really matters: Class size and student ratings of instructor effectiveness," Economics of Education Review, Elsevier, vol. 27(3), pages 253-265, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Philip Babcock, 2010. "Real Costs Of Nominal Grade Inflation? New Evidence From Student Course Evaluations," Economic Inquiry, Western Economic Association International, vol. 48(4), pages 983-996, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James F. Ragan & Bhavneet Walia, 2010. "Differences in Student Evaluations of Principles and Other Economics Courses and the Allocation of Faculty across Courses," The Journal of Economic Education, Taylor & Francis Journals, vol. 41(4), pages 335-352, September.
    2. Gorry, Devon, 2017. "The impact of grade ceilings on student grades and course evaluations: Evidence from a policy change," Economics of Education Review, Elsevier, vol. 56(C), pages 133-140.
    3. Tin-chun Lin, 2009. "Endogenous effects of midterm grades and evaluations: a simultaneous framework," Economics Bulletin, AccessEcon, vol. 29(3), pages 1731-1742.
    4. Maarten Goos & Anna Salomons, 2017. "Measuring teaching quality in higher education: assessing selection bias in course evaluations," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(4), pages 341-364, June.
    5. Braga, Michela & Paccagnella, Marco & Pellizzari, Michele, 2014. "Evaluating students’ evaluations of professors," Economics of Education Review, Elsevier, vol. 41(C), pages 71-88.
    6. Tin-chun Lin, 2009. "Implications of grade inflation: knowledge illusion and economic inefficiency in the knowledge market," Economics Bulletin, AccessEcon, vol. 29(3), pages 2314-2324.
    7. Langbein, Laura, 2008. "Management by results: Student evaluation of faculty teaching and the mis-measurement of performance," Economics of Education Review, Elsevier, vol. 27(4), pages 417-428, August.
    8. Sam Allgood & William B. Walstad & John J. Siegfried, 2015. "Research on Teaching Economics to Undergraduates," Journal of Economic Literature, American Economic Association, vol. 53(2), pages 285-325, June.
    9. Ali Palali & Roel van Elk & Jonneke Bolhaar & Iryna Rud, 2017. "Are good researchers also good teachers? The relationship between research quality and teaching quality," CPB Discussion Paper 347, CPB Netherlands Bureau for Economic Policy Analysis.
    10. Angelo Antoci & Irene Brunetti & Pierluigi Sacco & Mauro Sodini, 2021. "Student evaluation of teaching, social influence dynamics, and teachers’ choices: An evolutionary model," Journal of Evolutionary Economics, Springer, vol. 31(1), pages 325-348, January.
    11. Anna Salomons & Maarten Goos, 2014. "Measuring Teaching Quality in Higher Education: Assessing the Problem of Selection Bias in Course Evaluations," Working Papers 14-16, Utrecht School of Economics.
    12. Tin-chun Lin, 2009. "Application of a static game of complete information: economic behaviors of professors and students," Economics Bulletin, AccessEcon, vol. 29(3), pages 1678-1686.
    13. Ali Palali & Roel van Elk & Jonneke Bolhaar & Iryna Rud, 2017. "Are good researchers also good teachers? The relationship between research quality and teaching quality," CPB Discussion Paper 347.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    14. Akbar Marvasti, 2007. "Foreign-Born Teaching Assistants and Student Achievement: An Ordered Probit Analysis," The American Economist, Sage Publications, vol. 51(2), pages 61-71, October.
    15. Horacio Matos-Díaz & Alfred J. Crouch Ruiz, 2008. "¿Es sesgada la evaluación estudiantil? El caso de la Universidad de Puerto Rico en Bayamón," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 10(18), pages 241-260, January-J.
    16. Palali, Ali & van Elk, Roel & Bolhaar, Jonneke & Rud, Iryna, 2018. "Are good researchers also good teachers? The relationship between research quality and teaching quality," Economics of Education Review, Elsevier, vol. 64(C), pages 40-49.
    17. Beleche, Trinidad & Fairris, David & Marks, Mindy, 2012. "Do course evaluations truly reflect student learning? Evidence from an objectively graded post-test," Economics of Education Review, Elsevier, vol. 31(5), pages 709-719.
    18. Anne Boring, 2015. "Gender Biases in student evaluations of teachers," Documents de Travail de l'OFCE 2015-13, Observatoire Francais des Conjonctures Economiques (OFCE).
    19. Lusher, Lester & Campbell, Doug & Carrell, Scott, 2018. "TAs like me: Racial interactions between graduate teaching assistants and undergraduates," Journal of Public Economics, Elsevier, vol. 159(C), pages 203-224.
    20. Becker, William E. & Powers, John R., 2001. "Student performance, attrition, and class size given missing student data," Economics of Education Review, Elsevier, vol. 20(4), pages 377-388, August.

    More about this item

    JEL classification:

    • A2 - General Economics and Teaching - - Economic Education and Teaching of Economics
    • I2 - Health, Education, and Welfare - - Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:12844. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.