IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v108y2025ics0272775725000809.html

The quality of online instruction and returns to instructor experience

Author

Listed:
  • Zhang, Xi
  • Atwater, Ann

Abstract

We examine student satisfaction and performance in online versus in-person sections at a large research university in the United States, exploring whether observed gaps are inherent to online instruction or can be mitigated with increased teaching experience. Using administrative data from over 40,000 course sections taught over eight years, we find that students evaluate online courses as worse than in-person courses, despite minimal differences in performance. This gap persists even when restricting the sample to courses taught using both modalities by the same professor in the same semester, and after matching on observable student characteristics. Lower evaluations are primarily driven by student perceptions of instructor availability, concern for students, and the ability to stimulate interest in the course. Although teaching experience improves evaluations in online sections, the gap between modes remains, suggesting fundamental challenges in online instruction beyond technological familiarity.

Suggested Citation

  • Zhang, Xi & Atwater, Ann, 2025. "The quality of online instruction and returns to instructor experience," Economics of Education Review, Elsevier, vol. 108(C).
  • Handle: RePEc:eee:ecoedu:v:108:y:2025:i:c:s0272775725000809
    DOI: 10.1016/j.econedurev.2025.102700
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775725000809
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econedurev.2025.102700?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. David J. Deming & Claudia Goldin & Lawrence F. Katz & Noam Yuchtman, 2015. "Can Online Learning Bend the Higher Education Cost Curve?," American Economic Review, American Economic Association, vol. 105(5), pages 496-501, May.
    2. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 798-812, August.
    3. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    4. Eric P. Bettinger & Bridget Terry Long, 2005. "Do Faculty Serve as Role Models? The Impact of Instructor Gender on Female Students," American Economic Review, American Economic Association, vol. 95(2), pages 152-157, May.
    5. Ben Ost, 2014. "How Do Teachers Improve? The Relative Importance of Specific and General Human Capital," American Economic Journal: Applied Economics, American Economic Association, vol. 6(2), pages 127-151, April.
    6. Wiswall, Matthew, 2013. "The dynamics of teacher quality," Journal of Public Economics, Elsevier, vol. 100(C), pages 61-78.
    7. Tyler Cowen & Alex Tabarrok, 2014. "The Industrial Organization of Online Education," American Economic Review, American Economic Association, vol. 104(5), pages 519-522, May.
    8. David Figlio & Mark Rush & Lu Yin, 2013. "Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning," Journal of Labor Economics, University of Chicago Press, vol. 31(4), pages 763-784.
    9. Pieter De Vlieger & Brian Jacob & Kevin Stange, 2018. "Measuring Instructor Effectiveness in Higher Education," NBER Chapters, in: Productivity in Higher Education, pages 209-258, National Bureau of Economic Research, Inc.
    10. John M. Krieg & Steven E. Henson, 2016. "The Educational Impact of Online Learning: How Do University Students Perform in Subsequent Courses?," Education Finance and Policy, MIT Press, vol. 11(4), pages 426-448, Fall.
    11. Scott E. Carrell & James E. West, 2010. "Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors," Journal of Political Economy, University of Chicago Press, vol. 118(3), pages 409-432, June.
    12. Florian Hoffmann & Philip Oreopoulos, 2009. "Professor Qualities and Student Achievement," The Review of Economics and Statistics, MIT Press, vol. 91(1), pages 83-92, February.
    13. William T. Alpert & Kenneth A. Couch & Oskar R. Harmon, 2016. "A Randomized Assessment of Online Learning," American Economic Review, American Economic Association, vol. 106(5), pages 378-382, May.
    14. Di Xu & Shanna S. Jaggars, 2014. "Performance Gaps between Online and Face-to-Face Courses: Differences across Types of Students and Academic Subject Areas," The Journal of Higher Education, Taylor & Francis Journals, vol. 85(5), pages 633-659, September.
    15. Cook, Jason B. & Mansfield, Richard K., 2016. "Task-specific experience and task-specific talent: Decomposing the productivity of high school teachers," Journal of Public Economics, Elsevier, vol. 140(C), pages 51-72.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nirav Mehta, 2025. "A Partial Identification Approach to Identifying the Determinants of Human Capital Accumulation: An Application to Teachers," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(6), pages 639-654, September.
    2. Cook, Jason B. & Mansfield, Richard K., 2016. "Task-specific experience and task-specific talent: Decomposing the productivity of high school teachers," Journal of Public Economics, Elsevier, vol. 140(C), pages 51-72.
    3. Dinand Webbink & José María Cabrera, 2016. "Do higher salaries yield better teachers and better student outcomes?," Documentos de Trabajo/Working Papers 1604, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
    4. Nguyen, Nhu & Ost, Ben & Qureshi, Javaeria A., 2025. "OK Boomer: Generational differences in teacher quality," Journal of Public Economics, Elsevier, vol. 243(C).
    5. Justin C. Ortagus & Lijing Yang, 2018. "An Examination of the Influence of Decreases in State Appropriations on Online Enrollment at Public Universities," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(7), pages 847-865, November.
    6. Jose Maria Cabrera & Dinand Webbink, 2020. "Do Higher Salaries Yield Better Teachers and Better Student Outcomes?," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1222-1257.
    7. Courtney Bell & Jessalynn James & Eric S. Taylor & James Wyckoff, 2025. "Measuring returns to experience using supervisor ratings of observed performance: The case of classroom teachers," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 44(1), pages 12-44, January.
    8. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    9. Pieter De Vlieger & Brian Jacob & Kevin Stange, 2018. "Measuring Instructor Effectiveness in Higher Education," NBER Chapters, in: Productivity in Higher Education, pages 209-258, National Bureau of Economic Research, Inc.
    10. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    11. Sorensen, Lucy C. & Holt, Stephen B., 2021. "Sorting it Out: The Effects of Charter Expansion on Teacher and Student Composition at Traditional Public Schools," Economics of Education Review, Elsevier, vol. 82(C).
    12. M Paula Cacault & Christian Hildebrand & Jérémy Laurent-Lucchetti & Michele Pellizzari, 2021. "Distance Learning in Higher Education: Evidence from a Randomized Experiment [A Randomized Assessment of Online Learning]," Journal of the European Economic Association, European Economic Association, vol. 19(4), pages 2322-2372.
    13. Helen F. Ladd & Lucy C. Sorensen, 2017. "Returns to Teacher Experience: Student Achievement and Motivation in Middle School," Education Finance and Policy, MIT Press, vol. 12(2), pages 241-279, Spring.
    14. Michael Dinerstein & Isaac M. Opper, 2022. "Screening with Multitasking," CESifo Working Paper Series 9869, CESifo.
    15. Lee, Se Woong & Lee, Eunjung Alice, 2020. "Teacher qualification matters: The association between cumulative teacher qualification and students’ educational attainment," International Journal of Educational Development, Elsevier, vol. 77(C).
    16. Wang, Chunchao & Wang, Yao & Xiao, Aiping & Zhang, Yaru & Zou, Hang, 2025. "Student development in teacher–student interaction: Evidence from a randomized experiment in online education," Journal of Public Economics, Elsevier, vol. 242(C).
    17. Marigee Bacolod & Stephen Mehay & Elda Pema, 2018. "Who succeeds in distance learning? Evidence from quantile panel data estimation," Southern Economic Journal, John Wiley & Sons, vol. 84(4), pages 1129-1145, April.
    18. Michael S. Kofoed & Lucas Gebhart & Dallas Gilmore & Ryan Moschitto, 2024. "Zooming to Class? Experimental Evidence on College Students' Online Learning during COVID-19," American Economic Review: Insights, American Economic Association, vol. 6(3), pages 324-340, September.
    19. repec:osf:socarx:y6wh4_v1 is not listed on IDEAS
    20. Kameshwari Shankar & Punit Arora & Maria Christina Binz-Scharf, 2023. "Evidence on Online Higher Education: The Promise of COVID-19 Pandemic Data," Management and Labour Studies, XLRI Jamshedpur, School of Business Management & Human Resources, vol. 48(2), pages 242-249, May.
    21. Keng, Shao-Hsun, 2020. "Gender bias and statistical discrimination against female instructors in student evaluations of teaching," Labour Economics, Elsevier, vol. 66(C).

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:108:y:2025:i:c:s0272775725000809. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.