IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.21534.html

Generative AI Availability, Grades, and Student Satisfaction at a Large University

Author

Listed:
  • James M. Zumel Dumlao
  • Meng Wang
  • Zhonghan Xie
  • Junyao Hu
  • Ivan Bar
  • George Chaney III
  • Henry Gold
  • Misha Teplitskiy

Abstract

The spread of generative AI (GenAI) in higher education has raised concerns that students offload cognitive effort to AI, earning high grades without learning. If this "GenAI substitution hypothesis" is true, grades should rise disproportionately in GenAI-susceptible courses--those relying more on assessments like take-home problem sets and essays rather than in-class exams. Substitution could also affect student satisfaction, measured here as self-reported understanding and interest in the subject, which prior research links to assessments. We test the substitution hypothesis using syllabus and administrative data from a large U.S. university (2016-2025; 138,386 students; 72,730 course offerings). We measure courses' GenAI susceptibility using a human-validated LLM pipeline to extract assessment types from syllabi, and use a differences-in-differences design comparing outcomes across courses before and after ChatGPT's release, while modeling COVID-19 pandemic effects as either persistent or transient. We find no significant differential effect of GenAI availability on grades overall or among previously lower-performing students. Effects on self-reported understanding are likewise insignificant; effects on interest are significant only assuming transient pandemic effects. Our findings temper concerns that GenAI inflates grades and reduces students' satisfaction.

Suggested Citation

  • James M. Zumel Dumlao & Meng Wang & Zhonghan Xie & Junyao Hu & Ivan Bar & George Chaney III & Henry Gold & Misha Teplitskiy, 2026. "Generative AI Availability, Grades, and Student Satisfaction at a Large University," Papers 2607.21534, arXiv.org, revised Jul 2026.
  • Handle: RePEc:arx:papers:2607.21534
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.21534
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Tom Mitchell & Daniel Rock, 2018. "What Can Machines Learn, and What Does It Mean for Occupations and the Economy?," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 43-47, May.
    2. Ozge Demirci & Jonas Hannane & Xinrong Zhu, 2025. "Who Is AI Replacing? The Impact of Generative AI on Online Freelancing Platforms," Management Science, INFORMS, vol. 71(10), pages 8097-8108, October.
    3. Charles I. Jones, 2022. "The Past and Future of Economic Growth: A Semi-Endogenous Perspective," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 125-152, August.
    4. Romer, Paul M, 1990. "Endogenous Technological Change," Journal of Political Economy, University of Chicago Press, vol. 98(5), pages 71-102, October.
    5. Ásgeirsdóttir, Tinna Laufey & Francesconi, Marco & Jóhannsdóttir, Ásthildur M. & Zoega, Gylfi, 2026. "How home exams and peers affect college grades in unprecedented times," European Economic Review, Elsevier, vol. 183(C).
    6. Richard Sabot & John Wakeman-Linn, 1991. "Grade Inflation and Course Choice," Journal of Economic Perspectives, American Economic Association, vol. 5(1), pages 159-170, Winter.
    7. Tyna Eloundou & Sam Manning & Pamela Mishkin & Daniel Rock, 2023. "GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models," Papers 2303.10130, arXiv.org, revised Aug 2023.
    8. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2025. "Generative AI at Work," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(2), pages 889-942.
    9. Talia Bar & Vrinda Kadiyali & Asaf Zussman, 2012. "Putting Grades in Context," Journal of Labor Economics, University of Chicago Press, vol. 30(2), pages 445-478.
    10. Michael Gerlich, 2025. "AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking," Societies, MDPI, vol. 15(1), pages 1-28, January.
    11. Michael Gerlich, 2025. "Correction: Gerlich, M. AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking. Societies 2025, 15 , 6," Societies, MDPI, vol. 15(9), pages 1-1, September.
    12. Klijn, Flip & Mdaghri Alaoui, Mehdi & Vorsatz, Marc, 2022. "Academic integrity in on-line exams: Evidence from a randomized field experiment," Journal of Economic Psychology, Elsevier, vol. 93(C).
    13. Fabrizio Dell’Acqua & Edward McFowland & Ethan Mollick & Hila Lifshitz & Katherine C. Kellogg & Saran Rajendran & Lisa Krayer & François Candelon & Karim R. Lakhani, 2026. "Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality," Organization Science, INFORMS, vol. 37(2), pages 403-423, March.
    14. Talia Bar & Vrinda Kadiyali & Asaf Zussman, 2009. "Grade Information and Grade Inflation: The Cornell Experiment," Journal of Economic Perspectives, American Economic Association, vol. 23(3), pages 93-108, Summer.
    15. Andrew Grodner & Nicholas G. Rupp, 2013. "The Role of Homework in Student Learning Outcomes: Evidence from a Field Experiment," The Journal of Economic Education, Taylor & Francis Journals, vol. 44(2), pages 93-109, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gmyrek, Pawel, & Viollaz, Mariana, & Winkler, Hernan,, 2026. "Disruption without dividend? how the digital divide and task differences split GenAI’s global impact," ILO Working Papers 995694369002676, International Labour Organization.
    2. Maydell, Richard & Firth, John, 2025. "Tilting the Race Between Humans and AI: The Role of Education and Unemployment Policies," VfS Annual Conference 2025 (Cologne): Revival of Industrial Policy 325460, Verein für Socialpolitik / German Economic Association.
    3. Cantarella, Michele & Molinari, Giuseppe & Strozzi, Chiara, 2026. "Becoming The Man Without Qualities? Deskilling in the Age of Artificial Intelligence," IZA Discussion Papers 18751, IZA Network @ LISER.
    4. repec:ces:ceswps:_12072 is not listed on IDEAS
    5. Martin Gregor, 2021. "Electives Shopping, Grading Policies and Grading Competition," Economica, London School of Economics and Political Science, vol. 88(350), pages 364-398, April.
    6. Wang, Ping & Wong, Tsz-Nga, 2026. "Artificial intelligence and technological unemployment," Journal of Monetary Economics, Elsevier, vol. 158(C).
    7. Shao-Hsun Keng, 2016. "The Effect of a Stricter Academic Dismissal Policy on Course Selection, Student Effort, and Grading Leniency," Education Finance and Policy, MIT Press, vol. 11(2), pages 203-224, Spring.
    8. Wu, Yifan & Yuan, Yiming & Song, Xueyin, 2025. "The impact of AI adoption on R&D productivity: Evidence from Chinese pharmaceutical manufacturing industry," Journal of Asian Economics, Elsevier, vol. 97(C).
    9. Chen, Qin & Ge, Jinfeng & Xie, Huaqing & Xu, Xingcheng & Yang, Yanqing, 2025. "Large language models at work in China’s labor market," China Economic Review, Elsevier, vol. 92(C).
    10. Lehr, Nils H. & Restrepo, Pascual, 2026. "The price of intelligence: How should socially-minded firms price and deploy AI?," Journal of Monetary Economics, Elsevier, vol. 157(C).
    11. Christoph Riedl & Eric Bogert, 2024. "Who Benefits from AI? Self-Selection, Skill Gap, and the Hidden Costs of AI Feedback," Papers 2409.18660, arXiv.org, revised Apr 2026.
    12. Singh, Anuraag & Triulzi, Giorgio & Magee, Christopher L., 2021. "Technological improvement rate predictions for all technologies: Use of patent data and an extended domain description," Research Policy, Elsevier, vol. 50(9).
    13. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 28 Apr 2025.
    14. Pawel Gmyrek & Janine Berg & David Bescond, 2025. "Generative AI and Jobs: An Analysis of Potential Effects on Global Employment," Gospodarka Narodowa. The Polish Journal of Economics, Warsaw School of Economics, issue 3, pages 6-30.
    15. Leonardo Banh & Gero Strobel, 2023. "Generative artificial intelligence," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-17, December.
    16. Röser, Florian & Niemann, Stefan & Angelini, Daniele, 2023. "Fiscal Policy and Human Capital in the Race Against the Machine," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277672, Verein für Socialpolitik / German Economic Association.
    17. Carlo Drago & Alberto Costantiello & Marco Savorgnan & Angelo Leogrande, 2025. "Macroeconomic and Labor Market Drivers of AI Adoption in Europe: A Machine Learning and Panel Data Approach," Economies, MDPI, vol. 13(8), pages 1-62, August.
    18. Dong, Li & Liu, Junxian & Yang, Jinghan & Zhang, Xin, 2025. "The deployment of general large language models and corporate value: Evidence from the stock market," Finance Research Letters, Elsevier, vol. 86(PD).
    19. Maha Kalai & Hamdi Becha & Kamel Helali, 2024. "Effect of artificial intelligence on economic growth in European countries: a symmetric and asymmetric cointegration based on linear and non-linear ARDL approach," Journal of Economic Structures, Springer;Pan-Pacific Association of Input-Output Studies (PAPAIOS), vol. 13(1), pages 1-37, December.
    20. Lan Chen & Yufei Ji & Xichen Yao & Hengshu Zhu, 2024. "Occupation Life Cycle," Papers 2406.15373, arXiv.org.
    21. Soohyoung Lee & Dawoon Jeong & Jeong-Dong Lee, 2026. "Contrasting pathways of automation: routine task substitution vs. AI complementarity," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 13(1), pages 1-11, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.21534. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.