IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_9555.html

Tutoring in (Online) Higher Education: Experimental Evidence

Author

Listed:
  • David Hardt
  • Markus Nagler
  • Johannes Rincke

Abstract

Demand for personalized online tutoring in higher education is growing but there is little research on its effectiveness. We conducted an RCT offering remote peer tutoring in micro- and macroeconomics at a German university teaching online due to the Covid-pandemic. Treated students met in small groups, in alternating weeks with and without a more senior student tutor. The treatment improved study behavior and increased contact to other students. Tutored students achieved around 30% more credits and a one grade level better GPA across treated subjects. Our findings suggest that the program reduced outcome inequality. We find no impacts on mental health.

Suggested Citation

  • David Hardt & Markus Nagler & Johannes Rincke, 2022. "Tutoring in (Online) Higher Education: Experimental Evidence," CESifo Working Paper Series 9555, CESifo.
    • Handle: RePEc:ces:ceswps:_9555
    as

    Download full text from publisher

    File URL: https://www.ifo.de/DocDL/cesifo1_wp9555.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Duha Tore Altindag & Elif S. Filiz & Erdal Tekin, 2021. "Is Online Education Working?," NBER Working Papers 29113, National Bureau of Economic Research, Inc.
    2. Orlov, George & McKee, Douglas & Berry, James & Boyle, Austin & DiCiccio, Thomas & Ransom, Tyler & Rees-Jones, Alex & Stoye, Jörg, 2021. "Learning during the COVID-19 pandemic: It is not who you teach, but how you teach," Economics Letters, Elsevier, vol. 202(C).
    3. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    4. Paloyo, Alfredo R. & Rogan, Sally & Siminski, Peter, 2016. "The effect of supplemental instruction on academic performance: An encouragement design experiment," Economics of Education Review, Elsevier, vol. 55(C), pages 57-69.
    5. Patterson, Richard W., 2018. "Can behavioral tools improve online student outcomes? Experimental evidence from a massive open online course," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 293-321.
    6. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    7. Alberto Abadie & Matthew M. Chingos & Martin R. West, 2018. "Endogenous Stratification in Randomized Experiments," The Review of Economics and Statistics, MIT Press, vol. 100(4), pages 567-580, October.
    8. Andre Nickow & Philip Oreopoulos & Vincent Quan, 2020. "The Impressive Effects of Tutoring on PreK-12 Learning: A Systematic Review and Meta-Analysis of the Experimental Evidence," NBER Working Papers 27476, National Bureau of Economic Research, Inc.
    9. Carlana, Michela & La Ferrara, Eliana, 2021. "Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic," CEPR Discussion Papers 15761, Centre for Economic Policy Research.
    10. Abhijit V. Banerjee & Esther Duflo, 2014. "(Dis)organization and Success in an Economics MOOC," American Economic Review, American Economic Association, vol. 104(5), pages 514-518, May.
    11. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    12. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger & Zierow, Larissa, 2021. "COVID-19 and educational inequality: How school closures affect low- and high-achieving students," European Economic Review, Elsevier, vol. 140(C).
    13. Gordanier, John & Hauk, William & Sankaran, Chandini, 2019. "Early intervention in college classes and improved student outcomes," Economics of Education Review, Elsevier, vol. 72(C), pages 23-29.
    14. Rodríguez-Planas, Núria, 2022. "Hitting where it hurts most: COVID-19 and low-income urban college students," Economics of Education Review, Elsevier, vol. 87(C).
    15. Di Xu & Shanna S. Jaggars, 2014. "Performance Gaps between Online and Face-to-Face Courses: Differences across Types of Students and Academic Subject Areas," The Journal of Higher Education, Taylor & Francis Journals, vol. 85(5), pages 633-659, September.
    16. Bacher-Hicks, Andrew & Goodman, Joshua & Mulhern, Christine, 2021. "Inequality in household adaptation to schooling shocks: Covid-induced online learning engagement in real time," Journal of Public Economics, Elsevier, vol. 193(C).
    17. Oreopoulos, Philip & Petronijevic, Uros, 2019. "The Remarkable Unresponsiveness of College Students to Nudging and What We Can Learn from It," IZA Discussion Papers 12460, IZA Network @ LISER.
    18. Lavecchia, A.M. & Liu, H. & Oreopoulos, P., 2016. "Behavioral Economics of Education," Handbook of the Economics of Education,, Elsevier.
    19. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    20. Eric P. Bettinger & Lindsay Fox & Susanna Loeb & Eric S. Taylor, 2017. "Virtual Classrooms: How Online College Courses Affect Student Success," American Economic Review, American Economic Association, vol. 107(9), pages 2855-2875, September.
    21. Thomas S. Dee, 2005. "A Teacher Like Me: Does Race, Ethnicity, or Gender Matter?," American Economic Review, American Economic Association, vol. 95(2), pages 158-165, May.
    22. Aucejo, Esteban M. & French, Jacob & Ugalde Araya, Maria Paola & Zafar, Basit, 2020. "The impact of COVID-19 on student experiences and expectations: Evidence from a survey," Journal of Public Economics, Elsevier, vol. 191(C).
    23. Florian Hoffmann & Philip Oreopoulos, 2009. "A Professor Like Me: The Influence of Instructor Gender on College Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 44(2).
    24. Michael J. Weiss & Alyssa Ratledge & Colleen Sommo & Himani Gupta, 2019. "Supporting Community College Students from Start to Degree Completion: Long-Term Evidence from a Randomized Trial of CUNY's ASAP," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 253-297, July.
    25. Vincent G. Munley & Eoghan Garvey & Michael J. McConnell, 2010. "The Effectiveness of Peer Tutoring on Student Achievement at the University Level," American Economic Review, American Economic Association, vol. 100(2), pages 277-282, May.
    26. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    27. David Figlio & Mark Rush & Lu Yin, 2013. "Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning," Journal of Labor Economics, University of Chicago Press, vol. 31(4), pages 763-784.
    28. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    29. Thomas S. Dee, 2007. "Teachers and the Gender Gaps in Student Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 42(3).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maria Calle & Lucas Gortazar & Maria Hernandez-de-Benito & Claudia Hupkau & Teresa Molina-Millan & Antonio Roldan Mones, 2026. "From pilot to policy: experimental evidence from scaling online tutoring," CEP Discussion Papers dp2176, Centre for Economic Performance, LSE.
    2. Gortazar, Lucas & Hupkau, Claudia & Roldán-Monés, Antonio, 2024. "Online tutoring works: Experimental evidence from a program with vulnerable children," Journal of Public Economics, Elsevier, vol. 232(C).
    3. Antoine Platteau & Philippe Emplit & Dorothée Baillet & Catherine Dehon, 2026. "Evaluating the impact of student learning support programs in an open-access, low-tuition higher education institution," Working Papers ECARES 2026-02, ULB -- Universite Libre de Bruxelles.
    4. Pertold-Gebicka, Barbara, 2024. "Medium-run effects of COVID-19 induced distant learning on students’ academic performance," Labour Economics, Elsevier, vol. 89(C).
    5. Nicholas A. Wright & Puneet Arora & Jesse Wright, 2024. "I Promise to Work Hard: The Impact of a Non-Binding Commitment Pledge on Academic Performance," Working Papers 2411, Florida International University, Department of Economics.
    6. Wang, Deliang & Zhen, Yuanyi & Shan, Dapeng & Zhang, Chenwei & Kao, Ben & Chen, Gaowei, 2025. "More investment, more engagement? Analyzing dialogic behavior in online one-to-one tutoring among different payment mechanisms," International Journal of Educational Development, Elsevier, vol. 117(C).
    7. Cassandra M.D. Hart & Di Xu & Emily Alonso & Michael Hill, 2025. "COVID-19 in California Community Colleges: College Responses, College Resources, and Student Outcomes," Research in Higher Education, Springer;Association for Institutional Research, vol. 66(1), pages 1-28, February.
    8. Brian C. Jenkins, 2024. "Supporting Economic Understanding and Student Success Through Peer Assistance in an Economics Learning Center," The American Economist, Sage Publications, vol. 69(2), pages 278-287, October.
    9. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    2. Beam, Emily A. & Mukherjee, Priya & Navarro-Sola, Laia, 2022. "Lowering Barriers to Remote Education: Experimental Impacts on Parental Responses and Learning," IZA Discussion Papers 15596, IZA Network @ LISER.
    3. Hugues Champeaux & Lucia Mangiavacchi & Francesca Marchetta & Luca Piccoli, 2022. "Child development and distance learning in the age of COVID-19," Review of Economics of the Household, Springer, vol. 20(3), pages 659-685, September.
    4. Maria De Paola & Francesca Gioia & Vincenzo Scoppa, 2022. "Online Teaching, Procrastination And Students’ Achievement: Evidence From Covid-19 Induced Remote Learning," Working Papers 202202, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" - DESF.
    5. Masato Ikeda & Shintaro Yamaguchi, 2021. "Online learning during school closure due to COVID-19," The Japanese Economic Review, Springer, vol. 72(3), pages 471-507, July.
    6. William N. Evans & Melissa S. Kearney & Brendan Perry & James X. Sullivan, 2020. "Increasing Community College Completion Rates Among Low‐Income Students: Evidence from a Randomized Controlled Trial Evaluation of a Case‐Management Intervention," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(4), pages 930-965, September.
    7. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2024. "Telementoring and Homeschooling During School Closures: a Randomised Experiment in Rural Bangladesh," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2418-2438.
    8. Ellis, Jimmy R. & Gershenson, Seth, 2020. "Gender, peer advising, and college success," Labour Economics, Elsevier, vol. 62(C).
    9. Carlana, Michela & La Ferrara, Eliana, 2021. "Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic," CEPR Discussion Papers 15761, Centre for Economic Policy Research.
    10. Lusher, Lester & Campbell, Doug & Carrell, Scott, 2018. "TAs like me: Racial interactions between graduate teaching assistants and undergraduates," Journal of Public Economics, Elsevier, vol. 159(C), pages 203-224.
    11. Jimmy R. Ellis & Seth Gershenson, 2016. "LATE for the meeting: Gender, peer advising, and college success," Upjohn Working Papers 16-262, W.E. Upjohn Institute for Employment Research.
    12. Alicia Brandt & Hamid R. Oskorouchi & Alfonso Sousa-Poza, 2024. "The effect of SMS nudges on higher education performance," Empirical Economics, Springer, vol. 66(5), pages 2311-2334, May.
    13. Riudavets-Barcons, Marc & Uusitalo, Roope, 2023. "School Closures and Student Achievement: Evidence from a High Stakes Exam," IZA Discussion Papers 16074, IZA Network @ LISER.
    14. Clark, Andrew E. & Nong, Huifu & Zhu, Hongjia & Zhu, Rong, 2021. "Compensating for academic loss: Online learning and student performance during the COVID-19 pandemic," China Economic Review, Elsevier, vol. 68(C).
    15. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    16. Rodríguez-Planas, Núria, 2022. "COVID-19, college academic performance, and the flexible grading policy: A longitudinal analysis," Journal of Public Economics, Elsevier, vol. 207(C).
    17. Katharina Werner & Ludger Woessmann, 2021. "The Legacy of Covid-19 in Education," CESifo Working Paper Series 9358, CESifo.
    18. Acuña, Mauricio & Álvarez, Roberto & Avarca, Cristóbal, 2025. "The heterogeneous impact of COVID-19 on university student´s academic performance," International Review of Economics Education, Elsevier, vol. 49(C).
    19. Nishihata, Masaya & Kobayashi, Yohei, 2024. "Inequalities in student learning and screen time due to COVID-19: Evidence from Japan," Journal of the Japanese and International Economies, Elsevier, vol. 71(C).
    20. Wang, Yueqin & Zhang, Chuanchuan & Zhang, Junsen, 2026. "Academic and health outcomes of online education for primary and secondary students: Evidence from COVID-19," Journal of Comparative Economics, Elsevier, vol. 54(1), pages 147-163.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I10 - Health, Education, and Welfare - - Health - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_9555. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.