IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_9555.html
   My bibliography  Save this paper

Tutoring in (Online) Higher Education: Experimental Evidence

Author

Listed:
  • David Hardt
  • Markus Nagler
  • Johannes Rincke

Abstract

Demand for personalized online tutoring in higher education is growing but there is little research on its effectiveness. We conducted an RCT offering remote peer tutoring in micro- and macroeconomics at a German university teaching online due to the Covid-pandemic. Treated students met in small groups, in alternating weeks with and without a more senior student tutor. The treatment improved study behavior and increased contact to other students. Tutored students achieved around 30% more credits and a one grade level better GPA across treated subjects. Our findings suggest that the program reduced outcome inequality. We find no impacts on mental health.

Suggested Citation

  • David Hardt & Markus Nagler & Johannes Rincke, 2022. "Tutoring in (Online) Higher Education: Experimental Evidence," CESifo Working Paper Series 9555, CESifo.
    • Handle: RePEc:ces:ceswps:_9555
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp9555.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    2. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    3. Duha Tore Altindag & Elif S. Filiz & Erdal Tekin, 2021. "Is Online Education Working?," NBER Working Papers 29113, National Bureau of Economic Research, Inc.
    4. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    5. Orlov, George & McKee, Douglas & Berry, James & Boyle, Austin & DiCiccio, Thomas & Ransom, Tyler & Rees-Jones, Alex & Stoye, Jörg, 2021. "Learning during the COVID-19 pandemic: It is not who you teach, but how you teach," Economics Letters, Elsevier, vol. 202(C).
    6. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger & Zierow, Larissa, 2021. "COVID-19 and educational inequality: How school closures affect low- and high-achieving students," European Economic Review, Elsevier, vol. 140(C).
    7. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    8. Eric P. Bettinger & Lindsay Fox & Susanna Loeb & Eric S. Taylor, 2017. "Virtual Classrooms: How Online College Courses Affect Student Success," American Economic Review, American Economic Association, vol. 107(9), pages 2855-2875, September.
    9. Paloyo, Alfredo R. & Rogan, Sally & Siminski, Peter, 2016. "The effect of supplemental instruction on academic performance: An encouragement design experiment," Economics of Education Review, Elsevier, vol. 55(C), pages 57-69.
    10. Patterson, Richard W., 2018. "Can behavioral tools improve online student outcomes? Experimental evidence from a massive open online course," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 293-321.
    11. Thomas S. Dee, 2005. "A Teacher Like Me: Does Race, Ethnicity, or Gender Matter?," American Economic Review, American Economic Association, vol. 95(2), pages 158-165, May.
    12. Thomas S. Dee, 2007. "Teachers and the Gender Gaps in Student Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 42(3).
    13. Aucejo, Esteban M. & French, Jacob & Ugalde Araya, Maria Paola & Zafar, Basit, 2020. "The impact of COVID-19 on student experiences and expectations: Evidence from a survey," Journal of Public Economics, Elsevier, vol. 191(C).
    14. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    15. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    16. Philip Oreopoulos & Uros Petronijevic, 2019. "The Remarkable Unresponsiveness of College Students to Nudging And What We Can Learn from It," NBER Working Papers 26059, National Bureau of Economic Research, Inc.
    17. Alberto Abadie & Matthew M. Chingos & Martin R. West, 2018. "Endogenous Stratification in Randomized Experiments," The Review of Economics and Statistics, MIT Press, vol. 100(4), pages 567-580, October.
    18. Andre Nickow & Philip Oreopoulos & Vincent Quan, 2020. "The Impressive Effects of Tutoring on PreK-12 Learning: A Systematic Review and Meta-Analysis of the Experimental Evidence," NBER Working Papers 27476, National Bureau of Economic Research, Inc.
    19. Florian Hoffmann & Philip Oreopoulos, 2009. "A Professor Like Me: The Influence of Instructor Gender on College Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 44(2).
    20. Michael J. Weiss & Alyssa Ratledge & Colleen Sommo & Himani Gupta, 2019. "Supporting Community College Students from Start to Degree Completion: Long-Term Evidence from a Randomized Trial of CUNY's ASAP," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 253-297, July.
    21. Carlana, Michela & La Ferrara, Eliana, 2021. "Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic," CEPR Discussion Papers 15761, C.E.P.R. Discussion Papers.
    22. Rodríguez-Planas, Núria, 2022. "Hitting where it hurts most: COVID-19 and low-income urban college students," Economics of Education Review, Elsevier, vol. 87(C).
    23. Abhijit V. Banerjee & Esther Duflo, 2014. "(Dis)organization and Success in an Economics MOOC," American Economic Review, American Economic Association, vol. 104(5), pages 514-518, May.
    24. Vincent G. Munley & Eoghan Garvey & Michael J. McConnell, 2010. "The Effectiveness of Peer Tutoring on Student Achievement at the University Level," American Economic Review, American Economic Association, vol. 100(2), pages 277-282, May.
    25. Bacher-Hicks, Andrew & Goodman, Joshua & Mulhern, Christine, 2021. "Inequality in household adaptation to schooling shocks: Covid-induced online learning engagement in real time," Journal of Public Economics, Elsevier, vol. 193(C).
    26. David Figlio & Mark Rush & Lu Yin, 2013. "Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning," Journal of Labor Economics, University of Chicago Press, vol. 31(4), pages 763-784.
    27. Gordanier, John & Hauk, William & Sankaran, Chandini, 2019. "Early intervention in college classes and improved student outcomes," Economics of Education Review, Elsevier, vol. 72(C), pages 23-29.
    28. Di Xu & Shanna S. Jaggars, 2014. "Performance Gaps between Online and Face-to-Face Courses: Differences across Types of Students and Academic Subject Areas," The Journal of Higher Education, Taylor & Francis Journals, vol. 85(5), pages 633-659, September.
    29. Lavecchia, A.M. & Liu, H. & Oreopoulos, P., 2016. "Behavioral Economics of Education," Handbook of the Economics of Education,, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    2. Gortazar, Lucas & Hupkau, Claudia & Roldán-Monés, Antonio, 2024. "Online tutoring works: Experimental evidence from a program with vulnerable children," Journal of Public Economics, Elsevier, vol. 232(C).
    3. Nicholas A. Wright & Puneet Arora & Jesse Wright, 2024. "I Promise to Work Hard: The Impact of a Non-Binding Commitment Pledge on Academic Performance," Working Papers 2411, Florida International University, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    2. Emily Beam & Priya Mukherjee & Laia Navarro-Sola, 2022. "Lowering Barriers to Remote Education: Experimental Impacts on Parental Responses and Learning," Working Papers 2022-030, Human Capital and Economic Opportunity Working Group.
    3. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2024. "Telementoring and Homeschooling During School Closures: a Randomised Experiment in Rural Bangladesh," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2418-2438.
    4. Werner, Katharina & Woessmann, Ludger, 2021. "The Legacy of COVID-19 in Education," IZA Discussion Papers 14796, Institute of Labor Economics (IZA).
    5. Maria De Paola & Francesca Gioia & Vincenzo Scoppa, 2022. "Online Teaching, Procrastination And Students’ Achievement: Evidence From Covid-19 Induced Remote Learning," Working Papers 202202, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" - DESF.
    6. Hugues Champeaux & Lucia Mangiavacchi & Francesca Marchetta & Luca Piccoli, 2022. "Child development and distance learning in the age of COVID-19," Review of Economics of the Household, Springer, vol. 20(3), pages 659-685, September.
    7. Masato Ikeda & Shintaro Yamaguchi, 2021. "Online learning during school closure due to COVID-19," The Japanese Economic Review, Springer, vol. 72(3), pages 471-507, July.
    8. William N. Evans & Melissa S. Kearney & Brendan Perry & James X. Sullivan, 2020. "Increasing Community College Completion Rates Among Low‐Income Students: Evidence from a Randomized Controlled Trial Evaluation of a Case‐Management Intervention," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(4), pages 930-965, September.
    9. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    10. Ellis, Jimmy R. & Gershenson, Seth, 2016. "LATE for the Meeting: Gender, Peer Advising, and College Success," IZA Discussion Papers 9956, Institute of Labor Economics (IZA).
    11. Ellis, Jimmy R. & Gershenson, Seth, 2020. "Gender, peer advising, and college success," Labour Economics, Elsevier, vol. 62(C).
    12. Carlana, Michela & La Ferrara, Eliana, 2021. "Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic," CEPR Discussion Papers 15761, C.E.P.R. Discussion Papers.
    13. Gordanier, John & Hauk, William & Sankaran, Chandini, 2019. "Early intervention in college classes and improved student outcomes," Economics of Education Review, Elsevier, vol. 72(C), pages 23-29.
    14. Lusher, Lester & Campbell, Doug & Carrell, Scott, 2018. "TAs like me: Racial interactions between graduate teaching assistants and undergraduates," Journal of Public Economics, Elsevier, vol. 159(C), pages 203-224.
    15. Monroy-Gómez-Franco, Luis & Vélez-Grajales, Roberto & López-Calva, Luis F., 2022. "The potential effects of the COVID-19 pandemic on learnings," International Journal of Educational Development, Elsevier, vol. 91(C).
    16. Kato, Takao & Song, Yang, 2018. "An Advisor like Me: Does Gender Matter?," IZA Discussion Papers 11575, Institute of Labor Economics (IZA).
    17. Shinsuke Asakawa & Fumio Ohtake, 2021. "Impact of Temporary School Closure Due to COVID-19 on the Academic Achievement of Elementary School Students," Discussion Papers in Economics and Business 21-14, Osaka University, Graduate School of Economics.
    18. Ahn, Kunwon & Lee, Jun Yeong & Winters, John V., 2020. "Employment Opportunities and High School Completion during the COVID-19 Recession," IZA Discussion Papers 13802, Institute of Labor Economics (IZA).
    19. Clark, Andrew E. & Nong, Huifu & Zhu, Hongjia & Zhu, Rong, 2021. "Compensating for academic loss: Online learning and student performance during the COVID-19 pandemic," China Economic Review, Elsevier, vol. 68(C).
    20. Amer-Mestre, Josep & Ayarza-Astigarraga, Alaitz & Lopes, Marta C, 2021. "E-Learning Engagement Gap during School Closures: Differences by Academic Performance," IZA Discussion Papers 14904, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    tutoring; higher education; online teaching; Covid; mental health;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I10 - Health, Education, and Welfare - - Health - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_9555. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.