IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp14094.html

Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic

Author

Listed:
  • Carlana, Michela

    (Harvard Kennedy School)

  • La Ferrara, Eliana

    (Bocconi University)

Abstract

In response to the COVID-19 outbreak, the governments of most countries ordered the closure of schools, potentially exacerbating existing learning gaps. This paper evaluates the effectiveness of an intervention implemented in Italian middle schools that provides free individual tutoring online to disadvantaged students during lock-down. Tutors are university students who volunteer for 3 to 6 hours per week. They were randomly assigned to middle school students, from a list of potential beneficiaries compiled by school principals. Using original survey data collected from students, parents, teachers and tutors, we find that the program substantially increased students' academic performance (by 0.26 SD on average) and that it significantly improved their socio-emotional skills, aspirations, and psychological well-being. Effects are stronger for children from lower socioeconomic status and, in the case of psychological well-being, for immigrant children.

Suggested Citation

  • Carlana, Michela & La Ferrara, Eliana, 2021. "Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic," IZA Discussion Papers 14094, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp14094
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp14094.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ofer Malamud & Cristian Pop-Eleches, 2011. "Home Computer Use and the Development of Human Capital," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 987-1027.
    2. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    3. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    4. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    5. Engzell, Per & Frey, Arun & Verhagen, Mark D., 2020. "Learning Inequality During the Covid-19 Pandemic," SocArXiv ve4z7, Center for Open Science.
    6. Garance Genicot & Debraj Ray, 2017. "Aspirations and Inequality," Econometrica, Econometric Society, vol. 85, pages 489-519, March.
    7. Psacharopoulos,George & Collis,Victoria & Patrinos,Harry Anthony & Vegas,Emiliana, 2020. "Lost Wages : The COVID-19 Cost of School Closures," Policy Research Working Paper Series 9246, The World Bank.
    8. Maya Escueta & Vincent Quan & Andre Joshua Nickow & Philip Oreopoulos, 2017. "Education Technology: An Evidence-Based Review," NBER Working Papers 23744, National Bureau of Economic Research, Inc.
    9. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    10. Bacher-Hicks, Andrew & Goodman, Joshua & Mulhern, Christine, 2021. "Inequality in household adaptation to schooling shocks: Covid-induced online learning engagement in real time," Journal of Public Economics, Elsevier, vol. 193(C).
    11. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger & Zierow, Larissa, 2021. "COVID-19 and educational inequality: How school closures affect low- and high-achieving students," European Economic Review, Elsevier, vol. 140(C).
    12. João Pedro & Amer Hasan & Diana Goldemberg & Koen Geven & Syedah Aroob Iqbal, 2021. "Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates [Tackling Inequity in Education during and after COVID-19]," The World Bank Research Observer, World Bank, vol. 36(1), pages 1-40.
    13. Agostinelli, Francesco & Doepke, Matthias & Sorrenti, Giuseppe & Zilibotti, Fabrizio, 2022. "When the great equalizer shuts down: Schools, peers, and parents in pandemic times," Journal of Public Economics, Elsevier, vol. 206(C).
    14. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    15. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    16. Jonathan Guryan & Jens Ludwig & Monica P. Bhatt & Philip J. Cook & Jonathan M. V. Davis & Kenneth Dodge & George Farkas & Roland G. Fryer Jr. & Susan Mayer & Harold Pollack & Laurence Steinberg & Greg, 2023. "Not Too Late: Improving Academic Outcomes among Adolescents," American Economic Review, American Economic Association, vol. 113(3), pages 738-765, March.
    17. Angrist, Noam & Bergman, Peter & Matsheng, Moitshepi, 2020. "School's Out: Experimental Evidence on Limiting Learning Loss Using," IZA Discussion Papers 14009, Institute of Labor Economics (IZA).
    18. Lubhana Malik Mental, 2019. "Mental Health in Adolescents," Global Journal of Intellectual & Developmental Disabilities, Juniper Publishers Inc., vol. 6(3), pages 45-46, March.
    19. Andre Nickow & Philip Oreopoulos & Vincent Quan, 2020. "The Impressive Effects of Tutoring on PreK-12 Learning: A Systematic Review and Meta-Analysis of the Experimental Evidence," NBER Working Papers 27476, National Bureau of Economic Research, Inc.
    20. Eliana La Ferrara, 2019. "Presidential Address: Aspirations, Social Norms, and Development," Journal of the European Economic Association, European Economic Association, vol. 17(6), pages 1687-1722.
    21. João Pedro Azevedo & Amer Hasan & Diana Goldemberg & Koen Geven & Syedah Aroob Iqbal, 0. "Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates," World Bank Research Observer, World Bank Group, vol. 36(1), pages 1-40.
    22. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    23. Jonathan M.V. Davis & Sara B. Heller, 2017. "Using Causal Forests to Predict Treatment Heterogeneity: An Application to Summer Jobs," American Economic Review, American Economic Association, vol. 107(5), pages 546-550, May.
    24. Sule Alan & Teodora Boneva & Seda Ertac, 2019. "Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1121-1162.
    25. Gauri, Varun & Jamison, Julian C. & Mazar, Nina & Ozier, Owen, 2021. "Motivating bureaucrats through social recognition: External validity—A tale of two states," Organizational Behavior and Human Decision Processes, Elsevier, vol. 163(C), pages 117-131.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2024. "Telementoring and Homeschooling During School Closures: a Randomised Experiment in Rural Bangladesh," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2418-2438.
    2. Guido Neidhöfer & Nora Lustig & Mariano Tommasi, 2021. "Intergenerational transmission of lockdown consequences: prognosis of the longer-run persistence of COVID-19 in Latin America," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 19(3), pages 571-598, September.
    3. Alderighi, Lorenzo & Ballatore, Rosario M. & Tonello, Marco, 2023. "Hidden drop-out: Secondary education (unseen) failure in pandemic times," GLO Discussion Paper Series 1293, Global Labor Organization (GLO).
    4. Shinsuke Asakawa & Fumio Ohtake, 2021. "Impact of Temporary School Closure Due to COVID-19 on the Academic Achievement of Elementary School Students," Discussion Papers in Economics and Business 21-14, Osaka University, Graduate School of Economics.
    5. Engzell, Per & Frey, Arun & Verhagen, Mark D., 2020. "Learning Inequality During the Covid-19 Pandemic," SocArXiv ve4z7, Center for Open Science.
    6. Katharina Werner & Ludger Woessmann, 2021. "The Legacy of Covid-19 in Education," CESifo Working Paper Series 9358, CESifo.
    7. Haelermans, Carla & Jacobs, Madelon & van Vugt, Lynn & Aarts, Bas & Abbink, Henry & Smeets, Chayenne & van der Velden, Rolf & van Wetten, Sanne, 2021. "A full year COVID-19 crisis with interrupted learning and two school closures: The effects on learning growth and inequality in primary education," Research Memorandum 021, Maastricht University, Graduate School of Business and Economics (GSBE).
    8. Stefanie Stantcheva, 2022. "Inequalities in the times of a pandemic," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 37(109), pages 5-41.
    9. Boruchowicz, Cynthia & Parker, Susan W. & Robbins, Lindsay, 2022. "Time use of youth during a pandemic: Evidence from Mexico," World Development, Elsevier, vol. 149(C).
    10. Josep Amer-Mestre & Alaitz Ayarza-Astigarraga & Marta C. Lopes, 2024. "E-learning engagement gap during school closures: differences by academic performance," Applied Economics, Taylor & Francis Journals, vol. 56(3), pages 337-359, January.
    11. Hardt, David & Nagler, Markus & Rincke, Johannes, 2023. "Tutoring in (online) higher education: Experimental evidence," Economics of Education Review, Elsevier, vol. 92(C).
    12. Angrist, Noam & de Barros, Andreas & Bhula, Radhika & Chakera, Shiraz & Cummiskey, Chris & DeStefano, Joseph & Floretta, John & Kaffenberger, Michelle & Piper, Benjamin & Stern, Jonathan, 2021. "Building back better to avert a learning catastrophe: Estimating learning loss from COVID-19 school shutdowns in Africa and facilitating short-term and long-term learning recovery," International Journal of Educational Development, Elsevier, vol. 84(C).
    13. Clare Halloran & Rebecca Jack & James C. Okun & Emily Oster, 2021. "Pandemic Schooling Mode and Student Test Scores: Evidence from US States," NBER Working Papers 29497, National Bureau of Economic Research, Inc.
    14. de Ree, Joppe & Maggioni, Mario A. & Paulle, Bowen & Rossignoli, Domenico & Ruijs, Nienke & Walentek, Dawid, 2023. "Closing the income-achievement gap? Experimental evidence from high-dosage tutoring in Dutch primary education," Economics of Education Review, Elsevier, vol. 94(C).
    15. Liao, Haoye & Ma, Sen & Xue, Hao, 2022. "Does school shutdown increase inequality in academic performance? Evidence from COVID-19 pandemic in China," China Economic Review, Elsevier, vol. 75(C).
    16. Svaleryd, Helena & Vlachos, Jonas, 2022. "COVID-19 and School Closures," GLO Discussion Paper Series 1008, Global Labor Organization (GLO).
    17. Nora Lustig & Valentina Martinez Pabon & Guido Neidhöfer & Mariano Tommasi, 2020. "Short and Long-Run Distributional Impacts of COVID-19 in Latin America," Working Papers 2013, Tulane University, Department of Economics.
    18. Bonaccolto-Töpfer, Marina & Castagnetti, Carolina, 2021. "The COVID-19 pandemic: A threat to higher education?," Discussion Papers 117, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Labour and Regional Economics.
    19. Sanchis-Guarner, Rosa & Montalbán, José & Weinhardt, Felix, 2025. "Home broadband and human capital formation," Economics of Education Review, Elsevier, vol. 108(C).
    20. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp14094. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.