IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp14094.html
   My bibliography  Save this paper

Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic

Author

Listed:
  • Carlana, Michela

    (Harvard Kennedy School)

  • La Ferrara, Eliana

    (Bocconi University)

Abstract

In response to the COVID-19 outbreak, the governments of most countries ordered the closure of schools, potentially exacerbating existing learning gaps. This paper evaluates the effectiveness of an intervention implemented in Italian middle schools that provides free individual tutoring online to disadvantaged students during lock-down. Tutors are university students who volunteer for 3 to 6 hours per week. They were randomly assigned to middle school students, from a list of potential beneficiaries compiled by school principals. Using original survey data collected from students, parents, teachers and tutors, we find that the program substantially increased students' academic performance (by 0.26 SD on average) and that it significantly improved their socio-emotional skills, aspirations, and psychological well-being. Effects are stronger for children from lower socioeconomic status and, in the case of psychological well-being, for immigrant children.

Suggested Citation

  • Carlana, Michela & La Ferrara, Eliana, 2021. "Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic," IZA Discussion Papers 14094, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp14094
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp14094.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    2. Jonathan Guryan & Jens Ludwig & Monica P. Bhatt & Philip J. Cook & Jonathan M. V. Davis & Kenneth Dodge & George Farkas & Roland G. Fryer Jr. & Susan Mayer & Harold Pollack & Laurence Steinberg & Greg, 2023. "Not Too Late: Improving Academic Outcomes among Adolescents," American Economic Review, American Economic Association, vol. 113(3), pages 738-765, March.
    3. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    4. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    5. Agostinelli, Francesco & Doepke, Matthias & Sorrenti, Giuseppe & Zilibotti, Fabrizio, 2022. "When the great equalizer shuts down: Schools, peers, and parents in pandemic times," Journal of Public Economics, Elsevier, vol. 206(C).
    6. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    7. Psacharopoulos, George & Collis, Victoria & Patrinos, Harry Anthony & Vegas, Emiliana, 2020. "Lost Wages: The COVID-19 Cost of School Closures," GLO Discussion Paper Series 548, Global Labor Organization (GLO).
    8. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    9. Andre Nickow & Philip Oreopoulos & Vincent Quan, 2020. "The Impressive Effects of Tutoring on PreK-12 Learning: A Systematic Review and Meta-Analysis of the Experimental Evidence," NBER Working Papers 27476, National Bureau of Economic Research, Inc.
    10. Eliana La Ferrara, 2019. "Presidential Address: Aspirations, Social Norms, and Development," Journal of the European Economic Association, European Economic Association, vol. 17(6), pages 1687-1722.
    11. João Pedro Azevedo & Amer Hasan & Diana Goldemberg & Koen Geven & Syedah Aroob Iqbal, 0. "Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates," World Bank Research Observer, World Bank Group, vol. 36(1), pages 1-40.
    12. Ofer Malamud & Cristian Pop-Eleches, 2011. "Home Computer Use and the Development of Human Capital," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 987-1027.
    13. Garance Genicot & Debraj Ray, 2017. "Aspirations and Inequality," Econometrica, Econometric Society, vol. 85, pages 489-519, March.
    14. Maya Escueta & Vincent Quan & Andre Joshua Nickow & Philip Oreopoulos, 2017. "Education Technology: An Evidence-Based Review," NBER Working Papers 23744, National Bureau of Economic Research, Inc.
    15. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger & Zierow, Larissa, 2021. "COVID-19 and educational inequality: How school closures affect low- and high-achieving students," European Economic Review, Elsevier, vol. 140(C).
    16. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    17. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    18. Lubhana Malik Mental, 2019. "Mental Health in Adolescents," Global Journal of Intellectual & Developmental Disabilities, Juniper Publishers Inc., vol. 6(3), pages 45-46, March.
    19. Bacher-Hicks, Andrew & Goodman, Joshua & Mulhern, Christine, 2021. "Inequality in household adaptation to schooling shocks: Covid-induced online learning engagement in real time," Journal of Public Economics, Elsevier, vol. 193(C).
    20. Sule Alan & Teodora Boneva & Seda Ertac, 2019. "Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1121-1162.
    21. Jonathan M.V. Davis & Sara B. Heller, 2017. "Using Causal Forests to Predict Treatment Heterogeneity: An Application to Summer Jobs," American Economic Review, American Economic Association, vol. 107(5), pages 546-550, May.
    22. Gauri, Varun & Jamison, Julian C. & Mazar, Nina & Ozier, Owen, 2019. "Motivating Bureaucrats through Social Recognition: External Validity — A Tale of Two States," IZA Discussion Papers 12251, Institute of Labor Economics (IZA).
    23. Engzell, Per & Frey, Arun & Verhagen, Mark D., 2020. "Learning Inequality During the Covid-19 Pandemic," SocArXiv ve4z7, Center for Open Science.
    24. João Pedro & Amer Hasan & Diana Goldemberg & Koen Geven & Syedah Aroob Iqbal, 2021. "Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates [Tackling Inequity in Education during and after COVID-19]," The World Bank Research Observer, World Bank, vol. 36(1), pages 1-40.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic
      by maximorossi in NEP-LTV blog on 2021-05-21 20:10:08

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hardt, David & Nagler, Markus & Rincke, Johannes, 2023. "Tutoring in (online) higher education: Experimental evidence," Economics of Education Review, Elsevier, vol. 92(C).
    2. Abhijeet Singh & Mauricio Romero & Karthik Muralidharan, 2022. "Covid-19 Learning Loss and Recovery: Panel Data Evidence from India," NBER Working Papers 30552, National Bureau of Economic Research, Inc.
    3. Katharina Werner & Ludger Woessmann, 2021. "The Legacy of Covid-19 in Education," CESifo Working Paper Series 9358, CESifo.
    4. M. Niaz Asadullah & Anindita Bhattacharjee, 2022. "Digital Divide or Digital Provide? Technology, Time Use, and Learning Loss during COVID-19," Journal of Development Studies, Taylor & Francis Journals, vol. 58(10), pages 1934-1957, October.
    5. Hugues Champeaux & Lucia Mangiavacchi & Francesca Marchetta & Luca Piccoli, 2022. "Child development and distance learning in the age of COVID-19," Review of Economics of the Household, Springer, vol. 20(3), pages 659-685, September.
    6. de Ree, Joppe & Maggioni, Mario A. & Paulle, Bowen & Rossignoli, Domenico & Ruijs, Nienke & Walentek, Dawid, 2023. "Closing the income-achievement gap? Experimental evidence from high-dosage tutoring in Dutch primary education," Economics of Education Review, Elsevier, vol. 94(C).
    7. Elisa Failache & Nicolás Fiori & Noemi Katzkowicz & Alina Machado & Luciana Méndez, 2022. "Impact of COVID-19 on higher education: Evidence from Uruguay," Documentos de Trabajo (working papers) 22-02, Instituto de Economía - IECON.
    8. Gajderowicz,Tomasz Janusz & Jakubowski,Maciej Jan & Patrinos,Harry Anthony & Wrona,Sylwia Michalina, 2022. "Capturing the Educational and Economic Impacts of School Closures in Poland," Policy Research Working Paper Series 10253, The World Bank.
    9. Sakaue, Katsuki & Wokadala, James & Ogawa, Keiichi, 2023. "Effect of parental engagement on children’s home-based continued learning during COVID-19–induced school closures: Evidence from Uganda," International Journal of Educational Development, Elsevier, vol. 100(C).
    10. Francisco Gallego & Philip Oreopoulos & Noah Spencer, 2023. "The Importance of a Helping Hand in Education and in Life," Documentos de Trabajo 575, Instituto de Economia. Pontificia Universidad Católica de Chile..
    11. Sébastien Goudeau & Camille Sanrey & Arnaud Stanczak & Antony Manstead & Céline Darnon, 2021. "Why lockdown and distance learning during the COVID-19 pandemic are likely to increase the social class achievement gap," Nature Human Behaviour, Nature, vol. 5(10), pages 1273-1281, October.
    12. Lafortune, Jeanne & Pugatch, Todd & Tessada, José & Ubfal, Diego, 2022. "Can Interactive Online Training Make High School Students More Entrepreneurial? Experimental Evidence from Rwanda," IZA Discussion Papers 15064, Institute of Labor Economics (IZA).
    13. Emily Beam & Priya Mukherjee & Laia Navarro-Sola, 2022. "Lowering Barriers to Remote Education: Experimental Impacts on Parental Responses and Learning," Working Papers 2022-030, Human Capital and Economic Opportunity Working Group.
    14. Hassan, Hashibul & Islam, Asad & Siddique, Abu & Wang, Liang Choon, 2021. "Telementoring and homeschooling during school closures: A randomized experiment in rural Bangladesh," SocArXiv mhyq5, Center for Open Science.
    15. Wang, Liang Choon & Vlassopoulos, Michael & Islam, Asad & Hassan, Hashibul, 2023. "Delivering Remote Learning Using a Low-Tech Solution: Evidence from a Randomized Controlled Trial in Bangladesh," IZA Discussion Papers 15920, Institute of Labor Economics (IZA).
    16. Harry Anthony Patrinos, 2022. "Learning loss and learning recovery," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 49(2), pages 183-188, June.
    17. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    18. Kudlyak, Marianna & Anastasia, Giacomo & Boeri, Tito & Zholud, Oleksandr, 2022. "The Labor Market in Ukraine: Rebuild Better," CEPR Discussion Papers 17769, C.E.P.R. Discussion Papers.
    19. Shinsuke Asakawa & Fumio Ohtake, 2021. "Impact of Temporary School Closure Due to COVID-19 on the Academic Achievement of Elementary School Students," Discussion Papers in Economics and Business 21-14, Osaka University, Graduate School of Economics.
    20. Jakubowski,Maciej Jan & Gajderowicz,Tomasz Janusz & Patrinos,Harry Anthony, 2024. "COVID-19, School Closures, and Student Learning Outcomes : New Global Evidence from PISA," Policy Research Working Paper Series 10666, The World Bank.
    21. Amer-Mestre, Josep & Ayarza-Astigarraga, Alaitz & Lopes, Marta C, 2021. "E-Learning Engagement Gap during School Closures: Differences by Academic Performance," IZA Discussion Papers 14904, Institute of Labor Economics (IZA).
    22. Lucas Gortazar & Claudia Hupkau & Antonio Roldan, 2023. "Online tutoring works: experimental evidence from a program with vulnerable children," CEP Discussion Papers dp1908, Centre for Economic Performance, LSE.
    23. Boruchowicz, Cynthia & Parker, Susan W. & Robbins, Lindsay, 2022. "Time use of youth during a pandemic: Evidence from Mexico," World Development, Elsevier, vol. 149(C).
    24. Zhang, Yue & Zhao, Guochang & Zhou, Bo, 2021. "Does learning longer improve student achievement? Evidence from online education of graduating students in a high school during COVID-19 period," China Economic Review, Elsevier, vol. 70(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2021. "Telementoring and homeschooling during school closures: A randomized experiment in rural Bangladesh," Munich Papers in Political Economy 13, Munich School of Politics and Public Policy and the School of Management at the Technical University of Munich.
    2. Werner, Katharina & Woessmann, Ludger, 2021. "The Legacy of COVID-19 in Education," IZA Discussion Papers 14796, Institute of Labor Economics (IZA).
    3. Haelermans, Carla & Jacobs, Madelon & van Vugt, Lynn & Aarts, Bas & Abbink, Henry & Smeets, Chayenne & van der Velden, Rolf & van Wetten, Sanne, 2021. "A full year COVID-19 crisis with interrupted learning and two school closures: The effects on learning growth and inequality in primary education," ROA Research Memorandum 009, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    4. Alderighi, Lorenzo & Ballatore, Rosario M. & Tonello, Marco, 2023. "Hidden drop-out: Secondary education (unseen) failure in pandemic times," GLO Discussion Paper Series 1293, Global Labor Organization (GLO).
    5. Guido Neidhöfer & Nora Lustig & Mariano Tommasi, 2021. "Intergenerational transmission of lockdown consequences: prognosis of the longer-run persistence of COVID-19 in Latin America," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 19(3), pages 571-598, September.
    6. Stefanie Stantcheva, 2022. "Inequalities in the times of a pandemic," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 37(109), pages 5-41.
    7. Shinsuke Asakawa & Fumio Ohtake, 2021. "Impact of Temporary School Closure Due to COVID-19 on the Academic Achievement of Elementary School Students," Discussion Papers in Economics and Business 21-14, Osaka University, Graduate School of Economics.
    8. Engzell, Per & Frey, Arun & Verhagen, Mark D., 2020. "Learning Inequality During the Covid-19 Pandemic," SocArXiv ve4z7, Center for Open Science.
    9. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    10. Hardt, David & Nagler, Markus & Rincke, Johannes, 2023. "Tutoring in (online) higher education: Experimental evidence," Economics of Education Review, Elsevier, vol. 92(C).
    11. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    12. Boruchowicz, Cynthia & Parker, Susan W. & Robbins, Lindsay, 2022. "Time use of youth during a pandemic: Evidence from Mexico," World Development, Elsevier, vol. 149(C).
    13. de Ree, Joppe & Maggioni, Mario A. & Paulle, Bowen & Rossignoli, Domenico & Ruijs, Nienke & Walentek, Dawid, 2023. "Closing the income-achievement gap? Experimental evidence from high-dosage tutoring in Dutch primary education," Economics of Education Review, Elsevier, vol. 94(C).
    14. Angrist, Noam & de Barros, Andreas & Bhula, Radhika & Chakera, Shiraz & Cummiskey, Chris & DeStefano, Joseph & Floretta, John & Kaffenberger, Michelle & Piper, Benjamin & Stern, Jonathan, 2021. "Building back better to avert a learning catastrophe: Estimating learning loss from COVID-19 school shutdowns in Africa and facilitating short-term and long-term learning recovery," International Journal of Educational Development, Elsevier, vol. 84(C).
    15. Liao, Haoye & Ma, Sen & Xue, Hao, 2022. "Does school shutdown increase inequality in academic performance? Evidence from COVID-19 pandemic in China," China Economic Review, Elsevier, vol. 75(C).
    16. Bonaccolto-Töpfer, Marina & Castagnetti, Carolina, 2021. "The COVID-19 pandemic: A threat to higher education?," Discussion Papers 117, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Labour and Regional Economics.
    17. Rosa Sanchis-Guarner & José Montalbán & Felix Weinhardt, 2021. "Home Broadband and Human Capital Formation," CESifo Working Paper Series 8846, CESifo.
    18. Monroy-Gómez-Franco, Luis & Vélez-Grajales, Roberto & López-Calva, Luis F., 2022. "The potential effects of the COVID-19 pandemic on learnings," International Journal of Educational Development, Elsevier, vol. 91(C).
    19. Heidmann, Laure & Neirac, Lucie & Andreu, Sandra & Conceiçao, Pierre & Eteve, Yann & Fabre, Marianne & Vourc'h, Ronan, 2023. "Delayed learning to read and write during the COVID-19 pandemic: longitudinal study of the heterogeneous effects on all first graders in France," SocArXiv qn9a8, Center for Open Science.
    20. Joe Piacentini & Harley Frazis & Peter B. Meyer & Michael Schultz & Leo Sveikauskas, 2022. "The Impact of COVID-19 on Labor Markets and Inequality," Economic Working Papers 551, Bureau of Labor Statistics.

    More about this item

    Keywords

    tutoring; COVID-19; education; achievement; aspirations; socioemotional skills; well-being;
    All these keywords.

    JEL classification:

    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp14094. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.