IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/ve4z7.html
   My bibliography  Save this paper

Learning Inequality During the Covid-19 Pandemic

Author

Listed:
  • Engzell, Per
  • Frey, Arun
  • Verhagen, Mark D.

Abstract

Suspension of face-to-face instruction in schools during the COVID-19 pandemic has led to concerns about consequences for student learning. So far, data to study this question have been limited. Here we evaluate the effect of school closures on primary school performance using exceptionally rich data from the Netherlands (n≈350,000). The Netherlands represents a best-case scenario with a relatively short lockdown (8 weeks) and a high degree of technological preparedness. We use the fact that national exams took place before and after lockdown, and compare progress during this period to the same period in the three previous years using a difference-in-differences design. Our results reveal a learning loss of about 3 percentile points or 0.08 standard deviations. These results remain robust when balancing on the estimated propensity of treatment and using maximum entropy weights, or with fixed-effects specifications that compare students within the same school and family. Losses are up to 55% larger among students from less-educated homes. Investigating mechanisms, we find that most of the effect reflects the cumulative impact of knowledge learned rather than transitory influences on the day of testing. The average learning loss is equivalent to a fifth of a school year, nearly exactly the same period that schools remained closed. These results imply that students made little or no progress whilst learning from home, and suggest much larger losses in countries less prepared for remote learning.

Suggested Citation

  • Engzell, Per & Frey, Arun & Verhagen, Mark D., 2020. "Learning Inequality During the Covid-19 Pandemic," SocArXiv ve4z7, Center for Open Science.
  • Handle: RePEc:osf:socarx:ve4z7
    DOI: 10.31219/osf.io/ve4z7
    as

    Download full text from publisher

    File URL: https://osf.io/download/5f995b4687b7df03233b06fe/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/ve4z7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    2. Psacharopoulos, George & Collis, Victoria & Patrinos, Harry Anthony & Vegas, Emiliana, 2020. "Lost Wages: The COVID-19 Cost of School Closures," GLO Discussion Paper Series 548, Global Labor Organization (GLO).
    3. Michèle Belot & Dinand Webbink, 2010. "Do Teacher Strikes Harm Educational Attainment of Students?," LABOUR, CEIS, vol. 24(4), pages 391-406, December.
    4. João Pedro Azevedo & Amer Hasan & Diana Goldemberg & Koen Geven & Syedah Aroob Iqbal, 0. "Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates," World Bank Research Observer, World Bank Group, vol. 36(1), pages 1-40.
    5. Giorgio Di Pietro & Federico Biagi & Patricia Costa & Zbigniew Karpinski & Jacopo Mazza, 2020. "The likely impact of COVID-19 on education: Reflections based on the existing literature and recent international datasets," JRC Research Reports JRC121071, Joint Research Centre.
    6. Dave E. Marcotte & Steven W. Hemelt, 2008. "Unscheduled School Closings and Student Performance," Education Finance and Policy, MIT Press, vol. 3(3), pages 316-338, July.
    7. Raj Chetty & John N. Friedman & Michael Stepner & The Opportunity Insights Team, 2020. "The Economic Impacts of COVID-19: Evidence from a New Public Database Built Using Private Sector Data," NBER Working Papers 27431, National Bureau of Economic Research, Inc.
    8. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    9. Lubhana Malik Mental, 2019. "Mental Health in Adolescents," Global Journal of Intellectual & Developmental Disabilities, Juniper Publishers Inc., vol. 6(3), pages 45-46, March.
    10. Bacher-Hicks, Andrew & Goodman, Joshua & Mulhern, Christine, 2021. "Inequality in household adaptation to schooling shocks: Covid-induced online learning engagement in real time," Journal of Public Economics, Elsevier, vol. 193(C).
    11. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    12. R. Jisung Park & A. Patrick Behrer & Joshua Goodman, 2021. "Learning is inhibited by heat exposure, both internationally and within the United States," Nature Human Behaviour, Nature, vol. 5(1), pages 19-27, January.
    13. Pietro Biroli & Steven Bosworth & Marina Della Giusta & Amalia Di Girolamo & Sylvia Jaworska & Jeremy Vollen, 2020. "Family Life in Lockdown," Working Papers 2020-051, Human Capital and Economic Opportunity Working Group.
    14. Dirk Witteveen & Eva Velthorst, 2020. "Economic hardship and mental health complaints during COVID-19," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(44), pages 27277-27284, November.
    15. Bol, Thijs, 2020. "Inequality in homeschooling during the Corona crisis in the Netherlands. First results from the LISS Panel," SocArXiv hf32q, Center for Open Science.
    16. Francisco Cabrera-Hernández & Marí­a Padilla-Romo, 2020. "Hidden Violence: How COVID-19 School Closures Reduced the Reporting of Child Maltreatment," Working Papers 2020-02, University of Tennessee, Department of Economics.
    17. João Pedro & Amer Hasan & Diana Goldemberg & Koen Geven & Syedah Aroob Iqbal, 2021. "Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates [Tackling Inequity in Education during and after COVID-19]," The World Bank Research Observer, World Bank, vol. 36(1), pages 1-40.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haelermans, Carla & Jacobs, Madelon & van Vugt, Lynn & Aarts, Bas & Abbink, Henry & Smeets, Chayenne & van der Velden, Rolf & van Wetten, Sanne, 2021. "A full year COVID-19 crisis with interrupted learning and two school closures: The effects on learning growth and inequality in primary education," ROA Research Memorandum 009, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    2. Carlana, Michela & La Ferrara, Eliana, 2021. "Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic," CEPR Discussion Papers 15761, C.E.P.R. Discussion Papers.
    3. Guido Neidhöfer & Nora Lustig & Mariano Tommasi, 2021. "Intergenerational transmission of lockdown consequences: prognosis of the longer-run persistence of COVID-19 in Latin America," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 19(3), pages 571-598, September.
    4. Werner, Katharina & Woessmann, Ludger, 2021. "The Legacy of COVID-19 in Education," IZA Discussion Papers 14796, Institute of Labor Economics (IZA).
    5. Shinsuke Asakawa & Fumio Ohtake, 2021. "Impact of Temporary School Closure Due to COVID-19 on the Academic Achievement of Elementary School Students," Discussion Papers in Economics and Business 21-14, Osaka University, Graduate School of Economics.
    6. Jo Blanden & Matthias Doepke & Jan Stuhler, 2022. "Education inequality," CEP Discussion Papers dp1849, Centre for Economic Performance, LSE.
    7. Nora Lustig & Valentina Martinez Pabon & Guido Neidhöfer & Mariano Tommasi, 2020. "Short and Long-Run Distributional Impacts of COVID-19 in Latin America," Working Papers 2013, Tulane University, Department of Economics.
    8. Kuzmanic, Danilo & Valenzuela, Juan Pablo & Claro, Susana & Canales, Andrea & Cerda, Daniela & Undurraga, Eduardo A., 2023. "Socioeconomic disparities in the reopening of schools during the pandemic in Chile," International Journal of Educational Development, Elsevier, vol. 100(C).
    9. Liu, Jing & Lee, Monica & Gershenson, Seth, 2021. "The short- and long-run impacts of secondary school absences," Journal of Public Economics, Elsevier, vol. 199(C).
    10. Monroy-Gómez-Franco, Luis & Vélez-Grajales, Roberto & López-Calva, Luis F., 2022. "The potential effects of the COVID-19 pandemic on learnings," International Journal of Educational Development, Elsevier, vol. 91(C).
    11. Murat, Marina & Bonacini, Luca, 2020. "Coronavirus pandemic, remote learning and education inequalities," GLO Discussion Paper Series 679, Global Labor Organization (GLO).
    12. Francesca Caselli & Mr. Philippe Wingender, 2018. "Bunching at 3 Percent: The Maastricht Fiscal Criterion and Government Deficits," IMF Working Papers 2018/182, International Monetary Fund.
    13. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    14. Clark, Andrew E. & Nong, Huifu & Zhu, Hongjia & Zhu, Rong, 2021. "Compensating for academic loss: Online learning and student performance during the COVID-19 pandemic," China Economic Review, Elsevier, vol. 68(C).
    15. Kamila Cygan-Rehm, 2022. "Lifetime Consequences of Lost Instructional Time in the Classroom: Evidence from Shortened School Years," CESifo Working Paper Series 9892, CESifo.
    16. Schüller, Simone & Steinberg, Hannah S., 2022. "Parents under stress: Evaluating emergency childcare policies during the first COVID-19 lockdown in Germany," Labour Economics, Elsevier, vol. 78(C).
    17. Prerna Banati & Nicola Jones & Sally Youssef, 2020. "Intersecting Vulnerabilities: The Impacts of COVID-19 on the Psycho-emotional Lives of Young People in Low- and Middle-Income Countries," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 32(5), pages 1613-1638, December.
    18. Stefanie Stantcheva, 2022. "Inequalities in the times of a pandemic," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 37(109), pages 5-41.
    19. Ardington, Cally & Wills, Gabrielle & Kotze, Janeli, 2021. "COVID-19 learning losses: Early grade reading in South Africa," International Journal of Educational Development, Elsevier, vol. 86(C).
    20. Niranjala Hulugalla & Kyohei Yamada & Makoto Kakinaka, 2021. "Personal social capital and voluntary participation in the Village Development Programme in rural Sri Lanka," Journal of International Development, John Wiley & Sons, Ltd., vol. 33(5), pages 803-825, July.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:ve4z7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.