IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/29497.html
   My bibliography  Save this paper

Pandemic Schooling Mode and Student Test Scores: Evidence from US States

Author

Listed:
  • Clare Halloran
  • Rebecca Jack
  • James C. Okun
  • Emily Oster

Abstract

We estimate the impact of district-level schooling mode (in-person versus hybrid or distance learning) on test scores. We combine Spring 2021 state standardized test score data with comprehensive data on schooling in the 2020-21 school year across 12 states. We find that pass rates declined compared to prior years and that these declines were larger in districts with less in-person instruction. Passing rates in math declined by 14.2 percentage points on average; we estimate this decline was 10.1 percentage points smaller for districts fully in-person. Changes in English language arts scores were smaller, but were significantly larger in districts with larger populations of students who are Black, Hispanic or eligible for free and reduced price lunch.

Suggested Citation

  • Clare Halloran & Rebecca Jack & James C. Okun & Emily Oster, 2021. "Pandemic Schooling Mode and Student Test Scores: Evidence from US States," NBER Working Papers 29497, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:29497
    Note: CH ED EH
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w29497.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dalit Contini & Maria Laura Di Tommaso & Caterina Muratori & Daniela Piazzalunga & Lucia Schiavon, 2021. "The Covid-19 pandemic and school closure: learning loss in mathematics in primary education," CHILD Working Papers Series 97 JEL Classification: I2, Centre for Household, Income, Labour and Demographic Economics (CHILD) - CCA.
    2. Nicola Fuchs-Schündeln & Dirk Krueger & André Kurmann & Etienne Lalé & Alexander Ludwig & Irina Popova, 2023. "The Fiscal and Welfare Effects of Policy Responses to the Covid-19 School Closures," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(1), pages 35-98, March.
    3. -, 2020. "Education in the time of COVID-19," Coediciones, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 45905 edited by Eclac, February.
    4. repec:ecr:col016:45905 is not listed on IDEAS
    5. Musaddiq, Tareena & Stange, Kevin & Bacher-Hicks, Andrew & Goodman, Joshua, 2022. "The Pandemic’s effect on demand for public schools, homeschooling, and private schools," Journal of Public Economics, Elsevier, vol. 212(C).
    6. Thomas Dee & Elizabeth Huffaker & Cheryl Phillips & Eric Sagara, 2021. "The Revealed Preferences for School Reopening: Evidence from Public-School Disenrollment," NBER Working Papers 29156, National Bureau of Economic Research, Inc.
    7. Ardington, Cally & Wills, Gabrielle & Kotze, Janeli, 2021. "COVID-19 learning losses: Early grade reading in South Africa," International Journal of Educational Development, Elsevier, vol. 86(C).
    8. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    9. Bacher-Hicks, Andrew & Goodman, Joshua & Mulhern, Christine, 2021. "Inequality in household adaptation to schooling shocks: Covid-induced online learning engagement in real time," Journal of Public Economics, Elsevier, vol. 193(C).
    10. Dan Goldhaber & Scott A. Imberman & Katharine O. Strunk & Bryant G. Hopkins & Nate Brown & Erica Harbatkin & Tara Kilbride, 2022. "To What Extent Does In‐Person Schooling Contribute To The Spread Of Covid‐19? Evidence From Michigan And Washington," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(1), pages 318-349, January.
    11. João Pedro & Amer Hasan & Diana Goldemberg & Koen Geven & Syedah Aroob Iqbal, 2021. "Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates [Tackling Inequity in Education during and after COVID-19]," The World Bank Research Observer, World Bank, vol. 36(1), pages 1-40.
    12. Angrist, Noam & Bergman, Peter & Matsheng, Moitshepi, 2020. "School's Out: Experimental Evidence on Limiting Learning Loss Using," IZA Discussion Papers 14009, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlana, Michela & La Ferrara, Eliana, 2021. "Apart but Connected: Online Tutoring and Student Outcomes during the COVID-19 Pandemic," CEPR Discussion Papers 15761, C.E.P.R. Discussion Papers.
    2. Werner, Katharina & Woessmann, Ludger, 2021. "The Legacy of COVID-19 in Education," IZA Discussion Papers 14796, Institute of Labor Economics (IZA).
    3. Valenzuela, Juan Pablo & Kuzmanic, Danilo & Cortés, Fernanda, 2024. "Socioeconomic inequalities in opportunities and participation in in-person learning during the Covid-19 pandemic," International Journal of Educational Development, Elsevier, vol. 105(C).
    4. Dang, Hai-Anh H. & Oseni, Gbemisola & Abanokova, Kseniya, 2025. "Educational inequalities during COVID-19: Results from longitudinal surveys in Sub-Saharan Africa," International Journal of Educational Development, Elsevier, vol. 112(C).
    5. Riley K. Acton & Wenjia Cao & Emily E. Cook & Scott A. Imberman & Michael F. Lovenheim, 2022. "The Effect of Vaccine Mandates on Disease Spread: Evidence from College COVID-19 Mandates," NBER Working Papers 30303, National Bureau of Economic Research, Inc.
    6. Josep Amer-Mestre & Alaitz Ayarza-Astigarraga & Marta C. Lopes, 2024. "E-learning engagement gap during school closures: differences by academic performance," Applied Economics, Taylor & Francis Journals, vol. 56(3), pages 337-359, January.
    7. Bacher-Hicks, Andrew & Musaddiq, Tareena & Goodman, Joshua & Stange, Kevin, 2024. "The stickiness of pandemic-driven disenrollment from public schools," Economics of Education Review, Elsevier, vol. 100(C).
    8. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2024. "Telementoring and Homeschooling During School Closures: a Randomised Experiment in Rural Bangladesh," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2418-2438.
    9. Agostinelli, Francesco & Doepke, Matthias & Sorrenti, Giuseppe & Zilibotti, Fabrizio, 2022. "When the great equalizer shuts down: Schools, peers, and parents in pandemic times," Journal of Public Economics, Elsevier, vol. 206(C).
    10. Jo Blanden & Matthias Doepke & Jan Stuhler, 2022. "Education inequality," CEP Discussion Papers dp1849, Centre for Economic Performance, LSE.
    11. Chen, Yuanyuan & Feng, Shuaizhang & Zhang, Jing & Zhuo, Yi, 2024. "Gender differences in adolescents’ noncognitive skill development during the COVID-19 pandemic," Journal of Economic Behavior & Organization, Elsevier, vol. 225(C), pages 411-434.
    12. Mustafa Uğraş & Erdal Zengin & Stamatis Papadakis & Michail Kalogiannakis, 2023. "Early Childhood Learning Losses during COVID-19: Systematic Review," Sustainability, MDPI, vol. 15(7), pages 1-29, April.
    13. Krisztián Széll & Borbála Károlyi & Anikó Fehérvári, 2022. "Learning Patterns at the Time of COVID-19-Induced School Closures," Social Sciences, MDPI, vol. 11(9), pages 1-17, August.
    14. Alan, Sule & Turkum, Betul, 2024. "Abstract reasoning, theory of mind and character development in the school," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 307-326.
    15. Liao, Haoye & Ma, Sen & Xue, Hao, 2022. "Does school shutdown increase inequality in academic performance? Evidence from COVID-19 pandemic in China," China Economic Review, Elsevier, vol. 75(C).
    16. Ainoa Aparicio Fenoll, 2025. "The different effects of Covid on children with parents in teleworkable and non-teleworkable occupations," Journal of Population Economics, Springer;European Society for Population Economics, vol. 38(1), pages 1-28, March.
    17. Svaleryd, Helena & Vlachos, Jonas, 2022. "COVID-19 and School Closures," GLO Discussion Paper Series 1008, Global Labor Organization (GLO).
    18. Harbatkin, Erica & Strunk, Katharine O. & McIlwain, Aliyah, 2023. "School turnaround in a pandemic: An examination of the outsized implications of COVID-19 on low-performing turnaround schools, districts, and their communities," Economics of Education Review, Elsevier, vol. 97(C).
    19. Kuzmanic, Danilo & Valenzuela, Juan Pablo & Claro, Susana & Canales, Andrea & Cerda, Daniela & Undurraga, Eduardo A., 2023. "Socioeconomic disparities in the reopening of schools during the pandemic in Chile," International Journal of Educational Development, Elsevier, vol. 100(C).
    20. M. Niaz Asadullah & Anindita Bhattacharjee, 2022. "Digital Divide or Digital Provide? Technology, Time Use, and Learning Loss during COVID-19," Journal of Development Studies, Taylor & Francis Journals, vol. 58(10), pages 1934-1957, October.

    More about this item

    JEL classification:

    • I14 - Health, Education, and Welfare - - Health - - - Health and Inequality
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:29497. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.