Author
Listed:
- Akhtar, Shumi
- Guo, Liwen
- Hua, Yue
- Nguyen, Hang Anh
Abstract
Jack et al. (2023) estimated the impact of district-level schooling modes (in-person, hybrid, or virtual learning) during the 2020-2021 academic year on standardized test pass rates for grades 3-8 across 11 U.S. states. Between 2019 and 2021, average pass rates declined by 12.8 percentage points in mathematics and 6.8 percentage points in English Language Arts (ELA). By leveraging within-state and commuting zone variations, the study found that districts with full in-person learning experienced significantly smaller declines-13.4 percentage points in math and 8.3 percentage points in ELA. Furthermore, the benefits of in-person learning were particularly pronounced in districts with higher proportions of Black students. The study highlights the potential long-term effects of pandemic-related schooling disruptions and highlights the need for targeted policy interventions to address learning losses. In this report, we computationally reproduced all the main results from Jack et al. (2023) using the replication package provided, including code and data. Our replication confirmed that the estimates, directions, and significance levels were identical to those reported in the published study. Additionally, we conducted two robustness tests: (1) comparing balanced versus unbalanced panel datasets and (2) examining the influence of the distribution of the independent variable (e.g., the share of in-person versus online or hybrid learning) on student performance. Our analysis shows some evidence of outliers and state-level heterogeneity in the distribution of in-person learning, which led to some deviations from the original results in the coefficient magnitudes, but the direction and significance remain similar to original results.
Suggested Citation
Akhtar, Shumi & Guo, Liwen & Hua, Yue & Nguyen, Hang Anh, 2025.
"A comment on "Pandemic Schooling Mode and Student Test Scores: Evidence from US School Districts","
I4R Discussion Paper Series
247, The Institute for Replication (I4R).
Handle:
RePEc:zbw:i4rdps:247
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:247. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.