IDEAS home Printed from https://ideas.repec.org/p/war/wpaper/2026-21.html

Beyond Weeks Closed: Reassessing Pandemic Educational Disruption with TIMSS 2003–2023

Author

Listed:
  • Marzena Binkiewicz

    (University of Warsaw, Faculty of Economic Sciences)

  • Artur Pokropek

    (Polish Academy of Sciences, Institute of Philosophy and Sociology)

Abstract

Using six TIMSS cycles (2003–2023), UNESCO school-closure data, and World Bank GDP indicators, we estimate deviation-from-trend and continuous-treatment Difference-in-Differences models for mathematics achievement, liking learning mathematics, and confidence in mathematics. Mathematics achievement declined substantially relative to pre-pandemic trends, but closure duration did not consistently explain cross-national variation in achievement losses. Unexpectedly, longer closures were associated with slightly higher liking learning mathematics, particularly among Grade 4 students in higher-GDP countries, while confidence in mathematics remained largely unchanged. These findings suggest a decoupling of cognitive and affective outcomes during the pandemic and indicate that school-closure duration alone is an insufficient measure of educational harm. Comparative evaluations of pandemic education policies should therefore incorporate indicators of instructional continuity, remote-learning quality, and recovery efforts alongside formal school-closure measures.

Suggested Citation

  • Marzena Binkiewicz & Artur Pokropek, 2026. "Beyond Weeks Closed: Reassessing Pandemic Educational Disruption with TIMSS 2003–2023," Working Papers 2026-21, Faculty of Economic Sciences, University of Warsaw.
    • Handle: RePEc:war:wpaper:2026-21
    as

    Download full text from publisher

    File URL: https://www.wne.uw.edu.pl/download_file/f8cd9516-583e-4274-862c-ae484f0e78e8/4282
    File Function: First version, 2026
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dang, Hai-Anh H. & Oseni, Gbemisola & Abanokova, Kseniya, 2025. "Educational inequalities during COVID-19: Results from longitudinal surveys in Sub-Saharan Africa," International Journal of Educational Development, Elsevier, vol. 112(C).
    2. Albornoz, Facundo & Almeyda Torres, Gonzalo & Lombardi, María & Oubiña, Victoria & Lobaton, Pablo Zoido, 2026. "Remote tutoring in Latin America," Journal of Development Economics, Elsevier, vol. 179(C).
    3. Lafortune, Jeanne & Pugatch, Todd & Tessada, José & Ubfal, Diego, 2024. "Can gamified online training make high school students more entrepreneurial? Experimental evidence from Rwanda," Economics of Education Review, Elsevier, vol. 101(C).
    4. Gajderowicz, Tomasz & Jakubowski, Maciej & Kennedy, Alec & Christrup Kjeldsen, Christian & Patrinos, Harry Anthony & Strietholt, Rolf, 2024. "The Learning Crisis: Three Years After Covid-19," GLO Discussion Paper Series 1543, Global Labor Organization (GLO).
    5. Aulagnon, Raphaëlle & Cristia, Julian & Cueto, Santiago & Malamud, Ofer, 2025. "Streaks to success: The effects of highlighting streaks on student effort and learning," Economics of Education Review, Elsevier, vol. 109(C).
    6. Gallego, Francisco A. & Molina, Oswaldo & Neilson, Christopher A., 2025. "Lights, camera, school: Information provision though television during COVID-19 times," Journal of Development Economics, Elsevier, vol. 176(C).
    7. Beam, Emily A. & Mukherjee, Priya & Navarro-Sola, Laia, 2022. "Lowering Barriers to Remote Education: Experimental Impacts on Parental Responses and Learning," IZA Discussion Papers 15596, IZA Network @ LISER.
    8. Cristia, Julian P. & Cueto, Santiago & Malamud, Ofer & Aulagnon, Raphaëlle, 2024. "Streaking to Success: The Effects of Highlighting Streaks on Student Effort and Achievement," IDB Publications (Working Papers) 13498, Inter-American Development Bank.
    9. Hardt, David & Nagler, Markus & Rincke, Johannes, 2023. "Tutoring in (online) higher education: Experimental evidence," Economics of Education Review, Elsevier, vol. 92(C).
    10. Bawa, Issahaku & Bawa, Suleman, 2025. "Bridging EdTech gaps: Examining learning equity in low-income educational settings," International Journal of Educational Development, Elsevier, vol. 118(C).
    11. Kjetil Bjorvatn & Selim Gulesci & Arne Nasgowitz & Vincent Somville & Lore Vandewalle, 2025. "Promoting parental engagement in education: Experimental evidence from Uganda," Trinity Economics Papers tep1925, Trinity College Dublin, Department of Economics.
    12. Michael Gechter & Keisuke Hirano & Jean Lee & Mahreen Mahmud & Orville Mondal & Jonathan Morduch & Saravana Ravindran & Abu S. Shonchoy, 2024. "Selecting Experimental Sites for External Validity," Papers 2405.13241, arXiv.org.
    13. Rodriguez-Segura, Daniel & Schueler, Beth E., 2022. "Can learning be measured by phone? Evidence from Kenya," Economics of Education Review, Elsevier, vol. 90(C).
    14. Alicia Brandt & Hamid R. Oskorouchi & Alfonso Sousa-Poza, 2024. "The effect of SMS nudges on higher education performance," Empirical Economics, Springer, vol. 66(5), pages 2311-2334, May.
    15. Geven, Koen Martijn & Tahir, Ayesha & Fasih, Tazeen & Qureshi, Javaeria & Hasan, Amer & Fazili, Sheena & Malik, Rabea & Macdonald, Kevin Alan David, 2026. "Nudging at Scale : Evidence from a Government Text Messaging Campaign during School Shutdowns in Punjab, Pakistan," Policy Research Working Paper Series 11286, The World Bank.
    16. Crawfurd, Lee & Evans, David K. & Hares, Susannah & Sandefur, Justin, 2023. "Live tutoring calls did not improve learning during the COVID-19 pandemic in Sierra Leone," Journal of Development Economics, Elsevier, vol. 164(C).
    17. Abhijeet Singh & Mauricio Romero & Karthik Muralidharan, 2022. "Covid-19 Learning Loss and Recovery: Panel Data Evidence from India," CESifo Working Paper Series 10031, CESifo.
    18. John A. List, 2026. "The Economics of Scaling Early Childhood Programs: Lessons from the Chicago School," Journal of Political Economy, University of Chicago Press, vol. 134(1), pages 1-48.
    19. Shi Jiao & Hui Jin & Zheng You & Jie Wang, 2022. "Motivation and Its Effect on Language Achievement: Sustainable Development of Chinese Middle School Students’ Second Language Learning," Sustainability, MDPI, vol. 14(16), pages 1-18, August.
    20. Jakubowski,Maciej Jan & Gajderowicz,Tomasz Janusz & Patrinos,Harry Anthony, 2024. "COVID-19, School Closures, and Student Learning Outcomes : New Global Evidence from PISA," Policy Research Working Paper Series 10666, The World Bank.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:war:wpaper:2026-21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jacek Rapacz (email available below). General contact details of provider: https://edirc.repec.org/data/fesuwpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.