IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/28022.html

Learning During the COVID-19 Pandemic: It Is Not Who You Teach, but How You Teach

Author

Listed:
  • George Orlov
  • Douglas McKee
  • James Berry
  • Austin Boyle
  • Thomas DiCiccio
  • Tyler Ransom
  • Alex Rees-Jones
  • Jörg Stoye

Abstract

We use standardized end-of-course knowledge assessments to examine student learning during the disruptions induced by the COVID-19 pandemic. Examining seven economics courses taught at four US R1 institutions, we find that students performed substantially worse, on average, in Spring 2020 when compared to Spring or Fall 2019. We find no evidence that the effect was driven by specific demographic groups. However, our results suggest that teaching methods that encourage active engagement, such as the use of small group activities and projects, played an important role in mitigating this negative effect. Our results point to methods for more effective online teaching as the pandemic continues.

Suggested Citation

  • George Orlov & Douglas McKee & James Berry & Austin Boyle & Thomas DiCiccio & Tyler Ransom & Alex Rees-Jones & Jörg Stoye, 2020. "Learning During the COVID-19 Pandemic: It Is Not Who You Teach, but How You Teach," NBER Working Papers 28022, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:28022
    Note: ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w28022.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thomas G. Greene & C. Nathan Marti & Kay McClenney, 2008. "The Effort—Outcome Gap: Differences for African American and Hispanic Community College Students in Student Engagement and Academic Achievement," The Journal of Higher Education, Taylor & Francis Journals, vol. 79(5), pages 513-539, September.
    2. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    3. Di Xu & Shanna S. Jaggars, 2014. "Performance Gaps between Online and Face-to-Face Courses: Differences across Types of Students and Academic Subject Areas," The Journal of Higher Education, Taylor & Francis Journals, vol. 85(5), pages 633-659, September.
    4. Rita A. Balaban & Donna B. Gilleskie & Uyen Tran, 2016. "A quantitative evaluation of the flipped classroom in a large lecture principles of economics course," The Journal of Economic Education, Taylor & Francis Journals, vol. 47(4), pages 269-287, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
    2. Sandy Fréret & Denis Maguain, 2017. "The effects of agglomeration on tax competition: evidence from a two-regime spatial panel model on French data," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 24(6), pages 1100-1140, December.
    3. Francesco Berlingieri & Matija Kovacic, 2025. "Health and relationship quality of sexual minorities in Europe," Journal of Population Economics, Springer;European Society for Population Economics, vol. 38(1), pages 1-39, March.
    4. Cantoni, Enrico & Gazzè, Ludovica & Schafer, Jerome, 2021. "Turnout in concurrent elections: Evidence from two quasi-experiments in Italy," European Journal of Political Economy, Elsevier, vol. 70(C).
    5. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    6. Corno, Lucia & Voena, Alessandra, 2023. "Child marriage as informal insurance: Empirical evidence and policy simulations," Journal of Development Economics, Elsevier, vol. 162(C).
    7. Wissmann, Daniel, 2020. "Finally a Smoking Gun," Discussion Papers in Economics 73026, University of Munich, Department of Economics.
    8. Ilhom Abdulloev & Ira N Gang & Myeong-Su Yun, 2014. "Migration, Education and the Gender Gap in Labour Force Participation," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 26(4), pages 509-526, September.
    9. Marcel Fafchamps & Julien Labonne, 2017. "Do Politicians’ Relatives Get Better Jobs? Evidence from Municipal Elections," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 33(2), pages 268-300.
    10. Silverio-Murillo, Adan & Hoehn-Velasco, Lauren & Rodriguez Tirado, Abel & Balmori de la Miyar, Jose Roberto, 2021. "COVID-19 blues: Lockdowns and mental health-related google searches in Latin America," Social Science & Medicine, Elsevier, vol. 281(C).
    11. Bobonis, Gustavo J. & Morrow, Peter M., 2014. "Labor coercion and the accumulation of human capital," Journal of Development Economics, Elsevier, vol. 108(C), pages 32-53.
    12. Hossain, Marup & Songsermsawas, Tisorn, 2025. "Adapting to Thrive: Training and Access to Finance to Reduce Climate Vulnerability Among Smallholder Farmers in Nepal," 2025 AAEA & WAEA Joint Annual Meeting, July 27-29, 2025, Denver, CO 361170, Agricultural and Applied Economics Association.
    13. Manasvi Sharma, 2024. "Ethnic fertility and exposure to armed conflict: the case of Sri Lanka," Review of Economics of the Household, Springer, vol. 22(4), pages 1317-1351, December.
    14. Galletta, Sergio & Jametti, Mario, 2015. "How to tame two Leviathans? Revisiting the effect of direct democracy on local public expenditure in a federation," European Journal of Political Economy, Elsevier, vol. 39(C), pages 82-93.
    15. Lupi, Giacomo Roberto, 2026. "Mining expansion and intimate partner violence in the Democratic Republic of Congo: a difference-in-differences analysis of disaggregated violence types," Resources Policy, Elsevier, vol. 117(C).
    16. Hagemann, Andreas, 2019. "Placebo inference on treatment effects when the number of clusters is small," Journal of Econometrics, Elsevier, vol. 213(1), pages 190-209.
    17. Görlitz, Katja & Penny, Merlin & Tamm, Marcus, 2022. "The long-term effect of age at school entry on cognitive competencies in adulthood," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 91-104.
    18. Nicolas Jacquemet & Adam Zylbersztejn, 2014. "What drives failure to maximize payoffs in the lab? A test of the inequality aversion hypothesis," Review of Economic Design, Springer;Society for Economic Design, vol. 18(4), pages 243-264, December.
    19. Fumarco, Luca & Hartmann, Sven A. & Principe, Francesco, 2026. "Influence of within-class age differences on adolescents’ eating behaviors," Economics of Education Review, Elsevier, vol. 110(C).
    20. David Roodman & James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2019. "Fast and wild: Bootstrap inference in Stata using boottest," Stata Journal, StataCorp LLC, vol. 19(1), pages 4-60, March.

    More about this item

    JEL classification:

    • A2 - General Economics and Teaching - - Economic Education and Teaching of Economics
    • A22 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Undergraduate
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:28022. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.