IDEAS home Printed from https://ideas.repec.org/a/eee/ecolet/v202y2021ics0165176521000896.html
   My bibliography  Save this article

Learning during the COVID-19 pandemic: It is not who you teach, but how you teach

Author

Listed:
  • Orlov, George
  • McKee, Douglas
  • Berry, James
  • Boyle, Austin
  • DiCiccio, Thomas
  • Ransom, Tyler
  • Rees-Jones, Alex
  • Stoye, Jörg

Abstract

We use unique data from seven intermediate economics courses taught at four R1 institutions to examine the effects of the COVID-19 pandemic on student learning. Because the same assessments of course knowledge mastery were administered across semesters, we can cleanly infer the impact of the unanticipated switch to remote teaching in Spring 2020. During the pandemic, total assessment scores declined by 0.2 standard deviations on average. However, we find substantial heterogeneity in learning outcomes across courses. Course instructors were surveyed about their pedagogy practices and our analysis suggests that prior online teaching experience and teaching methods that encouraged active engagement, such as the use of small group activities and projects, played an important role in mitigating this negative effect. In contrast, we find that student characteristics, including gender, race, and first-generation status, had no significant association with the decline in student performance in the pandemic semester.

Suggested Citation

  • Orlov, George & McKee, Douglas & Berry, James & Boyle, Austin & DiCiccio, Thomas & Ransom, Tyler & Rees-Jones, Alex & Stoye, Jörg, 2021. "Learning during the COVID-19 pandemic: It is not who you teach, but how you teach," Economics Letters, Elsevier, vol. 202(C).
  • Handle: RePEc:eee:ecolet:v:202:y:2021:i:c:s0165176521000896
    DOI: 10.1016/j.econlet.2021.109812
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165176521000896
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econlet.2021.109812?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    2. Thomas G. Greene & C. Nathan Marti & Kay McClenney, 2008. "The Effort—Outcome Gap: Differences for African American and Hispanic Community College Students in Student Engagement and Academic Achievement," The Journal of Higher Education, Taylor & Francis Journals, vol. 79(5), pages 513-539, September.
    3. Di Xu & Shanna S. Jaggars, 2014. "Performance Gaps between Online and Face-to-Face Courses: Differences across Types of Students and Academic Subject Areas," The Journal of Higher Education, Taylor & Francis Journals, vol. 85(5), pages 633-659, September.
    4. Rita A. Balaban & Donna B. Gilleskie & Uyen Tran, 2016. "A quantitative evaluation of the flipped classroom in a large lecture principles of economics course," The Journal of Economic Education, Taylor & Francis Journals, vol. 47(4), pages 269-287, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hardt, David & Nagler, Markus & Rincke, Johannes, 2023. "Tutoring in (online) higher education: Experimental evidence," Economics of Education Review, Elsevier, vol. 92(C).
    2. Hugues Champeaux & Lucia Mangiavacchi & Francesca Marchetta & Luca Piccoli, 2022. "Child development and distance learning in the age of COVID-19," Review of Economics of the Household, Springer, vol. 20(3), pages 659-685, September.
    3. Sarah Cattan & Christine Farquharson & Sonya Krutikova & Angus Phimister & Adam Salisbury & Almudena Sevilla, 2021. "Inequalities in responses to school closures over the course of the first COVID-19 lockdown," IFS Working Papers W21/4, Institute for Fiscal Studies.
    4. Haelermans, Carla & Korthals, Roxanne & Jacobs, Madelon & de Leeuw, Suzanne & Vermeulen, Stan & van Vugt, Lynn & Aarts, Bas & Breuer, Tijana & van der Velden, Rolf & van Wetten, Sanne & de Wolf, Inge, 2021. "Sharp increase in inequality in education in times of the COVID-19-pandemic," ROA Research Memorandum 010, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    5. Badruddoza, Syed & Amin, Modhurima Dey, 2023. "Impacts of Teaching Modality on U.S. COVID-19 Spread in Fall 2020 Semester," Applied Economics Teaching Resources (AETR), Agricultural and Applied Economics Association, vol. 5(1), January.
    6. Monroy-Gómez-Franco, Luis & Vélez-Grajales, Roberto & López-Calva, Luis F., 2022. "The potential effects of the COVID-19 pandemic on learnings," International Journal of Educational Development, Elsevier, vol. 91(C).
    7. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    8. Szabó, Andrea & Fekete, Mariann & Böcskei, Balázs & Nagy, Ádám, 2023. "Real-time experiences of Hungarian youth in digital education as an example of the impact of pandemia. “I’ve never had better grades on average: I got straight all the time”," International Journal of Educational Development, Elsevier, vol. 99(C).
    9. Elena-Aurelia Botezat & Alexandru Constăngioară & Anca-Otilia Dodescu & Ioana-Crina Pop-Cohuţ, 2022. "How Stable Are Students’ Entrepreneurial Intentions in the COVID-19 Pandemic Context?," Sustainability, MDPI, vol. 14(9), pages 1-22, May.
    10. De Paola, Maria & Gioia, Francesca & Scoppa, Vincenzo, 2022. "Online Teaching, Procrastination and Students’ Achievement: Evidence from COVID-19 Induced Remote Learning," IZA Discussion Papers 15031, Institute of Labor Economics (IZA).
    11. Bratti, Massimiliano & Lippo, Enrico, 2022. "COVID-19 and the Gender Gap in University Student Performance," IZA Discussion Papers 15456, Institute of Labor Economics (IZA).
    12. Sanchayan Banerjee & Beatriz Jambrina-Canseco & Benjamin Brundu-Gonzalez & Claire Gordon & Jenni Carr, 2023. "Nudge or not, university teachers have mixed feelings about online teaching," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-10, December.
    13. List, John A. & Shah, Rohen, 2022. "The impact of team incentives on performance in graduate school: Evidence from two pilot RCTs," Economics Letters, Elsevier, vol. 221(C).
    14. Li, Haizheng & Ma, Mingyu & Liu, Qinyi, 2022. "How the COVID-19 pandemic affects job sentiments of rural teachers," China Economic Review, Elsevier, vol. 72(C).
    15. Picault, Julien, 2021. "Structure, Flexibility, and Consistency: A Dynamic Learning Approach for an Online Asynchronous Course," Applied Economics Teaching Resources (AETR), Agricultural and Applied Economics Association, vol. 3(4), October.
    16. Birdi, Alvin & Cook, Steve & Elliott, Caroline & Lait, Ashley & Mehari, Tesfa & Wood, Max, 2023. "A critical review of recent economics pedagogy literature, 2020–2021," International Review of Economics Education, Elsevier, vol. 43(C).
    17. Douglas McKee & Steven Zhu & George Orlov, 2023. "Econ-assessments.org: Automated Assessment of Economics Skills," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 49(1), pages 4-14, January.
    18. Kenneth G. Elzinga & Daniel Q. Harper, 2023. "In‐person versus online instruction: Evidence from principles of economics," Southern Economic Journal, John Wiley & Sons, vol. 90(1), pages 3-30, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Persson, Petra & Qiu, Xinyao & Rossin-Slater, Maya, 2021. "Family Spillover Effects of Marginal Diagnoses: The Case of ADHD," IZA Discussion Papers 14020, Institute of Labor Economics (IZA).
    2. Gustavo J. Bobonis & Paul J. Gertler & Marco Gonzalez-Navarro & Simeon Nichter, 2022. "Vulnerability and Clientelism," American Economic Review, American Economic Association, vol. 112(11), pages 3627-3659, November.
    3. Jongmoo Jay Choi & Hoje Jo & Jimi Kim & Moo Sung Kim, 2018. "Business Groups and Corporate Social Responsibility," Journal of Business Ethics, Springer, vol. 153(4), pages 931-954, December.
    4. Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
    5. Sandy Fréret & Denis Maguain, 2017. "The effects of agglomeration on tax competition: evidence from a two-regime spatial panel model on French data," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 24(6), pages 1100-1140, December.
    6. Valentine Fays & Benoît Mahy & François Rycx, 2023. "Wage differences according to workers' origin: The role of working more upstream in GVCs," LABOUR, CEIS, vol. 37(2), pages 319-342, June.
    7. Cantoni, Enrico & Gazzè, Ludovica & Schafer, Jerome, 2021. "Turnout in concurrent elections: Evidence from two quasi-experiments in Italy," European Journal of Political Economy, Elsevier, vol. 70(C).
    8. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    9. Thompson, Paul N., 2019. "Are school officials held accountable for fiscal stress? Evidence from school district financial intervention systems," Economics of Education Review, Elsevier, vol. 72(C), pages 44-54.
    10. repec:hal:wpspec:info:hdl:2441/6unm655ita9ojbuuc83c9h0is8 is not listed on IDEAS
    11. Corno, Lucia & Voena, Alessandra, 2023. "Child marriage as informal insurance: Empirical evidence and policy simulations," Journal of Development Economics, Elsevier, vol. 162(C).
    12. Wissmann, Daniel, 2020. "Finally a Smoking Gun," Discussion Papers in Economics 73026, University of Munich, Department of Economics.
    13. Ilhom Abdulloev & Ira N Gang & Myeong-Su Yun, 2014. "Migration, Education and the Gender Gap in Labour Force Participation," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 26(4), pages 509-526, September.
    14. Angrisani Marco & Guarino Antonio & Huck Steffen & Larson Nathan C, 2011. "No-Trade in the Laboratory," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 11(1), pages 1-58, April.
    15. Hamid Boustanifar & Everett Grant & Ariell Reshef, 2018. "Wages and Human Capital in Finance: International Evidence, 1970–2011 [Financial reform: what shakes it? What shapes it?]," Review of Finance, European Finance Association, vol. 22(2), pages 699-745.
    16. Grönqvist, Hans & Niknami, Susan, 2014. "Alcohol availability and crime: Lessons from liberalized weekend sales restrictions," Journal of Urban Economics, Elsevier, vol. 81(C), pages 77-84.
    17. Hollingsworth, Bruce & Ohinata, Asako & Picchio, Matteo & Walker, Ian, 2017. "Labour supply and informal care supply: The impacts of financial support for long-term elderly care," GLO Discussion Paper Series 118, Global Labor Organization (GLO).
    18. Renate Strobl & Conny Wunsch, 2021. "Risky choices and solidarity: disentangling different behavioural channels," Experimental Economics, Springer;Economic Science Association, vol. 24(4), pages 1185-1214, December.
    19. Marcel Fafchamps & Julien Labonne, 2017. "Do Politicians’ Relatives Get Better Jobs? Evidence from Municipal Elections," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 33(2), pages 268-300.
    20. Silverio-Murillo, Adan & Hoehn-Velasco, Lauren & Rodriguez Tirado, Abel & Balmori de la Miyar, Jose Roberto, 2021. "COVID-19 blues: Lockdowns and mental health-related google searches in Latin America," Social Science & Medicine, Elsevier, vol. 281(C).
    21. Kjetil Bjorvatn & Alexander W. Cappelen & Linda Helgesson Sekei & Erik Ø. Sørensen & Bertil Tungodden, 2020. "Teaching Through Television: Experimental Evidence on Entrepreneurship Education in Tanzania," Management Science, INFORMS, vol. 66(6), pages 2308-2325, June.

    More about this item

    Keywords

    COVID-19; Pedagogy; Student learning;
    All these keywords.

    JEL classification:

    • A2 - General Economics and Teaching - - Economic Education and Teaching of Economics
    • I2 - Health, Education, and Welfare - - Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:202:y:2021:i:c:s0165176521000896. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.