IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/9yqxw.html
   My bibliography  Save this paper

Comparing bad apples to orange soda: Flaws and Errors in an Estimation of Years of Life Lost Associated With School Closures and COVID-19 deaths by Christakis, Van Cleve, and Zimmerman

Author

Listed:
  • Meyerowitz-Katz, Gideon
  • Kashnitsky, Ilya

    (Netherlands Interdisciplinary Demographic Institute)

Abstract

We are writing this openly-published letter to express deep concerns regarding the paper recently published in JAMA Network Open: Estimation of US Children’s Educational Attainment and Years of Life Lost Associated With Primary School Closures During the Coronavirus Disease 2019 Pandemic https://doi.org/10.1001/jamanetworkopen.2020.28786 The paper by Christakis, Van Cleve, and Zimmerman (2020, abbrev. CVZ) is built upon multiple critically flawed assumptions, obvious misuse of the standard analytical tools, and clear mistakes in study design. Additionally, the analysis presented contains crucial mathematical and statistical errors that completely revert the main results, sufficient that if the estimates had been calculated according to the declared methodology, the results would completely contradict the stated conclusions and policy recommendations. These are not idle criticisms. This study has received enormous public attention, and its results immediately appeared in discussions of public health policies around schools worldwide. The central question is resolving an evidence base for the inevitable trade-off between (a) the very real harms of missed education provoked by policies that decrease viral spread vs. (b) the resumption of education as a social good which increases viral spread. This is an incredibly important public health question, and it demands careful cost-benefit analysis. To that end, this paper adds no usable evidence whatsoever.

Suggested Citation

  • Meyerowitz-Katz, Gideon & Kashnitsky, Ilya, 2020. "Comparing bad apples to orange soda: Flaws and Errors in an Estimation of Years of Life Lost Associated With School Closures and COVID-19 deaths by Christakis, Van Cleve, and Zimmerman," OSF Preprints 9yqxw, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:9yqxw
    DOI: 10.31219/osf.io/9yqxw
    as

    Download full text from publisher

    File URL: https://osf.io/download/5fcaadf1aa60b80258895aff/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/9yqxw?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Jaume & Alexander Willén, 2019. "The Long-Run Effects of Teacher Strikes: Evidence from Argentina," Journal of Labor Economics, University of Chicago Press, vol. 37(4), pages 1097-1139.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicola Fuchs-Schündeln & Dirk Krueger & André Kurmann & Etienne Lalé & Alexander Ludwig & Irina Popova, 2023. "The Fiscal and Welfare Effects of Policy Responses to the Covid-19 School Closures," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(1), pages 35-98, March.
    2. Nicola Fuchs-Schünde & Dirk Krueger & Alexander Ludwig & Irina Popova, 2022. "The Long-Term Distributional and Welfare Effects of Covid-19 School Closures," The Economic Journal, Royal Economic Society, vol. 132(645), pages 1647-1683.
    3. Winfree, Paul, 2023. "The long-run effects of temporarily closing schools: Evidence from Virginia, 1870s-1910s," QUCEH Working Paper Series 23-02, Queen's University Belfast, Queen's University Centre for Economic History.
    4. Giorgio Di Pietro & Federico Biagi & Patricia Costa & Zbigniew Karpinski & Jacopo Mazza, 2020. "The likely impact of COVID-19 on education: Reflections based on the existing literature and recent international datasets," JRC Research Reports JRC121071, Joint Research Centre.
    5. Nora Lustig & Valentina Martinez Pabon & Guido Neidhöfer & Mariano Tommasi, 2020. "Short and Long-Run Distributional Impacts of COVID-19 in Latin America," Working Papers 2013, Tulane University, Department of Economics.
    6. Philipp Ager & Katherine Eriksson & Ezra Karger & Peter Nencka & Melissa A. Thomasson, 2024. "School Closures during the 1918 Flu Pandemic," The Review of Economics and Statistics, MIT Press, vol. 106(1), pages 266-276, January.
    7. Piero Montebruno, 2020. "Disrupted schooling: impacts on achievement from the Chilean school occupations," CEP Discussion Papers dp1696, Centre for Economic Performance, LSE.
    8. Ludger Wößmann, 2020. "Follow-up Costs of Not Learning: What We Can Learn from Research on Coronavirus-Related School Closures," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 73(06), pages 38-44, June.
    9. Guido Neidhöfer & Nora Lustig & Mariano Tommasi, 2021. "Intergenerational transmission of lockdown consequences: prognosis of the longer-run persistence of COVID-19 in Latin America," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 19(3), pages 571-598, September.
    10. João Pedro & Amer Hasan & Diana Goldemberg & Koen Geven & Syedah Aroob Iqbal, 2021. "Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates [Tackling Inequity in Education during and after COVID-19]," The World Bank Research Observer, World Bank, vol. 36(1), pages 1-40.
    11. Martin Nistal & María Edo, 2022. "More time less time? The effect of lengthening the school day on learning trajectories," Asociación Argentina de Economía Política: Working Papers 4578, Asociación Argentina de Economía Política.
    12. Monroy-Gómez-Franco, Luis & Vélez-Grajales, Roberto & López-Calva, Luis F., 2022. "The potential effects of the COVID-19 pandemic on learnings," International Journal of Educational Development, Elsevier, vol. 91(C).
    13. Schüller, Simone & Steinberg, Hannah S., 2022. "Parents under stress: Evaluating emergency childcare policies during the first COVID-19 lockdown in Germany," Labour Economics, Elsevier, vol. 78(C).
    14. Katharina Werner & Ludger Woessmann, 2021. "The Legacy of Covid-19 in Education," CESifo Working Paper Series 9358, CESifo.
    15. Yasmine Bekkouche & Kenneth Houngbedji & Oswald Koussihouede, 2022. "Rainy days and learning outcomes: Evidence from Sub-Saharan Africa," Working Papers DT/2022/07, DIAL (Développement, Institutions et Mondialisation).
    16. Boruchowicz, Cynthia & Parker, Susan W. & Robbins, Lindsay, 2022. "Time use of youth during a pandemic: Evidence from Mexico," World Development, Elsevier, vol. 149(C).
    17. Abadía Alvarado, Luz Karime & Gómez Soler, Silvia C. & Cifuentes González, Juanita, 2021. "The effect of teacher strikes on academic achievement: Evidence from Colombia," International Journal of Educational Development, Elsevier, vol. 82(C).
    18. Buffie, Edward F. & Adam, Christopher & Zanna, Luis-Felipe & Kpodar, Kangni, 2023. "Loss-of-learning and the post-Covid recovery in low-income countries," Journal of Macroeconomics, Elsevier, vol. 75(C).
    19. OIKAWA Masato & TANAKA Ryuichi & BESSHO Shun-ichiro & KAWAMURA Akira & NOGUCHI Haruko, 2022. "Do Class Closures Affect Students' Achievements? Heterogeneous effects of students' socioeconomic backgrounds," Discussion papers 22042, Research Institute of Economy, Trade and Industry (RIETI).
    20. Neidhöfer, Guido & Lustig, Nora & Larroulet, Patricio, 2022. "Nowcasting the impact of COVID-19 on education, intergenerational mobility and earnings inequality in Sub-Saharan Africa," ZEW Discussion Papers 22-022, ZEW - Leibniz Centre for European Economic Research.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:9yqxw. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.