IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/9yqxw.html
   My bibliography  Save this paper

Comparing bad apples to orange soda: Flaws and Errors in an Estimation of Years of Life Lost Associated With School Closures and COVID-19 deaths by Christakis, Van Cleve, and Zimmerman

Author

Listed:
  • Meyerowitz-Katz, Gideon
  • Kashnitsky, Ilya

    (Netherlands Interdisciplinary Demographic Institute)

Abstract

We are writing this openly-published letter to express deep concerns regarding the paper recently published in JAMA Network Open: Estimation of US Children’s Educational Attainment and Years of Life Lost Associated With Primary School Closures During the Coronavirus Disease 2019 Pandemic https://doi.org/10.1001/jamanetworkopen.2020.28786 The paper by Christakis, Van Cleve, and Zimmerman (2020, abbrev. CVZ) is built upon multiple critically flawed assumptions, obvious misuse of the standard analytical tools, and clear mistakes in study design. Additionally, the analysis presented contains crucial mathematical and statistical errors that completely revert the main results, sufficient that if the estimates had been calculated according to the declared methodology, the results would completely contradict the stated conclusions and policy recommendations. These are not idle criticisms. This study has received enormous public attention, and its results immediately appeared in discussions of public health policies around schools worldwide. The central question is resolving an evidence base for the inevitable trade-off between (a) the very real harms of missed education provoked by policies that decrease viral spread vs. (b) the resumption of education as a social good which increases viral spread. This is an incredibly important public health question, and it demands careful cost-benefit analysis. To that end, this paper adds no usable evidence whatsoever.

Suggested Citation

  • Meyerowitz-Katz, Gideon & Kashnitsky, Ilya, 2020. "Comparing bad apples to orange soda: Flaws and Errors in an Estimation of Years of Life Lost Associated With School Closures and COVID-19 deaths by Christakis, Van Cleve, and Zimmerman," OSF Preprints 9yqxw, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:9yqxw
    DOI: 10.31219/osf.io/9yqxw
    as

    Download full text from publisher

    File URL: https://osf.io/download/5fcaadf1aa60b80258895aff/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/9yqxw?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Jaume & Alexander Willén, 2019. "The Long-Run Effects of Teacher Strikes: Evidence from Argentina," Journal of Labor Economics, University of Chicago Press, vol. 37(4), pages 1097-1139.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicola Fuchs-Schündeln & Dirk Krueger & André Kurmann & Etienne Lalé & Alexander Ludwig & Irina Popova, 2023. "The Fiscal and Welfare Effects of Policy Responses to the Covid-19 School Closures," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(1), pages 35-98, March.
    2. Winfree, Paul, 2023. "The long-run effects of temporarily closing schools: Evidence from Virginia, 1870s-1910s," QUCEH Working Paper Series 23-02, Queen's University Belfast, Queen's University Centre for Economic History.
    3. Ludger Wößmann, 2020. "Follow-up Costs of Not Learning: What We Can Learn from Research on Coronavirus-Related School Closures," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 73(06), pages 38-44, June.
    4. Philipp Ager & Katherine Eriksson & Ezra Karger & Peter Nencka & Melissa A. Thomasson, 2024. "School Closures during the 1918 Flu Pandemic," The Review of Economics and Statistics, MIT Press, vol. 106(1), pages 266-276, January.
    5. Martin Nistal & María Edo, 2022. "More time less time? The effect of lengthening the school day on learning trajectories," Asociación Argentina de Economía Política: Working Papers 4578, Asociación Argentina de Economía Política.
    6. Monroy-Gómez-Franco, Luis & Vélez-Grajales, Roberto & López-Calva, Luis F., 2022. "The potential effects of the COVID-19 pandemic on learnings," International Journal of Educational Development, Elsevier, vol. 91(C).
    7. Nicola Fuchs-Schünde & Dirk Krueger & Alexander Ludwig & Irina Popova, 2022. "The Long-Term Distributional and Welfare Effects of Covid-19 School Closures," The Economic Journal, Royal Economic Society, vol. 132(645), pages 1647-1683.
    8. Abadía Alvarado, Luz Karime & Gómez Soler, Silvia C. & Cifuentes González, Juanita, 2021. "The effect of teacher strikes on academic achievement: Evidence from Colombia," International Journal of Educational Development, Elsevier, vol. 82(C).
    9. Guido Neidhöfer & Nora Lustig & Mariano Tommasi, 2021. "Intergenerational transmission of lockdown consequences: prognosis of the longer-run persistence of COVID-19 in Latin America," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 19(3), pages 571-598, September.
    10. Werner, Katharina & Woessmann, Ludger, 2021. "The Legacy of COVID-19 in Education," IZA Discussion Papers 14796, Institute of Labor Economics (IZA).
    11. Mangiavacchi, Lucia & Piccoli, Luca & Pieroni, Luca, 2021. "Fathers matter: Intrahousehold responsibilities and children's wellbeing during the COVID-19 lockdown in Italy," Economics & Human Biology, Elsevier, vol. 42(C).
    12. Borazon, Elaine Quintana & Chuang, Hsueh-Hua, 2023. "Resilience in educational system: A systematic review and directions for future research," International Journal of Educational Development, Elsevier, vol. 99(C).
    13. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    14. Ludger Wößmann, 2021. "Bildungsverluste durch Corona: Wie lassen sie sich aufholen?," Wirtschaftsdienst, Springer;ZBW - Leibniz Information Centre for Economics, vol. 101(3), pages 150-151, March.
    15. Monroy-Gómez-Franco, Luis Angel, 2021. "Modelling the learning impacts of educational disruptions in the short and long run," SocArXiv z6x5s, Center for Open Science.
    16. Yasmine Bekkouche & Kenneth Houngbedji & Oswald Koussihouede, 2022. "Rainy days and learning outcomes: Evidence from Sub-Saharan Africa," Working Papers DT/2022/07, DIAL (Développement, Institutions et Mondialisation).
    17. Jaume, David & Willén, Alexander, 2021. "The effect of teacher strikes on parents," Journal of Development Economics, Elsevier, vol. 152(C).
    18. Nora Lustig & Valentina Martinez Pabon & Guido Neidhöfer & Mariano Tommasi, 2020. "Short and Long-Run Distributional Impacts of COVID-19 in Latin America," Working Papers 2013, Tulane University, Department of Economics.
    19. Kamila Cygan-Rehm, 2022. "Lifetime Consequences of Lost Instructional Time in the Classroom: Evidence from Shortened School Years," CESifo Working Paper Series 9892, CESifo.
    20. Harry Anthony Patrinos, 2022. "Learning loss and learning recovery," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 49(2), pages 183-188, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:9yqxw. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.