IDEAS home Printed from https://ideas.repec.org/a/gam/jforec/v4y2022i4p44-818d929399.html
   My bibliography  Save this article

Evaluating the Comparative Accuracy of COVID-19 Mortality Forecasts: An Analysis of the First-Wave Mortality Forecasts in the United States

Author

Listed:
  • Rahul Pathak

    (Marxe School of Public and International Affairs, Baruch College, City University of New York, One Bernard Baruch Way, Box D-901, New York, NY 10010, USA)

  • Daniel Williams

    (Marxe School of Public and International Affairs, Baruch College, City University of New York, One Bernard Baruch Way, Box D-901, New York, NY 10010, USA)

Abstract

The sudden onset of the COVID-19 pandemic posed significant challenges for forecasting professionals worldwide. This article examines the early forecasts of COVID-19 transmission, using the context of the United States, one of the early epicenters of the crisis. The article compares the relative accuracy of selected models from two forecasters who informed government policy in the first three months of the pandemic, the Institute of Health Metrics and Evaluation (IHME) and Columbia University. Furthermore, we examine whether the forecasts improved as more data became available in the subsequent months of the pandemic, using the forecasts from Los Alamos National Laboratory and the University of Texas, Austin. The analysis focuses on mortality estimates and compares forecasts using epidemiological and curve-fitting models during the first wave of the pandemic from March 2020 to October 2020. As health agencies worldwide struggled with uncertainty in models and projections of COVID-19 caseload and mortality, this article provides important insights that can be useful for crafting policy responses to the ongoing pandemic and future outbreaks.

Suggested Citation

  • Rahul Pathak & Daniel Williams, 2022. "Evaluating the Comparative Accuracy of COVID-19 Mortality Forecasts: An Analysis of the First-Wave Mortality Forecasts in the United States," Forecasting, MDPI, vol. 4(4), pages 1-21, September.
    • Handle: RePEc:gam:jforec:v:4:y:2022:i:4:p:44-818:d:929399
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-9394/4/4/44/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-9394/4/4/44/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nicholas G Reich & Craig J McGowan & Teresa K Yamana & Abhinav Tushar & Evan L Ray & Dave Osthus & Sasikiran Kandula & Logan C Brooks & Willow Crawford-Crudell & Graham Casey Gibson & Evan Moore & Reb, 2019. "Accuracy of real-time multi-model ensemble forecasts for seasonal influenza in the U.S," PLOS Computational Biology, Public Library of Science, vol. 15(11), pages 1-19, November.
    2. Joana Garcia & Nikolay Iskrev, 2019. "Inflation expectations in the Survey of Professional Forecasters: An exploratory analysis," Economic Bulletin and Financial Stability Report Articles and Banco de Portugal Economic Studies, Banco de Portugal, Economics and Research Department.
    3. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    4. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    5. Spyros Makridakis & Robert L. Winkler, 1983. "Averages of Forecasts: Some Empirical Results," Management Science, INFORMS, vol. 29(9), pages 987-996, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    2. Mirakyan, Atom & Meyer-Renschhausen, Martin & Koch, Andreas, 2017. "Composite forecasting approach, application for next-day electricity price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 228-237.
    3. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    4. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017. "Forecasting with temporal hierarchies," European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
    5. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    6. Theodosiou, Marina, 2011. "Forecasting monthly and quarterly time series using STL decomposition," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1178-1195, October.
    7. Pierre Dodin & Jingyi Xiao & Yossiri Adulyasak & Neda Etebari Alamdari & Lea Gauthier & Philippe Grangier & Paul Lemaitre & William L. Hamilton, 2023. "Bombardier Aftermarket Demand Forecast with Machine Learning," Interfaces, INFORMS, vol. 53(6), pages 425-445, November.
    8. Petropoulos, Fotios & Makridakis, Spyros & Assimakopoulos, Vassilios & Nikolopoulos, Konstantinos, 2014. "‘Horses for Courses’ in demand forecasting," European Journal of Operational Research, Elsevier, vol. 237(1), pages 152-163.
    9. Jaganathan, Srihari & Prakash, P.K.S., 2020. "A combination-based forecasting method for the M4-competition," International Journal of Forecasting, Elsevier, vol. 36(1), pages 98-104.
    10. Bacci, Livio Agnew & Mello, Luiz Gustavo & Incerti, Taynara & Paulo de Paiva, Anderson & Balestrassi, Pedro Paulo, 2019. "Optimization of combined time series methods to forecast the demand for coffee in Brazil: A new approach using Normal Boundary Intersection coupled with mixture designs of experiments and rotated fact," International Journal of Production Economics, Elsevier, vol. 212(C), pages 186-211.
    11. Fiorucci, Jose A. & Pellegrini, Tiago R. & Louzada, Francisco & Petropoulos, Fotios & Koehler, Anne B., 2016. "Models for optimising the theta method and their relationship to state space models," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1151-1161.
    12. Aye, Goodness C. & Balcilar, Mehmet & Gupta, Rangan & Majumdar, Anandamayee, 2015. "Forecasting aggregate retail sales: The case of South Africa," International Journal of Production Economics, Elsevier, vol. 160(C), pages 66-79.
    13. Srinivas Bollapragada & Salil Gupta & Brett Hurwitz & Paul Miles & Rajesh Tyagi, 2008. "NBC-Universal Uses a Novel Qualitative Forecasting Technique to Predict Advertising Demand," Interfaces, INFORMS, vol. 38(2), pages 103-111, April.
    14. Li, Li & Kang, Yanfei & Li, Feng, 2023. "Bayesian forecast combination using time-varying features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
    15. Zhenni Ding & Huayou Chen & Ligang Zhou, 2023. "Using shapely values to define subgroups of forecasts for combining," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 905-923, July.
    16. Avci, Ezgi & Ketter, Wolfgang & van Heck, Eric, 2018. "Managing electricity price modeling risk via ensemble forecasting: The case of Turkey," Energy Policy, Elsevier, vol. 123(C), pages 390-403.
    17. Samuels, Jon D. & Sekkel, Rodrigo M., 2017. "Model Confidence Sets and forecast combination," International Journal of Forecasting, Elsevier, vol. 33(1), pages 48-60.
    18. Julia A. Minson & Jennifer S. Mueller & Richard P. Larrick, 2018. "The Contingent Wisdom of Dyads: When Discussion Enhances vs. Undermines the Accuracy of Collaborative Judgments," Management Science, INFORMS, vol. 64(9), pages 4177-4192, September.
    19. Robert L. Winkler & Robert T. Clemen, 2004. "Multiple Experts vs. Multiple Methods: Combining Correlation Assessments," Decision Analysis, INFORMS, vol. 1(3), pages 167-176, September.
    20. Pennings, Clint L.P. & van Dalen, Jan & Rook, Laurens, 2019. "Coordinating judgmental forecasting: Coping with intentional biases," Omega, Elsevier, vol. 87(C), pages 46-56.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jforec:v:4:y:2022:i:4:p:44-818:d:929399. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.