IDEAS home Printed from https://ideas.repec.org/a/kap/hcarem/v26y2023i3d10.1007_s10729-023-09639-2.html
   My bibliography  Save this article

Forecasting ward-level bed requirements to aid pandemic resource planning: Lessons learned and future directions

Author

Listed:
  • Michael R. Johnson

    (Beedie School of Business, Simon Fraser University)

  • Hiten Naik

    (University of British Columbia)

  • Wei Siang Chan

    (University of British Columbia)

  • Jesse Greiner

    (Providence Health Care)

  • Matt Michaleski

    (Vancouver General Hospital)

  • Dong Liu

    (University of British Columbia)

  • Bruno Silvestre

    (University of Manitoba)

  • Ian P. McCarthy

    (Beedie School of Business, Simon Fraser University
    Luiss Guido Carli)

Abstract

During the COVID-19 pandemic, there has been considerable research on how regional and country-level forecasting can be used to anticipate required hospital resources. We add to and build on this work by focusing on ward-level forecasting and planning tools for hospital staff during the pandemic. We present an assessment, validation, and deployment of a working prototype forecasting tool used within a modified Traffic Control Bundling (TCB) protocol for resource planning during the pandemic. We compare statistical and machine learning forecasting methods and their accuracy at one of the largest hospitals (Vancouver General Hospital) in Canada against a medium-sized hospital (St. Paul’s Hospital) in Vancouver, Canada through the first three waves of the COVID-19 pandemic in the province of British Columbia. Our results confirm that traditional statistical and machine learning (ML) forecasting methods can provide valuable ward-level forecasting to aid in decision-making for pandemic resource planning. Using point forecasts with upper 95% prediction intervals, such forecasting methods would have provided better accuracy in anticipating required beds on COVID-19 hospital units than ward-level capacity decisions made by hospital staff. We have integrated our methodology into a publicly available online tool that operationalizes ward-level forecasting to aid with capacity planning decisions. Importantly, hospital staff can use this tool to translate forecasts into better patient care, less burnout, and improved planning for all hospital resources during pandemics.

Suggested Citation

  • Michael R. Johnson & Hiten Naik & Wei Siang Chan & Jesse Greiner & Matt Michaleski & Dong Liu & Bruno Silvestre & Ian P. McCarthy, 2023. "Forecasting ward-level bed requirements to aid pandemic resource planning: Lessons learned and future directions," Health Care Management Science, Springer, vol. 26(3), pages 477-500, September.
  • Handle: RePEc:kap:hcarem:v:26:y:2023:i:3:d:10.1007_s10729-023-09639-2
    DOI: 10.1007/s10729-023-09639-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10729-023-09639-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10729-023-09639-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Linying Yang & Teng Zhang & Peter Glynn & David Scheinker, 2021. "The development and deployment of a model for hospital-level COVID-19 associated patient demand intervals from consistent estimators (DICE)," Health Care Management Science, Springer, vol. 24(2), pages 375-401, June.
    2. Gaetano Perone, 2022. "Comparison of ARIMA, ETS, NNAR, TBATS and hybrid models to forecast the second wave of COVID-19 hospitalizations in Italy," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(6), pages 917-940, August.
    3. Muhammed Ordu & Eren Demir & Chris Tofallis, 2019. "A comprehensive modelling framework to forecast the demand for all hospital services," International Journal of Health Planning and Management, Wiley Blackwell, vol. 34(2), pages 1257-1271, April.
    4. Michael Fairley & David Scheinker & Margaret L. Brandeau, 2019. "Improving the efficiency of the operating room environment with an optimization and machine learning model," Health Care Management Science, Springer, vol. 22(4), pages 756-767, December.
    5. Bekker, René & uit het Broek, Michiel & Koole, Ger, 2023. "Modeling COVID-19 hospital admissions and occupancy in the Netherlands," European Journal of Operational Research, Elsevier, vol. 304(1), pages 207-218.
    6. Daniel Garcia-Vicuña & Laida Esparza & Fermin Mallor, 2022. "Hospital preparedness during epidemics using simulation: the case of COVID-19," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 30(1), pages 213-249, March.
    7. Marcel Goic & Mirko S Bozanic-Leal & Magdalena Badal & Leonardo J Basso, 2021. "COVID-19: Short-term forecast of ICU beds in times of crisis," PLOS ONE, Public Library of Science, vol. 16(1), pages 1-24, January.
    8. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    9. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    10. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    11. Spyros Makridakis & Evangelos Spiliotis & Vassilios Assimakopoulos, 2018. "Statistical and Machine Learning forecasting methods: Concerns and ways forward," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-26, March.
    12. Jonas Krämer & Jonas Schreyögg & Reinhard Busse, 2019. "Classification of hospital admissions into emergency and elective care: a machine learning approach," Health Care Management Science, Springer, vol. 22(1), pages 85-105, March.
    13. Zotteri, Giulio & Kalchschmidt, Matteo & Caniato, Federico, 2005. "The impact of aggregation level on forecasting performance," International Journal of Production Economics, Elsevier, vol. 93(1), pages 479-491, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    2. Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
    3. Huber, Jakob & Stuckenschmidt, Heiner, 2021. "Intraday shelf replenishment decision support for perishable goods," International Journal of Production Economics, Elsevier, vol. 231(C).
    4. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    5. Huber, Jakob & Stuckenschmidt, Heiner, 2020. "Daily retail demand forecasting using machine learning with emphasis on calendric special days," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1420-1438.
    6. Van Belle, Jente & Guns, Tias & Verbeke, Wouter, 2021. "Using shared sell-through data to forecast wholesaler demand in multi-echelon supply chains," European Journal of Operational Research, Elsevier, vol. 288(2), pages 466-479.
    7. Nghia Chu & Binh Dao & Nga Pham & Huy Nguyen & Hien Tran, 2022. "Predicting Mutual Funds' Performance using Deep Learning and Ensemble Techniques," Papers 2209.09649, arXiv.org, revised Jul 2023.
    8. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    9. Nasios, Ioannis & Vogklis, Konstantinos, 2022. "Blending gradient boosted trees and neural networks for point and probabilistic forecasting of hierarchical time series," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1448-1459.
    10. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2021. "Forecasting Principles from Experience with Forecasting Competitions," Forecasting, MDPI, vol. 3(1), pages 1-28, February.
    11. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    12. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    13. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    14. Twumasi, Clement & Twumasi, Juliet, 2022. "Machine learning algorithms for forecasting and backcasting blood demand data with missing values and outliers: A study of Tema General Hospital of Ghana," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1258-1277.
    15. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    16. Bojer, Casper Solheim & Meldgaard, Jens Peder, 2021. "Kaggle forecasting competitions: An overlooked learning opportunity," International Journal of Forecasting, Elsevier, vol. 37(2), pages 587-603.
    17. Winita Sulandari & Yudho Yudhanto & Sri Subanti & Crisma Devika Setiawan & Riskhia Hapsari & Paulo Canas Rodrigues, 2023. "Comparing the Simple to Complex Automatic Methods with the Ensemble Approach in Forecasting Electrical Time Series Data," Energies, MDPI, vol. 16(22), pages 1-16, November.
    18. Anna Almosova & Niek Andresen, 2023. "Nonlinear inflation forecasting with recurrent neural networks," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(2), pages 240-259, March.
    19. Evangelos Spiliotis & Fotios Petropoulos & Vassilios Assimakopoulos, 2023. "On the Disagreement of Forecasting Model Selection Criteria," Forecasting, MDPI, vol. 5(2), pages 1-12, June.
    20. Ioannis Nasios & Konstantinos Vogklis, 2023. "Blending gradient boosted trees and neural networks for point and probabilistic forecasting of hierarchical time series," Papers 2310.13029, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:hcarem:v:26:y:2023:i:3:d:10.1007_s10729-023-09639-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.