IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v39y2023i1p192-208.html
   My bibliography  Save this article

Towards a real-time prediction of waiting times in emergency departments: A comparative analysis of machine learning techniques

Author

Listed:
  • Benevento, Elisabetta
  • Aloini, Davide
  • Squicciarini, Nunzia

Abstract

Emergency Departments (EDs) can better manage activities and resources and anticipate overcrowding through accurate estimations of waiting times. However, the complex nature of EDs imposes a challenge on waiting time prediction. In this paper, we test various machine learning techniques, using predictive analytics, applied to two large datasets from real EDs. We evaluate the predictive ability of Lasso, Random Forest, Support Vector Regression, Artificial Neural Network, and the Ensemble Method, using different error metrics and computational times. To improve the prediction accuracy, new queue-based variables, that capture the current state of the ED, are defined as additional predictors. The results show that the Ensemble Method is the most effective at predicting waiting times. In terms of both accuracy and computational efficiency, Random Forest is a reasonable trade-off. The results have significant practical implications for EDs and hospitals, suggesting that a real-time performance monitoring system that supports operational decision-making is possible.

Suggested Citation

  • Benevento, Elisabetta & Aloini, Davide & Squicciarini, Nunzia, 2023. "Towards a real-time prediction of waiting times in emergency departments: A comparative analysis of machine learning techniques," International Journal of Forecasting, Elsevier, vol. 39(1), pages 192-208.
  • Handle: RePEc:eee:intfor:v:39:y:2023:i:1:p:192-208
    DOI: 10.1016/j.ijforecast.2021.10.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207021001692
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2021.10.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gianluca Bontempi & Souhaib Ben Taieb & Yann-Aël Le Borgne, 2013. "Machine learning strategies for time series forecasting," ULB Institutional Repository 2013/167761, ULB -- Universite Libre de Bruxelles.
    2. Flores, Benito E., 1989. "The utilization of the Wilcoxon test to compare forecasting methods: A note," International Journal of Forecasting, Elsevier, vol. 5(4), pages 529-535.
    3. Golmohammadi, Davood & Radnia, Naeimeh, 2016. "Prediction modeling and pattern recognition for patient readmission," International Journal of Production Economics, Elsevier, vol. 171(P1), pages 151-161.
    4. Elalouf, Amir & Wachtel, Guy, 2016. "An alternative scheduling approach for improving emergency department performance," International Journal of Production Economics, Elsevier, vol. 178(C), pages 65-71.
    5. Araz, Ozgur M. & Olson, David & Ramirez-Nafarrate, Adrian, 2019. "Predictive analytics for hospital admissions from the emergency department using triage information," International Journal of Production Economics, Elsevier, vol. 208(C), pages 199-207.
    6. van der Vaart, Taco & Vastag, Gyula & Wijngaard, Jacob, 2011. "Facets of operational performance in an emergency room (ER)," International Journal of Production Economics, Elsevier, vol. 133(1), pages 201-211, September.
    7. Golmohammadi, Davood, 2016. "Predicting hospital admissions to reduce emergency department boarding," International Journal of Production Economics, Elsevier, vol. 182(C), pages 535-544.
    8. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    9. Oualid Jouini & Zeynep Akşin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Manufacturing & Service Operations Management, INFORMS, vol. 13(4), pages 534-548, October.
    10. Oualid Jouini & Zeynep Aksin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Post-Print hal-00680769, HAL.
    11. Erjie Ang & Sara Kwasnick & Mohsen Bayati & Erica L. Plambeck & Michael Aratow, 2016. "Accurate Emergency Department Wait Time Prediction," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 141-156, February.
    12. Delen, Dursun & Cogdell, Douglas & Kasap, Nihat, 2012. "A comparative analysis of data mining methods in predicting NCAA bowl outcomes," International Journal of Forecasting, Elsevier, vol. 28(2), pages 543-552.
    13. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    14. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Koen W. de Bock, 2017. "The best of two worlds: Balancing model strength and comprehensibility in business failure prediction using spline-rule ensembles," Post-Print hal-01588059, HAL.
    2. Pierre Dodin & Jingyi Xiao & Yossiri Adulyasak & Neda Etebari Alamdari & Lea Gauthier & Philippe Grangier & Paul Lemaitre & William L. Hamilton, 2023. "Bombardier Aftermarket Demand Forecast with Machine Learning," Interfaces, INFORMS, vol. 53(6), pages 425-445, November.
    3. Cheng, Xian & Wu, Peng & Liao, Stephen Shaoyi & Wang, Xuelian, 2023. "An integrated model for crude oil forecasting: Causality assessment and technical efficiency," Energy Economics, Elsevier, vol. 117(C).
    4. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    5. Araz, Ozgur M. & Olson, David & Ramirez-Nafarrate, Adrian, 2019. "Predictive analytics for hospital admissions from the emergency department using triage information," International Journal of Production Economics, Elsevier, vol. 208(C), pages 199-207.
    6. Lee, Seung-Yup & Chinnam, Ratna Babu & Dalkiran, Evrim & Krupp, Seth & Nauss, Michael, 2021. "Proactive coordination of inpatient bed management to reduce emergency department patient boarding," International Journal of Production Economics, Elsevier, vol. 231(C).
    7. Ciner, Cetin, 2019. "Do industry returns predict the stock market? A reprise using the random forest," The Quarterly Review of Economics and Finance, Elsevier, vol. 72(C), pages 152-158.
    8. Merten, Michael & Rücker, Fabian & Schoeneberger, Ilka & Sauer, Dirk Uwe, 2020. "Automatic frequency restoration reserve market prediction: Methodology and comparison of various approaches," Applied Energy, Elsevier, vol. 268(C).
    9. Ma, Shaohui & Fildes, Robert & Huang, Tao, 2016. "Demand forecasting with high dimensional data: The case of SKU retail sales forecasting with intra- and inter-category promotional information," European Journal of Operational Research, Elsevier, vol. 249(1), pages 245-257.
    10. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    11. Carstensen, Kai & Heinrich, Markus & Reif, Magnus & Wolters, Maik H., 2020. "Predicting ordinary and severe recessions with a three-state Markov-switching dynamic factor model," International Journal of Forecasting, Elsevier, vol. 36(3), pages 829-850.
    12. Hou-Tai Chang & Ping-Huai Wang & Wei-Fang Chen & Chen-Ju Lin, 2022. "Risk Assessment of Early Lung Cancer with LDCT and Health Examinations," IJERPH, MDPI, vol. 19(8), pages 1-12, April.
    13. Wang, Qiao & Zhou, Wei & Cheng, Yonggang & Ma, Gang & Chang, Xiaolin & Miao, Yu & Chen, E, 2018. "Regularized moving least-square method and regularized improved interpolating moving least-square method with nonsingular moment matrices," Applied Mathematics and Computation, Elsevier, vol. 325(C), pages 120-145.
    14. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    15. Lucian Belascu & Alexandra Horobet & Georgiana Vrinceanu & Consuela Popescu, 2021. "Performance Dissimilarities in European Union Manufacturing: The Effect of Ownership and Technological Intensity," Sustainability, MDPI, vol. 13(18), pages 1-19, September.
    16. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    17. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2022. "Specification Choices in Quantile Regression for Empirical Macroeconomics," Working Papers 22-25, Federal Reserve Bank of Cleveland.
    18. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    19. Shuichi Kawano, 2014. "Selection of tuning parameters in bridge regression models via Bayesian information criterion," Statistical Papers, Springer, vol. 55(4), pages 1207-1223, November.
    20. Enrico Bergamini & Georg Zachmann, 2020. "Exploring EU’s Regional Potential in Low-Carbon Technologies," Sustainability, MDPI, vol. 13(1), pages 1-28, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:39:y:2023:i:1:p:192-208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.