IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v39y2023i1p192-208.html

Towards a real-time prediction of waiting times in emergency departments: A comparative analysis of machine learning techniques

Author

Listed:
  • Benevento, Elisabetta
  • Aloini, Davide
  • Squicciarini, Nunzia

Abstract

Emergency Departments (EDs) can better manage activities and resources and anticipate overcrowding through accurate estimations of waiting times. However, the complex nature of EDs imposes a challenge on waiting time prediction. In this paper, we test various machine learning techniques, using predictive analytics, applied to two large datasets from real EDs. We evaluate the predictive ability of Lasso, Random Forest, Support Vector Regression, Artificial Neural Network, and the Ensemble Method, using different error metrics and computational times. To improve the prediction accuracy, new queue-based variables, that capture the current state of the ED, are defined as additional predictors. The results show that the Ensemble Method is the most effective at predicting waiting times. In terms of both accuracy and computational efficiency, Random Forest is a reasonable trade-off. The results have significant practical implications for EDs and hospitals, suggesting that a real-time performance monitoring system that supports operational decision-making is possible.

Suggested Citation

  • Benevento, Elisabetta & Aloini, Davide & Squicciarini, Nunzia, 2023. "Towards a real-time prediction of waiting times in emergency departments: A comparative analysis of machine learning techniques," International Journal of Forecasting, Elsevier, vol. 39(1), pages 192-208.
  • Handle: RePEc:eee:intfor:v:39:y:2023:i:1:p:192-208
    DOI: 10.1016/j.ijforecast.2021.10.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207021001692
    Download Restriction: Full text may be restricted for ScienceDirect subscribers

    File URL: https://libkey.io/10.1016/j.ijforecast.2021.10.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Gianluca Bontempi & Souhaib Ben Taieb & Yann-Aël Le Borgne, 2013. "Machine learning strategies for time series forecasting," ULB Institutional Repository 2013/167761, ULB -- Universite Libre de Bruxelles.
    2. Flores, Benito E., 1989. "The utilization of the Wilcoxon test to compare forecasting methods: A note," International Journal of Forecasting, Elsevier, vol. 5(4), pages 529-535.
    3. Golmohammadi, Davood & Radnia, Naeimeh, 2016. "Prediction modeling and pattern recognition for patient readmission," International Journal of Production Economics, Elsevier, vol. 171(P1), pages 151-161.
    4. Elalouf, Amir & Wachtel, Guy, 2016. "An alternative scheduling approach for improving emergency department performance," International Journal of Production Economics, Elsevier, vol. 178(C), pages 65-71.
    5. Araz, Ozgur M. & Olson, David & Ramirez-Nafarrate, Adrian, 2019. "Predictive analytics for hospital admissions from the emergency department using triage information," International Journal of Production Economics, Elsevier, vol. 208(C), pages 199-207.
    6. van der Vaart, Taco & Vastag, Gyula & Wijngaard, Jacob, 2011. "Facets of operational performance in an emergency room (ER)," International Journal of Production Economics, Elsevier, vol. 133(1), pages 201-211, September.
    7. Golmohammadi, Davood, 2016. "Predicting hospital admissions to reduce emergency department boarding," International Journal of Production Economics, Elsevier, vol. 182(C), pages 535-544.
    8. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    9. Oualid Jouini & Zeynep Akşin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Manufacturing & Service Operations Management, INFORMS, vol. 13(4), pages 534-548, October.
    10. Oualid Jouini & Zeynep Aksin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Post-Print hal-00680769, HAL.
    11. Erjie Ang & Sara Kwasnick & Mohsen Bayati & Erica L. Plambeck & Michael Aratow, 2016. "Accurate Emergency Department Wait Time Prediction," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 141-156, February.
    12. Delen, Dursun & Cogdell, Douglas & Kasap, Nihat, 2012. "A comparative analysis of data mining methods in predicting NCAA bowl outcomes," International Journal of Forecasting, Elsevier, vol. 28(2), pages 543-552.
    13. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Ran & Zhou, Bo & Wang, Shiming & Ouyang, Huiyin, 2025. "Physician scheduling in case managers style emergency departments: machine learning-aided solution approaches," European Journal of Operational Research, Elsevier, vol. 327(1), pages 326-339.
    2. Aloini, Davide & Benevento, Elisabetta & Berdini, Marco & Stefanini, Alessandro, 2025. "Predicting radiology service times for enhancing emergency department management," Socio-Economic Planning Sciences, Elsevier, vol. 99(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aloini, Davide & Benevento, Elisabetta & Berdini, Marco & Stefanini, Alessandro, 2025. "Predicting radiology service times for enhancing emergency department management," Socio-Economic Planning Sciences, Elsevier, vol. 99(C).
    2. Araz, Ozgur M. & Olson, David & Ramirez-Nafarrate, Adrian, 2019. "Predictive analytics for hospital admissions from the emergency department using triage information," International Journal of Production Economics, Elsevier, vol. 208(C), pages 199-207.
    3. Lee, Seung-Yup & Chinnam, Ratna Babu & Dalkiran, Evrim & Krupp, Seth & Nauss, Michael, 2021. "Proactive coordination of inpatient bed management to reduce emergency department patient boarding," International Journal of Production Economics, Elsevier, vol. 231(C).
    4. Nitzan Carmeli & Galit B. Yom-Tov & Onno J. Boxma, 2023. "State-Dependent Estimation of Delay Distributions in Fork-Join Networks," Manufacturing & Service Operations Management, INFORMS, vol. 25(3), pages 1081-1098, May.
    5. Siddharth Arora & James W. Taylor & Ho-Yin Mak, 2023. "Probabilistic Forecasting of Patient Waiting Times in an Emergency Department," Manufacturing & Service Operations Management, INFORMS, vol. 25(4), pages 1489-1508, July.
    6. Eric Park & Huiyin Ouyang & Jingqi Wang & Sergei Savin & Siu Chung Leung & Timothy H. Rainer, 2025. "Patient Sensitivity to Emergency Department Waiting Time Announcements," Manufacturing & Service Operations Management, INFORMS, vol. 27(6), pages 1740-1759, November.
    7. Rouba Ibrahim & Ward Whitt, 2011. "Wait-Time Predictors for Customer Service Systems with Time-Varying Demand and Capacity," Operations Research, INFORMS, vol. 59(5), pages 1106-1118, October.
    8. Odysseas Kanavetas & Barış Balcıog̃lu, 2022. "The “Sensitive” Markovian queueing system and its application for a call center problem," Annals of Operations Research, Springer, vol. 317(2), pages 651-664, October.
    9. Voyant, Cyril & Notton, Gilles & Duchaud, Jean-Laurent & Gutiérrez, Luis Antonio García & Bright, Jamie M. & Yang, Dazhi, 2022. "Benchmarks for solar radiation time series forecasting," Renewable Energy, Elsevier, vol. 191(C), pages 747-762.
    10. Santiago Gallino & Nil Karacaoglu & Antonio Moreno, 2023. "Need for Speed: The Impact of In-Process Delays on Customer Behavior in Online Retail," Operations Research, INFORMS, vol. 71(3), pages 876-894, May.
    11. Kraig Delana & Nicos Savva & Tolga Tezcan, 2021. "Proactive Customer Service: Operational Benefits and Economic Frictions," Manufacturing & Service Operations Management, INFORMS, vol. 23(1), pages 70-87, 1-2.
    12. Siddharth Prakash Singh & Mohammad Delasay & Alan Scheller‐Wolf, 2023. "Real‐time delay announcement under competition," Production and Operations Management, Production and Operations Management Society, vol. 32(3), pages 863-881, March.
    13. Erjie Ang & Sara Kwasnick & Mohsen Bayati & Erica L. Plambeck & Michael Aratow, 2016. "Accurate Emergency Department Wait Time Prediction," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 141-156, February.
    14. Sophia Novitzky & Jamol Pender & Richard H. Rand & Elizabeth Wesson, 2020. "Limiting the oscillations in queues with delayed information through a novel type of delay announcement," Queueing Systems: Theory and Applications, Springer, vol. 95(3), pages 281-330, August.
    15. Ozan Candogan & Kimon Drakopoulos, 2020. "Optimal Signaling of Content Accuracy: Engagement vs. Misinformation," Operations Research, INFORMS, vol. 68(2), pages 497-515, March.
    16. Zeynep Akşin & Barış Ata & Seyed Morteza Emadi & Che-Lin Su, 2013. "Structural Estimation of Callers' Delay Sensitivity in Call Centers," Management Science, INFORMS, vol. 59(12), pages 2727-2746, December.
    17. Gad Allon & Kimon Drakopoulos & Vahideh Manshadi, 2021. "Information Inundation on Platforms and Implications," Operations Research, INFORMS, vol. 69(6), pages 1784-1804, November.
    18. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    19. Rouba Ibrahim, 2018. "Sharing delay information in service systems: a literature survey," Queueing Systems: Theory and Applications, Springer, vol. 89(1), pages 49-79, June.
    20. Charisios Grivas & Mikkel Mandrup & Orimar Sauri, 2026. "A Comparison of High-Dimensional Variable Selection Procedures for Electricity Spot Price Forecasting," Papers 2608.09213, arXiv.org.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:39:y:2023:i:1:p:192-208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.