IDEAS home Printed from https://ideas.repec.org/a/inm/ormsom/v18y2016i1p141-156.html
   My bibliography  Save this article

Accurate Emergency Department Wait Time Prediction

Author

Listed:
  • Erjie Ang

    (Graduate School of Business, Stanford University, Stanford, California 94305)

  • Sara Kwasnick

    (Graduate School of Business, Stanford University, Stanford, California 94305)

  • Mohsen Bayati

    (Graduate School of Business, Stanford University, Stanford, California 94305)

  • Erica L. Plambeck

    (Graduate School of Business, Stanford University, Stanford, California 94305)

  • Michael Aratow

    (San Mateo Medical Center, San Mateo, California 94403)

Abstract

This paper proposes the Q-Lasso method for wait time prediction, which combines statistical learning with fluid model estimators. In historical data from four remarkably different hospitals, Q-Lasso predicts the emergency department (ED) wait time for low-acuity patients with greater accuracy than rolling average methods (currently used by hospitals), fluid model estimators (from the service operations management literature), and quantile regression methods (from the emergency medicine literature). Q-Lasso achieves greater accuracy largely by correcting errors of underestimation in which a patient waits for longer than predicted. Implemented on the external website and in the triage room of the San Mateo Medical Center (SMMC), Q-Lasso achieves over 30% lower mean squared prediction error than would occur with the best rolling average method. The paper describes challenges and insights from the implementation at SMMC.

Suggested Citation

  • Erjie Ang & Sara Kwasnick & Mohsen Bayati & Erica L. Plambeck & Michael Aratow, 2016. "Accurate Emergency Department Wait Time Prediction," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 141-156, February.
  • Handle: RePEc:inm:ormsom:v:18:y:2016:i:1:p:141-156
    DOI: 10.1287/msom.2015.0560
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/msom.2015.0560
    Download Restriction: no

    File URL: https://libkey.io/10.1287/msom.2015.0560?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    2. Gad Allon & Achal Bassamboo & Itai Gurvich, 2011. "“We Will Be Right with You”: Managing Customer Expectations with Vague Promises and Cheap Talk," Operations Research, INFORMS, vol. 59(6), pages 1382-1394, December.
    3. Sarang Deo & Itai Gurvich, 2011. "Centralized vs. Decentralized Ambulance Diversion: A Network Perspective," Management Science, INFORMS, vol. 57(7), pages 1300-1319, July.
    4. Yina Lu & Andrés Musalem & Marcelo Olivares & Ariel Schilkrut, 2013. "Measuring the Effect of Queues on Customer Purchases," Management Science, INFORMS, vol. 59(8), pages 1743-1763, August.
    5. Mor Armony & Nahum Shimkin & Ward Whitt, 2009. "The Impact of Delay Announcements in Many-Server Queues with Abandonment," Operations Research, INFORMS, vol. 57(1), pages 66-81, February.
    6. Oualid Jouini & Zeynep Akşin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Manufacturing & Service Operations Management, INFORMS, vol. 13(4), pages 534-548, October.
    7. Soroush Saghafian & Wallace J. Hopp & Mark P. Van Oyen & Jeffrey S. Desmond & Steven L. Kronick, 2014. "Complexity-Augmented Triage: A Tool for Improving Patient Safety and Operational Efficiency," Manufacturing & Service Operations Management, INFORMS, vol. 16(3), pages 329-345, July.
    8. Mor Armony & Constantinos Maglaras, 2004. "Contact Centers with a Call-Back Option and Real-Time Delay Information," Operations Research, INFORMS, vol. 52(4), pages 527-545, August.
    9. Oualid Jouini & Zeynep Aksin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Post-Print hal-00680769, HAL.
    10. Avishai Mandelbaum & Sergey Zeltyn, 2009. "Staffing Many-Server Queues with Impatient Customers: Constraint Satisfaction in Call Centers," Operations Research, INFORMS, vol. 57(5), pages 1189-1205, October.
    11. Robert J. Batt & Christian Terwiesch, 2015. "Waiting Patiently: An Empirical Study of Queue Abandonment in an Emergency Department," Management Science, INFORMS, vol. 61(1), pages 39-59, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jun Li & Serguei Netessine & Sergei Koulayev, 2018. "Price to Compete … with Many: How to Identify Price Competition in High-Dimensional Space," Management Science, INFORMS, vol. 64(9), pages 4118-4136, September.
    2. Jerry Anunrojwong & Krishnamurthy Iyer & Vahideh Manshadi, 2023. "Information Design for Congested Social Services: Optimal Need-Based Persuasion," Management Science, INFORMS, vol. 69(7), pages 3778-3796, July.
    3. Jerry Anunrojwong & Krishnamurthy Iyer & David Lingenbrink, 2024. "Persuading Risk-Conscious Agents: A Geometric Approach," Operations Research, INFORMS, vol. 72(1), pages 151-166, January.
    4. Jung, Seung Hwan & Yang, Yunsi, 2023. "On the value of operational flexibility in the trailer shipment and assignment problem: Data-driven approaches and reinforcement learning," International Journal of Production Economics, Elsevier, vol. 264(C).
    5. Benevento, Elisabetta & Aloini, Davide & Squicciarini, Nunzia, 2023. "Towards a real-time prediction of waiting times in emergency departments: A comparative analysis of machine learning techniques," International Journal of Forecasting, Elsevier, vol. 39(1), pages 192-208.
    6. Araz, Ozgur M. & Olson, David & Ramirez-Nafarrate, Adrian, 2019. "Predictive analytics for hospital admissions from the emergency department using triage information," International Journal of Production Economics, Elsevier, vol. 208(C), pages 199-207.
    7. Batur, Demet & Bekki, Jennifer M. & Chen, Xi, 2018. "Quantile regression metamodeling: Toward improved responsiveness in the high-tech electronics manufacturing industry," European Journal of Operational Research, Elsevier, vol. 264(1), pages 212-224.
    8. Haolin Feng & Yiwu Jia & Siyi Zhou & Hongyi Chen & Teng Huang, 2023. "A Dataset of Service Time and Related Patient Characteristics from an Outpatient Clinic," Data, MDPI, vol. 8(3), pages 1-15, February.
    9. Mani Suleiman & Haydar Demirhan & Leanne Boyd & Federico Girosi & Vural Aksakalli, 2022. "Bayesian prediction of emergency department wait time," Health Care Management Science, Springer, vol. 25(2), pages 275-290, June.
    10. Tasquia Mizan & Sharareh Taghipour, 2021. "A causal model for short‐term time series analysis to predict incoming Medicare workload," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(2), pages 228-242, March.
    11. Rouba Ibrahim & Mor Armony & Achal Bassamboo, 2017. "Does the Past Predict the Future? The Case of Delay Announcements in Service Systems," Management Science, INFORMS, vol. 63(6), pages 1762-1780, June.
    12. Jérémie Gallien & Alan Scheller-Wolf, 2016. "Introduction to the Special Issue on Practice-Focused Research," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 1-4, February.
    13. Debjit Roy & Eirini Spiliotopoulou & Jelle de Vries, 2022. "Restaurant analytics: Emerging practice and research opportunities," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3687-3709, October.
    14. Bottmer, Lea & Croux, Christophe & Wilms, Ines, 2022. "Sparse regression for large data sets with outliers," European Journal of Operational Research, Elsevier, vol. 297(2), pages 782-794.
    15. Tinglong Dai & Sridhar Tayur, 2020. "OM Forum—Healthcare Operations Management: A Snapshot of Emerging Research," Manufacturing & Service Operations Management, INFORMS, vol. 22(5), pages 869-887, September.
    16. Nan Liu & Stacey R. Finkelstein & Margaret E. Kruk & David Rosenthal, 2018. "When Waiting to See a Doctor Is Less Irritating: Understanding Patient Preferences and Choice Behavior in Appointment Scheduling," Management Science, INFORMS, vol. 64(5), pages 1975-1996, May.
    17. Jing Dong & Elad Yom-Tov & Galit B. Yom-Tov, 2019. "The Impact of Delay Announcements on Hospital Network Coordination and Waiting Times," Management Science, INFORMS, vol. 67(5), pages 1969-1994, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lu, Yuwei & Xie, Xiaolan & Jiang, Zhibin, 2018. "Dynamic appointment scheduling with wait-dependent abandonment," European Journal of Operational Research, Elsevier, vol. 265(3), pages 975-984.
    2. Robert J. Batt & Christian Terwiesch, 2015. "Waiting Patiently: An Empirical Study of Queue Abandonment in an Emergency Department," Management Science, INFORMS, vol. 61(1), pages 39-59, January.
    3. Colm Crowley & Steven Guitron & Joseph Son & Oleg S Pianykh, 2020. "Modeling workflows: Identifying the most predictive features in healthcare operational processes," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-14, June.
    4. Zeynep Akşin & Baris Ata & Seyed Morteza Emadi & Che-Lin Su, 2017. "Impact of Delay Announcements in Call Centers: An Empirical Approach," Operations Research, INFORMS, vol. 65(1), pages 242-265, February.
    5. Rouba Ibrahim & Ward Whitt, 2011. "Wait-Time Predictors for Customer Service Systems with Time-Varying Demand and Capacity," Operations Research, INFORMS, vol. 59(5), pages 1106-1118, October.
    6. Junfei Huang & Avishai Mandelbaum & Hanqin Zhang & Jiheng Zhang, 2017. "Refined Models for Efficiency-Driven Queues with Applications to Delay Announcements and Staffing," Operations Research, INFORMS, vol. 65(5), pages 1380-1397, October.
    7. Siddharth Prakash Singh & Mohammad Delasay & Alan Scheller‐Wolf, 2023. "Real‐time delay announcement under competition," Production and Operations Management, Production and Operations Management Society, vol. 32(3), pages 863-881, March.
    8. Kaan Kuzu & Long Gao & Susan H. Xu, 2019. "To Wait or Not to Wait: The Theory and Practice of Ticket Queues," Manufacturing & Service Operations Management, INFORMS, vol. 21(4), pages 853-874, October.
    9. Rouba Ibrahim, 2018. "Sharing delay information in service systems: a literature survey," Queueing Systems: Theory and Applications, Springer, vol. 89(1), pages 49-79, June.
    10. Jamol Pender & Richard Rand & Elizabeth Wesson, 2020. "A Stochastic Analysis of Queues with Customer Choice and Delayed Information," Mathematics of Operations Research, INFORMS, vol. 45(3), pages 1104-1126, August.
    11. Odysseas Kanavetas & Barış Balcıog̃lu, 2022. "The “Sensitive” Markovian queueing system and its application for a call center problem," Annals of Operations Research, Springer, vol. 317(2), pages 651-664, October.
    12. Qiuping Yu & Gad Allon & Achal Bassamboo, 2017. "How Do Delay Announcements Shape Customer Behavior? An Empirical Study," Management Science, INFORMS, vol. 63(1), pages 1-20, January.
    13. Kraig Delana & Nicos Savva & Tolga Tezcan, 2021. "Proactive Customer Service: Operational Benefits and Economic Frictions," Manufacturing & Service Operations Management, INFORMS, vol. 23(1), pages 70-87, 1-2.
    14. Oualid Jouini & Zeynep Akşin & Yves Dallery, 2011. "Call Centers with Delay Information: Models and Insights," Manufacturing & Service Operations Management, INFORMS, vol. 13(4), pages 534-548, October.
    15. Kuang Xu & Carri W. Chan, 2016. "Using Future Information to Reduce Waiting Times in the Emergency Department via Diversion," Manufacturing & Service Operations Management, INFORMS, vol. 18(3), pages 314-331, July.
    16. Sophia Novitzky & Jamol Pender & Richard H. Rand & Elizabeth Wesson, 2020. "Limiting the oscillations in queues with delayed information through a novel type of delay announcement," Queueing Systems: Theory and Applications, Springer, vol. 95(3), pages 281-330, August.
    17. Zeynep Akşin & Barış Ata & Seyed Morteza Emadi & Che-Lin Su, 2013. "Structural Estimation of Callers' Delay Sensitivity in Call Centers," Management Science, INFORMS, vol. 59(12), pages 2727-2746, December.
    18. Junfei Huang & Boaz Carmeli & Avishai Mandelbaum, 2015. "Control of Patient Flow in Emergency Departments, or Multiclass Queues with Deadlines and Feedback," Operations Research, INFORMS, vol. 63(4), pages 892-908, August.
    19. Qiuping Yu & Yiming Zhang & Yong-Pin Zhou, 2022. "Delay Information in Virtual Queues: A Large-Scale Field Experiment on a Major Ride-Sharing Platform," Management Science, INFORMS, vol. 68(8), pages 5745-5757, August.
    20. Liu, Jian & Chen, Jian & Bo, Rui & Meng, Fanlin & Xu, Yong & Li, Peng, 2023. "Increases or discounts: Price strategies based on customers’ patience times," European Journal of Operational Research, Elsevier, vol. 305(2), pages 722-737.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormsom:v:18:y:2016:i:1:p:141-156. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.