IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v67y2021i7p4209-4232.html
   My bibliography  Save this article

Gatekeeping, Fast and Slow: An Empirical Study of Referral Errors in the Emergency Department

Author

Listed:
  • Michael Freeman

    (INSEAD, Republic of Singapore 138676)

  • Susan Robinson

    (Cambridge University Hospitals NHS Foundation Trust, Cambridge CB2 0QQ, United Kingdom)

  • Stefan Scholtes

    (Judge Business School, University of Cambridge, Cambridge CB2 1AG, United Kingdom)

Abstract

Using data from over 300,000 visits to an emergency department (ED), we study the accuracy of gatekeeping decisions—the choices that physicians make regarding patient discharge or admission to the hospital. In our study context, we focus specifically on the effectiveness of a second gatekeeping stage in the ED—a clinical decision unit (CDU). Although only 9.9% of patients in our sample are routed through the CDU, we find that had the unit not been in place during the observation period, the rates of unnecessary hospitalization and wrongful patient discharge from the ED would have increased by 14.3% and 29.6%, respectively. We also find that the CDU is especially beneficial for patients with a high ex ante risk of experiencing unnecessary hospitalization, with the rate for the most high-risk patients reduced from 14.0% without the CDU to just 4.8% had all such patients been routed through the CDU. The appropriateness of referrals is therefore a key contributor to the CDU’s effectiveness: We estimate that random allocation of patients in our study hospital to the CDU would have reduced the unit’s effectiveness by more than half. Finally, we investigate a critical trade-off in designing a two-stage gatekeeping system: Resources must be split between the two stages, increasing congestion in the first stage when the second stage is enlarged. We demonstrate that in the study hospital, the combination of an ED and CDU performs better than a pooled system that combines the capacity of both stages to enlarge the ED but does not have a designated CDU. In fact, we estimate that in this specific case, reducing the size of the first-stage ED in order to expand CDU capacity from the current 9.9% of ED patients to 25% would further reduce unnecessary hospitalizations by up to 33%. We discuss the insights that these results provide as to the circumstances under which it may be advantageous to add a second stage to a gatekeeping system.

Suggested Citation

  • Michael Freeman & Susan Robinson & Stefan Scholtes, 2021. "Gatekeeping, Fast and Slow: An Empirical Study of Referral Errors in the Emergency Department," Management Science, INFORMS, vol. 67(7), pages 4209-4232, July.
  • Handle: RePEc:inm:ormnsc:v:67:y:2021:i:7:p:4209-4232
    DOI: 10.1287/mnsc.2020.3711
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3711
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3711?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Shurtz, Ity, 2013. "The impact of medical errors on physician behavior: Evidence from malpractice litigation," Journal of Health Economics, Elsevier, vol. 32(2), pages 331-340.
    2. Wallace J. Hopp & Seyed M. R. Iravani & Gigi Y. Yuen, 2007. "Operations Systems with Discretionary Task Completion," Management Science, INFORMS, vol. 53(1), pages 61-77, January.
    3. Saed Alizamir & Francis de Véricourt & Peng Sun, 2013. "Diagnostic Accuracy Under Congestion," Management Science, INFORMS, vol. 59(1), pages 157-171, December.
    4. Soroush Saghafian & Wallace J. Hopp & Mark P. Van Oyen & Jeffrey S. Desmond & Steven L. Kronick, 2014. "Complexity-Augmented Triage: A Tool for Improving Patient Safety and Operational Efficiency," Manufacturing & Service Operations Management, INFORMS, vol. 16(3), pages 329-345, July.
    5. Carri W. Chan & Vivek F. Farias & Gabriel J. Escobar, 2017. "The Impact of Delays on Service Times in the Intensive Care Unit," Management Science, INFORMS, vol. 63(7), pages 2049-2072, July.
    6. Diwas S. Kc & Christian Terwiesch, 2009. "Impact of Workload on Service Time and Patient Safety: An Econometric Analysis of Hospital Operations," Management Science, INFORMS, vol. 55(9), pages 1486-1498, September.
    7. Zhe George Zhang & Hsing Paul Luh & Chia-Hung Wang, 2011. "Modeling Security-Check Queues," Management Science, INFORMS, vol. 57(11), pages 1979-1995, November.
    8. Soroush Saghafian & Wallace J. Hopp & Mark P. Van Oyen & Jeffrey S. Desmond & Steven L. Kronick, 2012. "Patient Streaming as a Mechanism for Improving Responsiveness in Emergency Departments," Operations Research, INFORMS, vol. 60(5), pages 1080-1097, October.
    9. Diwas Singh KC, 2014. "Does Multitasking Improve Performance? Evidence from the Emergency Department," Manufacturing & Service Operations Management, INFORMS, vol. 16(2), pages 168-183, May.
    10. Robert A. Shumsky & Edieal J. Pinker, 2003. "Gatekeepers and Referrals in Services," Management Science, INFORMS, vol. 49(7), pages 839-856, July.
    11. Carri W. Chan & Linda V. Green & Yina Lu & Nicole Leahy & Roger Yurt, 2013. "Prioritizing Burn-Injured Patients During a Disaster," Manufacturing & Service Operations Management, INFORMS, vol. 15(2), pages 170-190, May.
    12. Wilde, Joachim, 2000. "Identification of multiple equation probit models with endogenous dummy regressors," Economics Letters, Elsevier, vol. 69(3), pages 309-312, December.
    13. Sameer Hasija & Edieal J. Pinker & Robert A. Shumsky, 2005. "Staffing and routing in a two-tier call centre," International Journal of Operational Research, Inderscience Enterprises Ltd, vol. 1(1/2), pages 8-29.
    14. Michael Freeman & Nicos Savva & Stefan Scholtes, 2017. "Gatekeepers at Work: An Empirical Analysis of a Maternity Unit," Management Science, INFORMS, vol. 63(10), pages 3147-3167, October.
    15. Ludwig Kuntz & Roman Mennicken & Stefan Scholtes, 2015. "Stress on the Ward: Evidence of Safety Tipping Points in Hospitals," Management Science, INFORMS, vol. 61(4), pages 754-771, April.
    16. Diwas Singh KC & Christian Terwiesch, 2012. "An Econometric Analysis of Patient Flows in the Cardiac Intensive Care Unit," Manufacturing & Service Operations Management, INFORMS, vol. 14(1), pages 50-65, January.
    17. Robert J. Batt & Christian Terwiesch, 2015. "Waiting Patiently: An Empirical Study of Queue Abandonment in an Emergency Department," Management Science, INFORMS, vol. 61(1), pages 39-59, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ginger Zhe Jin & Ajin Lee & Susan Feng Lu, 2022. "Patient Routing to Skilled Nursing Facilities: The Consequences of the Medicare Reimbursement Rule," Management Science, INFORMS, vol. 68(12), pages 8722-8740, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Freeman & Nicos Savva & Stefan Scholtes, 2017. "Gatekeepers at Work: An Empirical Analysis of a Maternity Unit," Management Science, INFORMS, vol. 63(10), pages 3147-3167, October.
    2. Robert J. Batt & Christian Terwiesch, 2017. "Early Task Initiation and Other Load-Adaptive Mechanisms in the Emergency Department," Management Science, INFORMS, vol. 63(11), pages 3531-3551, November.
    3. Delasay, Mohammad & Ingolfsson, Armann & Kolfal, Bora & Schultz, Kenneth, 2019. "Load effect on service times," European Journal of Operational Research, Elsevier, vol. 279(3), pages 673-686.
    4. Carri W. Chan & Linda V. Green & Suparerk Lekwijit & Lijian Lu & Gabriel Escobar, 2019. "Assessing the Impact of Service Level When Customer Needs Are Uncertain: An Empirical Investigation of Hospital Step-Down Units," Management Science, INFORMS, vol. 65(2), pages 751-775, February.
    5. Diwas S. KC & Bradley R. Staats & Maryam Kouchaki & Francesca Gino, 2020. "Task Selection and Workload: A Focus on Completing Easy Tasks Hurts Performance," Management Science, INFORMS, vol. 66(10), pages 4397-4416, October.
    6. Tinglong Dai & Sridhar Tayur, 2020. "OM Forum—Healthcare Operations Management: A Snapshot of Emerging Research," Manufacturing & Service Operations Management, INFORMS, vol. 22(5), pages 869-887, September.
    7. Mirko Kremer & Francis de Véricourt, 2022. "Mismanaging diagnostic accuracy under congestion," ESMT Research Working Papers ESMT-22-01, ESMT European School of Management and Technology.
    8. Tom Fangyun Tan & Serguei Netessine, 2014. "When Does the Devil Make Work? An Empirical Study of the Impact of Workload on Worker Productivity," Management Science, INFORMS, vol. 60(6), pages 1574-1593, June.
    9. Büşra Ergün‐Şahin & Evrim Didem Güneş & Ayşe Kocabıyıkoğlu & Ahmet Keskin, 2022. "How does workload affect test ordering behavior of physicians? An empirical investigation," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2664-2680, June.
    10. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    11. Mohammad Delasay & Armann Ingolfsson & Bora Kolfal, 2016. "Modeling Load and Overwork Effects in Queueing Systems with Adaptive Service Rates," Operations Research, INFORMS, vol. 64(4), pages 867-885, August.
    12. Saghafian, Soroush & Hopp, Wallace J. & Iravani, Seyed M. R. & Cheng, Yao & Diermeier, Daniel, 2017. "Workload Management in Telemedical Physician Triage and Other Knowledge-Based Service Systems," Working Paper Series rwp17-035, Harvard University, John F. Kennedy School of Government.
    13. Ludwig Kuntz & Stefan Scholtes & Sandra Sülz, 2019. "Separate and Concentrate: Accounting for Patient Complexity in General Hospitals," Management Science, INFORMS, vol. 67(6), pages 2482-2501, June.
    14. Song, Lina & Saghafian, Soroush, 2019. "Do Hospital Closures Improve the Efficiency and Quality of Other Hospitals?," Working Paper Series rwp19-006, Harvard University, John F. Kennedy School of Government.
    15. Michael F. Kamali & Tolga Tezcan & Ozlem Yildiz, 2019. "When to Use Provider Triage in Emergency Departments," Management Science, INFORMS, vol. 65(3), pages 1003-1019, March.
    16. Noa Zychlinski, 2023. "Applications of fluid models in service operations management," Queueing Systems: Theory and Applications, Springer, vol. 103(1), pages 161-185, February.
    17. Teck-Hua Ho & Noah Lim & Sadat Reza & Xiaoyu Xia, 2017. "OM Forum—Causal Inference Models in Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 19(4), pages 509-525, October.
    18. Ludwig Kuntz & Sandra Sülz, 2013. "Treatment speed and high load in the Emergency Department—does staff quality matter?," Health Care Management Science, Springer, vol. 16(4), pages 366-376, December.
    19. Avishai Mandelbaum & Petar Momčilović, 2017. "Personalized queues: the customer view, via a fluid model of serving least-patient first," Queueing Systems: Theory and Applications, Springer, vol. 87(1), pages 23-53, October.
    20. Emilio Gutierrez & Adrian Rubli, 2021. "Shocks to Hospital Occupancy and Mortality: Evidence from the 2009 H1N1 Pandemic," Management Science, INFORMS, vol. 67(9), pages 5943-5952, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:67:y:2021:i:7:p:4209-4232. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.