IDEAS home Printed from https://ideas.repec.org/a/inm/ormsom/v26y2024i2p447-464.html

Shortening Emergency Medical Response Time with Joint Operations of Uncrewed Aerial Vehicles with Ambulances

Author

Listed:
  • Xiaoquan Gao

    (School of Industrial Engineering, Purdue University, West Lafayette, Indiana 47097)

  • Nan Kong

    (Weldon School of Biomedical Engineering, Purdue University, West Lafayette, Indiana 47907)

  • Paul Griffin

    (Department of Industrial and Manufacturing Engineering, Pennsylvania State University, University Park, Pennsylvania 16802; Consortium on Substance Use and Addiction, SSRI, Pennsylvania State University, University Park, Pennsylvania 16802)

Abstract

Problem definition : Uncrewed aerial vehicles (UAVs) are transforming emergency service logistics applications across sectors, offering easy deployment and rapid response. In the context of emergency medical services (EMS), UAVs have the potential to augment ambulances by leveraging bystander assistance, thereby reducing response times for delivering urgent medical interventions and improving EMS outcomes. Notably, the use of UAVs for opioid overdose cases is particularly promising as it addresses the challenges faced by ambulances in delivering timely medication. This study aims to optimize the integration of UAVs and bystanders into EMS in order to minimize average response times for overdose interventions. Methodology/results : We formulate the joint operation of UAVs with ambulances through a Markov decision process that captures random emergency vehicle travel times and bystander availability. We apply an approximate dynamic programming approach to mitigate the solution challenges from high-dimensional state variables and complex decisions through a neural network-based approximation of the value functions (NN-API). To design the approximation, we construct a set of basis functions based on queueing and geographic properties of the UAV-augmented EMS system. Managerial implications : The simulation results suggest that our NN-API policy tends to outperform several noteworthy rule- and optimization-based benchmark policies in terms of accumulated rewards, particularly for situations that are primarily characterized by high request arrival rates and a limited number of available ambulances and UAVs. The results also demonstrate the benefits of incorporating UAVs into the EMS system and the effectiveness of an intelligent real-time operations strategy in addressing capacity shortages, which are often a problem in rural areas of the United States. Additionally, the results provide insights into specific contributions of each dispatching or redeployment strategy to overall performance improvement. Supplemental Material: The online appendix is available at https://doi.org/10.1287/msom.2022.0166

Suggested Citation

  • Xiaoquan Gao & Nan Kong & Paul Griffin, 2024. "Shortening Emergency Medical Response Time with Joint Operations of Uncrewed Aerial Vehicles with Ambulances," Manufacturing & Service Operations Management, INFORMS, vol. 26(2), pages 447-464, March.
  • Handle: RePEc:inm:ormsom:v:26:y:2024:i:2:p:447-464
    DOI: 10.1287/msom.2022.0166
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/msom.2022.0166
    Download Restriction: no

    File URL: https://libkey.io/10.1287/msom.2022.0166?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mark S. Daskin, 1983. "A Maximum Expected Covering Location Model: Formulation, Properties and Heuristic Solution," Transportation Science, INFORMS, vol. 17(1), pages 48-70, February.
    2. Richard C. Larson, 1975. "Approximating the Performance of Urban Emergency Service Systems," Operations Research, INFORMS, vol. 23(5), pages 845-868, October.
    3. Marianov, Vladimir & ReVelle, Charles, 1996. "The Queueing Maximal availability location problem: A model for the siting of emergency vehicles," European Journal of Operational Research, Elsevier, vol. 93(1), pages 110-120, August.
    4. ReVelle, Charles & Marianov, Vladimir, 1991. "A probabilistic FLEET model with individual vehicle reliability requirements," European Journal of Operational Research, Elsevier, vol. 53(1), pages 93-105, July.
    5. Bélanger, V. & Ruiz, A. & Soriano, P., 2019. "Recent optimization models and trends in location, relocation, and dispatching of emergency medical vehicles," European Journal of Operational Research, Elsevier, vol. 272(1), pages 1-23.
    6. Soovin Yoon & Laura A. Albert & Veronica M. White, 2021. "A Stochastic Programming Approach for Locating and Dispatching Two Types of Ambulances," Transportation Science, INFORMS, vol. 55(2), pages 275-296, March.
    7. Doe-Simkins, M. & Walley, A.Y. & Epstein, A. & Moyer, P., 2009. "Saved by the nose: Bystander-administered intranasal naloxone hydrochloride for opioid overdose," American Journal of Public Health, American Public Health Association, vol. 99(5), pages 788-791.
    8. Damitha Bandara & Maria E Mayorga & Laura A McLay, 2014. "Priority dispatching strategies for EMS systems," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(4), pages 572-587, April.
    9. Niels Agatz & Paul Bouman & Marie Schmidt, 2018. "Optimization Approaches for the Traveling Salesman Problem with Drone," Transportation Science, INFORMS, vol. 52(4), pages 965-981, August.
    10. T Andersson & P Värbrand, 2007. "Decision support tools for ambulance dispatch and relocation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(2), pages 195-201, February.
    11. Armann Ingolfsson & Susan Budge & Erhan Erkut, 2008. "Optimal ambulance location with random delays and travel times," Health Care Management Science, Springer, vol. 11(3), pages 262-274, September.
    12. Laura McLay, 2009. "A maximum expected covering location model with two types of servers," IISE Transactions, Taylor & Francis Journals, vol. 41(8), pages 730-741.
    13. David Schilling & D. Jack Elzinga & Jared Cohon & Richard Church & Charles ReVelle, 1979. "The Team/Fleet Models for Simultaneous Facility and Equipment Siting," Transportation Science, INFORMS, vol. 13(2), pages 163-175, May.
    14. Kim, D. & Irwin, K.S. & Khoshnood, K., 2009. "Expanded access to naloxone: Options for critical response to the epidemic of opioid overdose mortality," American Journal of Public Health, American Public Health Association, vol. 99(3), pages 402-407.
    15. Amir Ali Nasrollahzadeh & Amin Khademi & Maria E. Mayorga, 2018. "Real-Time Ambulance Dispatching and Relocation," Manufacturing & Service Operations Management, INFORMS, vol. 20(3), pages 467-480, July.
    16. Elizabeth Ty Wilde, 2013. "Do Emergency Medical System Response Times Matter For Health Outcomes?," Health Economics, John Wiley & Sons, Ltd., vol. 22(7), pages 790-806, July.
    17. Kenneth Chelst & James P. Jarvis, 1979. "Technical Note—Estimating the Probability Distribution of Travel Times for Urban Emergency Service Systems," Operations Research, INFORMS, vol. 27(1), pages 199-204, February.
    18. Matthew S. Maxwell & Mateo Restrepo & Shane G. Henderson & Huseyin Topaloglu, 2010. "Approximate Dynamic Programming for Ambulance Redeployment," INFORMS Journal on Computing, INFORMS, vol. 22(2), pages 266-281, May.
    19. Kenneth C. Chong & Shane G. Henderson & Mark E. Lewis, 2016. "The Vehicle Mix Decision in Emergency Medical Service Systems," Manufacturing & Service Operations Management, INFORMS, vol. 18(3), pages 347-360, July.
    20. Schmid, Verena, 2012. "Solving the dynamic ambulance relocation and dispatching problem using approximate dynamic programming," European Journal of Operational Research, Elsevier, vol. 219(3), pages 611-621.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chun Cheng & Yossiri Adulyasak & Louis-Martin Rousseau, 2024. "Robust Drone Delivery with Weather Information," Manufacturing & Service Operations Management, INFORMS, vol. 26(4), pages 1402-1421, July.
    2. Beliën, Jeroen & Brailsford, Sally & Demeulemeester, Erik & Demirtas, Derya & Hans, Erwin W. & Harper, Paul, 2025. "Fifty years of operational research applied to healthcare," European Journal of Operational Research, Elsevier, vol. 326(2), pages 189-206.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bélanger, V. & Ruiz, A. & Soriano, P., 2019. "Recent optimization models and trends in location, relocation, and dispatching of emergency medical vehicles," European Journal of Operational Research, Elsevier, vol. 272(1), pages 1-23.
    2. Bélanger, V. & Lanzarone, E. & Nicoletta, V. & Ruiz, A. & Soriano, P., 2020. "A recursive simulation-optimization framework for the ambulance location and dispatching problem," European Journal of Operational Research, Elsevier, vol. 286(2), pages 713-725.
    3. Wang, Wei & Wu, Shining & Wang, Shuaian & Zhen, Lu & Qu, Xiaobo, 2021. "Emergency facility location problems in logistics: Status and perspectives," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 154(C).
    4. Rania Boujemaa & Aida Jebali & Sondes Hammami & Angel Ruiz & Hanen Bouchriha, 2018. "A stochastic approach for designing two-tiered emergency medical service systems," Flexible Services and Manufacturing Journal, Springer, vol. 30(1), pages 123-152, June.
    5. Wang, Wei & Wang, Shuaian & Zhen, Lu & Qu, Xiaobo, 2022. "EMS location-allocation problem under uncertainties," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 168(C).
    6. McCormack, Richard & Coates, Graham, 2015. "A simulation model to enable the optimization of ambulance fleet allocation and base station location for increased patient survival," European Journal of Operational Research, Elsevier, vol. 247(1), pages 294-309.
    7. Kenneth C. Chong & Shane G. Henderson & Mark E. Lewis, 2016. "The Vehicle Mix Decision in Emergency Medical Service Systems," Manufacturing & Service Operations Management, INFORMS, vol. 18(3), pages 347-360, July.
    8. Ibrahim Çapar & Sharif H Melouk & Burcu B Keskin, 2017. "Alternative metrics to measure EMS system performance," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(7), pages 792-808, July.
    9. Thije van Barneveld, 2016. "The Minimum Expected Penalty Relocation Problem for the Computation of Compliance Tables for Ambulance Vehicles," INFORMS Journal on Computing, INFORMS, vol. 28(2), pages 370-384, May.
    10. Yossi Luzon & Opher Baron & Vedat Verter & Oded Berman, 2025. "On Designing a Fire Emergency Vehicle Fleet," Manufacturing & Service Operations Management, INFORMS, vol. 27(6), pages 1995-2015, November.
    11. Soovin Yoon & Laura A. Albert, 2018. "An expected coverage model with a cutoff priority queue," Health Care Management Science, Springer, vol. 21(4), pages 517-533, December.
    12. Ansari, Sardar & Yoon, Soovin & Albert, Laura A., 2017. "An approximate hypercube model for public service systems with co-located servers and multiple response," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 103(C), pages 143-157.
    13. Boyacı, Burak & Geroliminis, Nikolas, 2015. "Approximation methods for large-scale spatial queueing systems," Transportation Research Part B: Methodological, Elsevier, vol. 74(C), pages 151-181.
    14. Soovin Yoon & Laura A. Albert & Veronica M. White, 2021. "A Stochastic Programming Approach for Locating and Dispatching Two Types of Ambulances," Transportation Science, INFORMS, vol. 55(2), pages 275-296, March.
    15. Xueping Li & Zhaoxia Zhao & Xiaoyan Zhu & Tami Wyatt, 2011. "Covering models and optimization techniques for emergency response facility location and planning: a review," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 74(3), pages 281-310, December.
    16. Karpova, Yulia & Villa, Fulgencia & Vallada, Eva, 2025. "Realistic strategies for dynamic ambulance relocation," Socio-Economic Planning Sciences, Elsevier, vol. 101(C).
    17. Yoon, Soovin & Albert, Laura A., 2021. "Dynamic dispatch policies for emergency response with multiple types of vehicles," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 152(C).
    18. Carvalho, A.S. & Captivo, M.E. & Marques, I., 2020. "Integrating the ambulance dispatching and relocation problems to maximize system’s preparedness," European Journal of Operational Research, Elsevier, vol. 283(3), pages 1064-1080.
    19. Sorensen, Paul & Church, Richard, 2010. "Integrating expected coverage and local reliability for emergency medical services location problems," Socio-Economic Planning Sciences, Elsevier, vol. 44(1), pages 8-18, March.
    20. Nelas, José & Dias, Joana, 2020. "Optimal Emergency Vehicles Location: An approach considering the hierarchy and substitutability of resources," European Journal of Operational Research, Elsevier, vol. 287(2), pages 583-599.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormsom:v:26:y:2024:i:2:p:447-464. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.