IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v667y2025ics0378437125002134.html
   My bibliography  Save this article

Machine learning-enhanced dynamic path decisions for emergency stewards in emergency evacuations

Author

Listed:
  • Yang, Peng
  • Zhang, Bozheng
  • Shi, Kai
  • Hui, Yi

Abstract

In emergency situations such as indoor fires, emergency stewards can significantly influence the evacuation behavior of trapped individuals, and the rationality of their own path decisions is crucial to the overall evacuation effectiveness. This paper introduces an improved social force model to reflect the impact of stewards on the behavior of those in distress, and designs a decision-making framework based on simulation models and Deep Reinforcement Learning (DRL) technology to optimize the path decisions of stewards in dynamic scenarios. The simulation model is used to simulate various scenarios to obtain sufficient sample data; the role of DRL is to interact with the environment and dynamically guide individuals towards optimal paths using learned effective strategies. Within this framework, the decision training for emergency stewards employs a Modified Priority Experience Deep Q-Network (MPE-DQN), avoiding areas with high personnel density to optimize evacuation path decisions. The safety metric during the evacuation process is measured by personnel density per unit area, and evacuation time is chosen as the efficiency metric. Simulation experiments conducted in AnyLogic show that compared to the standard DQN algorithm, our framework, using the MPE-DQN algorithm, increased safety by 58.77 % and improved efficiency by 14.2 %.

Suggested Citation

  • Yang, Peng & Zhang, Bozheng & Shi, Kai & Hui, Yi, 2025. "Machine learning-enhanced dynamic path decisions for emergency stewards in emergency evacuations," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 667(C).
    • Handle: RePEc:eee:phsmap:v:667:y:2025:i:c:s0378437125002134
    DOI: 10.1016/j.physa.2025.130561
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437125002134
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000
    File URL: https://libkey.io/10.1016/j.physa.2025.130561?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Parisi, D.R. & Dorso, C.O., 2007. "Morphological and dynamical aspects of the room evacuation process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 385(1), pages 343-355.
    2. Yang, Xiaoxia & Dong, Hairong & Yao, Xiuming & Sun, Xubin & Wang, Qianling & Zhou, Min, 2016. "Necessity of guides in pedestrian emergency evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 442(C), pages 397-408.
    3. Abdelghany, Ahmed & Abdelghany, Khaled & Mahmassani, Hani & Alhalabi, Wael, 2014. "Modeling framework for optimal evacuation of large-scale crowded pedestrian facilities," European Journal of Operational Research, Elsevier, vol. 237(3), pages 1105-1118.
    4. Dirk Helbing & Illés Farkas & Tamás Vicsek, 2000. "Simulating dynamical features of escape panic," Nature, Nature, vol. 407(6803), pages 487-490, September.
    5. Zhang, Yihao & Chai, Zhaojie & Lykotrafitis, George, 2021. "Deep reinforcement learning with a particle dynamics environment applied to emergency evacuation of a room with obstacles," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 571(C).
    6. Said Salhi, 2014. "Handbook of Metaheuristics (2nd edition)," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(2), pages 320-320, February.
    7. Kirchner, Ansgar & Schadschneider, Andreas, 2002. "Simulation of evacuation processes using a bionics-inspired cellular automaton model for pedestrian dynamics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 312(1), pages 260-276.
    8. Parisi, D.R. & Dorso, C.O., 2005. "Microscopic dynamics of pedestrian evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 354(C), pages 606-618.
    9. Yang, Xiaoxia & Yang, Xiaoli & Wang, Qianling & Kang, Yuanlei & Pan, Fuquan, 2020. "Guide optimization in pedestrian emergency evacuation," Applied Mathematics and Computation, Elsevier, vol. 365(C).
    10. Gao, Fengqiang & Yan, Yuyue & Chen, Zhihao & Zheng, Linxiao & Ren, Huan, 2022. "Effect of density control in partially observable asymmetric-exit evacuation under guidance: Strategic suggestion under time delay," Applied Mathematics and Computation, Elsevier, vol. 418(C).
    11. Zheng, Ying & Jia, Bin & Li, Xin-Gang & Zhu, Nuo, 2011. "Evacuation dynamics with fire spreading based on cellular automaton," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(18), pages 3147-3156.
    12. Guo, Xiwei & Chen, Jianqiao & Zheng, Yaochen & Wei, Junhong, 2012. "A heterogeneous lattice gas model for simulating pedestrian evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(3), pages 582-592.
    13. Yamamoto, Kazuhiro & Kokubo, Satoshi & Nishinari, Katsuhiro, 2007. "Simulation for pedestrian dynamics by real-coded cellular automata (RCA)," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 379(2), pages 654-660.
    14. Ma, Yi & Yuen, Richard Kwok Kit & Lee, Eric Wai Ming, 2016. "Effective leadership for crowd evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 450(C), pages 333-341.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Qian, 2018. "A social force model for the crowd evacuation in a terrorist attack," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 502(C), pages 315-330.
    2. Hou, Lei & Liu, Jian-Guo & Pan, Xue & Wang, Bing-Hong, 2014. "A social force evacuation model with the leadership effect," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 400(C), pages 93-99.
    3. Sticco, I.M. & Frank, G.A. & Cerrotta, S. & Dorso, C.O., 2017. "Room evacuation through two contiguous exits," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 474(C), pages 172-185.
    4. Yu Song & Jia Liu & Qian Liu, 2021. "Dynamic Decision-Making Process of Evacuees during Post-Earthquake Evacuation near an Automatic Flap Barrier Gate System: A Broken Windows Perspective," Sustainability, MDPI, vol. 13(16), pages 1-19, August.
    5. Zhao, Ruifeng & Zhai, Yue & Qu, Lu & Wang, Ruhao & Huang, Yaoying & Dong, Qi, 2021. "A continuous floor field cellular automata model with interaction area for crowd evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 575(C).
    6. Liu, Qian, 2018. "The effect of dedicated exit on the evacuation of heterogeneous pedestrians," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 506(C), pages 305-323.
    7. Yanyan Niu & Jia Yu & Dawei Lu & Renwu Mu & Jiahong Wen, 2022. "Spatial Allocation Method of Evacuation Guiders in Urban Open Public Spaces: A Case Study of Binjiang Green Space in Xuhui District, Shanghai, China," IJERPH, MDPI, vol. 19(19), pages 1-25, September.
    8. Huang, Keke & Zheng, Xiaoping & Cheng, Yuan & Yang, Yeqing, 2017. "Behavior-based cellular automaton model for pedestrian dynamics," Applied Mathematics and Computation, Elsevier, vol. 292(C), pages 417-424.
    9. Ma, Yi & Yuen, Richard Kwok Kit & Lee, Eric Wai Ming, 2016. "Effective leadership for crowd evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 450(C), pages 333-341.
    10. Zheng, Ying & Li, Xingang & Zhu, Nuo & Jia, Bin & Jiang, Rui, 2018. "Evacuation dynamics with smoking diffusion in three dimension based on an extended Floor-Field model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 507(C), pages 414-426.
    11. Gao, Fengqiang & Yan, Yuyue & Chen, Zhihao & Zheng, Linxiao & Ren, Huan, 2022. "Effect of density control in partially observable asymmetric-exit evacuation under guidance: Strategic suggestion under time delay," Applied Mathematics and Computation, Elsevier, vol. 418(C).
    12. Miyagawa, Daiki & Ichinose, Genki, 2020. "Cellular automaton model with turning behavior in crowd evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 549(C).
    13. Zheng, Xiaoping & Cheng, Yuan, 2011. "Conflict game in evacuation process: A study combining Cellular Automata model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(6), pages 1042-1050.
    14. Li, Jun & Fu, Siyao & He, Haibo & Jia, Hongfei & Li, Yanzhong & Guo, Yi, 2015. "Simulating large-scale pedestrian movement using CA and event driven model: Methodology and case study," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 437(C), pages 304-321.
    15. Zheng, Xiaoping & Li, Wei & Guan, Chao, 2010. "Simulation of evacuation processes in a square with a partition wall using a cellular automaton model for pedestrian dynamics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(11), pages 2177-2188.
    16. Li, Shuang & Yu, Xiaohui & Zhang, Yanjuan & Zhai, Changhai, 2018. "A numerical simulation strategy on occupant evacuation behaviors and casualty prediction in a building during earthquakes," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 1238-1250.
    17. Chen, Chang-Kun & Li, Jian & Zhang, Dong, 2012. "Study on evacuation behaviors at a T-shaped intersection by a force-driving cellular automata model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(7), pages 2408-2420.
    18. Zhao, Yongxiang & Li, Meifang & Lu, Xin & Tian, Lijun & Yu, Zhiyong & Huang, Kai & Wang, Yana & Li, Ting, 2017. "Optimal layout design of obstacles for panic evacuation using differential evolution," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 175-194.
    19. Cirillo, Emilio N.M. & Muntean, Adrian, 2013. "Dynamics of pedestrians in regions with no visibility— A lattice model without exclusion," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(17), pages 3578-3588.
    20. Zheng, Ying & Jia, Bin & Li, Xin-Gang & Zhu, Nuo, 2011. "Evacuation dynamics with fire spreading based on cellular automaton," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(18), pages 3147-3156.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:667:y:2025:i:c:s0378437125002134. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.