IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v404y2026ics0306261925018276.html

Enhancing resilience of electric vehicle charging management in hydrogen–electric coupled distribution networks: A risk-characterization multi-agent reinforcement learning approach

Author

Listed:
  • Xie, Hongbin
  • Zhang, Haoran
  • Song, Ge
  • Zhang, Jingyuan
  • Fu, Hongdi
  • Zhang, Liyu
  • Chen, Nianru
  • Song, Xuan

Abstract

With the rapid growth of electric vehicle (EV) ownership, the deep integration of power grids, renewable energy, and transportation systems has led to the emergence of highly coupled hydrogen–electric distributed networks. In this complex environment of multi-energy coordinated operation, EV charging management systems face not only supply–demand imbalances caused by renewable fluctuations but also multiple external risks such as extreme weather, natural disasters, and cyberattacks, which impose higher demands on system resilience. To address the limitations of existing studies—most of which focus on steady-state or small-disturbance scenarios and lack coordinated optimization strategies for extreme events and uncertainties—this paper proposes a centralized training and decentralized execution (CTDE) multi-agent reinforcement learning framework integrated with a risk characterization mechanism. The framework builds a dynamic simulation environment integrating EV charging facilities and hydrogen–electric hybrid energy storage systems, and introduces diffusion models to enrich the distribution of risk features in training data, thereby improving the perception and identification of rare and extreme risk events. An attention-based information filtering module and a low-frequency, high-efficiency communication strategy are designed to reduce communication costs and latency while enhancing coordination efficiency among agents in high-dimensional, long-horizon scenarios. Experimental results, evaluated on multi-dimensional resilience indicators including risk loss, response capability, and overall system resilience, demonstrate that the proposed method outperforms other reinforcement learning algorithms in enhancing resilience, reducing operational costs, and improving cross-scenario generalization. The diffusion model also shows strong adaptability to extreme risk disturbances. The proposed algorithm achieves an average reduction of approximately 27.8 % in operational cost compared to the best-performing baseline across all test scenarios and disturbance levels. This result is obtained from repeated trials and averaged outcomes, covering a wide range of risk types and intensities, and demonstrates high statistical reliability.

Suggested Citation

  • Xie, Hongbin & Zhang, Haoran & Song, Ge & Zhang, Jingyuan & Fu, Hongdi & Zhang, Liyu & Chen, Nianru & Song, Xuan, 2026. "Enhancing resilience of electric vehicle charging management in hydrogen–electric coupled distribution networks: A risk-characterization multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 404(C).
  • Handle: RePEc:eee:appene:v:404:y:2026:i:c:s0306261925018276
    DOI: 10.1016/j.apenergy.2025.127097
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925018276
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.127097?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Prabawa, Panggah & Choi, Dae-Hyun, 2024. "Safe deep reinforcement learning-assisted two-stage energy management for active power distribution networks with hydrogen fueling stations," Applied Energy, Elsevier, vol. 375(C).
    2. Jingzhe Hu & Xu Wang & Shengmin Tan, 2024. "Electric Vehicle Integration in Coupled Power Distribution and Transportation Networks: A Review," Energies, MDPI, vol. 17(19), pages 1-20, September.
    3. Mancarella, Pierluigi, 2014. "MES (multi-energy systems): An overview of concepts and evaluation models," Energy, Elsevier, vol. 65(C), pages 1-17.
    4. Wang, Yi & Qiu, Dawei & Strbac, Goran, 2022. "Multi-agent deep reinforcement learning for resilience-driven routing and scheduling of mobile energy storage systems," Applied Energy, Elsevier, vol. 310(C).
    5. Tang, Daogui & Ge, Pingxu & Yuan, Chengqing & Ren, Haidong & Zhong, Xiaohui & Dong, Mingwang & Agundis-Tinajero, Gibran David & Diaz-Londono, Cesar & Guerrero, Josep M. & Zio, Enrico, 2025. "Optimal management of coupled hydrogen-electricity energy systems at ports by multi-time scale scheduling," Applied Energy, Elsevier, vol. 391(C).
    6. Virdi, Parmit S. & Guo, Wei & Cattafesta, Louis N. & Cheetham, Peter & Cooley, Lance & Gladin, Jonathan C. & He, Jiangbiao & Kim, Chul & Li, Hui & Ordonez, Juan & Pamidi, Sastry & Zheng, Jian-Ping, 2025. "Liquid hydrogen storage, thermal management, and transfer-control system for integrated zero emission aviation (IZEA)," Applied Energy, Elsevier, vol. 393(C).
    7. Wu, Haochi & Qiu, Dawei & Zhang, Liyu & Sun, Mingyang, 2024. "Adaptive multi-agent reinforcement learning for flexible resource management in a virtual power plant with dynamic participating multi-energy buildings," Applied Energy, Elsevier, vol. 374(C).
    8. Yan, Yamin & Wang, Yumeng & Yan, Jie & Zhang, Haoran & Shang, Wenlong, 2024. "Wind electricity‑hydrogen-natural gas coupling: An integrated optimization approach for enhancing wind energy accommodation and carbon reduction," Applied Energy, Elsevier, vol. 369(C).
    9. Hengrui Ma & Bo Wang & Wenzhong Gao & Dichen Liu & Yong Sun & Zhijun Liu, 2018. "Optimal Scheduling of an Regional Integrated Energy System with Energy Storage Systems for Service Regulation," Energies, MDPI, vol. 11(1), pages 1-19, January.
    10. Norouzi, Mohammadali & Mohammadi-Ivatloo, Behnam & Aghaei, Jamshid & Alipour, Mohammadali & Ghorbani, Reza, 2025. "Three-layer resilience-aware scheduling framework in a hydrogen-integrated distribution network considering fuel cell electric vehicles," Energy, Elsevier, vol. 334(C).
    11. Masoumeh Sharifpour & Mohammad Taghi Ameli & Hossein Ameli & Goran Strbac, 2023. "A Resilience-Oriented Approach for Microgrid Energy Management with Hydrogen Integration during Extreme Events," Energies, MDPI, vol. 16(24), pages 1-18, December.
    12. Qi, Ning & Huang, Kaidi & Fan, Zhiyuan & Xu, Bolun, 2025. "Long-term energy management for microgrid with hybrid hydrogen-battery energy storage: A prediction-free coordinated optimization framework," Applied Energy, Elsevier, vol. 377(PB).
    13. Sun, Qirun & Wu, Zhi & Ma, Zhoujun & Gu, Wei & Zhang, Xiao-Ping & Lu, Yuping & Liu, Pengxiang, 2022. "Resilience enhancement strategy for multi-energy systems considering multi-stage recovery process and multi-energy coordination," Energy, Elsevier, vol. 241(C).
    14. Ge, Pingxu & Tang, Daogui & Yuan, Yuji & Guerrero, Josep M. & Zio, Enrico, 2025. "A hierarchical multi-objective co-optimization framework for sizing and energy management of coupled hydrogen-electricity energy storage systems at ports," Applied Energy, Elsevier, vol. 384(C).
    15. Kapil Deshpande & Philipp Möhl & Alexander Hämmerle & Georg Weichhart & Helmut Zörrer & Andreas Pichler, 2022. "Energy Management Simulation with Multi-Agent Reinforcement Learning: An Approach to Achieve Reliability and Resilience," Energies, MDPI, vol. 15(19), pages 1-35, October.
    16. Jiang, Kangrui & Tian, Zhongbei & Wen, Tao & Song, Kejian & Hillmansen, Stuart & Ochieng, Washington Yotto, 2025. "Collaborative optimization strategy of hydrogen fuel cell train energy and thermal management system based on deep reinforcement learning," Applied Energy, Elsevier, vol. 393(C).
    17. Qiu, Rui & Zhang, Haoran & Wang, Guotao & Liang, Yongtu & Yan, Jinyue, 2023. "Green hydrogen-based energy storage service via power-to-gas technologies integrated with multi-energy microgrid," Applied Energy, Elsevier, vol. 350(C).
    18. Xu, Guimin & Yang, Zhengxiang, 2025. "Risk-aware low carbon optimization of hydrogen-oriented multi-energy system with linear approximation of bi-product fuel cell," Energy, Elsevier, vol. 334(C).
    19. Olatomiwa, Lanre & Mekhilef, Saad & Ismail, M.S. & Moghavvemi, M., 2016. "Energy management strategies in hybrid renewable energy systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 62(C), pages 821-835.
    20. Eriksson, E.L.V. & Gray, E.MacA., 2017. "Optimization and integration of hybrid renewable energy hydrogen fuel cell energy systems – A critical review," Applied Energy, Elsevier, vol. 202(C), pages 348-364.
    21. Yang, Zhixue & Ren, Zhouyang & Li, Hui & Sun, Zhiyuan & Feng, Jianbing & Xia, Weiyi, 2024. "A multi-stage stochastic dispatching method for electricity‑hydrogen integrated energy systems driven by model and data," Applied Energy, Elsevier, vol. 371(C).
    22. Chen, Haoqian & Sui, Yi & Shang, Wen-long & Sun, Rencheng & Chen, Zhiheng & Wang, Changying & Han, Chunjia & Zhang, Yuqian & Zhang, Haoran, 2022. "Towards renewable public transport: Mining the performance of electric buses using solar-radiation as an auxiliary power source," Applied Energy, Elsevier, vol. 325(C).
    23. Huy, Truong Hoang Bao & Duy, Nguyen Thanh Minh & Phu, Pham Van & Le, Tien-Dat & Park, Seongkeun & Kim, Daehee, 2024. "Robust real-time energy management for a hydrogen refueling station using generative adversarial imitation learning," Applied Energy, Elsevier, vol. 373(C).
    24. Si, Ruiqi & Chen, Siyuan & Zhang, Jun & Xu, Jian & Zhang, Luxi, 2024. "A multi-agent reinforcement learning method for distribution system restoration considering dynamic network reconfiguration," Applied Energy, Elsevier, vol. 372(C).
    25. Guelpa, Elisa & Bischi, Aldo & Verda, Vittorio & Chertkov, Michael & Lund, Henrik, 2019. "Towards future infrastructures for sustainable multi-energy systems: A review," Energy, Elsevier, vol. 184(C), pages 2-21.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Muhammad Ikram & Daryoush Habibi & Asma Aziz, 2025. "Networked Multi-Agent Deep Reinforcement Learning Framework for the Provision of Ancillary Services in Hybrid Power Plants," Energies, MDPI, vol. 18(10), pages 1-34, May.
    2. Bizon, Nicu, 2019. "Real-time optimization strategies of Fuel Cell Hybrid Power Systems based on Load-following control: A new strategy, and a comparative study of topologies and fuel economy obtained," Applied Energy, Elsevier, vol. 241(C), pages 444-460.
    3. Bizon, Nicu, 2019. "Efficient fuel economy strategies for the Fuel Cell Hybrid Power Systems under variable renewable/load power profile," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    4. Fridgen, Gilbert & Keller, Robert & Körner, Marc-Fabian & Schöpf, Michael, 2020. "A holistic view on sector coupling," Energy Policy, Elsevier, vol. 147(C).
    5. Laura Canale & Anna Rita Di Fazio & Mario Russo & Andrea Frattolillo & Marco Dell’Isola, 2021. "An Overview on Functional Integration of Hybrid Renewable Energy Systems in Multi-Energy Buildings," Energies, MDPI, vol. 14(4), pages 1-33, February.
    6. Tian, Zhaoming & Cao, Xiaoyu & Zeng, Bo & Guan, Xiaohong, 2025. "Adaptive infinite-horizon control of hybrid EV/FCEV charging hubs: A large-model based deep reinforcement learning approach," Applied Energy, Elsevier, vol. 390(C).
    7. Berjawi, A.E.H. & Walker, S.L. & Patsios, C. & Hosseini, S.H.R., 2021. "An evaluation framework for future integrated energy systems: A whole energy systems approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 145(C).
    8. Jolando M. Kisse & Martin Braun & Simon Letzgus & Tanja M. Kneiske, 2020. "A GIS-Based Planning Approach for Urban Power and Natural Gas Distribution Grids with Different Heat Pump Scenarios," Energies, MDPI, vol. 13(16), pages 1-31, August.
    9. Feng, Jianbing & Ren, Zhouyang & Li, Wenyuan, 2025. "A robust safe reinforcement learning-based operation method for hybrid electric-hydrogen energy system risk-based dispatch considering dynamic efficiency characteristics of electrolysers," Renewable Energy, Elsevier, vol. 254(C).
    10. Saletti, Costanza & Morini, Mirko & Gambarotta, Agostino, 2022. "Smart management of integrated energy systems through co-optimization with long and short horizons," Energy, Elsevier, vol. 250(C).
    11. Calise, Francesco & Macaluso, Adriano & Piacentino, Antonio & Vanoli, Laura, 2017. "A novel hybrid polygeneration system supplying energy and desalinated water by renewable sources in Pantelleria Island," Energy, Elsevier, vol. 137(C), pages 1086-1106.
    12. Danko Vidović & Elis Sutlović & Matislav Majstrović, 2021. "A Unique Electrical Model for the Steady-State Analysis of a Multi-Energy System," Energies, MDPI, vol. 14(18), pages 1-23, September.
    13. He, Junqiang & Zhao, Haiyan & Yin, Jingyuan & Shi, Changli, 2026. "A hierarchical game-based price-demand-energy hub operation coordinated optimization strategy for near-carbon-neutral hydrogen industrial parks," Renewable Energy, Elsevier, vol. 258(C).
    14. Suyang Zhou & Di He & Zhiyang Zhang & Zhi Wu & Wei Gu & Junjie Li & Zhe Li & Gaoxiang Wu, 2019. "A Data-Driven Scheduling Approach for Hydrogen Penetrated Energy System Using LSTM Network," Sustainability, MDPI, vol. 11(23), pages 1-18, November.
    15. Cao, Yan & Xu, Yan, 2025. "Secure operation of a multi-energy system: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 211(C).
    16. Xia, Tian & Huang, Wujing & Lu, Xi & Zhang, Ning & Kang, Chongqing, 2020. "Planning district multiple energy systems considering year-round operation," Energy, Elsevier, vol. 213(C).
    17. Mahmud, Sakib & Sayed, Aya Nabil & Himeur, Yassine & Nhlabatsi, Armstrong & Bensaali, Faycal, 2026. "A comprehensive review of deep reinforcement learning applications from centralized power generation to modern energy internet frameworks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PE).
    18. Nicu Bizon & Mihai Oproescu, 2018. "Experimental Comparison of Three Real-Time Optimization Strategies Applied to Renewable/FC-Based Hybrid Power Systems Based on Load-Following Control," Energies, MDPI, vol. 11(12), pages 1-32, December.
    19. Ruiqiu Yao & Yukun Hu & Liz Varga, 2023. "Applications of Agent-Based Methods in Multi-Energy Systems—A Systematic Literature Review," Energies, MDPI, vol. 16(5), pages 1-36, March.
    20. Raheli, Enrica & Wu, Qiuwei & Zhang, Menglin & Wen, Changyun, 2021. "Optimal coordinated operation of integrated natural gas and electric power systems: A review of modeling and solution methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 145(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:404:y:2026:i:c:s0306261925018276. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.