IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v406y2026ics0306261925019488.html

SMART-EV: a stochastic macroscopic DRL-based method for enhancing distribution network resilience via EV coordination

Author

Listed:
  • Lian, Xianglong
  • Qiu, Lei
  • Liu, Weiming
  • Jiang, Yiqing
  • Song, Chenkai
  • Liu, Lijun
  • Tang, Wenhu

Abstract

The increasing penetration of electric vehicles (EVs) provides unprecedented flexibility for enhancing the resilience of distribution networks under extreme events. However, the inherent stochasticity in EV mobility and the need for real-time coordination with power system operations present significant challenges for disaster restoration. To address these challenges, this paper proposes a novel stochastic macroscopic adaptive resilience-trained EV (SMART-EV) method. Firstly, a stochastic macroscopic mobility model is developed to describe the random movement of EVs in a two-dimensional plane, enabling more realistic yet tractable modeling of large-scale fleet dynamics. Subsequently, the proposed SMART-EV achieves adaptive learning-driven physical systems by integrating deep reinforcement learning (DRL)-based decision-making of EV mobility and physical-layer grid operation. Finally, an improved deep deterministic policy gradient (DDPG) algorithm is introduced, which explicitly optimizes grid resilience objectives, accelerates convergence, and enhances training stability through auxiliary Nash-style (AuxiNash) multi-objective regularization. Case studies in IEEE 33-bus system demonstrate that the proposed SMART-EV method achieves in a 17.9 % increase in the resilience index and substantial reductions in computational effort.

Suggested Citation

  • Lian, Xianglong & Qiu, Lei & Liu, Weiming & Jiang, Yiqing & Song, Chenkai & Liu, Lijun & Tang, Wenhu, 2026. "SMART-EV: a stochastic macroscopic DRL-based method for enhancing distribution network resilience via EV coordination," Applied Energy, Elsevier, vol. 406(C).
  • Handle: RePEc:eee:appene:v:406:y:2026:i:c:s0306261925019488
    DOI: 10.1016/j.apenergy.2025.127218
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925019488
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.127218?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Shen, Yueqing & Qian, Tong & Li, Weiwei & Zhao, Wei & Tang, Wenhu & Chen, Xingyu & Yu, Zeyuan, 2023. "Mobile energy storage systems with spatial–temporal flexibility for post-disaster recovery of power distribution systems: A bilevel optimization approach," Energy, Elsevier, vol. 282(C).
    2. An, Sihai & Qiu, Jing & Lin, Jiafeng & Yao, Zongyu & Liang, Qijun & Lu, Xin, 2025. "Planning of a multi-agent mobile robot-based adaptive charging network for enhancing power system resilience under extreme conditions," Applied Energy, Elsevier, vol. 395(C).
    3. Babu, K. Victor Sam Moses & Dwivedi, Divyanshi & Chakraborty, Pratyush & Yemula, Pradeep Kumar & Pal, Mayukha, 2025. "A comprehensive review on resilience definitions, frameworks, metrics, and enhancement strategies in electrical distribution systems," Applied Energy, Elsevier, vol. 394(C).
    4. Qiu, Dawei & Wang, Yi & Hua, Weiqi & Strbac, Goran, 2023. "Reinforcement learning for electric vehicle applications in power systems:A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 173(C).
    5. Liu, Shanshan & Vlachokostas, Alex & Kontou, Eleftheria, 2025. "Leveraging electric vehicles as a resiliency solution for residential backup power during outages," Energy, Elsevier, vol. 318(C).
    6. Sun, Shaohua & Li, Gengfeng & Yang, Qiming & Bie, Zhaohong, 2024. "Co-optimize recovery modeling for transportation and power network with multi-type mobile resources dispatching," Applied Energy, Elsevier, vol. 366(C).
    7. Hussain, Akhtar & Kazemi, Nazli & Musilek, Petr, 2025. "Clustering-based EV suitability analysis for grid support services," Energy, Elsevier, vol. 320(C).
    8. Wu, Juai & Zhang, Mengying & Xu, Tianheng & Gu, Duan & Xie, Dongliang & Zhang, Tengfei & Hu, Honglin & Zhou, Ting, 2023. "A review of key technologies in relation to large-scale clusters of electric vehicles supporting a new power system," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    9. Wu, Hongbin & Lan, Xinjie & He, Ye & Wu, Andrew Y. & Ding, Ming, 2025. "Orderly charging of electric vehicles: A two-stage spatial-temporal scheduling method based on user-personalized navigation," Applied Energy, Elsevier, vol. 378(PA).
    10. Kumar, Roshan & De, Mala, 2025. "Advancement in power system resilience through deep reinforcement learning: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 222(C).
    11. Zhao, Ruoxuan & Yang, Qiming & Li, Gengfeng & Liu, Dafu & Ji, Chenlin & Bian, Yiheng & Bie, Zhaohong, 2025. "Interaction strategy for grid-hydrogen-vehicle system in extreme heat scenarios: Hybrid system dynamics and Bilevel optimization approach," Applied Energy, Elsevier, vol. 391(C).
    12. Qiu, Dawei & Wang, Yi & Sun, Mingyang & Strbac, Goran, 2022. "Multi-service provision for electric vehicles in power-transportation networks towards a low-carbon transition: A hierarchical and hybrid multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 313(C).
    13. Lian, Xianglong & Song, Chenkai & Li, Zepeng & Qiu, Lei & Liu, Lijun, 2026. "Resilience-oriented emergency resource dispatch for power–transportation coupled networks under rainstorm-induced flood hazards," Applied Energy, Elsevier, vol. 403(PA).
    14. Rehman, Anis Ur & Ullah, Zia & Qazi, Hasan Saeed & Hasanien, Hany M. & Khalid, Haris M., 2024. "Reinforcement learning-driven proximal policy optimization-based voltage control for PV and WT integrated power system," Renewable Energy, Elsevier, vol. 227(C).
    15. Dong, Qianyu & Zhou, Guanyu & Huang, Qilin & Dong, Zhaoyang & Jia, Youwei, 2025. "Resilience enhancement for power distribution networks in coordination with electric vehicle fleets," Applied Energy, Elsevier, vol. 390(C).
    16. Heuberger, Clara F. & Bains, Praveen K. & Mac Dowell, Niall, 2020. "The EV-olution of the power system: A spatio-temporal optimisation model to investigate the impact of electric vehicle deployment," Applied Energy, Elsevier, vol. 257(C).
    17. Lin, Jiafeng & Qiu, Jing & Yang, Yi & Sun, Xianzhuo & Lu, Xin & Yuan, Zhe, 2025. "Data integrity attack resilience for electric vehicle charging management centers in distributed optimal power flow with non-ideal Li-ion battery models," Applied Energy, Elsevier, vol. 391(C).
    18. Lee, Wonjong & Woo, JongRoul & Kim, Yong-gun & Koo, Yoonmo, 2024. "Vehicle-to-grid as a competitive alternative to energy storage in a renewable-dominant power system: An integrated approach considering both electric vehicle drivers' willingness and effectiveness," Energy, Elsevier, vol. 310(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lian, Xianglong & Song, Chenkai & Li, Zepeng & Qiu, Lei & Liu, Lijun, 2026. "Resilience-oriented emergency resource dispatch for power–transportation coupled networks under rainstorm-induced flood hazards," Applied Energy, Elsevier, vol. 403(PA).
    2. Wan, Yuyang & Wang, Ning & Du, Ershun & Liu, Xueshan & Wang, Yanbo & Chen, Zhe & Kang, Chongqing, 2025. "Coordinated operation of alternative fuel vehicle-integrated microgrid in a coupled power-transportation network: a Stackelberg–Nash game framework," Applied Energy, Elsevier, vol. 401(PC).
    3. Wang, Shixin & Lu, Qing-Chang & Liu, Liping & Xu, Peng-Cheng & Wang, Rundong & Zhang, Lei, 2026. "Interdependency analysis of coupled power and transportation networks considering the charging decision preferences of EV drivers," Reliability Engineering and System Safety, Elsevier, vol. 268(C).
    4. Yang, Meng & Chen, Yue & Huang, Shihan & Chen, Laijun, 2025. "Recent advances in coordination and optimization of power-transportation systems: An overview," Renewable and Sustainable Energy Reviews, Elsevier, vol. 220(C).
    5. Sun, Shaohua & Li, Gengfeng & Bie, Zhaohong & Zhang, Dingmao & Huang, Yuxiong, 2025. "Hybrid multi-agent deep reinforcement learning for multi-type mobile resources dispatching under transportation and power network recovery," Applied Energy, Elsevier, vol. 399(C).
    6. Su, Chutian & Wang, Yi & Strbac, Goran, 2025. "Coordinated electric vehicles dispatch for multi-service provisions: A comprehensive review of modelling and coordination approaches," Renewable and Sustainable Energy Reviews, Elsevier, vol. 223(C).
    7. Chuan Long & Xinting Yang & Yunche Su & Fang Liu & Ruiguang Ma & Tiannan Ma & Yangjin Wu & Xiaodong Shen, 2025. "Air Conditioning Load Forecasting for Geographical Grids Using Deep Reinforcement Learning and Density-Based Spatial Clustering of Applications with Noise and Graph Attention Networks," Energies, MDPI, vol. 18(11), pages 1-19, May.
    8. Vassilis M. Charitopoulos & Mathilde Fajardy & Chi Kong Chyong & David M. Reiner, 2022. "The case of 100% electrification of domestic heat in Great Britain," Working Papers EPRG2206, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    9. Chen, Yin & Chen, Yinyu & Zhou, Yue & Gan, Wei & Chen, Minwu & Chen, Xia, 2025. "Robust energy management of electrified railway traction substation providing secondary frequency regulation," Energy, Elsevier, vol. 335(C).
    10. Liu, Shan & Yan, Jie & Yan, Yamin & Zhang, Haoran & Zhang, Jing & Liu, Yongqian & Han, Shuang, 2024. "Joint operation of mobile battery, power system, and transportation system for improving the renewable energy penetration rate," Applied Energy, Elsevier, vol. 357(C).
    11. Zhang, Cong & Greenblatt, Jeffery B. & MacDougall, Pamela & Saxena, Samveg & Jayam Prabhakar, Aditya, 2020. "Quantifying the benefits of electric vehicles on the future electricity grid in the midwestern United States," Applied Energy, Elsevier, vol. 270(C).
    12. Abdolrasol, Maher G.M. & Hannan, M.A. & Tiong, S.K. & Ansari, Shaheer & Hamoudi, Yanis & Ker, Pin Jern & Hossain, M.J., 2025. "Vehicle-to-grid energy technologies: Patent landscape analysis, technical updates and innovations towards sustainable transportation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 224(C).
    13. Li, Yujing & Zhang, Zhisheng & Xing, Qiang, 2025. "Real-time online charging control of electric vehicle charging station based on a multi-agent deep reinforcement learning," Energy, Elsevier, vol. 319(C).
    14. Wang, Wenwei & Zhao, Wentao & Zhou, Xingyu & Zhang, Xinyong & Wu, Wentao & Liu, Manyu, 2025. "Deep learning-aided stochastic integrated optimization of highway service area renewable energy systems adopting a novel topology," Energy, Elsevier, vol. 338(C).
    15. Muhammed Cavus & Huseyin Ayan & Mahmut Sari & Osman Akbulut & Dilum Dissanayake & Margaret Bell, 2025. "Enhancing Smart Grid Reliability Through Data-Driven Optimisation and Cyber-Resilient EV Integration," Energies, MDPI, vol. 18(17), pages 1-24, August.
    16. Junyu Liang & Jun Zhou & Xingyu Yuan & Wei Huang & Xinyong Gong & Guipeng Zhang, 2024. "An Active Distribution Network Voltage Optimization Method Based on Source-Network-Load-Storage Coordination and Interaction," Energies, MDPI, vol. 17(18), pages 1-18, September.
    17. Fang, Qiuyang & Zhang, Chunyan & Wang, Chen & Xie, Guangming & Zhang, Jianlei, 2026. "Game-based scheduling of mobile charging robots for electric vehicle charging: A relay-like scheme," Applied Energy, Elsevier, vol. 402(PB).
    18. Dai, Yi & Liu, Xiaochen & Liu, Shuo & Zhang, Ji & Chen, Qi & Liu, Xiaohua & Zhang, Tao, 2026. "Assessment on electric vehicle dispatch-based demand-side energy storage requirement reduction via spectral decomposition," Applied Energy, Elsevier, vol. 402(PB).
    19. Hongdang Zhang & Hongtu Yang & Fengjiao Zhang & Xuhui Liao & Yanyan Zuo, 2025. "Research on Mode Transition Control of Power-Split Hybrid Electric Vehicle Based on Fixed Time," Energies, MDPI, vol. 18(16), pages 1-23, August.
    20. Strobel, Leo & Schlund, Jonas & Pruckner, Marco, 2022. "Joint analysis of regional and national power system impacts of electric vehicles—A case study for Germany on the county level in 2030," Applied Energy, Elsevier, vol. 315(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:406:y:2026:i:c:s0306261925019488. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.