IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v406y2026ics0306261925019488.html

SMART-EV: a stochastic macroscopic DRL-based method for enhancing distribution network resilience via EV coordination

Author

Listed:
  • Lian, Xianglong
  • Qiu, Lei
  • Liu, Weiming
  • Jiang, Yiqing
  • Song, Chenkai
  • Liu, Lijun
  • Tang, Wenhu

Abstract

The increasing penetration of electric vehicles (EVs) provides unprecedented flexibility for enhancing the resilience of distribution networks under extreme events. However, the inherent stochasticity in EV mobility and the need for real-time coordination with power system operations present significant challenges for disaster restoration. To address these challenges, this paper proposes a novel stochastic macroscopic adaptive resilience-trained EV (SMART-EV) method. Firstly, a stochastic macroscopic mobility model is developed to describe the random movement of EVs in a two-dimensional plane, enabling more realistic yet tractable modeling of large-scale fleet dynamics. Subsequently, the proposed SMART-EV achieves adaptive learning-driven physical systems by integrating deep reinforcement learning (DRL)-based decision-making of EV mobility and physical-layer grid operation. Finally, an improved deep deterministic policy gradient (DDPG) algorithm is introduced, which explicitly optimizes grid resilience objectives, accelerates convergence, and enhances training stability through auxiliary Nash-style (AuxiNash) multi-objective regularization. Case studies in IEEE 33-bus system demonstrate that the proposed SMART-EV method achieves in a 17.9 % increase in the resilience index and substantial reductions in computational effort.

Suggested Citation

  • Lian, Xianglong & Qiu, Lei & Liu, Weiming & Jiang, Yiqing & Song, Chenkai & Liu, Lijun & Tang, Wenhu, 2026. "SMART-EV: a stochastic macroscopic DRL-based method for enhancing distribution network resilience via EV coordination," Applied Energy, Elsevier, vol. 406(C).
  • Handle: RePEc:eee:appene:v:406:y:2026:i:c:s0306261925019488
    DOI: 10.1016/j.apenergy.2025.127218
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925019488
    Download Restriction: Full text may be restricted for ScienceDirect subscribers

    File URL: https://libkey.io/10.1016/j.apenergy.2025.127218?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Shen, Yueqing & Qian, Tong & Li, Weiwei & Zhao, Wei & Tang, Wenhu & Chen, Xingyu & Yu, Zeyuan, 2023. "Mobile energy storage systems with spatial–temporal flexibility for post-disaster recovery of power distribution systems: A bilevel optimization approach," Energy, Elsevier, vol. 282(C).
    2. Babu, K. Victor Sam Moses & Dwivedi, Divyanshi & Chakraborty, Pratyush & Yemula, Pradeep Kumar & Pal, Mayukha, 2025. "A comprehensive review on resilience definitions, frameworks, metrics, and enhancement strategies in electrical distribution systems," Applied Energy, Elsevier, vol. 394(C).
    3. Qiu, Dawei & Wang, Yi & Hua, Weiqi & Strbac, Goran, 2023. "Reinforcement learning for electric vehicle applications in power systems:A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 173(C).
    4. Sun, Shaohua & Li, Gengfeng & Yang, Qiming & Bie, Zhaohong, 2024. "Co-optimize recovery modeling for transportation and power network with multi-type mobile resources dispatching," Applied Energy, Elsevier, vol. 366(C).
    5. Hussain, Akhtar & Kazemi, Nazli & Musilek, Petr, 2025. "Clustering-based EV suitability analysis for grid support services," Energy, Elsevier, vol. 320(C).
    6. Wu, Juai & Zhang, Mengying & Xu, Tianheng & Gu, Duan & Xie, Dongliang & Zhang, Tengfei & Hu, Honglin & Zhou, Ting, 2023. "A review of key technologies in relation to large-scale clusters of electric vehicles supporting a new power system," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    7. Kumar, Roshan & De, Mala, 2025. "Advancement in power system resilience through deep reinforcement learning: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 222(C).
    8. Qiu, Dawei & Wang, Yi & Sun, Mingyang & Strbac, Goran, 2022. "Multi-service provision for electric vehicles in power-transportation networks towards a low-carbon transition: A hierarchical and hybrid multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 313(C).
    9. Lian, Xianglong & Song, Chenkai & Li, Zepeng & Qiu, Lei & Liu, Lijun, 2026. "Resilience-oriented emergency resource dispatch for power–transportation coupled networks under rainstorm-induced flood hazards," Applied Energy, Elsevier, vol. 403(PA).
    10. Rehman, Anis Ur & Ullah, Zia & Qazi, Hasan Saeed & Hasanien, Hany M. & Khalid, Haris M., 2024. "Reinforcement learning-driven proximal policy optimization-based voltage control for PV and WT integrated power system," Renewable Energy, Elsevier, vol. 227(C).
    11. Dong, Qianyu & Zhou, Guanyu & Huang, Qilin & Dong, Zhaoyang & Jia, Youwei, 2025. "Resilience enhancement for power distribution networks in coordination with electric vehicle fleets," Applied Energy, Elsevier, vol. 390(C).
    12. Heuberger, Clara F. & Bains, Praveen K. & Mac Dowell, Niall, 2020. "The EV-olution of the power system: A spatio-temporal optimisation model to investigate the impact of electric vehicle deployment," Applied Energy, Elsevier, vol. 257(C).
    13. Lee, Wonjong & Woo, JongRoul & Kim, Yong-gun & Koo, Yoonmo, 2024. "Vehicle-to-grid as a competitive alternative to energy storage in a renewable-dominant power system: An integrated approach considering both electric vehicle drivers' willingness and effectiveness," Energy, Elsevier, vol. 310(C).
    14. An, Sihai & Qiu, Jing & Lin, Jiafeng & Yao, Zongyu & Liang, Qijun & Lu, Xin, 2025. "Planning of a multi-agent mobile robot-based adaptive charging network for enhancing power system resilience under extreme conditions," Applied Energy, Elsevier, vol. 395(C).
    15. Liu, Shanshan & Vlachokostas, Alex & Kontou, Eleftheria, 2025. "Leveraging electric vehicles as a resiliency solution for residential backup power during outages," Energy, Elsevier, vol. 318(C).
    16. Wu, Hongbin & Lan, Xinjie & He, Ye & Wu, Andrew Y. & Ding, Ming, 2025. "Orderly charging of electric vehicles: A two-stage spatial-temporal scheduling method based on user-personalized navigation," Applied Energy, Elsevier, vol. 378(PA).
    17. Zhao, Ruoxuan & Yang, Qiming & Li, Gengfeng & Liu, Dafu & Ji, Chenlin & Bian, Yiheng & Bie, Zhaohong, 2025. "Interaction strategy for grid-hydrogen-vehicle system in extreme heat scenarios: Hybrid system dynamics and Bilevel optimization approach," Applied Energy, Elsevier, vol. 391(C).
    18. Lin, Jiafeng & Qiu, Jing & Yang, Yi & Sun, Xianzhuo & Lu, Xin & Yuan, Zhe, 2025. "Data integrity attack resilience for electric vehicle charging management centers in distributed optimal power flow with non-ideal Li-ion battery models," Applied Energy, Elsevier, vol. 391(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rehman, Anis ur, 2026. "Reinforcement learning as a control layer for electric vehicle interaction with multi-energy systems: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 231(C).
    2. Wu, Jing jin & Wu, Kunsong & Sun, Qian & Wu, Yunhui & Zhang, Meng & Liang, Zhisheng & Zhang, Ling, 2026. "Energy and monetary coordination in V2G systems: An E-P strategy and cost optimization model for stakeholder incentives," Energy, Elsevier, vol. 359(C).
    3. Lian, Xianglong & Song, Chenkai & Li, Zepeng & Qiu, Lei & Liu, Lijun, 2026. "Resilience-oriented emergency resource dispatch for power–transportation coupled networks under rainstorm-induced flood hazards," Applied Energy, Elsevier, vol. 403(PA).
    4. Miao, Hongzhi & Wang, Junpeng & Wu, Jiayu & Zhang, Xiang & Gan, Zuoxian & Li, Xinwei & Jia, Hongfei & Fan, Houming, 2026. "Integrated planning of supercharging networks for port drayage electrification: A transportation-power system coordination approach," Renewable Energy, Elsevier, vol. 265(C).
    5. Wan, Yuyang & Wang, Ning & Du, Ershun & Liu, Xueshan & Wang, Yanbo & Chen, Zhe & Kang, Chongqing, 2025. "Coordinated operation of alternative fuel vehicle-integrated microgrid in a coupled power-transportation network: a Stackelberg–Nash game framework," Applied Energy, Elsevier, vol. 401(PC).
    6. Wang, Shixin & Lu, Qing-Chang & Liu, Liping & Xu, Peng-Cheng & Wang, Rundong & Zhang, Lei, 2026. "Interdependency analysis of coupled power and transportation networks considering the charging decision preferences of EV drivers," Reliability Engineering and System Safety, Elsevier, vol. 268(C).
    7. Xiong, Chu & Gong, Ke & Hu, Jian, 2026. "The double penalty of congestion: V2G aggregation in capacity markets," Applied Energy, Elsevier, vol. 419(C).
    8. Kuai, Leyi & Zhu, Ronghui & Ma, Tieju, 2026. "Agent-based modeling on residential coordinated charging with dynamic participation," Energy, Elsevier, vol. 353(C).
    9. Gong, Fuda & Hao, Xu & Ye, Wenkai & Liu, Haoqiang & Xie, Yilin & Xing, Yan & Ji, Jean & Feng, Jiayu & Li, Feiyang & Shi, Hong & Wang, Yunshi & Wang, Hewu, 2026. "A privacy-preserving personalized federated reinforcement learning framework with heterogeneous EV willingness for V2G scheduling," Applied Energy, Elsevier, vol. 417(C).
    10. Yang, Meng & Chen, Yue & Huang, Shihan & Chen, Laijun, 2025. "Recent advances in coordination and optimization of power-transportation systems: An overview," Renewable and Sustainable Energy Reviews, Elsevier, vol. 220(C).
    11. Sun, Shaohua & Li, Gengfeng & Bie, Zhaohong & Zhang, Dingmao & Huang, Yuxiong, 2025. "Hybrid multi-agent deep reinforcement learning for multi-type mobile resources dispatching under transportation and power network recovery," Applied Energy, Elsevier, vol. 399(C).
    12. Su, Chutian & Wang, Yi & Strbac, Goran, 2025. "Coordinated electric vehicles dispatch for multi-service provisions: A comprehensive review of modelling and coordination approaches," Renewable and Sustainable Energy Reviews, Elsevier, vol. 223(C).
    13. Chuan Long & Xinting Yang & Yunche Su & Fang Liu & Ruiguang Ma & Tiannan Ma & Yangjin Wu & Xiaodong Shen, 2025. "Air Conditioning Load Forecasting for Geographical Grids Using Deep Reinforcement Learning and Density-Based Spatial Clustering of Applications with Noise and Graph Attention Networks," Energies, MDPI, vol. 18(11), pages 1-19, May.
    14. Vassilis M. Charitopoulos & Mathilde Fajardy & Chi Kong Chyong & David M. Reiner, 2022. "The case of 100% electrification of domestic heat in Great Britain," Working Papers EPRG2206, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    15. Chen, Haiwen & Li, Xuelian & Wang, Xiaoxue & Xin, Zhen & Ge, Leijiao & Zhao, Weida & Zhang, Yuanlin, 2026. "A fair and low-carbon V2G scheduling framework based on carbon-economic contracts and fulfillment-aware dispatch," Applied Energy, Elsevier, vol. 410(C).
    16. Chen, Yin & Chen, Yinyu & Zhou, Yue & Gan, Wei & Chen, Minwu & Chen, Xia, 2025. "Robust energy management of electrified railway traction substation providing secondary frequency regulation," Energy, Elsevier, vol. 335(C).
    17. Liu, Shan & Yan, Jie & Yan, Yamin & Zhang, Haoran & Zhang, Jing & Liu, Yongqian & Han, Shuang, 2024. "Joint operation of mobile battery, power system, and transportation system for improving the renewable energy penetration rate," Applied Energy, Elsevier, vol. 357(C).
    18. Zhang, Cong & Greenblatt, Jeffery B. & MacDougall, Pamela & Saxena, Samveg & Jayam Prabhakar, Aditya, 2020. "Quantifying the benefits of electric vehicles on the future electricity grid in the midwestern United States," Applied Energy, Elsevier, vol. 270(C).
    19. Liu, Zhifeng & Wang, Dao & Jin, Xiaolong & Jia, Hongjie, 2026. "Improving the multi-energy synergy flexibility of RIES: slackness-driven morphable multi-dimensional differentiated charging-discharging strategy for electric vehicle cluster," Applied Energy, Elsevier, vol. 414(C).
    20. Wang, Xu & Wang, Zihan & Ma, Fei & Dai, Rongjian & Zhou, Xiaoteng, 2026. "A similar day selection framework with heterogeneous feature integration for electric vehicle charging load forecasting," Applied Energy, Elsevier, vol. 413(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:406:y:2026:i:c:s0306261925019488. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.