IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v238y2025ics0960148124020500.html

Optimal self-consumption scheduling of highway electric vehicle charging station based on multi-agent deep reinforcement learning

Author

Listed:
  • Zhou, Jianshu
  • Xiang, Yue
  • Zhang, Xin
  • Sun, Zhou
  • Liu, Xuefei
  • Liu, Junyong

Abstract

Due to the randomness of renewable energy and electric vehicles (EVs) in highway charging stations, it is difficult to ensure the consistency of renewable energy supply and EVs demand. Considering the randomness of EVs charging and renewable energy power generation, an optimal self-consumption scheduling of a highway EV charging station based on multi-agent deep reinforcement learning (MADRL) is proposed to realize the economy, self-consumption, low-carbon operation and ensure reliability of power supply. In day-ahead, the traffic flow prediction model based on the CNN-BiLSTM and the queuing model based on user psychology are built to predict the charging load. The 24-h optimal charging price is obtained by solving the incentive price optimization model and guides the orderly charging of EVs. In intra-day, considering the prediction errors of day-ahead and the diversity of charging levels, an optimal scheduling based on the MADRL is proposed. Regarding the multi-objective scheduling of the highway charging station, the multi-objective nonlinear and non-convex problem is transformed into multi-agent Markov game model. Finally, the effectiveness and optimality of the proposed method are verified on a highway charging station The results show that the proposed method can realize the economy, self-consumption and low-carbon operation of the charging station.

Suggested Citation

  • Zhou, Jianshu & Xiang, Yue & Zhang, Xin & Sun, Zhou & Liu, Xuefei & Liu, Junyong, 2025. "Optimal self-consumption scheduling of highway electric vehicle charging station based on multi-agent deep reinforcement learning," Renewable Energy, Elsevier, vol. 238(C).
    • Handle: RePEc:eee:renene:v:238:y:2025:i:c:s0960148124020500
    DOI: 10.1016/j.renene.2024.121982
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148124020500
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2024.121982?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Hammam, Ahmed H. & Nayel, Mohamed A. & Mohamed, Mansour A., 2024. "Optimal design of sizing and allocations for highway electric vehicle charging stations based on a PV system," Applied Energy, Elsevier, vol. 376(PB).
    2. Xiang, Yue & Lu, Yu & Liu, Junyong, 2023. "Deep reinforcement learning based topology-aware voltage regulation of distribution networks with distributed energy storage," Applied Energy, Elsevier, vol. 332(C).
    3. Wang, Kang & Wang, Haixin & Yang, Zihao & Feng, Jiawei & Li, Yanzhen & Yang, Junyou & Chen, Zhe, 2023. "A transfer learning method for electric vehicles charging strategy based on deep reinforcement learning," Applied Energy, Elsevier, vol. 343(C).
    4. Feng, Jiawei & Hou, Shengya & Yu, Lijun & Dimov, Nikolay & Zheng, Pei & Wang, Chunping, 2020. "Optimization of photovoltaic battery swapping station based on weather/traffic forecasts and speed variable charging," Applied Energy, Elsevier, vol. 264(C).
    5. Jin, Ruiyang & Zhou, Yuke & Lu, Chao & Song, Jie, 2022. "Deep reinforcement learning-based strategy for charging station participating in demand response," Applied Energy, Elsevier, vol. 328(C).
    6. Woo, Hyeon & Son, Yongju & Cho, Jintae & Kim, Sung-Yul & Choi, Sungyun, 2023. "Optimal expansion planning of electric vehicle fast charging stations," Applied Energy, Elsevier, vol. 342(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ye, Yujiang & Zhang, Tengxi & Shi, Ruifeng & Liu, Zhuangzhuang & Jia, Limin, 2025. "A multi-stage stochastic-robust planning approach for highway service area self-contained energy system considering multiple uncertainties," Energy, Elsevier, vol. 340(C).
    2. Ni, Fangyuan & Xiang, Yue & Wang, Shiqian & Hu, Zechun & Liu, Fang & Xu, Xiao & Jiang, Yi & Wang, Yang, 2025. "Charging management of electric vehicles with consumption of renewable energy," Energy, Elsevier, vol. 321(C).
    3. Xie, Hongbin & Song, Ge & Shi, Zhuoran & Peng, Likun & Feng, Defan & Song, Xuan, 2025. "Stable energy management for highway electric vehicle charging based on reinforcement learning," Applied Energy, Elsevier, vol. 389(C).
    4. Wang, Wenwei & Zhao, Wentao & Zhou, Xingyu & Zhang, Xinyong & Wu, Wentao & Liu, Manyu, 2025. "Deep learning-aided stochastic integrated optimization of highway service area renewable energy systems adopting a novel topology," Energy, Elsevier, vol. 338(C).
    5. Song, Ge & Xie, Hongbin & Zhang, Jingyuan & Fu, Hongdi & Shi, Zhuoran & Feng, Defan & Song, Xuan & Zhang, Haoran, 2025. "Long-term efficient energy management for multi-station collaborative electric vehicle charging: A transformer-based multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 397(C).
    6. Arumugam, Rajapandiyan & Subbaiyan, Thangavel, 2025. "A synergistic EV charging framework for smart cities with commitment-driven penalty mechanism and preference-based optimal charging source selection," Applied Energy, Elsevier, vol. 401(PB).
    7. Ekaterina Dudkina & Claudio Scarpelli & Valerio Apicella & Massimo Ceraolo & Emanuele Crisostomi, 2025. "Optimised Centralised Charging of Electric Vehicles Along Motorways," Sustainability, MDPI, vol. 17(12), pages 1-15, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Muhammad Ikram & Daryoush Habibi & Asma Aziz, 2025. "Networked Multi-Agent Deep Reinforcement Learning Framework for the Provision of Ancillary Services in Hybrid Power Plants," Energies, MDPI, vol. 18(10), pages 1-34, May.
    2. Zhao, Zhonghao & Lee, Carman K.M. & Yan, Xiaoyuan & Wang, Haonan, 2024. "Reinforcement learning for electric vehicle charging scheduling: A systematic review," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 190(C).
    3. Zhu, Xingxu & Hou, Xiangchen & Li, Junhui & Yan, Gangui & Li, Cuiping & Wang, Dongbo, 2023. "Distributed online prediction optimization algorithm for distributed energy resources considering the multi-periods optimal operation," Applied Energy, Elsevier, vol. 348(C).
    4. Abbasi, Mohammad Hossein & Mishra, Dillip Kumar & Arjmandzadeh, Ziba & Zhang, Jiangfeng & Xu, Bin & Krovi, Venkat, 2025. "Collaborative participation of wind power producer and charging station aggregator in electricity markets," Applied Energy, Elsevier, vol. 401(PC).
    5. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    6. Ding, Yanyan & Jian, Sisi & Yu, Lin, 2025. "How to reduce carbon emissions in the urban transportation systems through carbon markets? Balancing the monetary and environmental benefits," Applied Energy, Elsevier, vol. 377(PB).
    7. Zhang, Tianren & Huang, Yuping & Liao, Hui & Liang, Yu, 2023. "A hybrid electric vehicle load classification and forecasting approach based on GBDT algorithm and temporal convolutional network," Applied Energy, Elsevier, vol. 351(C).
    8. Atefeh Alirezazadeh & Vahid Disfani, 2025. "Deep Reinforcement Learning-Based Optimization of Mobile Charging Station and Battery Recharging Under Grid Constraints," Energies, MDPI, vol. 18(20), pages 1-21, October.
    9. Huang, Ruchen & He, Hongwen & Su, Qicong & Wu, Jingda, 2025. "Towards sustainable and intelligent urban transportation: A novel deep transfer reinforcement learning framework for eco-driving of fuel cell buses," Energy, Elsevier, vol. 330(C).
    10. Wang, Dawei & Guo, Jingwei & Zhang, Yongxiang & Zhong, Qingwei & Xu, Hongke, 2025. "Optimizing expressway battery electric vehicle charging and mobile storage energy truck scheduling: A two-stage approach to improve photovoltaic generation utilization," Energy, Elsevier, vol. 320(C).
    11. Li, Yiqun & Pu, Ziyuan & Liu, Pei & Qian, Tao & Hu, Qinran & Zhang, Junyi & Wang, Yinhai, 2025. "Efficient predictive control strategy for mitigating the overlap of EV charging demand and residential load based on distributed renewable energy," Renewable Energy, Elsevier, vol. 240(C).
    12. Ali, Md Inayat & Mandal, Rajib Kumar & Kumar, Amitesh, 2025. "Optimization of battery swapping station for electric vehicles by novel adaptive GWO algorithm," Energy, Elsevier, vol. 333(C).
    13. Haiqing Gan & Wenjun Ruan & Mingshen Wang & Yi Pan & Huiyu Miu & Xiaodong Yuan, 2024. "Bi-Level Planning of Electric Vehicle Charging Stations Considering Spatial–Temporal Distribution Characteristics of Charging Loads in Uncertain Environments," Energies, MDPI, vol. 17(12), pages 1-30, June.
    14. Cho, Yongjun & Kim, Donghoon & Kim, Jinho, 2026. "Data-driven demand response aggregation for public EV charging stations: Overcoming decoupled governance challenges," Applied Energy, Elsevier, vol. 402(PB).
    15. Rabea Jamil Mahfoud & Nizar Faisal Alkayem & Emmanuel Fernandez-Rodriguez & Yuan Zheng & Yonghui Sun & Shida Zhang & Yuquan Zhang, 2024. "Evolutionary Approach for DISCO Profit Maximization by Optimal Planning of Distributed Generators and Energy Storage Systems in Active Distribution Networks," Mathematics, MDPI, vol. 12(2), pages 1-33, January.
    16. Escobar, Eros D. & Betancur, Daniel & Manrique, Tatiana & Isaac, Idi A., 2023. "Model predictive real-time architecture for secondary voltage control of microgrids," Applied Energy, Elsevier, vol. 345(C).
    17. Nayak, Dhyaan Sandeep & Misra, Shamik, 2024. "An operational scheduling framework for Electric Vehicle Battery Swapping Station under demand uncertainty," Energy, Elsevier, vol. 290(C).
    18. Meng, Yunfan & Sun, Yonghui & Xie, Dongliang & Xiao, Min & Yin, Chenxu & Zhao, Liang, 2025. "A two-stage optimization framework for EV charging station planning considering investment cost and service satisfaction," Applied Energy, Elsevier, vol. 402(PA).
    19. Jia, Bin & Li, Fan & Sun, Bo, 2024. "Knowledge-network-embedded deep reinforcement learning: An innovative way to high-efficiently develop an energy management strategy for the integrated energy system with renewable energy sources and multiple energy storage systems," Energy, Elsevier, vol. 301(C).
    20. Cui, Dingsong & Wang, Zhenpo & Liu, Peng & Wang, Shuo & Dorrell, David G. & Li, Xiaohui & Zhan, Weipeng, 2023. "Operation optimization approaches of electric vehicle battery swapping and charging station: A literature review," Energy, Elsevier, vol. 263(PE).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:238:y:2025:i:c:s0960148124020500. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.