IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v326y2025ics0360544225019504.html

Research on a novel multi-agent deep reinforcement learning eco-driving framework

Author

Listed:
  • Chen, Sihan
  • Huang, Yin
  • Zhang, Jie
  • Yu, Xinshu
  • Lu, Yifan
  • Xuan, Dongji

Abstract

With the worsening global environmental crisis and the rapid advancement of intelligent driving technology, eco-driving has emerged as a critical research focus to balance transportation efficiency and energy consumption. Addressing the multi-objective co-optimization challenge of driving performance and energy management in fuel cell hybrid electric vehicles within a car-following scenario, this paper proposes a multi-agent deep reinforcement learning framework incorporating a model predictive control guidance mechanism. By analyzing the scale factors between multi-agent reward value functions, the optimal weight coefficients are determined, significantly enhancing training efficiency. The improved multi-agent twin delay deep deterministic policy gradient algorithmic framework decouples the optimization objectives of different domains and provides guidance, and ultimately achieves good safety, comfort, state of charge of the lithium-ion battery maintenance, and economy through comprehensive comparative analyses under multiple driving cycles.

Suggested Citation

  • Chen, Sihan & Huang, Yin & Zhang, Jie & Yu, Xinshu & Lu, Yifan & Xuan, Dongji, 2025. "Research on a novel multi-agent deep reinforcement learning eco-driving framework," Energy, Elsevier, vol. 326(C).
  • Handle: RePEc:eee:energy:v:326:y:2025:i:c:s0360544225019504
    DOI: 10.1016/j.energy.2025.136308
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225019504
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.136308?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Huang, Yin & Kang, Zehao & Mao, Xuping & Hu, Haoqin & Tan, Jiaqi & Xuan, Dongji, 2023. "Deep reinforcement learning based energymanagement strategy considering running costs and energy source aging for fuel cell hybrid electric vehicle," Energy, Elsevier, vol. 283(C).
    2. Huang, Ruchen & He, Hongwen & Su, Qicong, 2024. "Towards a fossil-free urban transport system: An intelligent cross-type transferable energy management framework based on deep transfer reinforcement learning," Applied Energy, Elsevier, vol. 363(C).
    3. Wang, Yong & Wu, Yuankai & Tang, Yingjuan & Li, Qin & He, Hongwen, 2023. "Cooperative energy management and eco-driving of plug-in hybrid electric vehicle via multi-agent reinforcement learning," Applied Energy, Elsevier, vol. 332(C).
    4. Wang, Yichun & Zhang, Yuanzhi & Zhang, Caizhi & Zhou, Jiaming & Hu, Donghai & Yi, Fengyan & Fan, Zhixian & Zeng, Tao, 2023. "Genetic algorithm-based fuzzy optimization of energy management strategy for fuel cell vehicles considering driving cycles recognition," Energy, Elsevier, vol. 263(PF).
    5. Huang, Xuejin & Zhang, Jingyi & Ou, Kai & Huang, Yin & Kang, Zehao & Mao, Xuping & Zhou, Yujie & Xuan, Dongji, 2024. "Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework," Energy, Elsevier, vol. 304(C).
    6. Wang, Hanchen & Ye, Yiming & Zhang, Jiangfeng & Xu, Bin, 2023. "A comparative study of 13 deep reinforcement learning based energy management methods for a hybrid electric vehicle," Energy, Elsevier, vol. 266(C).
    7. Tang, Wenbin & Wang, Yaqian & Jiao, Xiaohong & Ren, Lina, 2023. "Hierarchical energy management strategy based on adaptive dynamic programming for hybrid electric vehicles in car-following scenarios," Energy, Elsevier, vol. 265(C).
    8. Zhou, Yujie & Huang, Yin & Mao, Xuping & Kang, Zehao & Huang, Xuejin & Xuan, Dongji, 2024. "Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning," Energy, Elsevier, vol. 293(C).
    9. Tang, Xiaolin & Zhou, Haitao & Wang, Feng & Wang, Weida & Lin, Xianke, 2022. "Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning," Energy, Elsevier, vol. 238(PA).
    10. Zou, Weitao & Li, Jianwei & Yang, Qingqing & Wan, Xinming & He, Yuntang & Lan, Hao, 2023. "A real-time energy management approach with fuel cell and battery competition-synergy control for the fuel cell vehicle," Applied Energy, Elsevier, vol. 334(C).
    11. Huang, Ruchen & He, Hongwen & Zhao, Xuyang & Wang, Yunlong & Li, Menglin, 2022. "Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm," Applied Energy, Elsevier, vol. 321(C).
    12. Li, Cheng & Xu, Xiangyang & Zhu, Helong & Gan, Jiongpeng & Chen, Zhige & Tang, Xiaolin, 2024. "Research on car-following control and energy management strategy of hybrid electric vehicles in connected scene," Energy, Elsevier, vol. 293(C).
    13. Sun, Zhendong & Wang, Yujie & Chen, Zonghai & Li, Xiyun, 2020. "Min-max game based energy management strategy for fuel cell/supercapacitor hybrid electric vehicles," Applied Energy, Elsevier, vol. 267(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Huang, Ruchen & He, Hongwen & Su, Qicong & Härtl, Martin & Jaensch, Malte, 2025. "Type- and task-crossing energy management for fuel cell vehicles with longevity consideration: A heterogeneous deep transfer reinforcement learning framework," Applied Energy, Elsevier, vol. 377(PC).
    2. Fan Wang & Yina Hong & Xiaohuan Zhao, 2025. "Research and Comparative Analysis of Energy Management Strategies for Hybrid Electric Vehicles: A Review," Energies, MDPI, vol. 18(11), pages 1-28, May.
    3. Zhang, Dehai & Li, Junhui & Guo, Ningyuan & Liu, Yonggang & Shen, Shiquan & Wei, Fuxing & Chen, Zheng & Zheng, Jia, 2024. "Adaptive deep reinforcement learning energy management for hybrid electric vehicles considering driving condition recognition," Energy, Elsevier, vol. 313(C).
    4. Huang, Xuejin & Zhang, Jingyi & Ou, Kai & Huang, Yin & Kang, Zehao & Mao, Xuping & Zhou, Yujie & Xuan, Dongji, 2024. "Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework," Energy, Elsevier, vol. 304(C).
    5. Huang, Ruchen & He, Hongwen & Su, Qicong, 2024. "An intelligent full-knowledge transferable collaborative eco-driving framework based on improved soft actor-critic algorithm," Applied Energy, Elsevier, vol. 375(C).
    6. Nie, Zhigen & Song, Hao & Lian, Yufeng & Shi, Zhuangfeng, 2025. "Hierarchical optimization of SAC-driven speed planning and energy management in intelligent fuel cell hybrid vehicle platoons under complex traffic environments," Energy, Elsevier, vol. 334(C).
    7. Huang, Hao & Lin, Xinyou & Huang, Qiang, 2026. "Enhancing adaptive health-conscious energy management control strategy with self-learning power correction for fuel cell hybrid electric vehicles," Applied Energy, Elsevier, vol. 402(PB).
    8. Huang, Ruchen & He, Hongwen, 2025. "UpdatingEMS: An online updating framework for deep reinforcement learning-based energy management of fuel cell hybrid electric bus with integrated transfer learning," Applied Energy, Elsevier, vol. 402(PA).
    9. Niu, Zegong & He, Hongwen, 2024. "A data-driven solution for intelligent power allocation of connected hybrid electric vehicles inspired by offline deep reinforcement learning in V2X scenario," Applied Energy, Elsevier, vol. 372(C).
    10. Juan Carlos Paredes-Rojas & Ramón Costa-Castelló & Rubén Vázquez-Medina & Juan Alejandro Flores-Campos & Christopher Rene Torres-San Miguel, 2025. "Experimental Study on Using Biodiesel in Hybrid Electric Vehicles," Energies, MDPI, vol. 18(7), pages 1-22, March.
    11. Nie, Zhigen & Song, Hao & Lian, Yufeng & Shi, Zhuangfeng, 2025. "BiLSTM-ATTENTION-CNN predictive energy management based on ISSA optimization for intelligent fuel cell hybrid vehicle platoon," Energy, Elsevier, vol. 324(C).
    12. Wang, Han & Zhu, Dan & Chen, Bojun & Ren, Yuyue & Ning, Shichao & Zhao, Xuan, 2025. "An experimentally validated health-aware hierarchical energy management strategy for fuel cell heavy-duty trucks," Energy, Elsevier, vol. 341(C).
    13. Liu, Hui & You, Congwen & Han, Lijin & Yang, Ningkang & Liu, Baoshuai, 2025. "Off-road hybrid electric vehicle energy management strategy using multi-agent soft actor-critic with collaborative-independent algorithm," Energy, Elsevier, vol. 328(C).
    14. Mubashir Rasool & Muhammad Adil Khan & Runmin Zou, 2023. "A Comprehensive Analysis of Online and Offline Energy Management Approaches for Optimal Performance of Fuel Cell Hybrid Electric Vehicles," Energies, MDPI, vol. 16(8), pages 1-33, April.
    15. Dai, Churong & Zuo, Wei & Li, Qingqing & Zhou, Kun & Huang, Yuhan & Zhang, Guangde & E, Jiaqiang, 2024. "Energy conversion efficiency improvement studies on the hydrogen-fueled micro planar combustor with multi-baffles for thermophotovoltaic applications," Energy, Elsevier, vol. 313(C).
    16. Lei, Nuo & Zhang, Hao & Hu, Jingjing & Hu, Zunyan & Wang, Zhi, 2025. "Sim-to-real design and development of reinforcement learning-based energy management strategies for fuel cell electric vehicles," Applied Energy, Elsevier, vol. 393(C).
    17. Fang, Shuo & Hu, Shuangxi & Liu, Yuntao & Zhao, Chunhui & Wang, Ying, 2025. "Power management unit with maximum-efficiency-point-tracking to enhance the efficiency of micro DMFC stack," Energy, Elsevier, vol. 315(C).
    18. Heuts, Y.J.J. & Wouters, J.J.F. & Hulsebos, O.F. & Donkers, M.C.F., 2025. "Modeling, implementation and experimental verification of eco-driving on a battery-electric heavy-duty vehicle," Applied Energy, Elsevier, vol. 390(C).
    19. Nie, Zhigen & Feng, Yaxing & Lian, Yufeng, 2025. "Deep reinforcement learning-based hierarchical control strategy for energy management of intelligent fuel cell hybrid electric vehicles," Energy, Elsevier, vol. 326(C).
    20. Huang, Ruchen & He, Hongwen & Su, Qicong & Wu, Jingda, 2025. "Towards sustainable and intelligent urban transportation: A novel deep transfer reinforcement learning framework for eco-driving of fuel cell buses," Energy, Elsevier, vol. 330(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:326:y:2025:i:c:s0360544225019504. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.