IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v334y2025ics0360544225032670.html

Hierarchical optimization of SAC-driven speed planning and energy management in intelligent fuel cell hybrid vehicle platoons under complex traffic environments

Author

Listed:
  • Nie, Zhigen
  • Song, Hao
  • Lian, Yufeng
  • Shi, Zhuangfeng

Abstract

Eco-driving and connected automation technology-driven platoon cooperative control techniques show significant potential for improving energy efficiency and traffic flow optimization. However, vehicle state fluctuations and road condition uncertainties in dynamic traffic environments pose serious challenges to fuel cell hybrid electric vehicle (FCHEV) platoon control. To this end, this study proposes a hierarchical co-optimization architecture that integrates speed planning and energy management to cope with complex working conditions. In the high-level speed planning layer, the ISSA-CNN-BiLSTM-ATT network is used to achieve accurate prediction of the speed of the lead vehicle, and the Soft Actor-Critic (SAC) algorithm is used for speed planning to dynamically adjust the inter-vehicle spacing in order to balance the safety, ride comfort, and economy; in the bottom energy management layer, the L2 regularized double-delay depth deterministic strategy gradient (L2-TD3) algorithm is introduced to optimize the fuel cell and battery power allocation, simultaneously considering the energy degradation cost and state-of-charge (SOC) stability. The simulation results show that the prediction error of the speed prediction strategy is reduced by 67.32 %, the speed planning strategy reduces the platoon demand power by 19.25 % and the global cost by 16.96 % under the prediction condition, and the energy management strategy reduces the global cost by 15.67 % and the SOC fluctuation by 1.69 % under the FTP75 condition.

Suggested Citation

  • Nie, Zhigen & Song, Hao & Lian, Yufeng & Shi, Zhuangfeng, 2025. "Hierarchical optimization of SAC-driven speed planning and energy management in intelligent fuel cell hybrid vehicle platoons under complex traffic environments," Energy, Elsevier, vol. 334(C).
  • Handle: RePEc:eee:energy:v:334:y:2025:i:c:s0360544225032670
    DOI: 10.1016/j.energy.2025.137625
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225032670
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.137625?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Chen, Daxin & Chen, Tao & Li, Zhijun & Liu, Zhixi & Sun, Chaoyang & Zhao, Hua, 2025. "Energy management strategy for plug-in hybrid electric vehicles based on vehicle speed prediction and limited traffic information," Energy, Elsevier, vol. 326(C).
    2. Jia, Chunchun & Zhou, Jiaming & He, Hongwen & Li, Jianwei & Wei, Zhongbao & Li, Kunang, 2024. "Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information," Energy, Elsevier, vol. 290(C).
    3. Chen, Zheng & Gu, Hongji & Shen, Shiquan & Shen, Jiangwei, 2022. "Energy management strategy for power-split plug-in hybrid electric vehicle based on MPC and double Q-learning," Energy, Elsevier, vol. 245(C).
    4. Fu, Shiyi & Tao, Shengyu & Fan, Hongtao & He, Kun & Liu, Xutao & Tao, Yulin & Zuo, Junxiong & Zhang, Xuan & Wang, Yu & Sun, Yaojie, 2024. "Data-driven capacity estimation for lithium-ion batteries with feature matching based transfer learning method," Applied Energy, Elsevier, vol. 353(PA).
    5. Nie, Zhigen & Jia, Yuan & Wang, Wanqiong & Chen, Zheng & Outbib, Rachid, 2022. "Co-optimization of speed planning and energy management for intelligent fuel cell hybrid vehicle considering complex traffic conditions," Energy, Elsevier, vol. 247(C).
    6. Zhang, Hanyu & Du, Lili & Shen, Jinglai, 2022. "Hybrid MPC System for Platoon based Cooperative Lane change Control Using Machine Learning Aided Distributed Optimization," Transportation Research Part B: Methodological, Elsevier, vol. 159(C), pages 104-142.
    7. Huang, Ruchen & He, Hongwen & Su, Qicong, 2024. "Towards a fossil-free urban transport system: An intelligent cross-type transferable energy management framework based on deep transfer reinforcement learning," Applied Energy, Elsevier, vol. 363(C).
    8. Nie, Zhigen & Song, Hao & Lian, Yufeng & Shi, Zhuangfeng, 2025. "BiLSTM-ATTENTION-CNN predictive energy management based on ISSA optimization for intelligent fuel cell hybrid vehicle platoon," Energy, Elsevier, vol. 324(C).
    9. Huang, Ruchen & He, Hongwen & Su, Qicong, 2024. "An intelligent full-knowledge transferable collaborative eco-driving framework based on improved soft actor-critic algorithm," Applied Energy, Elsevier, vol. 375(C).
    10. Ma, Yan & Qi, Baohui & Wang, Siyu & Ma, Qian & Sui, Zhen & Gao, Jinwu, 2025. "Real-time energy management of fuel cell hybrid electric vehicle based on variable horizon velocity prediction considering power source durability," Energy, Elsevier, vol. 315(C).
    11. Zhou, Yujie & Huang, Yin & Mao, Xuping & Kang, Zehao & Huang, Xuejin & Xuan, Dongji, 2024. "Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning," Energy, Elsevier, vol. 293(C).
    12. Huang, Ruchen & He, Hongwen & Zhao, Xuyang & Wang, Yunlong & Li, Menglin, 2022. "Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm," Applied Energy, Elsevier, vol. 321(C).
    13. İnci, Mustafa & Büyük, Mehmet & Demir, Mehmet Hakan & İlbey, Göktürk, 2021. "A review and research on fuel cell electric vehicles: Topologies, power electronic converters, energy management methods, technical challenges, marketing and future aspects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 137(C).
    14. Sun, Zhendong & Wang, Yujie & Chen, Zonghai & Li, Xiyun, 2020. "Min-max game based energy management strategy for fuel cell/supercapacitor hybrid electric vehicles," Applied Energy, Elsevier, vol. 267(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Chi & Xu, Zhezhuang & Zhou, Jiawei & Yuan, Yazhou & Ma, Kai & Yuan, Meng, 2026. "Deep reinforcement learning-based energy scheduling for green buildings with stationary and EV batteries of heterogeneous characteristics," Applied Energy, Elsevier, vol. 409(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Sihan & Huang, Yin & Zhang, Jie & Yu, Xinshu & Lu, Yifan & Xuan, Dongji, 2025. "Research on a novel multi-agent deep reinforcement learning eco-driving framework," Energy, Elsevier, vol. 326(C).
    2. Nie, Zhigen & Song, Hao & Lian, Yufeng & Shi, Zhuangfeng, 2025. "BiLSTM-ATTENTION-CNN predictive energy management based on ISSA optimization for intelligent fuel cell hybrid vehicle platoon," Energy, Elsevier, vol. 324(C).
    3. Fang, Shuo & Hu, Shuangxi & Liu, Yuntao & Zhao, Chunhui & Wang, Ying, 2025. "Power management unit with maximum-efficiency-point-tracking to enhance the efficiency of micro DMFC stack," Energy, Elsevier, vol. 315(C).
    4. Huang, Ruchen & He, Hongwen & Su, Qicong & Härtl, Martin & Jaensch, Malte, 2025. "Type- and task-crossing energy management for fuel cell vehicles with longevity consideration: A heterogeneous deep transfer reinforcement learning framework," Applied Energy, Elsevier, vol. 377(PC).
    5. Nie, Zhigen & Feng, Yaxing & Lian, Yufeng, 2025. "Deep reinforcement learning-based hierarchical control strategy for energy management of intelligent fuel cell hybrid electric vehicles," Energy, Elsevier, vol. 326(C).
    6. Huang, Ruchen & He, Hongwen & Su, Qicong & Wu, Jingda, 2025. "Towards sustainable and intelligent urban transportation: A novel deep transfer reinforcement learning framework for eco-driving of fuel cell buses," Energy, Elsevier, vol. 330(C).
    7. Zhao, Ganglei & Li, Xiang & Liu, Changxing & Zhang, Huiliu & Li, Po, 2026. "Experimental validation of real-time energy management for hybrid energy storage systems based on predictive wavelet transforms," Applied Energy, Elsevier, vol. 405(C).
    8. Huang, Ruchen & He, Hongwen & Su, Qicong, 2024. "Smart energy management for hybrid electric bus via improved soft actor-critic algorithm in a heuristic learning framework," Energy, Elsevier, vol. 309(C).
    9. Mahmud, Sakib & Sayed, Aya Nabil & Himeur, Yassine & Nhlabatsi, Armstrong & Bensaali, Faycal, 2026. "A comprehensive review of deep reinforcement learning applications from centralized power generation to modern energy internet frameworks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PE).
    10. Zhao, Di & Li, Shibo & Chu, Liang & Hou, Zhuoran & Zhou, Quan & Liu, Yonggang & Huang, Yanjun & Chen, Zheng & Zhao, Dezong & Zhang, Yuanjian, 2024. "A novel learning-based robust model predictive control strategy and case study for application in optimal control of FCEVs," Energy, Elsevier, vol. 310(C).
    11. Jia, Chunchun & Liu, Wei & He, Hongwen & Chau, K.T., 2025. "Health-conscious energy management for fuel cell vehicles: An integrated thermal management strategy for cabin and energy source systems," Energy, Elsevier, vol. 333(C).
    12. Li, Xueliang & Liu, Yilong & Yan, Mei & Tian, Dayu & Yang, Shujun & Peng, Zengxiong, 2026. "Data-driven a convergence-enhanced fusion energy management strategy based on teacher agent guidance for hybrid electric vehicles," Applied Energy, Elsevier, vol. 404(C).
    13. Dai, Churong & Zuo, Wei & Li, Qingqing & Zhou, Kun & Huang, Yuhan & Zhang, Guangde & E, Jiaqiang, 2024. "Energy conversion efficiency improvement studies on the hydrogen-fueled micro planar combustor with multi-baffles for thermophotovoltaic applications," Energy, Elsevier, vol. 313(C).
    14. Tang, Tianfeng & Peng, Qianlong & Shi, Qing & Peng, Qingguo & Zhao, Jin & Chen, Chaoyi & Wang, Guangwei, 2024. "Energy management of fuel cell hybrid electric bus in mountainous regions: A deep reinforcement learning approach considering terrain characteristics," Energy, Elsevier, vol. 311(C).
    15. Zhang, Yahui & You, Xiongxiong & Song, Yunfeng & Zhao, Yahui & Wei, Zeyi & Jiao, Xiaohong, 2025. "Hierarchical eco-driving of connected hybrid electric vehicles: Integrating predictive cruise control and cost-to-go approximation-guided energy management," Energy, Elsevier, vol. 319(C).
    16. Li, Hao & Zhou, Xingfei & Hu, Ziyang & Zhang, Houcheng, 2025. "Waste heat recycling from phosphoric acid fuel cells for desalination with hydrophilic modified tubular stills: Performance prediction and regulation," Energy, Elsevier, vol. 317(C).
    17. Dagang Lu & Yu Chen & Yan Sun & Wenxuan Wei & Shilin Ji & Hongshuo Ruan & Fengyan Yi & Chunchun Jia & Donghai Hu & Kunpeng Tang & Song Huang & Jing Wang, 2025. "Research Progress in Multi-Domain and Cross-Domain AI Management and Control for Intelligent Electric Vehicles," Energies, MDPI, vol. 18(17), pages 1-52, August.
    18. Badji, Abderrezak & Abdeslam, Djaffar Ould & Chabane, Djafar & Benamrouche, Nacereddine, 2022. "Real-time implementation of improved power frequency approach based energy management of fuel cell electric vehicle considering storage limitations," Energy, Elsevier, vol. 249(C).
    19. Jia, Chunchun & Li, Kunang & He, Hongwen & Zhou, Jiaming & Li, Jianwei & Wei, Zhongbao, 2023. "Health-aware energy management strategy for fuel cell hybrid bus considering air-conditioning control based on TD3 algorithm," Energy, Elsevier, vol. 283(C).
    20. Dawei Zhong & Bolan Liu & Liang Liu & Wenhao Fan & Jingxian Tang, 2025. "Artificial Intelligence Algorithms for Hybrid Electric Powertrain System Control: A Review," Energies, MDPI, vol. 18(8), pages 1-30, April.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:334:y:2025:i:c:s0360544225032670. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.