IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v336y2025ics0360544225039568.html

Durability-enhanced decision-making with style awareness for autonomous hydrogen fuel cell vehicle based on integrated reinforcement learning approaches

Author

Listed:
  • Yu, Sichen
  • Peng, Jiankun
  • Zhou, Jiaxuan
  • Ren, Tinghui
  • Wu, Jingda
  • Fan, Yi

Abstract

Fuel cell hybrid electric vehicles (FCHEVs) are pivotal for hydrogen-powered transport, yet achieving sustainability requires co-optimizing autonomous driving and powertrain control. This paper proposes an integrated reinforcement learning framework that synergistically optimizes tactical driving behavior and powertrain energy management of FCHEVs. Building upon the upstream rainbow deep Q-network (RDQN)-based lane-changing module that enhances driving decision space and energy-saving potential, a downstream improved soft actor-critic (SAC) algorithm is developed to concurrently optimize continuous acceleration control and power distribution, incorporating durability-aware reward mechanisms. While amplifying decision interpretability, it accounts for driver preferences and ensures coordinated vehicle-environment-energy interaction. Experimental results demonstrate that this tightly coupled approach attains 98 % near-optimal energy efficiency with collaborative lateral-longitudinal decisions. Style-aware optimization yields divergent outcomes: cautious trajectories deliver comfort with reduced consumption, against aggressive ones boosting velocity at 1.3 times hydrogen cost.

Suggested Citation

  • Yu, Sichen & Peng, Jiankun & Zhou, Jiaxuan & Ren, Tinghui & Wu, Jingda & Fan, Yi, 2025. "Durability-enhanced decision-making with style awareness for autonomous hydrogen fuel cell vehicle based on integrated reinforcement learning approaches," Energy, Elsevier, vol. 336(C).
    • Handle: RePEc:eee:energy:v:336:y:2025:i:c:s0360544225039568
    DOI: 10.1016/j.energy.2025.138314
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225039568
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2025.138314?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Song, Ke & Wang, Xiaodi & Li, Feiqiang & Sorrentino, Marco & Zheng, Bailin, 2020. "Pontryagin’s minimum principle-based real-time energy management strategy for fuel cell hybrid electric vehicle considering both fuel economy and power source durability," Energy, Elsevier, vol. 205(C).
    2. Nie, Zifei & Farzaneh, Hooman, 2023. "Energy-efficient lane-change motion planning for personalized autonomous driving," Applied Energy, Elsevier, vol. 338(C).
    3. Sun, Xilei & Fu, Jianqin & Yang, Huiyong & Xie, Mingke & Liu, Jingping, 2023. "An energy management strategy for plug-in hybrid electric vehicles based on deep learning and improved model predictive control," Energy, Elsevier, vol. 269(C).
    4. Liu, Bo & Sun, Chao & Wang, Bo & Liang, Weiqiang & Ren, Qiang & Li, Junqiu & Sun, Fengchun, 2022. "Bi-level convex optimization of eco-driving for connected Fuel Cell Hybrid Electric Vehicles through signalized intersections," Energy, Elsevier, vol. 252(C).
    5. Zhang, Zhen & Zhang, Tiezhu & Hong, Jichao & Zhang, Hongxin & Yang, Jian & Jia, Qingxiao, 2023. "Double deep Q-network guided energy management strategy of a novel electric-hydraulic hybrid electric vehicle," Energy, Elsevier, vol. 269(C).
    6. Xu, Nan & Kong, Yan & Yan, Jinyue & Zhang, Yuanjian & Sui, Yan & Ju, Hao & Liu, Heng & Xu, Zhe, 2022. "Global optimization energy management for multi-energy source vehicles based on “Information layer - Physical layer - Energy layer - Dynamic programming” (IPE-DP)," Applied Energy, Elsevier, vol. 312(C).
    7. Wu, Jingda & He, Hongwen & Peng, Jiankun & Li, Yuecheng & Li, Zhanjiang, 2018. "Continuous reinforcement learning of energy management with deep Q network for a power split hybrid electric bus," Applied Energy, Elsevier, vol. 222(C), pages 799-811.
    8. Fathabadi, Hassan, 2019. "Combining a proton exchange membrane fuel cell (PEMFC) stack with a Li-ion battery to supply the power needs of a hybrid electric vehicle," Renewable Energy, Elsevier, vol. 130(C), pages 714-724.
    9. Ettihir, K. & Boulon, L. & Agbossou, K., 2016. "Optimization-based energy management strategy for a fuel cell/battery hybrid power system," Applied Energy, Elsevier, vol. 163(C), pages 142-153.
    10. Fan, Yi & Peng, Jiankun & Yu, Sichen & Yan, Fang & Wang, Zexing & Li, Menglin & Yan, Mei, 2025. "Global optimization guided energy management strategy for hybrid electric vehicles based on generative adversarial network embedded reinforcement learning," Energy, Elsevier, vol. 322(C).
    11. Zhang, Hailong & Peng, Jiankun & Dong, Hanxuan & Tan, Huachun & Ding, Fan, 2023. "Hierarchical reinforcement learning based energy management strategy of plug-in hybrid electric vehicle for ecological car-following process," Applied Energy, Elsevier, vol. 333(C).
    12. Quan, Shengwei & Wang, Ya-Xiong & Xiao, Xuelian & He, Hongwen & Sun, Fengchun, 2021. "Real-time energy management for fuel cell electric vehicle using speed prediction-based model predictive control considering performance degradation," Applied Energy, Elsevier, vol. 304(C).
    13. Zhou, Jiaxuan & Peng, Jiankun & Wu, Jingda & Wei, Zhongbao & Fan, Yi & Guo, Xin, 2024. "Multi-performance enhanced eco-driving strategy for connected fuel cell hybrid electric bus based on stein soft actor-3-critic," Energy, Elsevier, vol. 307(C).
    14. Hu, Lin & Tian, Qingtao & Zou, Changfu & Huang, Jing & Ye, Yao & Wu, Xianhui, 2022. "A study on energy distribution strategy of electric vehicle hybrid energy storage system considering driving style based on real urban driving data," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    15. Feng, Zhanyu & Zhang, Jian & Jiang, Han & Yao, Xuejian & Qian, Yu & Zhang, Haiyan, 2024. "Energy consumption prediction strategy for electric vehicle based on LSTM-transformer framework," Energy, Elsevier, vol. 302(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ling, Chenxi & Peng, Jiankun & Fan, Yi & Wang, Zexing & Yu, Sichen & Wu, Changcheng, 2025. "Safety-awareness enhanced eco-driving strategy for dual-motor electric vehicle in highway scenarios based on improved proximal policy optimization algorithm," Energy, Elsevier, vol. 340(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Jiaxuan & Peng, Jiankun & Wu, Jingda & Wei, Zhongbao & Fan, Yi & Guo, Xin, 2024. "Multi-performance enhanced eco-driving strategy for connected fuel cell hybrid electric bus based on stein soft actor-3-critic," Energy, Elsevier, vol. 307(C).
    2. Lei, Nuo & Zhang, Hao & Hu, Jingjing & Hu, Zunyan & Wang, Zhi, 2025. "Sim-to-real design and development of reinforcement learning-based energy management strategies for fuel cell electric vehicles," Applied Energy, Elsevier, vol. 393(C).
    3. Wu, Jinglai & Zhang, Yunqing & Ruan, Jiageng & Liang, Zhaowen & Liu, Kai, 2023. "Rule and optimization combined real-time energy management strategy for minimizing cost of fuel cell hybrid electric vehicles," Energy, Elsevier, vol. 285(C).
    4. Zhang, Baodi & Chang, Liang & Teng, Teng & Chen, Qifang & Li, Qiangwei & Cao, Yaoguang & Yang, Shichun & Zhang, Xin, 2024. "Multi-objective optimization with Q-learning for cruise and power allocation control parameters of connected fuel cell hybrid vehicles," Applied Energy, Elsevier, vol. 373(C).
    5. Shi, Dehua & Xu, Han & Wang, Shaohua & Hu, Jia & Chen, Long & Yin, Chunfang, 2024. "Deep reinforcement learning based adaptive energy management for plug-in hybrid electric vehicle with double deep Q-network," Energy, Elsevier, vol. 305(C).
    6. Lin, Xinyou & Zhou, Qiang & Tu, Jiayi & Xu, Xinhao & Xie, Liping, 2024. "Self-learning Markov prediction algorithm based aging-oriented gradient drop power control strategy for the transient modes of fuel cell hybrid electric vehicles," Applied Energy, Elsevier, vol. 376(PA).
    7. Huang, Ruchen & He, Hongwen & Su, Qicong & Härtl, Martin & Jaensch, Malte, 2025. "Type- and task-crossing energy management for fuel cell vehicles with longevity consideration: A heterogeneous deep transfer reinforcement learning framework," Applied Energy, Elsevier, vol. 377(PC).
    8. Huang, Ruchen & He, Hongwen & Su, Qicong & Wu, Jingda, 2025. "Towards sustainable and intelligent urban transportation: A novel deep transfer reinforcement learning framework for eco-driving of fuel cell buses," Energy, Elsevier, vol. 330(C).
    9. Zhang, Hao & Lei, Nuo & Chen, Boli & Li, Bingbing & Li, Rulong & Wang, Zhi, 2024. "Modeling and control system optimization for electrified vehicles: A data-driven approach," Energy, Elsevier, vol. 310(C).
    10. Zhou, Hongxu & Yu, Zhongwei & Wu, Xiaohua & Fan, Zhanfeng & Yin, Xiaofeng & Zhou, Lingxue, 2023. "Dynamic programming improved online fuzzy power distribution in a demonstration fuel cell hybrid bus," Energy, Elsevier, vol. 284(C).
    11. Macias, A. & Kandidayeni, M. & Boulon, L. & Trovão, J.P., 2021. "Fuel cell-supercapacitor topologies benchmark for a three-wheel electric vehicle powertrain," Energy, Elsevier, vol. 224(C).
    12. Mokesioluwa Fanoro & Mladen Božanić & Saurabh Sinha, 2022. "A Review of the Impact of Battery Degradation on Energy Management Systems with a Special Emphasis on Electric Vehicles," Energies, MDPI, vol. 15(16), pages 1-29, August.
    13. Ma, Shuai & Lin, Meng & Lin, Tzu-En & Lan, Tian & Liao, Xun & Maréchal, François & Van herle, Jan & Yang, Yongping & Dong, Changqing & Wang, Ligang, 2021. "Fuel cell-battery hybrid systems for mobility and off-grid applications: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    14. Chengqun, Qiu & Wan, Xinshan & Wang, Na & Cao, Sunjia & Ji, Xinchen & Wu, Kun & Hu, Yaoyu & Meng, Mingyu, 2023. "A novel regenerative braking energy recuperation system for electric vehicles based on driving style," Energy, Elsevier, vol. 283(C).
    15. Bo, Lin & Han, Lijin & Xiang, Changle & Liu, Hui & Ma, Tian, 2022. "A Q-learning fuzzy inference system based online energy management strategy for off-road hybrid electric vehicles," Energy, Elsevier, vol. 252(C).
    16. Dawei Zhong & Bolan Liu & Liang Liu & Wenhao Fan & Jingxian Tang, 2025. "Artificial Intelligence Algorithms for Hybrid Electric Powertrain System Control: A Review," Energies, MDPI, vol. 18(8), pages 1-30, April.
    17. Changqing Du & Shiyang Huang & Yuyao Jiang & Dongmei Wu & Yang Li, 2022. "Optimization of Energy Management Strategy for Fuel Cell Hybrid Electric Vehicles Based on Dynamic Programming," Energies, MDPI, vol. 15(12), pages 1-25, June.
    18. Wu, Xiaohua & Ma, Pengfei & Zhou, Lingxue & Fan, Zhanfeng & Zhu, Qingbo & Yin, Xiaofeng & Ouyang, Quan, 2025. "Collaborative optimization of velocity planning and energy management for fuel cell hybrid buses at multiple intersections and bus stations," Energy, Elsevier, vol. 326(C).
    19. Tian, Weiyong & Liu, Li & Zhang, Xiaohui & Shao, Jiaqi, 2024. "Flight trajectory and energy management coupled optimization for hybrid electric UAVs with adaptive sequential convex programming method," Applied Energy, Elsevier, vol. 364(C).
    20. Wang, Yue & Li, Weiliang & Wu, Jingda & Gao, Bolin & Zhong, Wei & He, Lei & Lv, Chen & He, Hongwen & Li, Keqiang, 2025. "Interaction-aware eco-driving control under complex traffic environment: A comprehensive review," Applied Energy, Elsevier, vol. 401(PB).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:336:y:2025:i:c:s0360544225039568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.