IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v335y2025ics0360544225034784.html

Deep reinforcement learning-based optimal decision-making framework for eco-driving in connected hub-motor electric vehicles

Author

Listed:
  • Abdullah, Mohamed
  • Liu, Shaoxun
  • Hu, Chuan
  • Zhang, Xi

Abstract

The integration of V2X communication in electric vehicles introduces new opportunities for energy-efficient and intelligent control, but also poses challenges for battery management and powertrain coordination. This paper presents a co-simulation framework of a connected hub-motor electric vehicle (CHMEV) in Simulink and SUMO, incorporating detailed models of the battery, in-wheel motors, and V2X modules. A multi-step optimal-based decision-making architecture is developed, combining deep reinforcement learning (DRL) with model predictive control (MPC) to compute optimal acceleration profiles for adaptive cruise control in V2X-enabled environments. A key contribution is a novel methodology to embed environmental constraints directly into the DRL training process via early-stage constraint-aware training, ensuring strict compliance with operational and safety boundaries. A torque allocation module was established, and a comprehensive analysis was conducted comparing three approaches to demonstrate the impact of different driving styles on battery and energy savings in both V2V and V2I scenarios. Simulation results demonstrate up to 22.2% improvement in energy efficiency under the proposed method in a V2I scenario, along with significant potential to extend battery life and vehicle driving range by applying a blended brake operation. The findings highlight the advantage of merging data-driven and model-based approaches for connected EV control.

Suggested Citation

  • Abdullah, Mohamed & Liu, Shaoxun & Hu, Chuan & Zhang, Xi, 2025. "Deep reinforcement learning-based optimal decision-making framework for eco-driving in connected hub-motor electric vehicles," Energy, Elsevier, vol. 335(C).
    • Handle: RePEc:eee:energy:v:335:y:2025:i:c:s0360544225034784
    DOI: 10.1016/j.energy.2025.137836
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225034784
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2025.137836?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Shi, Dehua & Xu, Han & Wang, Shaohua & Hu, Jia & Chen, Long & Yin, Chunfang, 2024. "Deep reinforcement learning based adaptive energy management for plug-in hybrid electric vehicle with double deep Q-network," Energy, Elsevier, vol. 305(C).
    2. Wang, Jinhai & Du, Changqing & Yan, Fuwu & Hua, Min & Gongye, Xiangyu & Yuan, Quan & Xu, Hongming & Zhou, Quan, 2025. "Bayesian optimization for hyper-parameter tuning of an improved twin delayed deep deterministic policy gradients based energy management strategy for plug-in hybrid electric vehicles," Applied Energy, Elsevier, vol. 381(C).
    3. Du, Guodong & Zou, Yuan & Zhang, Xudong & Liu, Teng & Wu, Jinlong & He, Dingbo, 2020. "Deep reinforcement learning based energy management for a hybrid electric vehicle," Energy, Elsevier, vol. 201(C).
    4. Lian, Renzong & Peng, Jiankun & Wu, Yuankai & Tan, Huachun & Zhang, Hailong, 2020. "Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle," Energy, Elsevier, vol. 197(C).
    5. Chen, Zheng & Hu, Hengjie & Wu, Yitao & Zhang, Yuanjian & Li, Guang & Liu, Yonggang, 2020. "Stochastic model predictive control for energy management of power-split plug-in hybrid electric vehicles based on reinforcement learning," Energy, Elsevier, vol. 211(C).
    6. Liu, Teng & Tan, Wenhao & Tang, Xiaolin & Zhang, Jinwei & Xing, Yang & Cao, Dongpu, 2021. "Driving conditions-driven energy management strategies for hybrid electric vehicles: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    7. Li, Jie & Wu, Xiaodong & Fan, Jiawei & Liu, Yonggang & Xu, Min, 2023. "Overcoming driving challenges in complex urban traffic: A multi-objective eco-driving strategy via safety model based reinforcement learning," Energy, Elsevier, vol. 284(C).
    8. Liu, Bo & Sun, Chao & Wang, Bo & Liang, Weiqiang & Ren, Qiang & Li, Junqiu & Sun, Fengchun, 2022. "Bi-level convex optimization of eco-driving for connected Fuel Cell Hybrid Electric Vehicles through signalized intersections," Energy, Elsevier, vol. 252(C).
    9. Li, Jie & Fotouhi, Abbas & Pan, Wenjun & Liu, Yonggang & Zhang, Yuanjian & Chen, Zheng, 2023. "Deep reinforcement learning-based eco-driving control for connected electric vehicles at signalized intersections considering traffic uncertainties," Energy, Elsevier, vol. 279(C).
    10. Wang, Zhifu & Zhang, Shunshun & Luo, Wei & Xu, Song, 2024. "Deep reinforcement learning with deep-Q-network based energy management for fuel cell hybrid electric truck," Energy, Elsevier, vol. 306(C).
    11. Wei, Hongqian & Ai, Qiang & Zhao, Wenqiang & Zhang, Youtong, 2022. "Modelling and experimental validation of an EV torque distribution strategy towards active safety and energy efficiency," Energy, Elsevier, vol. 239(PA).
    12. Liao, Peng & Tang, Tie-Qiao & Liu, Ronghui & Huang, Hai-Jun, 2021. "An eco-driving strategy for electric vehicle based on the powertrain," Applied Energy, Elsevier, vol. 302(C).
    13. Nesma M Ashraf & Reham R Mostafa & Rasha H Sakr & M Z Rashad, 2021. "Optimizing hyperparameters of deep reinforcement learning for autonomous driving based on whale optimization algorithm," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-24, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dagang Lu & Yu Chen & Yan Sun & Wenxuan Wei & Shilin Ji & Hongshuo Ruan & Fengyan Yi & Chunchun Jia & Donghai Hu & Kunpeng Tang & Song Huang & Jing Wang, 2025. "Research Progress in Multi-Domain and Cross-Domain AI Management and Control for Intelligent Electric Vehicles," Energies, MDPI, vol. 18(17), pages 1-52, August.
    2. Yang, Dongpo & Liu, Tong & Song, Dafeng & Zhang, Xuanming & Zeng, Xiaohua, 2023. "A real time multi-objective optimization Guided-MPC strategy for power-split hybrid electric bus based on velocity prediction," Energy, Elsevier, vol. 276(C).
    3. Dawei Zhong & Bolan Liu & Liang Liu & Wenhao Fan & Jingxian Tang, 2025. "Artificial Intelligence Algorithms for Hybrid Electric Powertrain System Control: A Review," Energies, MDPI, vol. 18(8), pages 1-30, April.
    4. Wang, Yue & Li, Weiliang & Wu, Jingda & Gao, Bolin & Zhong, Wei & He, Lei & Lv, Chen & He, Hongwen & Li, Keqiang, 2025. "Interaction-aware eco-driving control under complex traffic environment: A comprehensive review," Applied Energy, Elsevier, vol. 401(PB).
    5. Dong, Peng & Zhao, Junwei & Liu, Xuewu & Wu, Jian & Xu, Xiangyang & Liu, Yanfang & Wang, Shuhan & Guo, Wei, 2022. "Practical application of energy management strategy for hybrid electric vehicles based on intelligent and connected technologies: Development stages, challenges, and future trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    6. Kong, Yan & Xu, Nan & Liu, Qiao & Sui, Yan & Yue, Fenglai, 2023. "A data-driven energy management method for parallel PHEVs based on action dependent heuristic dynamic programming (ADHDP) model," Energy, Elsevier, vol. 265(C).
    7. Li, Jie & Wu, Xiaodong & Xu, Min & Liu, Yonggang, 2022. "Deep reinforcement learning and reward shaping based eco-driving control for automated HEVs among signalized intersections," Energy, Elsevier, vol. 251(C).
    8. Li, Menglin & Yin, Long & Yan, Mei & Wu, Jingda & He, Hongwe & Jia, Chunchun, 2024. "Hierarchical intelligent energy-saving control strategy for fuel cell hybrid electric buses based on traffic flow predictions," Energy, Elsevier, vol. 304(C).
    9. Xiang Tian & Ma Wan & Xinqiang Chen & Yingfeng Cai & Xiaodong Sun & Zhen Zhu, 2025. "Driver-Oriented Adaptive Equivalent Consumption Minimization Strategy for Plug-in Hybrid Electric Buses," Energies, MDPI, vol. 18(18), pages 1-18, September.
    10. Zhu, Tao & Wills, Richard G.A. & Lot, Roberto & Ruan, Haijun & Jiang, Zhihao, 2021. "Adaptive energy management of a battery-supercapacitor energy storage system for electric vehicles based on flexible perception and neural network fitting," Applied Energy, Elsevier, vol. 292(C).
    11. Jiang, Yue & Meng, Hao & Chen, Guanpeng & Yang, Congnan & Xu, Xiaojun & Zhang, Lei & Xu, Haijun, 2022. "Differential-steering based path tracking control and energy-saving torque distribution strategy of 6WID unmanned ground vehicle," Energy, Elsevier, vol. 254(PA).
    12. Ju, Fei & Zhuang, Weichao & Wang, Liangmo & Zhang, Zhe, 2020. "Comparison of four-wheel-drive hybrid powertrain configurations," Energy, Elsevier, vol. 209(C).
    13. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    14. Miranda, Matheus H.R. & Silva, Fabrício L. & Lourenço, Maria A.M. & Eckert, Jony J. & Silva, Ludmila C.A., 2022. "Vehicle drivetrain and fuzzy controller optimization using a planar dynamics simulation based on a real-world driving cycle," Energy, Elsevier, vol. 257(C).
    15. Penghui Qiang & Peng Wu & Tao Pan & Huaiquan Zang, 2021. "Real-Time Approximate Equivalent Consumption Minimization Strategy Based on the Single-Shaft Parallel Hybrid Powertrain," Energies, MDPI, vol. 14(23), pages 1-22, November.
    16. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    17. Sundar, Anirudh & Ghate, Atharva & Zhu, Qilun & Prucka, Robert & Figueroa-Santos, Miriam & Barron, Morgan, 2026. "An integrated power, energy, and thermal management strategy using cascaded Control for off-road autonomous hybrid vehicles," Applied Energy, Elsevier, vol. 406(C).
    18. Huang, Ruchen & He, Hongwen & Su, Qicong & Härtl, Martin & Jaensch, Malte, 2025. "Type- and task-crossing energy management for fuel cell vehicles with longevity consideration: A heterogeneous deep transfer reinforcement learning framework," Applied Energy, Elsevier, vol. 377(PC).
    19. Qi, Chunyang & Zhu, Yiwen & Song, Chuanxue & Yan, Guangfu & Xiao, Feng & Da wang, & Zhang, Xu & Cao, Jingwei & Song, Shixin, 2022. "Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle," Energy, Elsevier, vol. 238(PA).
    20. Tan, Yingqi & Xu, Jingyi & Ma, Junyi & Li, Zirui & Chen, Huiyan & Xi, Junqiang & Liu, Haiou, 2024. "A transferable perception-guided EMS for series hybrid electric unmanned tracked vehicles," Energy, Elsevier, vol. 306(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:335:y:2025:i:c:s0360544225034784. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.