IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i16p6848-d1453345.html
   My bibliography  Save this article

Optimal Rule-Interposing Reinforcement Learning-Based Energy Management of Series—Parallel-Connected Hybrid Electric Vehicles

Author

Listed:
  • Lihong Dai

    (State Key Laboratory of Engines, Tianjin University, Tianjin 300072, China
    Chery Jetour Automobile Co., Ltd., Wuhu 241100, China)

  • Peng Hu

    (Chery Jetour Automobile Co., Ltd., Wuhu 241100, China)

  • Tianyou Wang

    (State Key Laboratory of Engines, Tianjin University, Tianjin 300072, China)

  • Guosheng Bian

    (KUNTYE Vehicle System Co., Ltd., Tongling 213025, China)

  • Haoye Liu

    (State Key Laboratory of Engines, Tianjin University, Tianjin 300072, China)

Abstract

P2–P3 series–parallel hybrid electric vehicles exhibit complex configurations with multiple power sources and operational modes, presenting a difficulty in developing efficient energy management strategies. This paper takes a P2–P3 series–parallel hybrid power system-KunTye 2DHT system as the research object and proposes a deep reinforcement learning framework based on pre-optimized energy management to improve the energy consumption performance of the hybrid electric vehicles. Firstly, a control-oriented model is established based on its system configuration and characteristics. Then, the optimal distribution of the motor energy under different operating modes is pre-optimized, which aims to reduce the energy management task’s dimensionality by equating two motors as an equivalent motor. Subsequently, based on real-time traffic information under connected conditions, deep reinforcement learning is utilized to optimize the optimal operating modes of the hybrid system and the optimal distribution between the engine and equivalent motors. Combining the pre-optimized results, the optimal energy distribution between the engine and the two motors in the system is achieved. Finally, performance comparisons are made between the predictive control and the traditional Dynamic Programming and Adaptive Equivalent Consumption Minimization Strategy, revealing the proposed optimization algorithm’s promising potential in reducing fuel consumption.

Suggested Citation

  • Lihong Dai & Peng Hu & Tianyou Wang & Guosheng Bian & Haoye Liu, 2024. "Optimal Rule-Interposing Reinforcement Learning-Based Energy Management of Series—Parallel-Connected Hybrid Electric Vehicles," Sustainability, MDPI, vol. 16(16), pages 1-17, August.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:16:p:6848-:d:1453345
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/16/6848/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/16/6848/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wu, Yitao & Zhang, Yuanjian & Li, Guang & Shen, Jiangwei & Chen, Zheng & Liu, Yonggang, 2020. "A predictive energy management strategy for multi-mode plug-in hybrid electric vehicles based on multi neural networks," Energy, Elsevier, vol. 208(C).
    2. Shi, Dehua & Liu, Sheng & Cai, Yingfeng & Wang, Shaohua & Li, Haoran & Chen, Long, 2021. "Pontryagin’s minimum principle based fuzzy adaptive energy management for hybrid electric vehicle using real-time traffic information," Applied Energy, Elsevier, vol. 286(C).
    3. Liu, Yonggang & Wu, Yitao & Wang, Xiangyu & Li, Liang & Zhang, Yuanjian & Chen, Zheng, 2023. "Energy management for hybrid electric vehicles based on imitation reinforcement learning," Energy, Elsevier, vol. 263(PC).
    4. Guo, Ningyuan & Zhang, Xudong & Zou, Yuan & Guo, Lingxiong & Du, Guodong, 2021. "Real-time predictive energy management of plug-in hybrid electric vehicles for coordination of fuel economy and battery degradation," Energy, Elsevier, vol. 214(C).
    5. Han, Lijin & Yang, Ke & Ma, Tian & Yang, Ningkang & Liu, Hui & Guo, Lingxiong, 2022. "Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning," Energy, Elsevier, vol. 259(C).
    6. Yang, Ningkang & Ruan, Shumin & Han, Lijin & Liu, Hui & Guo, Lingxiong & Xiang, Changle, 2023. "Reinforcement learning-based real-time intelligent energy management for hybrid electric vehicles in a model predictive control framework," Energy, Elsevier, vol. 270(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Han, Lijin & You, Congwen & Yang, Ningkang & Liu, Hui & Chen, Ke & Xiang, Changle, 2024. "Adaptive real-time energy management strategy using heuristic search for off-road hybrid electric vehicles," Energy, Elsevier, vol. 304(C).
    2. Yang, Ningkang & Han, Lijin & Bo, Lin & Liu, Baoshuai & Chen, Xiuqi & Liu, Hui & Xiang, Changle, 2023. "Real-time adaptive energy management for off-road hybrid electric vehicles based on decision-time planning," Energy, Elsevier, vol. 282(C).
    3. Guo, Ningyuan & Zhang, Wencan & Li, Junqiu & Chen, Zheng & Li, Jianwei & Sun, Chao, 2024. "Predictive energy management of fuel cell plug-in hybrid electric vehicles: A co-state boundaries-oriented PMP optimization approach," Applied Energy, Elsevier, vol. 362(C).
    4. Chen, Zheng & Gu, Hongji & Shen, Shiquan & Shen, Jiangwei, 2022. "Energy management strategy for power-split plug-in hybrid electric vehicle based on MPC and double Q-learning," Energy, Elsevier, vol. 245(C).
    5. Cui, Wei & Cui, Naxin & Li, Tao & Cui, Zhongrui & Du, Yi & Zhang, Chenghui, 2022. "An efficient multi-objective hierarchical energy management strategy for plug-in hybrid electric vehicle in connected scenario," Energy, Elsevier, vol. 257(C).
    6. Wei, Hongqian & Ai, Qiang & Zhao, Wenqiang & Zhang, Youtong, 2022. "Modelling and experimental validation of an EV torque distribution strategy towards active safety and energy efficiency," Energy, Elsevier, vol. 239(PA).
    7. Wilberforce, Tabbi & Anser, Afaaq & Swamy, Jangam Aishwarya & Opoku, Richard, 2023. "An investigation into hybrid energy storage system control and power distribution for hybrid electric vehicles," Energy, Elsevier, vol. 279(C).
    8. Liu, Yonggang & Wu, Yitao & Wang, Xiangyu & Li, Liang & Zhang, Yuanjian & Chen, Zheng, 2023. "Energy management for hybrid electric vehicles based on imitation reinforcement learning," Energy, Elsevier, vol. 263(PC).
    9. Zhou, Quan & Du, Changqing & Yan, Yunbing, 2024. "A multi-layer predictive energy management strategy for intelligent hybrid electric trucks collaborated with eco-driving control," Energy, Elsevier, vol. 308(C).
    10. Chen, Jie & Wang, Ruochen & Ding, Renkai & Luo, Ding, 2024. "Matching design and numerical optimization of automotive thermoelectric generator system applied to range-extended electric vehicle," Applied Energy, Elsevier, vol. 370(C).
    11. Ku, Donggyun & Choi, Minje & Yoo, Nakyoung & Shin, Seungheon & Lee, Seungjae, 2021. "A new algorithm for eco-friendly path guidance focused on electric vehicles," Energy, Elsevier, vol. 233(C).
    12. Ma, Zhikai & Huo, Qian & Wang, Wei & Zhang, Tao, 2023. "Voltage-temperature aware thermal runaway alarming framework for electric vehicles via deep learning with attention mechanism in time-frequency domain," Energy, Elsevier, vol. 278(C).
    13. Zhang, Yagang & Wang, Hui & Wang, Jingchao & Cheng, Xiaodan & Wang, Tong & Zhao, Zheng, 2024. "Ensemble optimization approach based on hybrid mode decomposition and intelligent technology for wind power prediction system," Energy, Elsevier, vol. 292(C).
    14. Gao, Kai & Luo, Pan & Xie, Jin & Chen, Bin & Wu, Yue & Du, Ronghua, 2023. "Energy management of plug-in hybrid electric vehicles based on speed prediction fused driving intention and LIDAR," Energy, Elsevier, vol. 284(C).
    15. Yavuz Eray Altun & Osman Akın Kutlar, 2024. "Energy Management Systems’ Modeling and Optimization in Hybrid Electric Vehicles," Energies, MDPI, vol. 17(7), pages 1-39, April.
    16. Wenna Xu & Hao Huang & Chun Wang & Yixin Hu & Xinmei Gao, 2025. "Research on Multi-Objective Parameter Matching and Stepwise Energy Management Strategies for Hybrid Energy Storage Systems," Energies, MDPI, vol. 18(6), pages 1-22, March.
    17. Chen, Fujun & Wang, Bowen & Ni, Meng & Gong, Zhichao & Jiao, Kui, 2024. "Online energy management strategy for ammonia-hydrogen hybrid electric vehicles harnessing deep reinforcement learning," Energy, Elsevier, vol. 301(C).
    18. Liu, Xinzhi & Qi, Nanjian & Dai, Keren & Yin, Yajiang & Zhao, Jiahao & Wang, Xiaofeng & You, Zheng, 2022. "Sponge Supercapacitor rule-based energy management strategy for wireless sensor nodes optimized by using dynamic programing algorithm," Energy, Elsevier, vol. 239(PE).
    19. da Silva, Samuel Filgueira & Eckert, Jony Javorski & Corrêa, Fernanda Cristina & Silva, Fabrício Leonardo & Silva, Ludmila C.A. & Dedini, Franco Giuseppe, 2022. "Dual HESS electric vehicle powertrain design and fuzzy control based on multi-objective optimization to increase driving range and battery life cycle," Applied Energy, Elsevier, vol. 324(C).
    20. Seydali Ferahtia & Hegazy Rezk & Rania M. Ghoniem & Ahmed Fathy & Reem Alkanhel & Mohamed M. Ghonem, 2023. "Optimal Energy Management for Hydrogen Economy in a Hybrid Electric Vehicle," Sustainability, MDPI, vol. 15(4), pages 1-19, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:16:p:6848-:d:1453345. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.