IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v335y2025ics0360544225036783.html

Evolutionary integrated thermal and energy management strategy based on reinforcement learning for distributed four-wheel drive electric vehicles

Author

Listed:
  • Wu, Changcheng
  • Peng, Jiankun
  • Guo, Xin
  • Jia, Yongqiang
  • Cao, Guanghui

Abstract

Under the impetus of transportation electrification and intelligentization, distributed four-wheel drive electric vehicles (4WD-EVs) have emerged as a pivotal new energy vehicle architecture. However, high-frequency dynamic coordination of multiple motors leads to challenges in energy and thermal management. Traditional energy management strategies and thermal management strategies have been independently optimized, neglecting the intricate coupling relationship between them. This study elucidates the nonlinear coupling between energy management strategies and thermal management strategies in 4WD-EVs and proposes an improved soft actor-critic (SAC) integrated with an evolutionary strategy (ES) to develop an integrated thermal and energy management strategy (ITEMS). The collaborative learning framework enables joint optimization of power distribution and thermodynamic regulation. Compared to model predictive control-based ITEMS, simulation results show the proposed improved SAC based ITEMS reduces energy consumption by 5.52 % for energy management tasks and 15.94 % for thermal management tasks. Meanwhile, it achieves more precise temperature control for motors, battery, and the cabin among these comparison ITEMSs. Moreover, the embedded ES effectively lowers the power consumption of thermal management accessories while improving motor efficiency. This study provides a novel learning framework for breaking through the performance ceiling of 4WD-EVs.

Suggested Citation

  • Wu, Changcheng & Peng, Jiankun & Guo, Xin & Jia, Yongqiang & Cao, Guanghui, 2025. "Evolutionary integrated thermal and energy management strategy based on reinforcement learning for distributed four-wheel drive electric vehicles," Energy, Elsevier, vol. 335(C).
  • Handle: RePEc:eee:energy:v:335:y:2025:i:c:s0360544225036783
    DOI: 10.1016/j.energy.2025.138036
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225036783
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.138036?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Fu, Jianqin & Li, Hao & Sun, Xilei & He, Tingpu & Zhang, Guanjie & Wei, Changhe, 2025. "Multi-physics simulation modeling and energy flow characterization of thermal management system for a sport utility vehicle under high-temperature conditions," Energy, Elsevier, vol. 316(C).
    2. Ling, Chenxi & Peng, Jiankun & Fan, Yi & Wu, Changcheng & Zhou, Jiaxuan & Yu, Sichen, 2025. "Ecological driving strategy for dual-motor electric vehicles based on sequential hierarchical deep reinforcement learning," Energy, Elsevier, vol. 333(C).
    3. Hemmati, S. & Doshi, N. & Hanover, D. & Morgan, C. & Shahbakhti, M., 2021. "Integrated cabin heating and powertrain thermal energy management for a connected hybrid electric vehicle," Applied Energy, Elsevier, vol. 283(C).
    4. Sun, Xilei & Zhou, Feng & Fu, Jianqin & Liu, Jingping, 2024. "Experiment and simulation study on energy flow characteristics of a battery electric vehicle throughout the entire driving range in low-temperature conditions," Energy, Elsevier, vol. 292(C).
    5. Sun, Xilei & Fu, Jianqin, 2024. "Many-objective optimization of BEV design parameters based on gradient boosting decision tree models and the NSGA-III algorithm considering the ambient temperature," Energy, Elsevier, vol. 288(C).
    6. Zhou, Jiaxuan & Peng, Jiankun & Wu, Jingda & Wei, Zhongbao & Fan, Yi & Guo, Xin, 2024. "Multi-performance enhanced eco-driving strategy for connected fuel cell hybrid electric bus based on stein soft actor-3-critic," Energy, Elsevier, vol. 307(C).
    7. Wu, Changcheng & Peng, Jiankun & Chen, Jun & He, Hongwen & Pi, Dawei & Wang, Zhongwei & Ma, Chunye, 2024. "Battery health-considered energy management strategy for a dual-motor two-speed battery electric vehicle based on a hybrid soft actor-critic algorithm with memory function," Applied Energy, Elsevier, vol. 376(PB).
    8. Liang, Zhaowen & Ruan, Jiageng & Wang, Zhenpo & Liu, Kai & Li, Bin, 2024. "Soft actor-critic-based EMS design for dual motor battery electric bus," Energy, Elsevier, vol. 288(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ling, Chenxi & Peng, Jiankun & Fan, Yi & Wang, Zexing & Yu, Sichen & Wu, Changcheng, 2025. "Safety-awareness enhanced eco-driving strategy for dual-motor electric vehicle in highway scenarios based on improved proximal policy optimization algorithm," Energy, Elsevier, vol. 340(C).
    2. Wei, Xiaofei & Qian, Yejian & Gong, Zhen & Yao, Mingyao & Meng, Shun & Zhang, Yu & Xu, Zefei & Qian, Duode & Zhang, Chao, 2024. "Experimental and numerical study on energy flow characteristics of a plug-in hybrid electric vehicle with integrated thermal management system," Energy, Elsevier, vol. 312(C).
    3. Shen, Yaorui & Fu, Jianqin & Li, Chao & Chang, Chaozheng & Sun, Xilei, 2025. "Irreversible thermodynamics-driven optimization of proton exchange membrane fuel cell with gradient-structured cathode catalyst layers," Renewable Energy, Elsevier, vol. 253(C).
    4. Lei, Nuo & Zhang, Hao & Hu, Jingjing & Hu, Zunyan & Wang, Zhi, 2025. "Sim-to-real design and development of reinforcement learning-based energy management strategies for fuel cell electric vehicles," Applied Energy, Elsevier, vol. 393(C).
    5. Zhang, Baifu & Zhao, Zhen & Li, Yongxin & Zhang, Xiaohui & Li, Xinjun & Hao, Daning & Zhang, Zutao, 2025. "Design and analysis of a piezoelectric energy harvesting shock absorber for light truck applications," Applied Energy, Elsevier, vol. 377(PB).
    6. Alexander Wahl & Christoph Wellmann & Björn Krautwig & Patrick Manns & Bicheng Chen & Christof Schernus & Jakob Andert, 2022. "Efficiency Increase through Model Predictive Thermal Control of Electric Vehicle Powertrains," Energies, MDPI, vol. 15(4), pages 1-21, February.
    7. Haibo Wu & Xingwang Tang & Sichuan Xu & Jiangbin Zhou, 2022. "Research on Energy Saving of PHEV Air Conditioning System Based on Reducing Air Backflow in Underhood," Energies, MDPI, vol. 15(9), pages 1-15, April.
    8. Sun, Xilei & Zhou, Feng & Fu, Jianqin & Liu, Jingping, 2024. "Experiment and simulation study on energy flow characteristics of a battery electric vehicle throughout the entire driving range in low-temperature conditions," Energy, Elsevier, vol. 292(C).
    9. Guo, Xin & Peng, Jiankun & Jia, Yongqiang & Peng, Yangcheng & Ma, Chunye, 2026. "Integrated energy and thermal strategy for connected 4WID- EVs platoon via multi-agent reinforcement learning: A cloud-to-vehicle hierarchical control architecture," Energy, Elsevier, vol. 344(C).
    10. Yu, Sichen & Peng, Jiankun & Zhou, Jiaxuan & Ren, Tinghui & Wu, Jingda & Fan, Yi, 2025. "Durability-enhanced decision-making with style awareness for autonomous hydrogen fuel cell vehicle based on integrated reinforcement learning approaches," Energy, Elsevier, vol. 336(C).
    11. Huang, Ruchen & He, Hongwen & Su, Qicong & Wu, Jingda, 2025. "Towards sustainable and intelligent urban transportation: A novel deep transfer reinforcement learning framework for eco-driving of fuel cell buses," Energy, Elsevier, vol. 330(C).
    12. Xi, Dexiang & Jiang, Longlong & Cui, Jingchen & Sun, Xilei & Long, Wuqiang, 2025. "Fuel economy-emission trade-off optimization for diesel/natural gas dual-fuel engine using many-objective many-population hybrid genetic algorithm," Energy, Elsevier, vol. 333(C).
    13. Wang, Rumin & Liu, Jingping & Duan, Xiongbo, 2025. "Synergistic effects of n-butanol and hydrogen on combustion stability, efficiency, and emissions in a gasoline engine at low load," Energy, Elsevier, vol. 335(C).
    14. Li, Chao & Fu, Jianqin & Huang, Yuting & Sun, Xilei, 2024. "Experimental analysis and physics-informed optimization algorithm for ejector in fuel cells based on boundary-breaking and dimension reduction," Renewable Energy, Elsevier, vol. 237(PC).
    15. Zhou, Xingyu & Guo, Yuekai & Huang, Youliang & Zhao, Nianhan, 2025. "Driving cycle reproduction supported deep learning co-optimization of freight EV powertrains in stochastic operation environments," Energy, Elsevier, vol. 340(C).
    16. Zhang, Hong & Zhao, Yuxuan & Tian, Yu & Zhang, Yifan & Tao, Zhenyi & Xu, Shiqi, 2025. "Multi-level optimization of low-temperature heating methods for large-capacity lithium-ion batteries based on temperature uniformity," Energy, Elsevier, vol. 330(C).
    17. Zhou, Feng & Wu, Chenghao & Fu, Jianqin & Liu, Jingping & Duan, Xiongbo & Sun, Zhiqiang, 2025. "Abnormal combustion and NOx emissions control strategies of hydrogen internal combustion engine," Renewable and Sustainable Energy Reviews, Elsevier, vol. 219(C).
    18. Maksymilian Mądziel, 2025. "State of Charge Prediction for Li-Ion Batteries in EVs for Traffic Microsimulation," Energies, MDPI, vol. 18(18), pages 1-24, September.
    19. Ren, Zhaolong & Song, Yulong & Yin, Xiang & Cao, Feng & Wang, Yibiao, 2025. "Energetic and driving range investigation of the ejector enhanced CO2 thermal management system used in electric vehicles," Energy, Elsevier, vol. 324(C).
    20. Ivan Panfilov & Alexey N. Beskopylny & Besarion Meskhi, 2023. "Numerical Simulation of Heat Transfer and Spread of Virus Particles in the Car Interior," Mathematics, MDPI, vol. 11(3), pages 1-18, February.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:335:y:2025:i:c:s0360544225036783. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.