IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v265y2023ics0360544222031929.html
   My bibliography  Save this article

A data-driven energy management method for parallel PHEVs based on action dependent heuristic dynamic programming (ADHDP) model

Author

Listed:
  • Kong, Yan
  • Xu, Nan
  • Liu, Qiao
  • Sui, Yan
  • Yue, Fenglai

Abstract

Due to the strong self-learning ability and adaptability of neural network, adaptive dynamic programming (ADP) method is regarded as an effective method to improve the vehicle economy in the case of uncertain driving conditions. With the look-ahead information, a data-driven energy management method is proposed based on action dependent heuristic dynamic programming (ADHDP) algorithm. Firstly, based on statistical analysis of DP behavior, a reference SOC trajectory is generated to limit the electricity consumption, which is adjusted with the dynamically updated driving information. Then, a data-driven energy management control method is developed for HEV architectures, including information acquisition module, shift scheduling module, energy distribution module. The gear shift command is designed by enumeration and the power distribution is performed by multiple ADHDP models, the core of which is to determine the utility function, action network (ANN), critic network (CNN) and training process. To ensure practical driveability, the restrictions on gear shifting and engine starting-stopping are taken as additional conditions in ADHDP optimizing process. Finally, two case studies under different driving scenarios are given. Simulation results demonstrate that the proposed method gains a good performance in both optimality approximation and adaptivity to uncertain driving conditions.

Suggested Citation

  • Kong, Yan & Xu, Nan & Liu, Qiao & Sui, Yan & Yue, Fenglai, 2023. "A data-driven energy management method for parallel PHEVs based on action dependent heuristic dynamic programming (ADHDP) model," Energy, Elsevier, vol. 265(C).
    • Handle: RePEc:eee:energy:v:265:y:2023:i:c:s0360544222031929
    DOI: 10.1016/j.energy.2022.126306
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544222031929
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2022.126306?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Bin & Rathod, Dhruvang & Zhang, Darui & Yebi, Adamu & Zhang, Xueyu & Li, Xiaoya & Filipi, Zoran, 2020. "Parametric study on reinforcement learning optimized energy management strategy for a hybrid electric vehicle," Applied Energy, Elsevier, vol. 259(C).
    2. Shabbir, Wassif & Evangelou, Simos A., 2014. "Real-time control strategy to maximize hybrid electric vehicle powertrain efficiency," Applied Energy, Elsevier, vol. 135(C), pages 512-522.
    3. Du, Guodong & Zou, Yuan & Zhang, Xudong & Liu, Teng & Wu, Jinlong & He, Dingbo, 2020. "Deep reinforcement learning based energy management for a hybrid electric vehicle," Energy, Elsevier, vol. 201(C).
    4. Lin, Xinyou & Wu, Jiayun & Wei, Yimin, 2021. "An ensemble learning velocity prediction-based energy management strategy for a plug-in hybrid electric vehicle considering driving pattern adaptive reference SOC," Energy, Elsevier, vol. 234(C).
    5. Sun, Chao & Sun, Fengchun & He, Hongwen, 2017. "Investigating adaptive-ECMS with velocity forecast ability for hybrid electric vehicles," Applied Energy, Elsevier, vol. 185(P2), pages 1644-1653.
    6. Lian, Renzong & Peng, Jiankun & Wu, Yuankai & Tan, Huachun & Zhang, Hailong, 2020. "Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle," Energy, Elsevier, vol. 197(C).
    7. Chen, Zheng & Hu, Hengjie & Wu, Yitao & Zhang, Yuanjian & Li, Guang & Liu, Yonggang, 2020. "Stochastic model predictive control for energy management of power-split plug-in hybrid electric vehicles based on reinforcement learning," Energy, Elsevier, vol. 211(C).
    8. Shuai, Bin & Zhou, Quan & Li, Ji & He, Yinglong & Li, Ziyang & Williams, Huw & Xu, Hongming & Shuai, Shijin, 2020. "Heuristic action execution for energy efficient charge-sustaining control of connected hybrid vehicles with model-free double Q-learning," Applied Energy, Elsevier, vol. 267(C).
    9. Kong, Yan & Xu, Nan & Zhang, Yuanjian & Sui, Yan & Ju, Hao & Liu, Heng & Xu, Zhe, 2021. "Acquisition of full-factor trip information for global optimization energy management in multi-energy source vehicles and the measure of the amount of information to be transmitted," Energy, Elsevier, vol. 236(C).
    10. Xu, Nan & Kong, Yan & Zhang, Yuanjian & Yue, Fenglai & Sui, Yan & Li, Xiaohan & Liu, Heng & Xu, Zhe, 2022. "Determination of vehicle working modes for global optimization energy management and evaluation of the economic performance for a certain control strategy," Energy, Elsevier, vol. 251(C).
    11. Qi, Chunyang & Zhu, Yiwen & Song, Chuanxue & Yan, Guangfu & Xiao, Feng & Da wang, & Zhang, Xu & Cao, Jingwei & Song, Shixin, 2022. "Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle," Energy, Elsevier, vol. 238(PA).
    12. Hou, Cong & Ouyang, Minggao & Xu, Liangfei & Wang, Hewu, 2014. "Approximate Pontryagin’s minimum principle applied to the energy management of plug-in hybrid electric vehicles," Applied Energy, Elsevier, vol. 115(C), pages 174-189.
    13. Changqing Du & Shiyang Huang & Yuyao Jiang & Dongmei Wu & Yang Li, 2022. "Optimization of Energy Management Strategy for Fuel Cell Hybrid Electric Vehicles Based on Dynamic Programming," Energies, MDPI, vol. 15(12), pages 1-25, June.
    14. Wei, Changyin & Sun, Xiuxiu & Chen, Yong & Zang, Libin & Bai, Shujie, 2021. "Comparison of architecture and adaptive energy management strategy for plug-in hybrid electric logistics vehicle," Energy, Elsevier, vol. 230(C).
    15. Chen, Zheng & Xia, Bing & You, Chenwen & Mi, Chunting Chris, 2015. "A novel energy management method for series plug-in hybrid electric vehicles," Applied Energy, Elsevier, vol. 145(C), pages 172-179.
    16. Fan, Likang & Wang, Yufei & Wei, Hongqian & Zhang, Youtong & Zheng, Pengyu & Huang, Tianyi & Li, Wei, 2022. "A GA-based online real-time optimized energy management strategy for plug-in hybrid electric vehicles," Energy, Elsevier, vol. 241(C).
    17. Enang, Wisdom & Bannister, Chris, 2017. "Modelling and control of hybrid electric vehicles (A comprehensive review)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 1210-1239.
    18. Xie, Shanshan & He, Hongwen & Peng, Jiankun, 2017. "An energy management strategy based on stochastic model predictive control for plug-in hybrid electric buses," Applied Energy, Elsevier, vol. 196(C), pages 279-288.
    19. Chen, Zeyu & Xiong, Rui & Wang, Chun & Cao, Jiayi, 2017. "An on-line predictive energy management strategy for plug-in hybrid electric vehicles to counter the uncertain prediction of the driving cycle," Applied Energy, Elsevier, vol. 185(P2), pages 1663-1672.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gao, Kai & Luo, Pan & Xie, Jin & Chen, Bin & Wu, Yue & Du, Ronghua, 2023. "Energy management of plug-in hybrid electric vehicles based on speed prediction fused driving intention and LIDAR," Energy, Elsevier, vol. 284(C).
    2. Wang, Shaohua & Zhang, Kaimei & Shi, Dehua & Li, Meng & Yin, Chunfang, 2024. "Research on economical shifting strategy for multi-gear and multi-mode parallel plug-in HEV based on DIRECT algorithm," Energy, Elsevier, vol. 286(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Teng & Tan, Wenhao & Tang, Xiaolin & Zhang, Jinwei & Xing, Yang & Cao, Dongpu, 2021. "Driving conditions-driven energy management strategies for hybrid electric vehicles: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    2. Zhuang, Weichao & Li (Eben), Shengbo & Zhang, Xiaowu & Kum, Dongsuk & Song, Ziyou & Yin, Guodong & Ju, Fei, 2020. "A survey of powertrain configuration studies on hybrid electric vehicles," Applied Energy, Elsevier, vol. 262(C).
    3. Yang, Dongpo & Liu, Tong & Song, Dafeng & Zhang, Xuanming & Zeng, Xiaohua, 2023. "A real time multi-objective optimization Guided-MPC strategy for power-split hybrid electric bus based on velocity prediction," Energy, Elsevier, vol. 276(C).
    4. Wang, Yue & Li, Keqiang & Zeng, Xiaohua & Gao, Bolin & Hong, Jichao, 2023. "Investigation of novel intelligent energy management strategies for connected HEB considering global planning of fixed-route information," Energy, Elsevier, vol. 263(PB).
    5. Dong, Peng & Zhao, Junwei & Liu, Xuewu & Wu, Jian & Xu, Xiangyang & Liu, Yanfang & Wang, Shuhan & Guo, Wei, 2022. "Practical application of energy management strategy for hybrid electric vehicles based on intelligent and connected technologies: Development stages, challenges, and future trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    6. Zhu, Tao & Wills, Richard G.A. & Lot, Roberto & Ruan, Haijun & Jiang, Zhihao, 2021. "Adaptive energy management of a battery-supercapacitor energy storage system for electric vehicles based on flexible perception and neural network fitting," Applied Energy, Elsevier, vol. 292(C).
    7. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    8. Miranda, Matheus H.R. & Silva, Fabrício L. & Lourenço, Maria A.M. & Eckert, Jony J. & Silva, Ludmila C.A., 2022. "Vehicle drivetrain and fuzzy controller optimization using a planar dynamics simulation based on a real-world driving cycle," Energy, Elsevier, vol. 257(C).
    9. Penghui Qiang & Peng Wu & Tao Pan & Huaiquan Zang, 2021. "Real-Time Approximate Equivalent Consumption Minimization Strategy Based on the Single-Shaft Parallel Hybrid Powertrain," Energies, MDPI, vol. 14(23), pages 1-22, November.
    10. Zhuang, Weichao & Zhang, Xiaowu & Li, Daofei & Wang, Liangmo & Yin, Guodong, 2017. "Mode shift map design and integrated energy management control of a multi-mode hybrid electric vehicle," Applied Energy, Elsevier, vol. 204(C), pages 476-488.
    11. Fengqi Zhang & Lihua Wang & Serdar Coskun & Hui Pang & Yahui Cui & Junqiang Xi, 2020. "Energy Management Strategies for Hybrid Electric Vehicles: Review, Classification, Comparison, and Outlook," Energies, MDPI, vol. 13(13), pages 1-35, June.
    12. Wei, Changyin & Sun, Xiuxiu & Chen, Yong & Zang, Libin & Bai, Shujie, 2021. "Comparison of architecture and adaptive energy management strategy for plug-in hybrid electric logistics vehicle," Energy, Elsevier, vol. 230(C).
    13. Li, Guozhen & Zhang, Zhenyu & Shi, Wankai & Li, Wenyong, 2023. "Energy management strategy and simulation analysis of a hybrid train based on a comprehensive efficiency optimization," Applied Energy, Elsevier, vol. 349(C).
    14. Xie, Shaobo & Hu, Xiaosong & Xin, Zongke & Brighton, James, 2019. "Pontryagin’s Minimum Principle based model predictive control of energy management for a plug-in hybrid electric bus," Applied Energy, Elsevier, vol. 236(C), pages 893-905.
    15. Marouane Adnane & Ahmed Khoumsi & João Pedro F. Trovão, 2023. "Efficient Management of Energy Consumption of Electric Vehicles Using Machine Learning—A Systematic and Comprehensive Survey," Energies, MDPI, vol. 16(13), pages 1-39, June.
    16. Yang, Chao & Du, Xuelong & Wang, Weida & Yuan, Lijuan & Yang, Liuquan, 2024. "Variable optimization domain-based cooperative energy management strategy for connected plug-in hybrid electric vehicles," Energy, Elsevier, vol. 290(C).
    17. Qi, Chunyang & Song, Chuanxue & Xiao, Feng & Song, Shixin, 2022. "Generalization ability of hybrid electric vehicle energy management strategy based on reinforcement learning method," Energy, Elsevier, vol. 250(C).
    18. Lin, Xinyou & Zeng, Songrong & Li, Xuefan, 2021. "Online correction predictive energy management strategy using the Q-learning based swarm optimization with fuzzy neural network," Energy, Elsevier, vol. 223(C).
    19. Wei, Changyin & Chen, Yong & Li, Xiaoyu & Lin, Xiaozhe, 2022. "Integrating intelligent driving pattern recognition with adaptive energy management strategy for extender range electric logistics vehicle," Energy, Elsevier, vol. 247(C).
    20. Chen, Zheng & Hu, Hengjie & Wu, Yitao & Zhang, Yuanjian & Li, Guang & Liu, Yonggang, 2020. "Stochastic model predictive control for energy management of power-split plug-in hybrid electric vehicles based on reinforcement learning," Energy, Elsevier, vol. 211(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:265:y:2023:i:c:s0360544222031929. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.