IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v329y2023ics030626192201529x.html
   My bibliography  Save this article

Enabling Safety-Enhanced fast charging of electric vehicles via soft actor Critic-Lagrange DRL algorithm in a Cyber-Physical system

Author

Listed:
  • Yang, Xiaofeng
  • He, Hongwen
  • Wei, Zhongbao
  • Wang, Rui
  • Xu, Ke
  • Zhang, Dong

Abstract

Fast charging of lithium-ion battery (LIB) is critical for the further popularity of electric vehicles. However, the partial pursuit of high-power charging can violate the physical limits of LIB, and further cause unexpected side effects or even catastrophic safety issues. Motivated by this, this paper proposes a multi-state-constrained fast charging strategy for LIB, enabled by a novel deep reinforcement learning (DRL) technique. In particular, the SAC-Lagrange DRL is developed, for the first time, to train the fast-charging strategy assisted by an electro-thermal model for unmeasurable state perceiving. The proposed strategy is further performed within a cyber-physical system-based management framework, where the complicated training is carried out in the cloud, while the trained low-complexity policy is executed in the onboard controller to mitigate the risk of high computing burden. Hardware-in-Loop tests and practical charging experiments are carried out for validation. Results reveal that the proposed strategy can boost the charging speed remarkably while smartly avoid violating the electrical and thermal safety limits of LIB. Compared with the advanced DDPG-based and SAC-based strategies, the proposed one has improved the optimality and stability, and thus enjoys more guaranteed convenience and versatility in practical charging applications.

Suggested Citation

  • Yang, Xiaofeng & He, Hongwen & Wei, Zhongbao & Wang, Rui & Xu, Ke & Zhang, Dong, 2023. "Enabling Safety-Enhanced fast charging of electric vehicles via soft actor Critic-Lagrange DRL algorithm in a Cyber-Physical system," Applied Energy, Elsevier, vol. 329(C).
  • Handle: RePEc:eee:appene:v:329:y:2023:i:c:s030626192201529x
    DOI: 10.1016/j.apenergy.2022.120272
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626192201529X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2022.120272?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Changfu & Hu, Xiaosong & Wei, Zhongbao & Tang, Xiaolin, 2017. "Electrothermal dynamics-conscious lithium-ion battery cell-level charging management via state-monitored predictive control," Energy, Elsevier, vol. 141(C), pages 250-259.
    2. Sun, Wenjing & Zou, Yuan & Zhang, Xudong & Guo, Ningyuan & Zhang, Bin & Du, Guodong, 2022. "High robustness energy management strategy of hybrid electric vehicle based on improved soft actor-critic deep reinforcement learning," Energy, Elsevier, vol. 258(C).
    3. Ignacio Rodriguez & Rasmus Suhr Mogensen & Andreas Fink & Taus Raunholt & Søren Markussen & Per Hartmann Christensen & Gilberto Berardinelli & Preben Mogensen & Casper Schou & Ole Madsen, 2021. "An Experimental Framework for 5G Wireless System Integration into Industry 4.0 Applications," Energies, MDPI, vol. 14(15), pages 1-23, July.
    4. Xiao, Boyi & Yang, Weiwei & Wu, Jiamin & Walker, Paul D. & Zhang, Nong, 2022. "Energy management strategy via maximum entropy reinforcement learning for an extended range logistics vehicle," Energy, Elsevier, vol. 253(C).
    5. Chu, Zhengyu & Feng, Xuning & Lu, Languang & Li, Jianqiu & Han, Xuebing & Ouyang, Minggao, 2017. "Non-destructive fast charging algorithm of lithium-ion batteries based on the control-oriented electrochemical model," Applied Energy, Elsevier, vol. 204(C), pages 1240-1250.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Qian & Wang, Jun & Xiong, Rui & Shen, Weixiang & He, Hongwen, 2019. "Towards a smarter battery management system: A critical review on optimal charging methods of lithium ion batteries," Energy, Elsevier, vol. 183(C), pages 220-234.
    2. Sattarzadeh, Sara & Padisala, Shanthan K. & Shi, Ying & Mishra, Partha Pratim & Smith, Kandler & Dey, Satadru, 2023. "Feedback-based fault-tolerant and health-adaptive optimal charging of batteries," Applied Energy, Elsevier, vol. 343(C).
    3. Angeles Cabañero, Maria & Altmann, Johannes & Gold, Lukas & Boaretto, Nicola & Müller, Jana & Hein, Simon & Zausch, Jochen & Kallo, Josef & Latz, Arnulf, 2019. "Investigation of the temperature dependence of lithium plating onset conditions in commercial Li-ion batteries," Energy, Elsevier, vol. 171(C), pages 1217-1228.
    4. Wang, Bin & Wang, Shifeng & Tang, Yuanyuan & Tsang, Chi-Wing & Dai, Jinchuan & Leung, Michael K.H. & Lu, Xiao-Ying, 2019. "Micro/nanostructured MnCo2O4.5 anodes with high reversible capacity and excellent rate capability for next generation lithium-ion batteries," Applied Energy, Elsevier, vol. 252(C), pages 1-1.
    5. Li, Niansi & Liu, Xiaoyong & Yu, Bendong & Li, Liang & Xu, Jianqiang & Tan, Qiong, 2021. "Study on the environmental adaptability of lithium-ion battery powered UAV under extreme temperature conditions," Energy, Elsevier, vol. 219(C).
    6. Ramadan, Mohamad & Murr, Rabih & Khaled, Mahmoud & Olabi, Abdul Ghani, 2018. "Mixed numerical - Experimental approach to enhance the heat pump performance by drain water heat recovery," Energy, Elsevier, vol. 149(C), pages 1010-1021.
    7. Xu, Meng & Wang, Xia & Zhang, Liwen & Zhao, Peng, 2021. "Comparison of the effect of linear and two-step fast charging protocols on degradation of lithium ion batteries," Energy, Elsevier, vol. 227(C).
    8. Xiaogang Wu & Siyu Lv & Jizhong Chen, 2017. "Determination of the Optimum Heat Transfer Coefficient and Temperature Rise Analysis for a Lithium-Ion Battery under the Conditions of Harbin City Bus Driving Cycles," Energies, MDPI, vol. 10(11), pages 1-17, October.
    9. Li, Yunjian & Li, Kuining & Xie, Yi & Liu, Jiangyan & Fu, Chunyun & Liu, Bin, 2020. "Optimized charging of lithium-ion battery for electric vehicles: Adaptive multistage constant current–constant voltage charging strategy," Renewable Energy, Elsevier, vol. 146(C), pages 2688-2699.
    10. Meng, Lingyu & See, K.W. & Wang, Guofa & Wang, Yunpeng & Zhang, Yong & Zang, Caiyun & Xie, Bin, 2022. "Explosion-proof lithium-ion battery pack – In-depth investigation and experimental study on the design criteria," Energy, Elsevier, vol. 249(C).
    11. Yang, Fangfang & Song, Xiangbao & Dong, Guangzhong & Tsui, Kwok-Leung, 2019. "A coulombic efficiency-based model for prognostics and health estimation of lithium-ion batteries," Energy, Elsevier, vol. 171(C), pages 1173-1182.
    12. Soham Neupane & Morteza Alipanah & Derek Barnes & Xianglin Li, 2018. "Heat Generation Characteristics of LiFePO 4 Pouch Cells with Passive Thermal Management," Energies, MDPI, vol. 11(5), pages 1-14, May.
    13. Eneko Artetxe & Oscar Barambones & Isidro Calvo & Pablo Fernández-Bustamante & Imanol Martin & Jokin Uralde, 2023. "Wireless Technologies for Industry 4.0 Applications," Energies, MDPI, vol. 16(3), pages 1-13, January.
    14. Yin, Yilin & Choe, Song-Yul, 2020. "Actively temperature controlled health-aware fast charging method for lithium-ion battery using nonlinear model predictive control," Applied Energy, Elsevier, vol. 271(C).
    15. Fanqi Meng & Xiaohong Su, 2017. "Reducing WCET Overestimations by Correcting Errors in Loop Bound Constraints," Energies, MDPI, vol. 10(12), pages 1-18, December.
    16. Ardani, M.I. & Patel, Y. & Siddiq, A. & Offer, G.J. & Martinez-Botas, R.F., 2018. "Combined experimental and numerical evaluation of the differences between convective and conductive thermal control on the performance of a lithium ion cell," Energy, Elsevier, vol. 144(C), pages 81-97.
    17. Mengshu Sun & Yuankun Xue & Paul Bogdan & Jian Tang & Yanzhi Wang & Xue Lin, 2018. "Hierarchical and hybrid energy storage devices in data centers: Architecture, control and provisioning," PLOS ONE, Public Library of Science, vol. 13(1), pages 1-19, January.
    18. Ye Yang & Youtong Zhang & Jingyi Tian & Si Zhang, 2018. "Research on a Plug-In Hybrid Electric Bus Energy Management Strategy Considering Drivability," Energies, MDPI, vol. 11(8), pages 1-22, August.
    19. Li, Junqiu & Sun, Danni & Jin, Xin & Shi, Wentong & Sun, Chao, 2019. "Lithium-ion battery overcharging thermal characteristics analysis and an impedance-based electro-thermal coupled model simulation," Applied Energy, Elsevier, vol. 254(C).
    20. Yu Peng & Yandong Hou & Yuchen Song & Jingyue Pang & Datong Liu, 2018. "Lithium-Ion Battery Prognostics with Hybrid Gaussian Process Function Regression," Energies, MDPI, vol. 11(6), pages 1-20, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:329:y:2023:i:c:s030626192201529x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.