IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v223y2021ics0360544221003200.html
   My bibliography  Save this article

Online correction predictive energy management strategy using the Q-learning based swarm optimization with fuzzy neural network

Author

Listed:
  • Lin, Xinyou
  • Zeng, Songrong
  • Li, Xuefan

Abstract

The performance of predictive energy management (PEM) strategy depends greatly on the precise prediction. Inevitably, the imprecise prediction occurs under changeable driving conditions. This study proposes an online correction predictive energy management strategy to address the above issue. The first is development of a PEM using the sequential quadratic programming (SQP) combined with back-propagation neural network-based velocity prediction. Second, a correction algorithm based Fuzzy Neural Network (FNN) is designed to evaluate the correction factor. The Q-learning based Swarm Optimization (QSO) algorithm is implemented to optimize the parameters of the FNN and evaluate accurately the correction factor. Finally, in combination with the above efforts, a novel correction algorithm based on the SQP backup control strategy and integrated the QSO algorithm with the FNN has been further established accordingly. The numerical validation results demonstrate that the superior performance of the proposed strategy in economic compared with the benchmark strategies, and the effectiveness of the proposed strategy is validated by Hardware-in-the-loop (HIL) experiments. Both the numerical validation and HIL results indicate that the combination of QSO and FNN made it possible to develop the online correction algorithm capable of significantly further improving the hydrogen consumption of the fuel cell electric vehicle.

Suggested Citation

  • Lin, Xinyou & Zeng, Songrong & Li, Xuefan, 2021. "Online correction predictive energy management strategy using the Q-learning based swarm optimization with fuzzy neural network," Energy, Elsevier, vol. 223(C).
    • Handle: RePEc:eee:energy:v:223:y:2021:i:c:s0360544221003200
    DOI: 10.1016/j.energy.2021.120071
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221003200
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2021.120071?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wu, Yitao & Zhang, Yuanjian & Li, Guang & Shen, Jiangwei & Chen, Zheng & Liu, Yonggang, 2020. "A predictive energy management strategy for multi-mode plug-in hybrid electric vehicles based on multi neural networks," Energy, Elsevier, vol. 208(C).
    2. Xie, Shaobo & Hu, Xiaosong & Xin, Zongke & Brighton, James, 2019. "Pontryagin’s Minimum Principle based model predictive control of energy management for a plug-in hybrid electric bus," Applied Energy, Elsevier, vol. 236(C), pages 893-905.
    3. Li, Liang & You, Sixiong & Yang, Chao & Yan, Bingjie & Song, Jian & Chen, Zheng, 2016. "Driving-behavior-aware stochastic model predictive control for plug-in hybrid electric buses," Applied Energy, Elsevier, vol. 162(C), pages 868-879.
    4. Li, Xunming & Han, Lijin & Liu, Hui & Wang, Weida & Xiang, Changle, 2019. "Real-time optimal energy management strategy for a dual-mode power-split hybrid electric vehicle based on an explicit model predictive control algorithm," Energy, Elsevier, vol. 172(C), pages 1161-1178.
    5. Du, Guodong & Zou, Yuan & Zhang, Xudong & Liu, Teng & Wu, Jinlong & He, Dingbo, 2020. "Deep reinforcement learning based energy management for a hybrid electric vehicle," Energy, Elsevier, vol. 201(C).
    6. Zhang, Pei & Yan, Fuwu & Du, Changqing, 2015. "A comprehensive analysis of energy management strategies for hybrid electric vehicles based on bibliometrics," Renewable and Sustainable Energy Reviews, Elsevier, vol. 48(C), pages 88-104.
    7. M. Sabri, M.F. & Danapalasingam, K.A. & Rahmat, M.F., 2016. "A review on hybrid electric vehicles architecture and energy management strategies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 53(C), pages 1433-1442.
    8. Peng, Jiankun & He, Hongwen & Xiong, Rui, 2017. "Rule based energy management strategy for a series–parallel plug-in hybrid electric bus optimized by dynamic programming," Applied Energy, Elsevier, vol. 185(P2), pages 1633-1643.
    9. Sun, Chao & Sun, Fengchun & He, Hongwen, 2017. "Investigating adaptive-ECMS with velocity forecast ability for hybrid electric vehicles," Applied Energy, Elsevier, vol. 185(P2), pages 1644-1653.
    10. Zhang, Shuo & Xiong, Rui & Sun, Fengchun, 2017. "Model predictive control for power management in a plug-in hybrid electric vehicle with a hybrid energy storage system," Applied Energy, Elsevier, vol. 185(P2), pages 1654-1662.
    11. Xie, Shanshan & He, Hongwen & Peng, Jiankun, 2017. "An energy management strategy based on stochastic model predictive control for plug-in hybrid electric buses," Applied Energy, Elsevier, vol. 196(C), pages 279-288.
    12. Chen, Zeyu & Xiong, Rui & Wang, Chun & Cao, Jiayi, 2017. "An on-line predictive energy management strategy for plug-in hybrid electric vehicles to counter the uncertain prediction of the driving cycle," Applied Energy, Elsevier, vol. 185(P2), pages 1663-1672.
    13. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mojgan Fayyazi & Paramjotsingh Sardar & Sumit Infent Thomas & Roonak Daghigh & Ali Jamali & Thomas Esch & Hans Kemper & Reza Langari & Hamid Khayyam, 2023. "Artificial Intelligence/Machine Learning in Energy Management Systems, Control, and Optimization of Hydrogen Fuel Cell Vehicles," Sustainability, MDPI, vol. 15(6), pages 1-38, March.
    2. Jaikumar Shanmuganathan & Aruldoss Albert Victoire & Gobu Balraj & Amalraj Victoire, 2022. "Deep Learning LSTM Recurrent Neural Network Model for Prediction of Electric Vehicle Charging Demand," Sustainability, MDPI, vol. 14(16), pages 1-28, August.
    3. Vincenzo Varriale & Antonello Cammarano & Francesca Michelino & Mauro Caputo, 2023. "Industry 5.0 and Triple Bottom Line Approach in Supply Chain Management: The State-of-the-Art," Sustainability, MDPI, vol. 15(7), pages 1-30, March.
    4. Ifaei, Pouya & Nazari-Heris, Morteza & Tayerani Charmchi, Amir Saman & Asadi, Somayeh & Yoo, ChangKyoo, 2023. "Sustainable energies and machine learning: An organized review of recent applications and challenges," Energy, Elsevier, vol. 266(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fengqi Zhang & Lihua Wang & Serdar Coskun & Hui Pang & Yahui Cui & Junqiang Xi, 2020. "Energy Management Strategies for Hybrid Electric Vehicles: Review, Classification, Comparison, and Outlook," Energies, MDPI, vol. 13(13), pages 1-35, June.
    2. Zhuang, Weichao & Li (Eben), Shengbo & Zhang, Xiaowu & Kum, Dongsuk & Song, Ziyou & Yin, Guodong & Ju, Fei, 2020. "A survey of powertrain configuration studies on hybrid electric vehicles," Applied Energy, Elsevier, vol. 262(C).
    3. Dong, Peng & Zhao, Junwei & Liu, Xuewu & Wu, Jian & Xu, Xiangyang & Liu, Yanfang & Wang, Shuhan & Guo, Wei, 2022. "Practical application of energy management strategy for hybrid electric vehicles based on intelligent and connected technologies: Development stages, challenges, and future trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    4. Zhu, Tao & Wills, Richard G.A. & Lot, Roberto & Ruan, Haijun & Jiang, Zhihao, 2021. "Adaptive energy management of a battery-supercapacitor energy storage system for electric vehicles based on flexible perception and neural network fitting," Applied Energy, Elsevier, vol. 292(C).
    5. Qi, Chunyang & Zhu, Yiwen & Song, Chuanxue & Yan, Guangfu & Xiao, Feng & Da wang, & Zhang, Xu & Cao, Jingwei & Song, Shixin, 2022. "Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle," Energy, Elsevier, vol. 238(PA).
    6. Chen, Zheng & Gu, Hongji & Shen, Shiquan & Shen, Jiangwei, 2022. "Energy management strategy for power-split plug-in hybrid electric vehicle based on MPC and double Q-learning," Energy, Elsevier, vol. 245(C).
    7. Liu, Teng & Tan, Wenhao & Tang, Xiaolin & Zhang, Jinwei & Xing, Yang & Cao, Dongpu, 2021. "Driving conditions-driven energy management strategies for hybrid electric vehicles: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    8. Ahmed M. Ali & Dirk Söffker, 2018. "Towards Optimal Power Management of Hybrid Electric Vehicles in Real-Time: A Review on Methods, Challenges, and State-Of-The-Art Solutions," Energies, MDPI, vol. 11(3), pages 1-24, February.
    9. Wu, Yuankai & Tan, Huachun & Peng, Jiankun & Zhang, Hailong & He, Hongwen, 2019. "Deep reinforcement learning of energy management with continuous control strategy and traffic information for a series-parallel plug-in hybrid electric bus," Applied Energy, Elsevier, vol. 247(C), pages 454-466.
    10. Chen, Z. & Liu, Y. & Ye, M. & Zhang, Y. & Chen, Z. & Li, G., 2021. "A survey on key techniques and development perspectives of equivalent consumption minimisation strategy for hybrid electric vehicles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    11. Zhuang, Weichao & Zhang, Xiaowu & Li, Daofei & Wang, Liangmo & Yin, Guodong, 2017. "Mode shift map design and integrated energy management control of a multi-mode hybrid electric vehicle," Applied Energy, Elsevier, vol. 204(C), pages 476-488.
    12. Li, Ji & Zhou, Quan & He, Yinglong & Shuai, Bin & Li, Ziyang & Williams, Huw & Xu, Hongming, 2019. "Dual-loop online intelligent programming for driver-oriented predict energy management of plug-in hybrid electric vehicles," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    13. Xie, Shaobo & Hu, Xiaosong & Xin, Zongke & Brighton, James, 2019. "Pontryagin’s Minimum Principle based model predictive control of energy management for a plug-in hybrid electric bus," Applied Energy, Elsevier, vol. 236(C), pages 893-905.
    14. Guo, Ningyuan & Zhang, Xudong & Zou, Yuan & Guo, Lingxiong & Du, Guodong, 2021. "Real-time predictive energy management of plug-in hybrid electric vehicles for coordination of fuel economy and battery degradation," Energy, Elsevier, vol. 214(C).
    15. Kong, Yan & Xu, Nan & Liu, Qiao & Sui, Yan & Yue, Fenglai, 2023. "A data-driven energy management method for parallel PHEVs based on action dependent heuristic dynamic programming (ADHDP) model," Energy, Elsevier, vol. 265(C).
    16. Geng, Wenran & Lou, Diming & Wang, Chen & Zhang, Tong, 2020. "A cascaded energy management optimization method of multimode power-split hybrid electric vehicles," Energy, Elsevier, vol. 199(C).
    17. Saiteja, Pemmareddy & Ashok, B., 2022. "Critical review on structural architecture, energy control strategies and development process towards optimal energy management in hybrid vehicles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 157(C).
    18. Manzolli, Jônatas Augusto & Trovão, João Pedro & Antunes, Carlos Henggeler, 2022. "A review of electric bus vehicles research topics – Methods and trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    19. Xie, Shaobo & Hu, Xiaosong & Qi, Shanwei & Tang, Xiaolin & Lang, Kun & Xin, Zongke & Brighton, James, 2019. "Model predictive energy management for plug-in hybrid electric vehicles considering optimal battery depth of discharge," Energy, Elsevier, vol. 173(C), pages 667-678.
    20. Liu, Hanwu & Lei, Yulong & Fu, Yao & Li, Xingzhong, 2022. "A novel hybrid-point-line energy management strategy based on multi-objective optimization for range-extended electric vehicle," Energy, Elsevier, vol. 247(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:223:y:2021:i:c:s0360544221003200. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.