IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i16p3976-d1454106.html
   My bibliography  Save this article

TransRUL: A Transformer-Based Multihead Attention Model for Enhanced Prediction of Battery Remaining Useful Life

Author

Listed:
  • Umar Saleem

    (School of Automation, Northwestern Polytechnical University, Xi’an 710072, China)

  • Wenjie Liu

    (School of Automation, Northwestern Polytechnical University, Xi’an 710072, China)

  • Saleem Riaz

    (School of Automation, Northwestern Polytechnical University, Xi’an 710072, China)

  • Weilin Li

    (School of Automation, Northwestern Polytechnical University, Xi’an 710072, China)

  • Ghulam Amjad Hussain

    (College of Engineering and IT, University of Dubai, Dubai 14143, United Arab Emirates)

  • Zeeshan Rashid

    (Department of Electrical Engineering, The Islamia University of Bahawalpur, Bahawalpur 63100, Pakistan)

  • Zeeshan Ahmad Arfeen

    (Department of Electrical Engineering, The Islamia University of Bahawalpur, Bahawalpur 63100, Pakistan)

Abstract

The efficient operation of power-electronic-based systems heavily relies on the reliability and longevity of battery-powered systems. An accurate prediction of the remaining useful life (RUL) of batteries is essential for their effective maintenance, reliability, and safety. However, traditional RUL prediction methods and deep learning-based approaches face challenges in managing battery degradation processes, such as achieving robust prediction performance, to ensure scalability and computational efficiency. There is a need to develop adaptable models that can generalize across different battery types that operate in diverse operational environments. To solve these issues, this research work proposes a TransRUL model to enhance battery RUL prediction. The proposed model incorporates advanced approaches of a time series transformer using a dual encoder with integration positional encoding and multi-head attention. This research utilized data collected by the Centre for Advanced Life Cycle Engineering (CALCE) on CS_2-type lithium-ion batteries that spanned four groups that used a sliding window technique to generate features and labels. The experimental results demonstrate that TransRUL obtained superior performance as compared with other methods in terms of the following evaluation metrics: mean absolute error (MAE), root-mean-squared error (RMSE), and R 2 values. The efficient computational power of the TransRUL model will facilitate the real-time prediction of the RUL, which is vital for power-electronic-based appliances. This research highlights the potential of the TransRUL model, which significantly enhances the accuracy of battery RUL prediction and additionally improves the management and control of battery-based systems.

Suggested Citation

  • Umar Saleem & Wenjie Liu & Saleem Riaz & Weilin Li & Ghulam Amjad Hussain & Zeeshan Rashid & Zeeshan Ahmad Arfeen, 2024. "TransRUL: A Transformer-Based Multihead Attention Model for Enhanced Prediction of Battery Remaining Useful Life," Energies, MDPI, vol. 17(16), pages 1-24, August.
  • Handle: RePEc:gam:jeners:v:17:y:2024:i:16:p:3976-:d:1454106
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/16/3976/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/17/16/3976/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yunlong Han & Conghui Li & Linfeng Zheng & Gang Lei & Li Li, 2023. "Remaining Useful Life Prediction of Lithium-Ion Batteries by Using a Denoising Transformer-Based Neural Network," Energies, MDPI, vol. 16(17), pages 1-16, August.
    2. Xu, Xiaodong & Tang, Shengjin & Yu, Chuanqiang & Xie, Jian & Han, Xuebing & Ouyang, Minggao, 2021. "Remaining Useful Life Prediction of Lithium-ion Batteries Based on Wiener Process Under Time-Varying Temperature Condition," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giovane Ronei Sylvestrin & Joylan Nunes Maciel & Marcio Luís Munhoz Amorim & João Paulo Carmo & José A. Afonso & Sérgio F. Lopes & Oswaldo Hideo Ando Junior, 2025. "State of the Art in Electric Batteries’ State-of-Health (SoH) Estimation with Machine Learning: A Review," Energies, MDPI, vol. 18(3), pages 1-77, February.
    2. Guangzai Ye & Li Feng & Jianlan Guo & Yuqiang Chen, 2024. "IIP-Mixer: Intra–Inter-Patch Mixing Architecture for Battery Remaining Useful Life Prediction," Energies, MDPI, vol. 17(14), pages 1-15, July.
    3. Zhang, Jiusi & Jiang, Yuchen & Li, Xiang & Huo, Mingyi & Luo, Hao & Yin, Shen, 2022. "An adaptive remaining useful life prediction approach for single battery with unlabeled small sample data and parameter uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    4. Chen, Xiaowu & Liu, Zhen, 2022. "A long short-term memory neural network based Wiener process model for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    5. Cao, Mengda & Zhang, Tao & Liu, Yajie & Zhang, Yajun & Wang, Yu & Li, Kaiwen, 2022. "An ensemble learning prognostic method for capacity estimation of lithium-ion batteries based on the V-IOWGA operator," Energy, Elsevier, vol. 257(C).
    6. Liu, Xingheng & Matias, José & Jäschke, Johannes & Vatn, Jørn, 2022. "Gibbs sampler for noisy Transformed Gamma process: Inference and remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    7. Ma, Jie & Cai, Li & Liao, Guobo & Yin, Hongpeng & Si, Xiaosheng & Zhang, Peng, 2023. "A multi-phase Wiener process-based degradation model with imperfect maintenance activities," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    8. Tian, Yuan & Han, Minghao & Kulkarni, Chetan & Fink, Olga, 2022. "A prescriptive Dirichlet power allocation policy with deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    9. Wang, Fujin & Wu, Ziqian & Zhao, Zhibin & Zhai, Zhi & Wang, Chenxi & Chen, Xuefeng, 2024. "Physical knowledge guided state of health estimation of lithium-ion battery with limited segment data," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    10. Liu, Zhi-Feng & Huang, Ya-He & Zhang, Shu-Rui & Luo, Xing-Fu & Chen, Xiao-Rui & Lin, Jun-Jie & Tang, Yu & Guo, Liang & Li, Ji-Xiang, 2025. "A collaborative interaction gate-based deep learning model with optimal bandwidth adjustment strategies for lithium-ion battery capacity point-interval forecasting," Applied Energy, Elsevier, vol. 377(PD).
    11. Mu, Lin & Wang, Zhen & Sun, Meng & Shang, Yan & Pu, Hang & Dong, Ming, 2024. "Machine learning model with a novel self–adjustment method: A powerful tool for predicting biomass ash fusibility and enhancing its potential applications," Renewable Energy, Elsevier, vol. 237(PA).
    12. Meng, Huixing & Geng, Mengyao & Han, Te, 2023. "Long short-term memory network with Bayesian optimization for health prognostics of lithium-ion batteries based on partial incremental capacity analysis," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    13. Hu, Changhua & Xing, Yuanxing & Du, Dangbo & Si, Xiaosheng & Zhang, Jianxun, 2023. "Remaining useful life estimation for two-phase nonlinear degradation processes," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    14. Wang, Fujin & Zhao, Zhibin & Zhai, Zhi & Guo, Yanjie & Xi, Huan & Wang, Shibin & Chen, Xuefeng, 2023. "Feature disentanglement and tendency retainment with domain adaptation for Lithium-ion battery capacity estimation," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    15. Xie, Lin & Ustolin, Federico & Lundteigen, Mary Ann & Li, Tian & Liu, Yiliu, 2022. "Performance analysis of safety barriers against cascading failures in a battery pack," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    16. Wang, Fengfei & Tang, Shengjin & Han, Xuebing & Yu, Chuanqiang & Sun, Xiaoyan & Lu, Languang & Ouyang, Minggao, 2024. "Capacity prediction of lithium-ion batteries with fusing aging information," Energy, Elsevier, vol. 293(C).
    17. Cai, Xiao & Li, Naipeng & Xie, Min, 2024. "RUL prediction for two-phase degrading systems considering physical damage observations," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    18. Meng, Fanbing & Yang, Fangfang & Yang, Jun & Xie, Min, 2023. "A power model considering initial battery state for remaining useful life prediction of lithium-ion batteries," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    19. Wang, Yujie & Xiang, Haoxiang & Soo, Yin-Yi & Fan, Xiaofei, 2025. "Aging mechanisms, prognostics and management for lithium-ion batteries: Recent advances," Renewable and Sustainable Energy Reviews, Elsevier, vol. 207(C).
    20. Lin, Mingqiang & You, Yuqiang & Wang, Wei & Wu, Ji, 2023. "Battery health prognosis with gated recurrent unit neural networks and hidden Markov model considering uncertainty quantification," Reliability Engineering and System Safety, Elsevier, vol. 230(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:16:p:3976-:d:1454106. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.