IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v342y2026ics0360544225050595.html

LLM-MSIformer: A method for lithium-ion battery state of health estimation based on a large language model and multi-time scale interval transformer

Author

Listed:
  • Zhang, Wenjie
  • Feng, Haohao
  • Ren, Mifeng
  • Liu, Kailong
  • Yan, Gaowei

Abstract

Accurate state of health (SOH) estimation of lithium-ion batteries (LIBs) is critical for the safe and stable operation of battery system. Current SOH prediction models generally suffer from three critical limitations: insufficient robustness under extreme operating conditions, inadequate utilization of multimodal data, and poorly characterized coupling mechanisms of multi-timescale degradation features. To bridge this gap, this study proposes an innovative SOH prediction framework combining Large Language Model (LLM) with a Multi-Time Scale Interval Transformer (MSIformer). Firstly, the incremental capacity analysis (ICA) curves are derived from the charging voltage and capacity of LIBs. Then, health factors (HFs) are extracted from the charging data and ICA curves using Pearson correlation coefficient analysis. Subsequently, contextual prompts and textual metadata are fed into the pre-trained LLM, which generates denoised text embeddings through its noise-resilient semantic reasoning and contextual inference capabilities. After that, a hierarchical fusion mechanism combines the numerical features and LLM-derived contextual embeddings, enhancing interference immunity through complementary information integration. The MSIformer then hierarchically decouples multi-timescale dependencies from fused features via dilated convolutions and temporal attention, explicitly modeling cross-modal aging dynamics. Finally, cross-attention dynamically recalibrates multimodal features by aligning cross-modal multi-timescale dependencies with historical SOH trends, and the refined features are directly utilized for SOH prediction. The proposed framework is validated on a commercial 21700 and 18650 LIBs dataset, demonstrating statistically significant improvements over nine state-of-the-art benchmarks. Quantitative results show minimum reductions of 66.42% in RMSE, 70.19% in MAE, and 70.33% in MAPE, confirming both accuracy and operational robustness.

Suggested Citation

  • Zhang, Wenjie & Feng, Haohao & Ren, Mifeng & Liu, Kailong & Yan, Gaowei, 2026. "LLM-MSIformer: A method for lithium-ion battery state of health estimation based on a large language model and multi-time scale interval transformer," Energy, Elsevier, vol. 342(C).
  • Handle: RePEc:eee:energy:v:342:y:2026:i:c:s0360544225050595
    DOI: 10.1016/j.energy.2025.139417
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225050595
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.139417?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Ruixue & Jiang, Benben, 2025. "A multi-time-resolution attention-based interaction network for co-estimation of multiple battery states," Applied Energy, Elsevier, vol. 381(C).
    2. Zhang, Zhen & Zhu, Yuhao & Zhang, Qi & Cui, Naxin & Shang, Yunlong, 2024. "Multi-cycle charging information guided state of health estimation for lithium-ion batteries based on pre-trained large language model," Energy, Elsevier, vol. 313(C).
    3. Qian, Cheng & Xu, Binghui & Xia, Quan & Ren, Yi & Sun, Bo & Wang, Zili, 2023. "SOH prediction for Lithium-Ion batteries by using historical state and future load information with an AM-seq2seq model," Applied Energy, Elsevier, vol. 336(C).
    4. Zhao, Hongqian & Chen, Zheng & Shu, Xing & Shen, Jiangwei & Lei, Zhenzhen & Zhang, Yuanjian, 2023. "State of health estimation for lithium-ion batteries based on hybrid attention and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    5. Wen, Jianping & Chen, Xing & Li, Xianghe & Li, Yikun, 2022. "SOH prediction of lithium battery based on IC curve feature and BP neural network," Energy, Elsevier, vol. 261(PA).
    6. Wei, Zhongbao & Zhao, Difan & He, Hongwen & Cao, Wanke & Dong, Guangzhong, 2020. "A noise-tolerant model parameterization method for lithium-ion battery management system," Applied Energy, Elsevier, vol. 268(C).
    7. Gu, Xinyu & See, K.W. & Li, Penghua & Shan, Kangheng & Wang, Yunpeng & Zhao, Liang & Lim, Kai Chin & Zhang, Neng, 2023. "A novel state-of-health estimation for the lithium-ion battery using a convolutional neural network and transformer model," Energy, Elsevier, vol. 262(PB).
    8. Yang, Bo & Qian, Yucun & Li, Qiang & Chen, Qian & Wu, Jiyang & Luo, Enbo & Xie, Rui & Zheng, Ruyi & Yan, Yunfeng & Su, Shi & Wang, Jingbo, 2024. "Critical summary and perspectives on state-of-health of lithium-ion battery," Renewable and Sustainable Energy Reviews, Elsevier, vol. 190(PA).
    9. Ming Zhang & Dongfang Yang & Jiaxuan Du & Hanlei Sun & Liwei Li & Licheng Wang & Kai Wang, 2023. "A Review of SOH Prediction of Li-Ion Batteries Based on Data-Driven Algorithms," Energies, MDPI, vol. 16(7), pages 1-28, March.
    10. Lyu, Guangzheng & Zhang, Heng & Miao, Qiang, 2024. "An adaptive and interpretable SOH estimation method for lithium-ion batteries based-on relaxation voltage cross-scale features and multi-LSTM-RFR2," Energy, Elsevier, vol. 304(C).
    11. Li, Yi & Liu, Kailong & Foley, Aoife M. & Zülke, Alana & Berecibar, Maitane & Nanini-Maury, Elise & Van Mierlo, Joeri & Hoster, Harry E., 2019. "Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 113(C), pages 1-1.
    12. Ma, Yan & Li, Jiaqi & Gao, Jinwu & Chen, Hong, 2024. "State of health prediction of lithium-ion batteries under early partial data based on IWOA-BiLSTM with single feature," Energy, Elsevier, vol. 295(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yaxuan & Guo, Shilong & Cui, Yue & Deng, Liang & Zhao, Lei & Li, Junfu & Wang, Zhenbo, 2025. "A comprehensive review of machine learning-based state of health estimation for lithium-ion batteries: data, features, algorithms, and future challenges," Renewable and Sustainable Energy Reviews, Elsevier, vol. 224(C).
    2. Zhang, Hao & Gao, Jingyi & Kang, Le & Zhang, Yi & Wang, Licheng & Wang, Kai, 2023. "State of health estimation of lithium-ion batteries based on modified flower pollination algorithm-temporal convolutional network," Energy, Elsevier, vol. 283(C).
    3. Geng, Mengyao & Su, Yanghan & Liu, Changlin & Chen, Liqun & Huang, Xinyan, 2025. "Interpretable deep learning with uncertainty quantification for lithium-ion battery SOH estimation," Energy, Elsevier, vol. 335(C).
    4. Tang, Telu & Yang, Xiangguo & Li, Muheng & Li, Xin & Huang, Hai & Guan, Cong & Huang, Jiangfan & Wang, Yufan & Zhou, Chaobin, 2025. "Deep learning model-based real-time state-of-health estimation of lithium-ion batteries under dynamic operating conditions," Energy, Elsevier, vol. 317(C).
    5. Chen, Kui & Luo, Yang & Long, Zhou & Li, Yang & Nie, Guangbo & Liu, Kai & Xin, Dongli & Gao, Guoqiang & Wu, Guangning, 2025. "Big data-driven prognostics and health management of lithium-ion batteries:A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 214(C).
    6. Wang, Zhuoer & Zhu, Xiaowen & Wang, Qingbo & Zhou, Jian & Li, Bijun & Shi, Baohan & Zhang, Chenming, 2025. "MapVC: Map-based deep learning for real-time current prediction in eco-driving electric vehicles," Applied Energy, Elsevier, vol. 396(C).
    7. Yao, Jiachi & Han, Te, 2023. "Data-driven lithium-ion batteries capacity estimation based on deep transfer learning using partial segment of charging/discharging data," Energy, Elsevier, vol. 271(C).
    8. Peng, Simin & Zhu, Junchao & Wu, Tiezhou & Tang, Aihua & Kan, Jiarong & Pecht, Michael, 2024. "SOH early prediction of lithium-ion batteries based on voltage interval selection and features fusion," Energy, Elsevier, vol. 308(C).
    9. Sun, Wenjie & Wu, Chengke & Xie, Chengde & Wang, Xikang & Guo, Yuanjun & Tang, Yongbing & Zhang, Yanhui & Li, Kang & Du, Guanhao & Yang, Zhile & Yao, Wenjiao, 2025. "Fine-tuning enables state of health estimation for lithium-ion batteries via a time series foundation model," Energy, Elsevier, vol. 318(C).
    10. Li, Xiaopeng & Zhao, Minghang & Zhong, Shisheng & Li, Junfu & Fu, Song & Yan, Zhiqi, 2024. "BMSFormer: An efficient deep learning model for online state-of-health estimation of lithium-ion batteries under high-frequency early SOC data with strong correlated single health indicator," Energy, Elsevier, vol. 313(C).
    11. Ouyang, Tiancheng & Gong, Yubin & Ye, Jinlu & Deng, Qiaoyang & Su, Yingying, 2025. "State co-estimation for lithium-ion batteries based on multi-innovations online identification," Renewable and Sustainable Energy Reviews, Elsevier, vol. 210(C).
    12. Zhu, Bo & Jia, Li & Pan, Quanke & Zhang, Hui, 2025. "Cross-domain battery SOH and RUL estimation via Domain-Adaptive Transformer," Energy, Elsevier, vol. 341(C).
    13. Zhao, Jingyuan & Wang, Zhenghong & Wu, Yuyan & Burke, Andrew F., 2025. "Predictive pretrained transformer (PPT) for real-time battery health diagnostics," Applied Energy, Elsevier, vol. 377(PD).
    14. Peng, Simin & Wang, Yujian & Tang, Aihua & Jiang, Yuxia & Kan, Jiarong & Pecht, Michael, 2025. "State of health estimation joint improved grey wolf optimization algorithm and LSTM using partial discharging health features for lithium-ion batteries," Energy, Elsevier, vol. 315(C).
    15. Zhang, Zhengjie & Cao, Rui & Zheng, Yifan & Zhang, Lisheng & Guang, Haoran & Liu, Xinhua & Gao, Xinlei & Yang, Shichun, 2024. "Online state of health estimation for lithium-ion batteries based on gene expression programming," Energy, Elsevier, vol. 294(C).
    16. Sun, Jinlei & Liu, Xinwei & Li, Xin & Chen, Siwen & Xing, Shiyou & Guo, Yilong, 2025. "State of health estimation of lithium-ion battery based on constant current charging time feature extraction and internal resistance compensation," Energy, Elsevier, vol. 315(C).
    17. Wu, Chunling & Wang, Liding & Meng, Jinhao & Huang, Jingyun & Yang, Taiping & Wang, Li & Chang, Yating & He, Xiangming, 2025. "A hybrid deep learning model for lithium-ion battery state-of-health estimation using electrochemical impedance spectroscopy," Energy, Elsevier, vol. 339(C).
    18. Li, Qingbo & Lu, Taolin & Lai, Chunyan & Li, Jiwei & Pan, Long & Ma, Changjun & Zhu, Yunpeng & Xie, Jingying, 2024. "Lithium-ion battery capacity estimation based on fragment charging data using deep residual shrinkage networks and uncertainty evaluation," Energy, Elsevier, vol. 290(C).
    19. Wang, Zhen & Zhao, Li & Li, Yiding & Wang, Wenwei, 2025. "A data-efficient method for lithium-ion battery state-of-health estimation based on real-time frequent itemset image encoding," Applied Energy, Elsevier, vol. 398(C).
    20. Li, Ziyang & Zhang, Xiangwen & Gao, Wei, 2024. "State of health estimation of lithium-ion battery during fast charging process based on BiLSTM-Transformer," Energy, Elsevier, vol. 311(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:342:y:2026:i:c:s0360544225050595. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.