IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i12p3177-d1680789.html
   My bibliography  Save this article

Degradation Prediction of Proton Exchange Membrane Fuel Cell Based on Multi-Head Attention Neural Network and Transformer Model

Author

Listed:
  • Yikai Tang

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

  • Xing Huang

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

  • Yanju Li

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

  • Haoran Ma

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

  • Kai Zhang

    (School of Aerospace Engineering and Applied Mechanics, Tongji University, Shanghai 200092, China)

  • Ke Song

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

Abstract

Proton exchange membrane fuel cells are a clean energy technology with wide application in transportation and stationary energy systems. Due to the problem of voltage degradation under long-term dynamic loads, predicting their performance degradation trend is of great significance for extending the life of proton exchange membrane fuel cells and improving system reliability. This study adopts a data-driven approach to construct a degradation prediction model. In view of the problem of many input parameters and complex distribution of degradation features, a neural network model based on a multi-head attention mechanism and class token is first proposed to analyze the impact of different operating parameters on the output voltage prediction. The importance of each input variable is quantified by the attention weight matrix to assist feature screening. Subsequently, a prediction model is constructed based on Transformer to characterize the voltage degradation trend of fuel cells under dynamic conditions. The experimental results show that the root mean square error and mean absolute error of the model in the test phase are 0.008954 and 0.006590, showing strong prediction performance. Based on the importance evaluation provided by the first model, 11 key parameters were selected as inputs. After this input simplification, the model still maintained a prediction accuracy comparable to that of the full-feature model. This result verifies the effectiveness of the feature screening strategy and demonstrates its contribution to improved generalization and robustness.

Suggested Citation

  • Yikai Tang & Xing Huang & Yanju Li & Haoran Ma & Kai Zhang & Ke Song, 2025. "Degradation Prediction of Proton Exchange Membrane Fuel Cell Based on Multi-Head Attention Neural Network and Transformer Model," Energies, MDPI, vol. 18(12), pages 1-20, June.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:12:p:3177-:d:1680789
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/12/3177/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/12/3177/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Pei, Pucheng & Chen, Huicui, 2014. "Main factors affecting the lifetime of Proton Exchange Membrane fuel cells in vehicle applications: A review," Applied Energy, Elsevier, vol. 125(C), pages 60-75.
    2. Zuo, Jian & Lv, Hong & Zhou, Daming & Xue, Qiong & Jin, Liming & Zhou, Wei & Yang, Daijun & Zhang, Cunman, 2021. "Deep learning based prognostic framework towards proton exchange membrane fuel cell for automotive application," Applied Energy, Elsevier, vol. 281(C).
    3. Song, Ke & Ding, Yuhang & Hu, Xiao & Xu, Hongjie & Wang, Yimin & Cao, Jing, 2021. "Degradation adaptive energy management strategy using fuel cell state-of-health for fuel economy improvement of hybrid electric vehicle," Applied Energy, Elsevier, vol. 285(C).
    4. Chen, Kui & Badji, Abderrezak & Laghrouche, Salah & Djerdir, Abdesslem, 2022. "Polymer electrolyte membrane fuel cells degradation prediction using multi-kernel relevance vector regression and whale optimization algorithm," Applied Energy, Elsevier, vol. 318(C).
    5. Siavash Khalili & Eetu Rantanen & Dmitrii Bogdanov & Christian Breyer, 2019. "Global Transportation Demand Development with Impacts on the Energy Demand and Greenhouse Gas Emissions in a Climate-Constrained World," Energies, MDPI, vol. 12(20), pages 1-54, October.
    6. Lingling Lv & Pucheng Pei & Peng Ren & He Wang & Geng Wang, 2025. "Exploring Performance Degradation of Proton Exchange Membrane Fuel Cells Based on Diffusion Transformer Model," Energies, MDPI, vol. 18(5), pages 1-22, February.
    7. Zachary P. Cano & Dustin Banham & Siyu Ye & Andreas Hintennach & Jun Lu & Michael Fowler & Zhongwei Chen, 2018. "Batteries and fuel cells for emerging electric vehicle markets," Nature Energy, Nature, vol. 3(4), pages 279-289, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Ze & Xu, Sichuan & Zhao, Honghui & Wang, Yupeng, 2022. "Durability estimation and short-term voltage degradation forecasting of vehicle PEMFC system: Development and evaluation of machine learning models," Applied Energy, Elsevier, vol. 326(C).
    2. Yu, Yang & Yu, Qinghua & Luo, RunSen & Chen, Sheng & Yang, Jiebo & Yan, Fuwu, 2024. "Degradation and polarization curve prediction of proton exchange membrane fuel cells: An interpretable model perspective," Applied Energy, Elsevier, vol. 365(C).
    3. Huang, Ruike & Zhang, Xuexia & Dong, Sidi & Huang, Lei & Liao, Hongbo & Li, Yuan, 2024. "A refined grey Verhulst model for accurate degradation prognostication of PEM fuel cells based on inverse hyperbolic sine function transformation," Renewable Energy, Elsevier, vol. 237(PC).
    4. He, Wenbin & Liu, Ting & Ming, Wuyi & Li, Zongze & Du, Jinguang & Li, Xiaoke & Guo, Xudong & Sun, Peiyan, 2024. "Progress in prediction of remaining useful life of hydrogen fuel cells based on deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    5. Tao, Zihan & Zhang, Chu & Xiong, Jinlin & Hu, Haowen & Ji, Jie & Peng, Tian & Nazir, Muhammad Shahzad, 2023. "Evolutionary gate recurrent unit coupling convolutional neural network and improved manta ray foraging optimization algorithm for performance degradation prediction of PEMFC," Applied Energy, Elsevier, vol. 336(C).
    6. Wang, Zifei & Tao, Jili & Liu, Zhitao & Feng, Han & Ma, Longhua & Xu, Ming & Su, Hongye, 2024. "A proton exchange membrane fuel cells degradation prediction method based on multi-scale temporal information merging network," Energy, Elsevier, vol. 313(C).
    7. Mojgan Fayyazi & Paramjotsingh Sardar & Sumit Infent Thomas & Roonak Daghigh & Ali Jamali & Thomas Esch & Hans Kemper & Reza Langari & Hamid Khayyam, 2023. "Artificial Intelligence/Machine Learning in Energy Management Systems, Control, and Optimization of Hydrogen Fuel Cell Vehicles," Sustainability, MDPI, vol. 15(6), pages 1-38, March.
    8. Lu, Dagang & Yi, Fengyan & Hu, Donghai & Li, Jianwei & Yang, Qingqing & Wang, Jing, 2023. "Online optimization of energy management strategy for FCV control parameters considering dual power source lifespan decay synergy," Applied Energy, Elsevier, vol. 348(C).
    9. Chen, Dongfang & Wu, Wenlong & Chang, Kuanyu & Li, Yuehua & Pei, Pucheng & Xu, Xiaoming, 2023. "Performance degradation prediction method of PEM fuel cells using bidirectional long short-term memory neural network based on Bayesian optimization," Energy, Elsevier, vol. 285(C).
    10. Daeichian, Abolghasem & Ghaderi, Razieh & Kandidayeni, Mohsen & Soleymani, Mehdi & Trovão, João P. & Boulon, Loïc, 2021. "Online characteristics estimation of a fuel cell stack through covariance intersection data fusion," Applied Energy, Elsevier, vol. 292(C).
    11. Pang, Ran & Zhang, Caizhi & Dai, Haifeng & Bai, Yunfeng & Hao, Dong & Chen, Jinrui & Zhang, Bin, 2022. "Intelligent health states recognition of fuel cell by cell voltage consistency under typical operating parameters," Applied Energy, Elsevier, vol. 305(C).
    12. Stančin, H. & Mikulčić, H. & Wang, X. & Duić, N., 2020. "A review on alternative fuels in future energy system," Renewable and Sustainable Energy Reviews, Elsevier, vol. 128(C).
    13. Oyewo, Ayobami Solomon & Solomon, A.A. & Bogdanov, Dmitrii & Aghahosseini, Arman & Mensah, Theophilus Nii Odai & Ram, Manish & Breyer, Christian, 2021. "Just transition towards defossilised energy systems for developing economies: A case study of Ethiopia," Renewable Energy, Elsevier, vol. 176(C), pages 346-365.
    14. Deng, Zhihua & Chan, Siew Hwa & Chen, Qihong & Liu, Hao & Zhang, Liyan & Zhou, Keliang & Tong, Sirui & Fu, Zhichao, 2023. "Efficient degradation prediction of PEMFCs using ELM-AE based on fuzzy extension broad learning system," Applied Energy, Elsevier, vol. 331(C).
    15. Sun, Li & Sun, Wen & You, Fengqi, 2020. "Core temperature modelling and monitoring of lithium-ion battery in the presence of sensor bias," Applied Energy, Elsevier, vol. 271(C).
    16. Zhao, Chuyun & Tang, Jinjun & Kong, Xiangxin & Yu, Tianjian & Li, Zhitao, 2024. "Emission analysis of multi-mode public transportation based on joint choice model considering built environment factors," Energy, Elsevier, vol. 309(C).
    17. Dugoua, Eugenie & Dumas, Marion, 2024. "Coordination dynamics between fuel cell and battery technologies in the transition to clean cars," LSE Research Online Documents on Economics 124029, London School of Economics and Political Science, LSE Library.
    18. Lei, Nuo & Zhang, Hao & Hu, Jingjing & Hu, Zunyan & Wang, Zhi, 2025. "Sim-to-real design and development of reinforcement learning-based energy management strategies for fuel cell electric vehicles," Applied Energy, Elsevier, vol. 393(C).
    19. Gaultier Gibey & Elodie Pahon & Noureddine Zerhouni & Daniel Hissel, 2025. "Predictive Maintenance of Proton-Exchange-Membrane Fuel Cells for Transportation Applications," Energies, MDPI, vol. 18(11), pages 1-16, June.
    20. Zheng Huang & Laisuo Su & Yunjie Yang & Linsong Gao & Xinyu Liu & Heng Huang & Yubai Li & Yongchen Song, 2023. "Three-Dimensional Simulation on the Effects of Different Parameters and Pt Loading on the Long-Term Performance of Proton Exchange Membrane Fuel Cells," Sustainability, MDPI, vol. 15(4), pages 1-22, February.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:12:p:3177-:d:1680789. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.