IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i12p3177-d1680789.html
   My bibliography  Save this article

Degradation Prediction of Proton Exchange Membrane Fuel Cell Based on Multi-Head Attention Neural Network and Transformer Model

Author

Listed:
  • Yikai Tang

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

  • Xing Huang

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

  • Yanju Li

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

  • Haoran Ma

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

  • Kai Zhang

    (School of Aerospace Engineering and Applied Mechanics, Tongji University, Shanghai 200092, China)

  • Ke Song

    (School of Automotive Studies, Tongji University, Shanghai 201804, China
    National Fuel Cell Vehicle and Powertrain System Engineering Research Center, Tongji University, Shanghai 201804, China)

Abstract

Proton exchange membrane fuel cells are a clean energy technology with wide application in transportation and stationary energy systems. Due to the problem of voltage degradation under long-term dynamic loads, predicting their performance degradation trend is of great significance for extending the life of proton exchange membrane fuel cells and improving system reliability. This study adopts a data-driven approach to construct a degradation prediction model. In view of the problem of many input parameters and complex distribution of degradation features, a neural network model based on a multi-head attention mechanism and class token is first proposed to analyze the impact of different operating parameters on the output voltage prediction. The importance of each input variable is quantified by the attention weight matrix to assist feature screening. Subsequently, a prediction model is constructed based on Transformer to characterize the voltage degradation trend of fuel cells under dynamic conditions. The experimental results show that the root mean square error and mean absolute error of the model in the test phase are 0.008954 and 0.006590, showing strong prediction performance. Based on the importance evaluation provided by the first model, 11 key parameters were selected as inputs. After this input simplification, the model still maintained a prediction accuracy comparable to that of the full-feature model. This result verifies the effectiveness of the feature screening strategy and demonstrates its contribution to improved generalization and robustness.

Suggested Citation

  • Yikai Tang & Xing Huang & Yanju Li & Haoran Ma & Kai Zhang & Ke Song, 2025. "Degradation Prediction of Proton Exchange Membrane Fuel Cell Based on Multi-Head Attention Neural Network and Transformer Model," Energies, MDPI, vol. 18(12), pages 1-20, June.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:12:p:3177-:d:1680789
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/12/3177/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/12/3177/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zuo, Jian & Lv, Hong & Zhou, Daming & Xue, Qiong & Jin, Liming & Zhou, Wei & Yang, Daijun & Zhang, Cunman, 2021. "Deep learning based prognostic framework towards proton exchange membrane fuel cell for automotive application," Applied Energy, Elsevier, vol. 281(C).
    2. Lingling Lv & Pucheng Pei & Peng Ren & He Wang & Geng Wang, 2025. "Exploring Performance Degradation of Proton Exchange Membrane Fuel Cells Based on Diffusion Transformer Model," Energies, MDPI, vol. 18(5), pages 1-22, February.
    3. Song, Ke & Ding, Yuhang & Hu, Xiao & Xu, Hongjie & Wang, Yimin & Cao, Jing, 2021. "Degradation adaptive energy management strategy using fuel cell state-of-health for fuel economy improvement of hybrid electric vehicle," Applied Energy, Elsevier, vol. 285(C).
    4. Zachary P. Cano & Dustin Banham & Siyu Ye & Andreas Hintennach & Jun Lu & Michael Fowler & Zhongwei Chen, 2018. "Batteries and fuel cells for emerging electric vehicle markets," Nature Energy, Nature, vol. 3(4), pages 279-289, April.
    5. Chen, Kui & Badji, Abderrezak & Laghrouche, Salah & Djerdir, Abdesslem, 2022. "Polymer electrolyte membrane fuel cells degradation prediction using multi-kernel relevance vector regression and whale optimization algorithm," Applied Energy, Elsevier, vol. 318(C).
    6. Siavash Khalili & Eetu Rantanen & Dmitrii Bogdanov & Christian Breyer, 2019. "Global Transportation Demand Development with Impacts on the Energy Demand and Greenhouse Gas Emissions in a Climate-Constrained World," Energies, MDPI, vol. 12(20), pages 1-54, October.
    7. Pei, Pucheng & Chen, Huicui, 2014. "Main factors affecting the lifetime of Proton Exchange Membrane fuel cells in vehicle applications: A review," Applied Energy, Elsevier, vol. 125(C), pages 60-75.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Ze & Xu, Sichuan & Zhao, Honghui & Wang, Yupeng, 2022. "Durability estimation and short-term voltage degradation forecasting of vehicle PEMFC system: Development and evaluation of machine learning models," Applied Energy, Elsevier, vol. 326(C).
    2. Yu, Yang & Yu, Qinghua & Luo, RunSen & Chen, Sheng & Yang, Jiebo & Yan, Fuwu, 2024. "Degradation and polarization curve prediction of proton exchange membrane fuel cells: An interpretable model perspective," Applied Energy, Elsevier, vol. 365(C).
    3. Huang, Ruike & Zhang, Xuexia & Dong, Sidi & Huang, Lei & Liao, Hongbo & Li, Yuan, 2024. "A refined grey Verhulst model for accurate degradation prognostication of PEM fuel cells based on inverse hyperbolic sine function transformation," Renewable Energy, Elsevier, vol. 237(PC).
    4. Wang, Zifei & Tao, Jili & Liu, Zhitao & Feng, Han & Ma, Longhua & Xu, Ming & Su, Hongye, 2024. "A proton exchange membrane fuel cells degradation prediction method based on multi-scale temporal information merging network," Energy, Elsevier, vol. 313(C).
    5. Mojgan Fayyazi & Paramjotsingh Sardar & Sumit Infent Thomas & Roonak Daghigh & Ali Jamali & Thomas Esch & Hans Kemper & Reza Langari & Hamid Khayyam, 2023. "Artificial Intelligence/Machine Learning in Energy Management Systems, Control, and Optimization of Hydrogen Fuel Cell Vehicles," Sustainability, MDPI, vol. 15(6), pages 1-38, March.
    6. Lu, Dagang & Yi, Fengyan & Hu, Donghai & Li, Jianwei & Yang, Qingqing & Wang, Jing, 2023. "Online optimization of energy management strategy for FCV control parameters considering dual power source lifespan decay synergy," Applied Energy, Elsevier, vol. 348(C).
    7. Daeichian, Abolghasem & Ghaderi, Razieh & Kandidayeni, Mohsen & Soleymani, Mehdi & Trovão, João P. & Boulon, Loïc, 2021. "Online characteristics estimation of a fuel cell stack through covariance intersection data fusion," Applied Energy, Elsevier, vol. 292(C).
    8. Pang, Ran & Zhang, Caizhi & Dai, Haifeng & Bai, Yunfeng & Hao, Dong & Chen, Jinrui & Zhang, Bin, 2022. "Intelligent health states recognition of fuel cell by cell voltage consistency under typical operating parameters," Applied Energy, Elsevier, vol. 305(C).
    9. He, Wenbin & Liu, Ting & Ming, Wuyi & Li, Zongze & Du, Jinguang & Li, Xiaoke & Guo, Xudong & Sun, Peiyan, 2024. "Progress in prediction of remaining useful life of hydrogen fuel cells based on deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    10. Tao, Zihan & Zhang, Chu & Xiong, Jinlin & Hu, Haowen & Ji, Jie & Peng, Tian & Nazir, Muhammad Shahzad, 2023. "Evolutionary gate recurrent unit coupling convolutional neural network and improved manta ray foraging optimization algorithm for performance degradation prediction of PEMFC," Applied Energy, Elsevier, vol. 336(C).
    11. Chen, Dongfang & Wu, Wenlong & Chang, Kuanyu & Li, Yuehua & Pei, Pucheng & Xu, Xiaoming, 2023. "Performance degradation prediction method of PEM fuel cells using bidirectional long short-term memory neural network based on Bayesian optimization," Energy, Elsevier, vol. 285(C).
    12. Deng, Zhihua & Chan, Siew Hwa & Chen, Qihong & Liu, Hao & Zhang, Liyan & Zhou, Keliang & Tong, Sirui & Fu, Zhichao, 2023. "Efficient degradation prediction of PEMFCs using ELM-AE based on fuzzy extension broad learning system," Applied Energy, Elsevier, vol. 331(C).
    13. Sun, Li & Sun, Wen & You, Fengqi, 2020. "Core temperature modelling and monitoring of lithium-ion battery in the presence of sensor bias," Applied Energy, Elsevier, vol. 271(C).
    14. Ren, Peng & Pei, Pucheng & Li, Yuehua & Wu, Ziyao & Chen, Dongfang & Huang, Shangwei & Jia, Xiaoning, 2019. "Diagnosis of water failures in proton exchange membrane fuel cell with zero-phase ohmic resistance and fixed-low-frequency impedance," Applied Energy, Elsevier, vol. 239(C), pages 785-792.
    15. Lucio Ciabattoni & Stefano Cardarelli & Marialaura Di Somma & Giorgio Graditi & Gabriele Comodi, 2021. "A Novel Open-Source Simulator Of Electric Vehicles in a Demand-Side Management Scenario," Energies, MDPI, vol. 14(6), pages 1-16, March.
    16. Géremi Gilson Dranka & Paula Ferreira, 2020. "Electric Vehicles and Biofuels Synergies in the Brazilian Energy System," Energies, MDPI, vol. 13(17), pages 1-22, August.
    17. Wu, Kangcheng & Du, Qing & Zu, Bingfeng & Wang, Yupeng & Cai, Jun & Gu, Xin & Xuan, Jin & Jiao, Kui, 2021. "Enabling real-time optimization of dynamic processes of proton exchange membrane fuel cell: Data-driven approach with semi-recurrent sliding window method," Applied Energy, Elsevier, vol. 303(C).
    18. Youssef Amry & Elhoussin Elbouchikhi & Franck Le Gall & Mounir Ghogho & Soumia El Hani, 2022. "Electric Vehicle Traction Drives and Charging Station Power Electronics: Current Status and Challenges," Energies, MDPI, vol. 15(16), pages 1-30, August.
    19. Samuel Simon Araya & Fan Zhou & Simon Lennart Sahlin & Sobi Thomas & Christian Jeppesen & Søren Knudsen Kær, 2019. "Fault Characterization of a Proton Exchange Membrane Fuel Cell Stack," Energies, MDPI, vol. 12(1), pages 1-17, January.
    20. Togun, Hussein & Basem, Ali & Abdulrazzaq, Tuqa & Biswas, Nirmalendu & Abed, Azher M. & dhabab, Jameel M. & Chattopadhyay, Anirban & Slimi, Khalifa & Paul, Dipankar & Barmavatu, Praveen & Chrouda, Ama, 2025. "Development and comparative analysis between battery electric vehicles (BEV) and fuel cell electric vehicles (FCEV)," Applied Energy, Elsevier, vol. 388(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:12:p:3177-:d:1680789. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.