Reinforcement learning-based maintenance scheduling for a stochastic deteriorating fuel cell considering stack-to-stack heterogeneity
Author
Abstract
Suggested Citation
DOI: 10.1016/j.ress.2024.110700
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Zhao, Jian & Li, Xianguo & Shum, Chris & McPhee, John, 2023. "Control-oriented computational fuel cell dynamics modeling – Model order reduction vs. computational speed," Energy, Elsevier, vol. 266(C).
- Zuo, Jian & Cadet, Catherine & Li, Zhongliang & Bérenguer, Christophe & Outbib, Rachid, 2024. "A deterioration-aware energy management strategy for the lifetime improvement of a multi-stack fuel cell system subject to a random dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
- Zhang, Chen & Gao, Wei & Yang, Tao & Guo, Sheng, 2019. "Opportunistic maintenance strategy for wind turbines considering weather conditions and spare parts inventory management," Renewable Energy, Elsevier, vol. 133(C), pages 703-711.
- Zuo, Jian & Lv, Hong & Zhou, Daming & Xue, Qiong & Jin, Liming & Zhou, Wei & Yang, Daijun & Zhang, Cunman, 2021. "Deep learning based prognostic framework towards proton exchange membrane fuel cell for automotive application," Applied Energy, Elsevier, vol. 281(C).
- Pinciroli, Luca & Baraldi, Piero & Ballabio, Guido & Compare, Michele & Zio, Enrico, 2022. "Optimization of the Operation and Maintenance of renewable energy systems by Deep Reinforcement Learning," Renewable Energy, Elsevier, vol. 183(C), pages 752-763.
- Yue, Meiling & Jemei, Samir & Zerhouni, Noureddine & Gouriveau, Rafael, 2021. "Proton exchange membrane fuel cell system prognostics and decision-making: Current status and perspectives," Renewable Energy, Elsevier, vol. 179(C), pages 2277-2294.
- Linmiao Zhang & Yong Lei & Houcai Shen, 2016. "How heterogeneity influences condition-based maintenance for gamma degradation process," International Journal of Production Research, Taylor & Francis Journals, vol. 54(19), pages 5829-5841, October.
- Ma, Rui & Yang, Tao & Breaz, Elena & Li, Zhongliang & Briois, Pascal & Gao, Fei, 2018. "Data-driven proton exchange membrane fuel cell degradation predication through deep learning method," Applied Energy, Elsevier, vol. 231(C), pages 102-115.
- Castro, Inma T. & Basten, Rob J.I. & van Houtum, Geert-Jan, 2020. "Maintenance cost evaluation for heterogeneous complex systems under continuous monitoring," Reliability Engineering and System Safety, Elsevier, vol. 200(C).
- Chen, Huicui & Pei, Pucheng & Song, Mancun, 2015. "Lifetime prediction and the economic lifetime of Proton Exchange Membrane fuel cells," Applied Energy, Elsevier, vol. 142(C), pages 154-163.
- Jian Zuo & Catherine Cadet & Zhongliang Li & Christophe Berenguer & Rachid Outbib, 2023. "Post-prognostics decision-making strategy for load allocation on a stochastically deteriorating multi-stack fuel cell system," Journal of Risk and Reliability, , vol. 237(1), pages 40-57, February.
- Wang, Guihua & Miller, Marshall & Fulton, Lewis, 2022. "Estimating Maintenance and Repair Costs for Battery Electric and Fuel Cell Heavy Duty Trucks," Institute of Transportation Studies, Working Paper Series qt36c08395, Institute of Transportation Studies, UC Davis.
- Mosayebi Omshi, E. & Grall, A., 2021. "Replacement and imperfect repair of deteriorating system: Study of a CBM policy and impact of repair efficiency," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
- Zhang, Ning & Qi, Faqun & Zhang, Chengjie & Zhou, Hongming, 2022. "Joint optimization of condition-based maintenance policy and buffer capacity for a two-unit series system," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
- Guo, Chunhui & Liang, Zhenglin, 2022. "A predictive Markov decision process for optimizing inspection and maintenance strategies of partially observable multi-state systems," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
- Wang, Chu & Dou, Manfeng & Li, Zhongliang & Outbib, Rachid & Zhao, Dongdong & Zuo, Jian & Wang, Yuanlin & Liang, Bin & Wang, Peng, 2023. "Data-driven prognostics based on time-frequency analysis and symbolic recurrent neural network for fuel cells under dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
- Zhang, Nailong & Si, Wujun, 2020. "Deep reinforcement learning for condition-based maintenance planning of multi-component systems under dependent competing risks," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
- van Noortwijk, J.M., 2009. "A survey of the application of gamma processes in maintenance," Reliability Engineering and System Safety, Elsevier, vol. 94(1), pages 2-21.
- Lin, Chun Pang & Ling, Man Ho & Cabrera, Javier & Yang, Fangfang & Yu, Denis Yau Wai & Tsui, Kwok Leung, 2021. "Prognostics for lithium-ion batteries using a two-phase gamma degradation process model," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
- Wang, Wei & Lin, Mingqiang & Fu, Yongnian & Luo, Xiaoping & Chen, Hanghang, 2020. "Multi-objective optimization of reliability-redundancy allocation problem for multi-type production systems considering redundancy strategies," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
- Bahrami, Milad & Martin, Jean-Philippe & Maranzana, Gaël & Pierfederici, Serge & Weber, Mathieu & Didierjean, Sophie, 2022. "Fuel cell management system: An approach to increase its durability," Applied Energy, Elsevier, vol. 306(PB).
- Pinciroli, Luca & Baraldi, Piero & Zio, Enrico, 2023. "Maintenance optimization in industry 4.0," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
- Ren, Zhengru & Verma, Amrit Shankar & Li, Ye & Teuwen, Julie J.E. & Jiang, Zhiyu, 2021. "Offshore wind turbine operations and maintenance: A state-of-the-art review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Zuo, Jian & Steiner, Nadia Yousfi & Li, Zhongliang & Hissel, Daniel, 2024. "Health management review for fuel cells: Focus on action phase," Renewable and Sustainable Energy Reviews, Elsevier, vol. 201(C).
- Chen, Kui & Badji, Abderrezak & Laghrouche, Salah & Djerdir, Abdesslem, 2022. "Polymer electrolyte membrane fuel cells degradation prediction using multi-kernel relevance vector regression and whale optimization algorithm," Applied Energy, Elsevier, vol. 318(C).
- Huang, Ruike & Zhang, Xuexia & Dong, Sidi & Huang, Lei & Liao, Hongbo & Li, Yuan, 2024. "A refined grey Verhulst model for accurate degradation prognostication of PEM fuel cells based on inverse hyperbolic sine function transformation," Renewable Energy, Elsevier, vol. 237(PC).
- Liu, Ze & Xu, Sichuan & Zhao, Honghui & Wang, Yupeng, 2022. "Durability estimation and short-term voltage degradation forecasting of vehicle PEMFC system: Development and evaluation of machine learning models," Applied Energy, Elsevier, vol. 326(C).
- Song, Ke & Huang, Xing & Huang, Pengyu & Sun, Hui & Chen, Yuhui & Huang, Dongya, 2024. "Data-driven health state estimation and remaining useful life prediction of fuel cells," Renewable Energy, Elsevier, vol. 227(C).
- Yu, Yulong & Zheng, Qiang & Zhang, Tianyi & Li, Zhengyan & Chen, Lei & Tao, Wen-Quan, 2025. "Forecasting the output performance of PEMFCs via a novel deep learning framework considering varying operating conditions and time scales," Applied Energy, Elsevier, vol. 389(C).
- He, Wenbin & Liu, Ting & Ming, Wuyi & Li, Zongze & Du, Jinguang & Li, Xiaoke & Guo, Xudong & Sun, Peiyan, 2024. "Progress in prediction of remaining useful life of hydrogen fuel cells based on deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
- Mosayebi Omshi, E. & Shemehsavar, S. & Grall, A., 2024. "An intelligent maintenance policy for a latent degradation system," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
- Lv, Jianfeng & Shen, Xiaoning & Gao, Yabin & Liu, Jianxing & Sun, Guanghui, 2024. "The seasonal-trend disentangle based prognostic framework for PEM fuel cells," Renewable Energy, Elsevier, vol. 228(C).
- Qiang Liu & Weihong Zang & Wentao Zhang & Yang Zhang & Yuqi Tong & Yanbiao Feng, 2025. "Steady-State Model Enabled Dynamic PEMFC Performance Degradation Prediction via Recurrent Neural Network," Energies, MDPI, vol. 18(10), pages 1-20, May.
- Zhang, Qin & Liu, Yu & Xiang, Yisha & Xiahou, Tangfan, 2024. "Reinforcement learning in reliability and maintenance optimization: A tutorial," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
- Deng, Zhihua & Chan, Siew Hwa & Chen, Qihong & Liu, Hao & Zhang, Liyan & Zhou, Keliang & Tong, Sirui & Fu, Zhichao, 2023. "Efficient degradation prediction of PEMFCs using ELM-AE based on fuzzy extension broad learning system," Applied Energy, Elsevier, vol. 331(C).
- Finkelstein, Maxim & Cha, Ji Hwan & Langston, Amy, 2023. "Improving classical optimal age-replacement policies for degrading items," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
- Liu, Xingheng & Matias, José & Jäschke, Johannes & Vatn, Jørn, 2022. "Gibbs sampler for noisy Transformed Gamma process: Inference and remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
- Si, Guojin & Xia, Tangbin & Gebraeel, Nagi & Wang, Dong & Pan, Ershun & Xi, Lifeng, 2025. "Holistic opportunistic maintenance scheduling and routing for offshore wind farms," Renewable and Sustainable Energy Reviews, Elsevier, vol. 207(C).
- Zuo, Jian & Cadet, Catherine & Li, Zhongliang & Bérenguer, Christophe & Outbib, Rachid, 2024. "A deterioration-aware energy management strategy for the lifetime improvement of a multi-stack fuel cell system subject to a random dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
- Yang, Yang & Yu, Xiaoran & Zhu, Wenchao & Xie, Changjun & Zhao, Bo & Zhang, Leiqi & Shi, Ying & Huang, Liang & Zhang, Ruiming, 2023. "Degradation prediction of proton exchange membrane fuel cells with model uncertainty quantification," Renewable Energy, Elsevier, vol. 219(P2).
- Zhang, Jingqi & Fouladirad, Mitra & Limnios, Nikolaos, 2025. "Sensitivity analysis of an imperfect maintenance policy for Proton-exchange membrane fuel cell based on geometric a semi-Markov model," Reliability Engineering and System Safety, Elsevier, vol. 255(C).
- Tian, Lei & Gao, Yan & Yang, Haiyu & Wang, Renkang, 2025. "Multi-scenario long-term degradation prediction of PEMFC based on generative inference informer model," Applied Energy, Elsevier, vol. 377(PA).
- Pliego Marugán, Alberto & Pinar-Pérez, Jesús M. & GarcÃa Márquez, Fausto Pedro, 2024. "A reinforcement learning agent for maintenance of deteriorating systems with increasingly imperfect repairs," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
More about this item
Keywords
Proton exchange membrane fuel cell; Maintenance scheduling; Proximal policy optimization; Markov decision process; Stochastic deterioration;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:256:y:2025:i:c:s0951832024007713. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.