Online reinforcement learning for condition-based group maintenance using factored Markov decision processes
Author
Abstract
Suggested Citation
DOI: 10.1016/j.ejor.2023.11.039
Download full text from publisher
As the access to this document is restricted, you may want to
for a different version of it.References listed on IDEAS
- Wang, Jun & Zhu, Xiaoyan, 2021. "Joint optimization of condition-based maintenance and inventory control for a k-out-of-n:F system of multi-state degrading components," European Journal of Operational Research, Elsevier, vol. 290(2), pages 514-529.
- Liu, Bin & Pandey, Mahesh D. & Wang, Xiaolin & Zhao, Xiujie, 2021. "A finite-horizon condition-based maintenance policy for a two-unit system with dependent degradation processes," European Journal of Operational Research, Elsevier, vol. 295(2), pages 705-717.
- Deep, Akash & Zhou, Shiyu & Veeramani, Dharmaraj & Chen, Yong, 2023. "Partially observable Markov decision process-based optimal maintenance planning with time-dependent observations," European Journal of Operational Research, Elsevier, vol. 311(2), pages 533-544.
- Chen, Nan & Ye, Zhi-Sheng & Xiang, Yisha & Zhang, Linmiao, 2015. "Condition-based maintenance using the inverse Gaussian degradation model," European Journal of Operational Research, Elsevier, vol. 243(1), pages 190-199.
- Zhou, Yifan & Guo, Yiming & Lin, Tian Ran & Ma, Lin, 2018. "Maintenance optimisation of a series production system with intermediate buffers using a multi-agent FMDP," Reliability Engineering and System Safety, Elsevier, vol. 180(C), pages 39-48.
- Barlow, E. & Bedford, T. & Revie, M. & Tan, J. & Walls, L., 2021. "A performance-centred approach to optimising maintenance of complex systems," European Journal of Operational Research, Elsevier, vol. 292(2), pages 579-595.
- Zheng, Meimei & Lin, Jie & Xia, Tangbin & Liu, Yu & Pan, Ershun, 2023. "Joint condition-based maintenance and spare provisioning policy for a K-out-of-N system with failures during inspection intervals," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1220-1232.
- Zhicheng Zhu & Yisha Xiang, 2021. "Condition-based maintenance for multi-component systems: Modeling, structural properties, and algorithms," IISE Transactions, Taylor & Francis Journals, vol. 53(1), pages 88-100, January.
- Olde Keizer, Minou C.A. & Teunter, Ruud H. & Veldman, Jasper, 2017. "Joint condition-based maintenance and inventory optimization for systems with multiple components," European Journal of Operational Research, Elsevier, vol. 257(1), pages 209-222.
- Wildeman, R. E. & Dekker, R. & Smit, A. C. J. M., 1997.
"A dynamic policy for grouping maintenance activities,"
European Journal of Operational Research, Elsevier, vol. 99(3), pages 530-551, June.
- Wildeman, R.E. & Dekker, R. & Smit, A.C.J.M., 1995. "A Dynamic Policy for Grouping Maintenance Activities," Econometric Institute Research Papers EI 9537-/A, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
- Brown, Bodunrin & Liu, Bin & McIntyre, Stuart & Revie, Matthew, 2022. "Reliability analysis of load-sharing systems with spatial dependence and proximity effects," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
- Kıvanç, İpek & Özgür-Ünlüakın, Demet & Bilgiç, Taner, 2022. "Maintenance policy analysis of the regenerative air heater system using factored POMDPs," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
- Olde Keizer, Minou C.A. & Flapper, Simme Douwe P. & Teunter, Ruud H., 2017. "Condition-based maintenance policies for systems with multiple dependent components: A review," European Journal of Operational Research, Elsevier, vol. 261(2), pages 405-420.
- Alaa H. Elwany & Nagi Z. Gebraeel & Lisa M. Maillart, 2011. "Structured Replacement Policies for Components with Complex Degradation Processes and Dedicated Sensors," Operations Research, INFORMS, vol. 59(3), pages 684-695, June.
- Gámiz, María Luz & Limnios, Nikolaos & Segovia-García, María del Carmen, 2023. "Hidden markov models in reliability and maintenance," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1242-1255.
- Zhou, Yifan & Lin, Tian Ran & Sun, Yong & Ma, Lin, 2016. "Maintenance optimisation of a parallel-series system with stochastic and economic dependence under limited maintenance capacity," Reliability Engineering and System Safety, Elsevier, vol. 155(C), pages 137-146.
- de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
- Tian, Zhigang & Liao, Haitao, 2011. "Condition based maintenance optimization for multi-component systems using proportional hazards model," Reliability Engineering and System Safety, Elsevier, vol. 96(5), pages 581-589.
- Xiujie Zhao & Zhenglin Liang & Ajith K. Parlikad & Min Xie, 2022. "Performance-oriented risk evaluation and maintenance for multi-asset systems: A Bayesian perspective," IISE Transactions, Taylor & Francis Journals, vol. 54(3), pages 251-270, March.
- Olde Keizer, Minou C.A. & Teunter, Ruud H. & Veldman, Jasper, 2016. "Clustering condition-based maintenance for systems with redundancy and economic dependencies," European Journal of Operational Research, Elsevier, vol. 251(2), pages 531-540.
- Abderrahmane Abbou & Viliam Makis, 2019. "Group Maintenance: A Restless Bandits Approach," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 719-731, October.
- Nguyen, Ho Si Hung & Do, Phuc & Vu, Hai-Canh & Iung, Benoit, 2019. "Dynamic maintenance grouping and routing for geographically dispersed production systems," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 392-404.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Alexandre, Rodrigo e Alvim & Fragoso, Marcelo D. & Filho, Virgílio J.M. Ferreira & Arruda, Edilson F., 2025. "Solving Markov decision processes via state space decomposition and time aggregation," European Journal of Operational Research, Elsevier, vol. 324(1), pages 155-167.
- Boujarif, Abdelhamid & Coit, David W. & Jouini, Oualid & Zeng, Zhiguo & Heidsieck, Robert, 2025. "Repairing smarter: Opportunistic maintenance for a closed-loop supply chain with spare parts dependency," Reliability Engineering and System Safety, Elsevier, vol. 255(C).
- Wu, Bin & Zhu, Wenjin & Luo, Xu & Si, Shubin, 2025. "Simultaneous tasks planning and resources assignment in maintenance scheduling under uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 259(C).
- Zhang, Qin & Liu, Yu & Xiang, Yisha & Xiahou, Tangfan, 2024. "Reinforcement learning in reliability and maintenance optimization: A tutorial," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
- Andersen, Jesper Fink & Nielsen, Bo Friis, 2025. "A comparative study of time-based maintenance and condition-based maintenance for multi-component systems," Reliability Engineering and System Safety, Elsevier, vol. 256(C).
- Abada, Ibrahim & Lambin, Xavier & Tchakarov, Nikolay, 2024. "Collusion by mistake: Does algorithmic sophistication drive supra-competitive profits?," European Journal of Operational Research, Elsevier, vol. 318(3), pages 927-953.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Arts, Joachim & Boute, Robert N. & Loeys, Stijn & van Staden, Heletjé E., 2025. "Fifty years of maintenance optimization: Reflections and perspectives," European Journal of Operational Research, Elsevier, vol. 322(3), pages 725-739.
- Liu, Bin & Pandey, Mahesh D. & Wang, Xiaolin & Zhao, Xiujie, 2021. "A finite-horizon condition-based maintenance policy for a two-unit system with dependent degradation processes," European Journal of Operational Research, Elsevier, vol. 295(2), pages 705-717.
- de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
- Leppinen, Jussi & Punkka, Antti & Ekholm, Tommi & Salo, Ahti, 2025. "An optimization model for determining cost-efficient maintenance policies for multi-component systems with economic and structural dependencies," Omega, Elsevier, vol. 130(C).
- Eggertsson, Ragnar & Eruguz, Ayse Sena & Basten, Rob & Maillart, Lisa M., 2025. "Maintenance optimization for multi-component systems with a single sensor," European Journal of Operational Research, Elsevier, vol. 320(3), pages 559-569.
- Azizi, Fariba & Salari, Nooshin, 2023. "A novel condition-based maintenance framework for parallel manufacturing systems based on bivariate birth/birth–death processes," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
- Barlow, E. & Bedford, T. & Revie, M. & Tan, J. & Walls, L., 2021. "A performance-centred approach to optimising maintenance of complex systems," European Journal of Operational Research, Elsevier, vol. 292(2), pages 579-595.
- Karabağ, Oktay & Bulut, Önder & Toy, Ayhan Özgür & Fadıloğlu, Mehmet Murat, 2024. "An efficient procedure for optimal maintenance intervention in partially observable multi-component systems," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
- Andersen, Jesper Fink & Andersen, Anders Reenberg & Kulahci, Murat & Nielsen, Bo Friis, 2022. "A numerical study of Markov decision process algorithms for multi-component replacement problems," European Journal of Operational Research, Elsevier, vol. 299(3), pages 898-909.
- Wang, Yukun & Li, Xiaopeng & Chen, Junyan & Liu, Yiliu, 2022. "A condition-based maintenance policy for multi-component systems subject to stochastic and economic dependencies," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
- Shi, Yue & Zhu, Weihang & Xiang, Yisha & Feng, Qianmei, 2020. "Condition-based maintenance optimization for multi-component systems subject to a system reliability requirement," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
- Ece Zeliha Demirci & Joachim Arts & Geert-Jan van Houtum, 2025.
"A restless bandit approach for capacitated condition based maintenance scheduling,"
Flexible Services and Manufacturing Journal, Springer, vol. 37(1), pages 179-207, March.
- Ece Zeliha Demirci & Joachim Arts & Geert-Jan Van Houtum, 2022. "A restless bandit approach for capacitated condition based maintenance scheduling," DEM Discussion Paper Series 22-01, Department of Economics at the University of Luxembourg.
- Liu, Xinbao & Yang, Tianji & Pei, Jun & Liao, Haitao & Pohl, Edward A., 2019. "Replacement and inventory control for a multi-customer product service system with decreasing replacement costs," European Journal of Operational Research, Elsevier, vol. 273(2), pages 561-574.
- Alaswad, Suzan & Xiang, Yisha, 2017. "A review on condition-based maintenance optimization models for stochastically deteriorating system," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 54-63.
- Uit Het Broek, Michiel A.J. & Teunter, Ruud H. & de Jonge, Bram & Veldman, Jasper, 2021. "Joint condition-based maintenance and load-sharing optimization for two-unit systems with economic dependency," European Journal of Operational Research, Elsevier, vol. 295(3), pages 1119-1131.
- Zhang, Wenyu & Zhang, Xiaohong & He, Shuguang & Zhao, Xing & He, Zhen, 2024. "Optimal condition-based maintenance policy for multi-component repairable systems with economic dependence in a finite-horizon," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
- Deep, Akash & Zhou, Shiyu & Veeramani, Dharmaraj & Chen, Yong, 2023. "Partially observable Markov decision process-based optimal maintenance planning with time-dependent observations," European Journal of Operational Research, Elsevier, vol. 311(2), pages 533-544.
- Wu, Tianyi & Yang, Li & Ma, Xiaobing & Zhang, Zihan & Zhao, Yu, 2020. "Dynamic maintenance strategy with iteratively updated group information," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
- Huynh, K.T. & Vu, H.C. & Nguyen, T.D. & Ho, A.C., 2022. "A predictive maintenance model for k-out-of-n:F continuously deteriorating systems subject to stochastic and economic dependencies," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
- Wang, Yukun & Gao, Weizheng & Li, Xiaopeng & Liu, Yiliu, 2024. "Joint optimization of performance-based contracting, condition-based maintenance and spare parts inventory for degrading production systems," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:315:y:2024:i:1:p:176-190. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.