IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v243y2024ics0951832023007172.html
   My bibliography  Save this article

Approximate dynamic programming for condition-based node deployment in a wireless sensor network

Author

Listed:
  • Boardman, Nicholas T.
  • Sullivan, Kelly M.

Abstract

The flexibility of deployment strategies combined with the low cost of individual sensor nodes allow wireless sensor networks (WSNs) to be integrated into a variety of applications. Network operations degrade over time as sensors consume a finite power supply and begin to fail. In this work we address the selective maintenance of a WSN through a condition-based deployment policy (CBDP) in which sensors are deployed over a series of missions. The main contribution is a Markov decision process (MDP) model to maintain a reliable WSN with respect to region coverage. Due to the resulting high dimensional state and outcome space, we explore approximate dynamic programming (ADP) methodology in the search for high quality CBDPs. Our model is one of the first related to the selective maintenance of a large-scale WSN through the repeated deployment of new sensor nodes with a reliability objective, and one of the first ADP applications for the maintenance of a complex WSN. Additionally, our methodology incorporates a destruction spectrum reliability estimate which has received significant attention with respect to network reliability, but its value in a maintenance setting has not been widely explored. We conclude with a discussion on CBDPs in a range of test instances, and compare the performance to alternative deployment strategies.

Suggested Citation

  • Boardman, Nicholas T. & Sullivan, Kelly M., 2024. "Approximate dynamic programming for condition-based node deployment in a wireless sensor network," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    • Handle: RePEc:eee:reensy:v:243:y:2024:i:c:s0951832023007172
    DOI: 10.1016/j.ress.2023.109803
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023007172
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2023.109803?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jiang, Tao & Liu, Yu, 2020. "Selective maintenance strategy for systems executing multiple consecutive missions with uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    2. Salvatore Distefano, 2013. "Evaluating reliability of WSN with sleep/wake-up interfering nodes," International Journal of Systems Science, Taylor & Francis Journals, vol. 44(10), pages 1793-1806.
    3. Chakraborty, Suparna & Goyal, N.K. & Mahapatra, S. & Soh, Sieteng, 2020. "A Monte-Carlo Markov chain approach for coverage-area reliability of mobile wireless sensor networks with multistate nodes," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    4. Richard Cassady, C. & Paul Murdock, W. & Pohl, Edward A., 2001. "Selective maintenance for support equipment involving multiple maintenance actions," European Journal of Operational Research, Elsevier, vol. 129(2), pages 252-258, March.
    5. Bistouni, Fathollah & Jahanshahi, Mohsen, 2015. "Evaluating failure rate of fault-tolerant multistage interconnection networks using Weibull life distribution," Reliability Engineering and System Safety, Elsevier, vol. 144(C), pages 128-146.
    6. Jorge Navarro & Francisco J. Samaniego & N. Balakrishnan & Debasis Bhattacharya, 2008. "On the application and extension of system signatures in engineering reliability," Naval Research Logistics (NRL), John Wiley & Sons, vol. 55(4), pages 313-327, June.
    7. Shahraki, Ameneh Forouzandeh & Yadav, Om Prakash & Vogiatzis, Chrysafis, 2020. "Selective maintenance optimization for multi-state systems considering stochastically dependent components and stochastic imperfect maintenance actions," Reliability Engineering and System Safety, Elsevier, vol. 196(C).
    8. Saeed, Umer & Jan, Sana Ullah & Lee, Young-Doo & Koo, Insoo, 2021. "Fault diagnosis based on extremely randomized trees in wireless sensor networks," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    9. Liu, Yu & Chen, Yiming & Jiang, Tao, 2020. "Dynamic selective maintenance optimization for multi-state systems over a finite horizon: A deep reinforcement learning approach," European Journal of Operational Research, Elsevier, vol. 283(1), pages 166-181.
    10. Maxim Finkelstein & James Vaupel, 2015. "On random age and remaining lifetime for populations of items," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 31(5), pages 681-689, September.
    11. Wang, Ning & Xiao, Yiyong & Tian, Tianzi & Yang, Jun, 2023. "The optimal 5G base station location of the wireless sensor network considering timely reliability," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    12. Dao, Cuong D. & Zuo, Ming J., 2017. "Selective maintenance of multi-state systems with structural dependence," Reliability Engineering and System Safety, Elsevier, vol. 159(C), pages 184-195.
    13. Park, Jae-Hyun, 2017. "Time-dependent reliability of wireless networks with dependent failures," Reliability Engineering and System Safety, Elsevier, vol. 165(C), pages 47-61.
    14. Maxim Finkelstein & Ilya Gertsbakh, 2015. "‘Time‐free’ preventive maintenance of systems with structures described by signatures," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 31(6), pages 836-845, November.
    15. Zhou, Yifan & Lin, Tian Ran & Sun, Yong & Ma, Lin, 2016. "Maintenance optimisation of a parallel-series system with stochastic and economic dependence under limited maintenance capacity," Reliability Engineering and System Safety, Elsevier, vol. 155(C), pages 137-146.
    16. Zhang, Changzhen & Yang, Jun & Wang, Ning, 2023. "Timely reliability modeling and evaluation of wireless sensor networks with adaptive N-policy sleep scheduling," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    17. Fu, Xiuwen & Yang, Yongsheng, 2020. "Modeling and analysis of cascading node-link failures in multi-sink wireless sensor networks," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
    18. Xu, Jun & Liang, Zhenglin & Li, Yan-Fu & Wang, Kaibo, 2021. "Generalized condition-based maintenance optimization for multi-component systems considering stochastic dependency and imperfect maintenance," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yin, Mingang & Liu, Yu & Liu, Shuntao & Chen, Yiming & Yan, Yutao, 2023. "Scheduling heterogeneous repair channels in selective maintenance of multi-state systems with maintenance duration uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    2. Chaabane, K. & Khatab, A. & Diallo, C. & Aghezzaf, E.-H. & Venkatadri, U., 2020. "Integrated imperfect multimission selective maintenance and repairpersons assignment problem," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    3. Ma, Weining & Zhang, Qin & Xiahou, Tangfan & Liu, Yu & Jia, Xisheng, 2023. "Integrated selective maintenance and task assignment optimization for multi-state systems executing multiple missions," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    4. Liu, Lujie & Yang, Jun & Kong, Xuefeng & Xiao, Yiyong, 2022. "Multi-mission selective maintenance and repairpersons assignment problem with stochastic durations," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    5. Ghorbani, Milad & Nourelfath, Mustapha & Gendreau, Michel, 2022. "A two-stage stochastic programming model for selective maintenance optimization," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    6. Zhang, Lin & Chen, Xiaohui & Khatab, Abdelhakim & An, Youjun & Feng, XiaoNing, 2024. "Joint optimization of selective maintenance and repairpersons assignment problem for mission-oriented systems operating under s-dependent competing risks," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    7. Ghorbani, Milad & Nourelfath, Mustapha & Gendreau, Michel, 2024. "Stochastic programming for selective maintenance optimization with uncertainty in the next mission conditions," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Zhou, Yifan & Li, Bangcheng & Lin, Tian Ran, 2022. "Maintenance optimisation of multicomponent systems using hierarchical coordinated reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    9. Chen, Yiming & Liu, Yu & Jiang, Tao, 2021. "Optimal maintenance strategy for multi-state systems with single maintenance capacity and arbitrarily distributed maintenance time," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    10. Shen, Jingyuan & Hu, Jiawen & Ma, Yizhong, 2020. "Two preventive replacement strategies for systems with protective auxiliary parts subject to degradation and economic dependence," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    11. Hamzea Al-Jabouri & Ahmed Saif & Claver Diallo, 2023. "Robust selective maintenance optimization of series–parallel mission-critical systems subject to maintenance quality uncertainty," Computational Management Science, Springer, vol. 20(1), pages 1-31, December.
    12. Zhang, Changzhen & Yang, Jun & Wang, Ning, 2023. "Timely reliability modeling and evaluation of wireless sensor networks with adaptive N-policy sleep scheduling," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    13. Zhang, Nan & Cai, Kaiquan & Zhang, Jun & Wang, Tian, 2022. "A condition-based maintenance policy considering failure dependence and imperfect inspection for a two-component system," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    14. Liu, Yu & Chen, Yiming & Jiang, Tao, 2020. "Dynamic selective maintenance optimization for multi-state systems over a finite horizon: A deep reinforcement learning approach," European Journal of Operational Research, Elsevier, vol. 283(1), pages 166-181.
    15. Xia, Tangbin & Si, Guojin & Shi, Guo & Zhang, Kaigan & Xi, Lifeng, 2022. "Optimal selective maintenance scheduling for series–parallel systems based on energy efficiency optimization," Applied Energy, Elsevier, vol. 314(C).
    16. Dui, Hongyan & Liu, Meng & Song, Jiaying & Wu, Shaomin, 2023. "Importance measure-based resilience management: Review, methodology and perspectives on maintenance," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    17. Diallo, Claver & Venkatadri, Uday & Khatab, Abdelhakim & Liu, Zhuojun, 2018. "Optimal selective maintenance decisions for large serial k-out-of-n: G systems under imperfect maintenance," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 234-245.
    18. Barlow, E. & Bedford, T. & Revie, M. & Tan, J. & Walls, L., 2021. "A performance-centred approach to optimising maintenance of complex systems," European Journal of Operational Research, Elsevier, vol. 292(2), pages 579-595.
    19. Zhang, Qin & Liu, Yu & Xiahou, Tangfan & Huang, Hong-Zhong, 2023. "A heuristic maintenance scheduling framework for a military aircraft fleet under limited maintenance capacities," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    20. Shahraki, Ameneh Forouzandeh & Yadav, Om Prakash & Vogiatzis, Chrysafis, 2020. "Selective maintenance optimization for multi-state systems considering stochastically dependent components and stochastic imperfect maintenance actions," Reliability Engineering and System Safety, Elsevier, vol. 196(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:243:y:2024:i:c:s0951832023007172. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.