IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v182y2024ics0960077924002649.html

A mobile node path optimization approach based on Q-learning to defend against cascading failures on static-mobile networks

Author

Listed:
  • Yin, Rongrong
  • Wang, Yumeng
  • Li, Linhui
  • Zhang, Le
  • Hao, Zhenyang
  • Lang, Chun

Abstract

The research on cascading failures in static networks has become relatively mature, and an increasing number of scholars have started to explore the network scenarios where mobile nodes and static nodes coexist. In order to enhance the resilience of static-mobile networks against cascading failures, an algorithm based on Q-learning for optimizing the path of the mobile node is proposed in this paper. This paper proposes a Q-learning-based algorithm for optimizing the path of the mobile node. To achieve this objective, a cascading failure model is established based on sequential interactions between mobile nodes and static nodes in this study. In this model, the motion paths of the mobile node are generated by the Q-learning algorithm. Based on this approach, extensive experiments are conducted, and the results demonstrate the following findings: 1) By increasing the adjustable load parameters of static nodes in the network, the occurrence of cascading failures is delayed, and the frequency of cascading failures is decreased. 2) Increasing the adjustable load parameter, capacity parameter, and network size of static nodes contributes to the network's resilience against cascading failures. 3) As the communication radius of the mobile node increases, the scale of failures in the static network initially increases and then decreases. 4) Different trajectories of the mobile node have a significant impact on network robustness, and paths generated based on Q-learning algorithm exhibit significantly improved network robustness compared to Gaussian-Markov mobility trajectories. The Q-learning algorithm is compared to the Ant Colony Optimization algorithm in terms of execution time, path length, and network robustness, and the Q-learning algorithm demonstrating favorable performance. These experimental results can be valuable for theoretical research on cascading failures in static-mobile networks.

Suggested Citation

  • Yin, Rongrong & Wang, Yumeng & Li, Linhui & Zhang, Le & Hao, Zhenyang & Lang, Chun, 2024. "A mobile node path optimization approach based on Q-learning to defend against cascading failures on static-mobile networks," Chaos, Solitons & Fractals, Elsevier, vol. 182(C).
    • Handle: RePEc:eee:chsofr:v:182:y:2024:i:c:s0960077924002649
    DOI: 10.1016/j.chaos.2024.114712
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077924002649
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.chaos.2024.114712?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Sun, H.J. & Zhao, H. & Wu, J.J., 2008. "A robust matching model of capacity to defense cascading failure on complex networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(25), pages 6431-6435.
    2. Cristopher Moore & M. E. J. Newman, 2000. "Epidemics and Percolation in Small-World Networks," Working Papers 00-01-002, Santa Fe Institute.
    3. Zhang, Lin & Wen, Huiying & Lu, Jian & Lei, Da & Li, Shubin & Ukkusuri, Satish V., 2022. "Exploring cascading reliability of multi-modal public transit network based on complex networks," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    4. Tian, Meng & Dong, Zhengcheng & Wang, Xianpei, 2021. "Reinforcement learning approach for robustness analysis of complex networks with incomplete information," Chaos, Solitons & Fractals, Elsevier, vol. 144(C).
    5. Zhao, Yanwei & Wang, Huanqing & Xu, Ning & Zong, Guangdeng & Zhao, Xudong, 2023. "Reinforcement learning-based decentralized fault tolerant control for constrained interconnected nonlinear systems," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).
    6. Volker Turau & Christoph Weyer, 2019. "Cascading failures in complex networks caused by overload attacks," Journal of Heuristics, Springer, vol. 25(6), pages 837-859, December.
    7. Lv, Changchun & Yuan, Ziwei & Si, Shubin & Duan, Dongli & Yao, Shirui, 2022. "Cascading failure in networks with dynamical behavior against multi-node removal," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).
    8. Tu, Haicheng & Xia, Yongxiang & Chen, Xi, 2022. "Vulnerability analysis of cyber physical systems under the false alarm cyber attacks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 599(C).
    9. Yin, Rongrong & Zhang, Kai & Ma, Xuyao & Wang, Yumeng & Li, Linhui, 2023. "Analysis of cascading failures caused by mobile overload attacks in scale-free networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 615(C).
    10. Yin, Rong-Rong & Liu, Bin & Liu, Hao-Ran & Li, Ya-Qian, 2014. "The critical load of scale-free fault-tolerant topology in wireless sensor networks for cascading failures," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 409(C), pages 8-16.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Shuliang & Wang, Jin & Luan, Shengyang & Song, Bo, 2024. "Deep sparse autoencoders-based community detection and resilience analysis of interdependent infrastructure networks," Chaos, Solitons & Fractals, Elsevier, vol. 189(P2).
    2. Jiang, Ting & Liu, Kai & Xiang, Bing-Bing & Zhang, Hai-Feng & Wang, Huan, 2025. "A cost-constrained dismantling framework for hypergraph with dynamic cascading failure using deep reinforcement learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 679(C).
    3. Fu, Xiuwen & Zheng, Dingyi & Liu, Xiangwei & Xing, Liudong & Peng, Rui, 2025. "Systematic review and future perspectives on cascading failures in Internet of Things: Modeling and optimization," Reliability Engineering and System Safety, Elsevier, vol. 254(PA).
    4. Abdulkadirov, Ruslan & Lyakhov, Pavel & Bergerman, Maxim & Nagornov, Nikolay, 2025. "Transformer operator network with fast difference gradient positive–negative momentum for solving Navier–Stokes equations," Chaos, Solitons & Fractals, Elsevier, vol. 200(P1).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yin, Rongrong & Zhang, Kai & Ma, Xuyao & Wang, Yumeng & Li, Linhui, 2023. "Analysis of cascading failures caused by mobile overload attacks in scale-free networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 615(C).
    2. Yuan, Yifan & Shen, Xiaohong & Sun, Lin & Yan, Yongsheng & Wang, Haiyan, 2025. "Critical node identification of dynamic-load wireless sensor networks for cascading failure protection," Reliability Engineering and System Safety, Elsevier, vol. 264(PA).
    3. Zhang, Hai-Feng & Wang, Hao-Ren & Xiang, Bing-Bing & Wang, Huan, 2024. "Robustness study of hybrid hypergraphs," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    4. Shen, Yi & Yang, Huang & Xie, Yuangcheng & Liu, Yang & Ren, Gang, 2023. "Adaptive robustness optimization against network cascading congestion induced by fluctuant load via a bilateral-adaptive strategy," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    5. Wandelt, Sebastian & Chen, Xinyue & Sun, Xiaoqian, 2025. "Recent advances in network dismantling: A comprehensive review and list of recommendations for future work," Chaos, Solitons & Fractals, Elsevier, vol. 199(P2).
    6. Jiang, Ting & Liu, Kai & Xiang, Bing-Bing & Zhang, Hai-Feng & Wang, Huan, 2025. "A cost-constrained dismantling framework for hypergraph with dynamic cascading failure using deep reinforcement learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 679(C).
    7. Tian, Wenjie & Xu, Jihui & Ma, Chuhan & Zou, Xingqi, 2025. "Enhancing communication network robustness under adaptive load-capacity model and multistate stochastic Markov cascading failure model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 675(C).
    8. Li, Chunhong & Jia, Bin & Wang, Weiping & Gao, Jianxi & Solé-Ribalta, Albert & Borge-Holthoefer, Javier, 2026. "From flood-prone to flood-ready: The restoration-adaptation interplay in building resilient multimodal transport networks," Reliability Engineering and System Safety, Elsevier, vol. 266(PB).
    9. Ganjeh-Ghazvini, Mostafa & Masihi, Mohsen & Ghaedi, Mojtaba, 2014. "Random walk–percolation-based modeling of two-phase flow in porous media: Breakthrough time and net to gross ratio estimation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 406(C), pages 214-221.
    10. Xiuwen Fu & Haiqing Yao & Yongsheng Yang, 2019. "Sink-Convergence Cascading Model for Wireless Sensor Networks with Different Load-Redistribution Schemes," Complexity, Hindawi, vol. 2019, pages 1-9, June.
    11. Sadeghnejad, S. & Masihi, M. & King, P.R., 2013. "Dependency of percolation critical exponents on the exponent of power law size distribution," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(24), pages 6189-6197.
    12. Song, Bo & Fan, Ziyang & Song, Yurong & Ding, Lei & Qin, Yi & Wang, Xu, 2026. "Network robustness against cascading failures with time-varying adaptive behaviors triggered by information propagation," Chaos, Solitons & Fractals, Elsevier, vol. 202(P1).
    13. Pan, Ya-Nan & Lou, Jing-Jing & Han, Xiao-Pu, 2014. "Outbreak patterns of the novel avian influenza (H7N9)," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 401(C), pages 265-270.
    14. Rahimi, Farshad, 2024. "Adaptive dynamic programming-based fault tolerant control for nonlinear time-delay systems," Chaos, Solitons & Fractals, Elsevier, vol. 188(C).
    15. Zhao, Yixin & Cai, Baoping & Cozzani, Valerio & Liu, Yiliu, 2025. "Failure dependence and cascading failures: A literature review and research opportunities," Reliability Engineering and System Safety, Elsevier, vol. 256(C).
    16. Chen, Lei & Kou, Yingxin & Li, Zhanwu & Xu, An & Wu, Cheng, 2018. "Empirical research on complex networks modeling of combat SoS based on data from real war-game, Part I: Statistical characteristics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 754-773.
    17. Di Maio, Francesco & Pettorossi, Chiara & Zio, Enrico, 2023. "Entropy-driven Monte Carlo simulation method for approximating the survival signature of complex infrastructures," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    18. Greg Morrison & L Mahadevan, 2012. "Discovering Communities through Friendship," PLOS ONE, Public Library of Science, vol. 7(7), pages 1-9, July.
    19. Andrea Giovannetti, 2012. "Financial Contagion in Industrial Clusters: A Dynamical Analysis and Network Simulation," Department of Economics University of Siena 654, Department of Economics, University of Siena.
    20. Brunner, L.G. & Peer, R.A.M. & Zorn, C. & Paulik, R. & Logan, T.M., 2024. "Understanding cascading risks through real-world interdependent urban infrastructure," Reliability Engineering and System Safety, Elsevier, vol. 241(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:182:y:2024:i:c:s0960077924002649. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.