IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v586y2022ics0378437121007408.html
   My bibliography  Save this article

Weighted interdependent network disintegration strategy based on Q-learning

Author

Listed:
  • Chen, Wenhao
  • Li, Jichao
  • Jiang, Jiang
  • Chen, Gang

Abstract

The problem of network disintegration is one of the core topics in the field of network science. Currently, most of the existing research is based on homogeneous and single-layer networks of nodes. However, the various components of complex systems in the real world are often interdependent, and the cost of attacking different units is diverse, causing the traditional network disintegration method to lack good applicability. This paper establishes a weighted interdependent network (WIN) model, and based on this, a WIN disintegration strategy based on Q-learning is proposed. First, the network nodes are divided into multiple node sets according to the dependencies between the nodes, and the state and action space of Q-learning are determined. Next, the disintegration cost constraints and Q-learning parameters are defined to perform iterative learning. Then, the optimal network disintegration strategy is calculated according to the iterative Q-table. The results show that when the cost sensitivity factor (p) is fixed, DSQ can maintain good results in disintegrating different types of networks under different cost constraints, while the baseline methods have difficulty guaranteeing the disintegration effect in the face of different types of networks. Furthermore, we perform a sensitivity analysis on the p value and find that the effect of most of the baseline methods worsens as the p value increases, while DSQ maintains a good effect.

Suggested Citation

  • Chen, Wenhao & Li, Jichao & Jiang, Jiang & Chen, Gang, 2022. "Weighted interdependent network disintegration strategy based on Q-learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 586(C).
  • Handle: RePEc:eee:phsmap:v:586:y:2022:i:c:s0378437121007408
    DOI: 10.1016/j.physa.2021.126467
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437121007408
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2021.126467?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Huang, Binchao & Yang, Jin-Xuan & Li, Xin, 2021. "Identifying influential links to control spreading of epidemics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 583(C).
    2. Yu, Yang & Deng, Ye & Tan, Suo-Yi & Wu, Jun, 2018. "Efficient disintegration strategy in directed networks based on tabu search," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 507(C), pages 435-442.
    3. Xuzhen Zhu & Jinming Ma & Xin Su & Hui Tian & Wei Wang & Shimin Cai, 2019. "Information Spreading on Weighted Multiplex Social Network," Complexity, Hindawi, vol. 2019, pages 1-15, November.
    4. Qingqing Zhai & Rui Peng & Jun Zhuang, 2020. "Defender–Attacker Games with Asymmetric Player Utilities," Risk Analysis, John Wiley & Sons, vol. 40(2), pages 408-420, February.
    5. Alessandro Vespignani, 2018. "Twenty years of network science," Nature, Nature, vol. 558(7711), pages 528-529, June.
    6. Gu, Yu & Fu, Xiao & Liu, Zhiyuan & Xu, Xiangdong & Chen, Anthony, 2020. "Performance of transportation network under perturbations: Reliability, vulnerability, and resilience," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 133(C).
    7. Mahmoud Saleh & Yusef Esa & Ahmed Mohamed, 2018. "Applications of Complex Network Analysis in Electric Power Systems," Energies, MDPI, vol. 11(6), pages 1-16, May.
    8. Faramondi, Luca & Setola, Roberto & Panzieri, Stefano & Pascucci, Federica & Oliva, Gabriele, 2018. "Finding critical nodes in infrastructure networks," International Journal of Critical Infrastructure Protection, Elsevier, vol. 20(C), pages 3-15.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng, Xiao & He, Shiwei & Li, Guangye & Chi, Jushang, 2021. "Transfer network of high-speed rail and aviation: Structure and critical components," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 581(C).
    2. Xu, Xiangdong & Qu, Kai & Chen, Anthony & Yang, Chao, 2021. "A new day-to-day dynamic network vulnerability analysis approach with Weibit-based route adjustment process," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 153(C).
    3. Lin, Chen & Xiao, Hui & Kou, Gang & Peng, Rui, 2020. "Defending a series system with individual protection, overarching protection, and disinformation," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    4. Xinyuan Chen & Ruyang Yin & Qinhe An & Yuan Zhang, 2021. "Modeling a Distance-Based Preferential Fare Scheme for Park-and-Ride Services in a Multimodal Transport Network," Sustainability, MDPI, vol. 13(5), pages 1-14, March.
    5. Ali Nouri Qarahasanlou & Ali Zamani & Abbas Barabadi & Mahdi Mokhberdoran, 2021. "Resilience Assessment: A Performance-Based Importance Measure," Energies, MDPI, vol. 14(22), pages 1-16, November.
    6. Hector Eduardo Roman & Fabrizio Croccolo, 2021. "Spreading of Infections on Network Models: Percolation Clusters and Random Trees," Mathematics, MDPI, vol. 9(23), pages 1-22, November.
    7. Lawford, Steve & Mehmeti, Yll, 2020. "Cliques and a new measure of clustering: With application to U.S. domestic airlines," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 560(C).
    8. Li, Yang & Sun, Hao & Xiong, Wanda & Xu, Genjiu, 2021. "Belief model of complex contagions on random networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 567(C).
    9. Yin, Kai & Wu, Jianjun & Wang, Weiping & Lee, Der-Horng & Wei, Yun, 2023. "An integrated resilience assessment model of urban transportation network: A case study of 40 cities in China," Transportation Research Part A: Policy and Practice, Elsevier, vol. 173(C).
    10. Fang, Yinhai & Xu, Haiyan & Perc, Matjaž & Tan, Qingmei, 2019. "Dynamic evolution of economic networks under the influence of mergers and divestitures," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 524(C), pages 89-99.
    11. Hunt, Kyle & Agarwal, Puneet & Zhuang, Jun, 2022. "On the adoption of new technology to enhance counterterrorism measures: An attacker–defender game with risk preferences," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    12. Zhu, Xiaoning & Yan, Rui & Peng, Rui & Zhang, Zhongxin, 2020. "Optimal routing, loading and aborting of UAVs executing both visiting tasks and transportation tasks," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    13. Konstantinos Ntafloukas & Liliana Pasquale & Beatriz Martinez-Pastor & Daniel P. McCrum, 2023. "A Vulnerability Assessment Approach for Transportation Networks Subjected to Cyber–Physical Attacks," Future Internet, MDPI, vol. 15(3), pages 1-23, February.
    14. Hassan Al-Zarooni & Hamdi Bashir, 2020. "An integrated ISM fuzzy MICMAC approach for modeling and analyzing electrical power system network interdependencies," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 11(6), pages 1204-1226, December.
    15. Chenming Jiang & Junliang He & Shengxue Zhu & Wenbo Zhang & Gen Li & Weikun Xu, 2023. "Injury-Based Surrogate Resilience Measure: Assessing the Post-Crash Traffic Resilience of the Urban Roadway Tunnels," Sustainability, MDPI, vol. 15(8), pages 1-15, April.
    16. Ana Teresa Santos & Sandro Mendonça, 2022. "The small world of innovation studies: an “editormetrics” perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7471-7486, December.
    17. Jiang, Cheng & Liu, Zhonghua, 2019. "Detecting multiple key players under the positive effect by using a distance-based connectivity approach," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 534(C).
    18. Xu, Xiangdong & Chen, Anthony & Xu, Guangming & Yang, Chao & Lam, William H.K., 2021. "Enhancing network resilience by adding redundancy to road networks," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 154(C).
    19. Li, Yulong & Lin, Jie & Zhang, Chi & Zhu, Huaxing & Zeng, Saixing & Sun, Chengshaung, 2022. "Joint optimization of structure and protection of interdependent infrastructure networks," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    20. Fu, Hao & Lam, William H.K. & Shao, Hu & Kattan, Lina & Salari, Mostafa, 2022. "Optimization of multi-type traffic sensor locations for estimation of multi-period origin-destination demands with covariance effects," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 157(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:586:y:2022:i:c:s0378437121007408. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.