IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v164y2022ics0960077922008633.html
   My bibliography  Save this article

Hybrid learning promotes cooperation in the spatial prisoner’s dilemma game

Author

Listed:
  • Han, Xu
  • Zhao, Xiaowei
  • Xia, Haoxiang

Abstract

Individuals’ strategy updating is an important factor in the spatial prisoner’s dilemma game. According to Bandura’s social learning theory, adaptive behavior adjustment involves imitating others (i.e. social-learning) and reinforcing the current behaviors based on self-feedback (i.e. self-learning). The existing researches have shown that although social learning and self-learning can promote cooperation under certain conditions, there are some deficiencies in the stability of evolution and the cooperation level. It is, therefore, worthwhile to examine whether hybrid strategy-updating can overcome the deficiencies. In this paper, we propose a hybrid strategy-updating mechanism combining social learning and self-learning. Simulation results show that the proposed hybrid strategy learning mechanism can effectively promote cooperation under appropriate parameter settings. The weight of self-learning and the aspiration of payoff have great impacts on cooperation. We find that at a low aspiration level, higher tendency towards social learning is beneficial to cooperation, while at a high level of aspiration, higher tendency towards self-learning has a significantly positive effect on cooperation. Furthermore, the dynamic mechanism of hybrid learning is explored, revealing that hybrid learning is more conducive to the maintenance of cooperation than social learning and self-learning per se. Finally, through the analysis on the evolutionary stability, we show that the hybrid learning mechanism can prevent the spread of defection when random strategy invasion happens and maintain a high cooperation level.

Suggested Citation

  • Han, Xu & Zhao, Xiaowei & Xia, Haoxiang, 2022. "Hybrid learning promotes cooperation in the spatial prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
  • Handle: RePEc:eee:chsofr:v:164:y:2022:i:c:s0960077922008633
    DOI: 10.1016/j.chaos.2022.112684
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077922008633
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2022.112684?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shu, Feng & Li, Min & Liu, Xingwen, 2019. "Memory mechanism with weighting promotes cooperation in the evolutionary games," Chaos, Solitons & Fractals, Elsevier, vol. 120(C), pages 17-24.
    2. Jia, Danyang & Shen, Chen & Guo, Hao & Chu, Chen & Lu, Jun & Shi, Lei, 2018. "The impact of loners’ participation willingness on cooperation in voluntary prisoner's dilemma," Chaos, Solitons & Fractals, Elsevier, vol. 108(C), pages 218-223.
    3. Takahiro Ezaki & Yutaka Horita & Masanori Takezawa & Naoki Masuda, 2016. "Reinforcement Learning Explains Conditional Cooperation and Its Moody Cousin," PLOS Computational Biology, Public Library of Science, vol. 12(7), pages 1-13, July.
    4. Yang, Kai & Huang, Changwei & Dai, Qionglin & Yang, Junzhong, 2018. "The effects of attribute persistence on cooperation in evolutionary games," Chaos, Solitons & Fractals, Elsevier, vol. 115(C), pages 23-28.
    5. Geng, Yini & Shen, Chen & Guo, Hao & Chu, Chen & Yu, Dalei & Shi, Lei, 2017. "Historical payoff promotes cooperation in voluntary prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 105(C), pages 145-149.
    6. Quan, Ji & Tang, Caixia & Zhou, Yawen & Wang, Xianjia & Yang, Jian-Bo, 2020. "Reputation evaluation with tolerance and reputation-dependent imitation on cooperation in spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 131(C).
    7. Qi Su & Lei Zhou & Long Wang, 2019. "Evolutionary multiplayer games on graphs with edge diversity," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-22, April.
    8. K. M. Ariful Kabir & Jun Tanimoto & Zhen Wang, 2018. "Influence of bolstering network reciprocity in the evolutionary spatial Prisoner’s Dilemma game: a perspective," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 91(12), pages 1-10, December.
    9. Takahiro Ezaki & Naoki Masuda, 2017. "Reinforcement learning account of network reciprocity," PLOS ONE, Public Library of Science, vol. 12(12), pages 1-8, December.
    10. Wang, Xianjia & Lv, Shaojie, 2019. "The roles of particle swarm intelligence in the prisoner’s dilemma based on continuous and mixed strategy systems on scale-free networks," Applied Mathematics and Computation, Elsevier, vol. 355(C), pages 213-220.
    11. Pan, Qiuhui & Wang, Linpeng & He, Mingfeng, 2020. "Social dilemma based on reputation and successive behavior," Applied Mathematics and Computation, Elsevier, vol. 384(C).
    12. Fernando P. Santos & Francisco C. Santos & Jorge M. Pacheco, 2018. "Social norm complexity and past reputations in the evolution of cooperation," Nature, Nature, vol. 555(7695), pages 242-245, March.
    13. Li, Bing & Zhao, Xiaowei & Xia, Haoxiang, 2019. "Promotion of cooperation by Hybrid Migration mechanisms in the Spatial Prisoner’s Dilemma Game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 514(C), pages 1-8.
    14. Szolnoki, Attila & Chen, Xiaojie, 2020. "Gradual learning supports cooperation in spatial prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 130(C).
    15. Hisashi Ohtsuki & Christoph Hauert & Erez Lieberman & Martin A. Nowak, 2006. "A simple rule for the evolution of cooperation on graphs and social networks," Nature, Nature, vol. 441(7092), pages 502-505, May.
    16. Gao, Kun & Wang, Wen-Xu & Wang, Bing-Hong, 2007. "Self-questioning games and ping-pong effect in the BA network," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 380(C), pages 528-538.
    17. Yang, Han-Xin & Yang, Jing, 2019. "Reputation-based investment strategy promotes cooperation in public goods games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 523(C), pages 886-893.
    18. Han, Xu & Zhao, Xiaowei & Xia, Haoxiang, 2018. "Promotion of cooperation by adaptive interaction: The role of heterogeneity in neighborhoods," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 502(C), pages 483-491.
    19. Christian Hilbe & Štěpán Šimsa & Krishnendu Chatterjee & Martin A. Nowak, 2018. "Evolution of cooperation in stochastic games," Nature, Nature, vol. 559(7713), pages 246-249, July.
    20. Nagashima, Keisuke & Tanimoto, Jun, 2019. "A stochastic Pairwise Fermi rule modified by utilizing the average in payoff differences of neighbors leads to increased network reciprocity in spatial prisoner's dilemma games," Applied Mathematics and Computation, Elsevier, vol. 361(C), pages 661-669.
    21. Li, Cong & Xu, Hedong & Fan, Suohai, 2020. "Synergistic effects of self-optimization and imitation rules on the evolution of cooperation in the investor sharing game," Applied Mathematics and Computation, Elsevier, vol. 370(C).
    22. Liu, Yongkui & Li, Zhi & Chen, Xiaojie & Wang, Long, 2010. "Memory-based prisoner’s dilemma on square lattices," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(12), pages 2390-2396.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ma, Lin & Zhang, Jiqiang & Zheng, Guozhong & Liang, Rizhou & Chen, Li, 2023. "Emergence of cooperation in a population with bimodal response behaviors," Chaos, Solitons & Fractals, Elsevier, vol. 171(C).
    2. Li, Wen-Jing & Chen, Zhi & Wang, Jun & Jiang, Luo-Luo & Perc, Matjaž, 2023. "Social mobility and network reciprocity shape cooperation in collaborative networks," Chaos, Solitons & Fractals, Elsevier, vol. 170(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Han, Xu & Zhao, Xiaowei & Xia, Haoxiang, 2021. "Evolution of cooperation through aspiration-based adjustment of interaction range in spatial prisoner’s dilemma game," Applied Mathematics and Computation, Elsevier, vol. 393(C).
    2. Wang, Mengyao & Pan, Qiuhui & He, Mingfeng, 2020. "The interplay of behaviors and attitudes in public goods game considering environmental investment," Applied Mathematics and Computation, Elsevier, vol. 382(C).
    3. Quan, Ji & Tang, Caixia & Wang, Xianjia, 2021. "Reputation-based discount effect in imitation on the evolution of cooperation in spatial public goods games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 563(C).
    4. Lv, Ran & Qian, Jia-Li & Hao, Qing-Yi & Wu, Chao-Yun & Guo, Ning & Ling, Xiang, 2023. "The impact of current and historical reputation with non-uniform change on cooperation in spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 175(P1).
    5. Utsumi, Shinobu & Tatsukawa, Yuichi & Tanimoto, Jun, 2022. "Does a resource-storing mechanism favor “the wealthy do not fight”?—An approach from evolutionary game theory," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).
    6. Zhang, Liming & Huang, Changwei & Li, Haihong & Dai, Qionglin & Yang, Junzhong, 2021. "Cooperation guided by imitation, aspiration and conformity-driven dynamics in evolutionary games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 561(C).
    7. Liu, Yandi & Wang, Hexin & Ding, Yi & Yang, Xuan & Dai, Yu, 2022. "Can weak diversity help in propagating cooperation? Invasion of cooperators at the conformity-conflict boundary," Chaos, Solitons & Fractals, Elsevier, vol. 156(C).
    8. Song, Zhao & Guo, Hao & Jia, Danyang & Perc, Matjaž & Li, Xuelong & Wang, Zhen, 2021. "Third party interventions mitigate conflicts on interdependent networks," Applied Mathematics and Computation, Elsevier, vol. 403(C).
    9. Shi, Juan & Hu, Die & Tao, Rui & Peng, Yunchen & Li, Yong & Liu, Jinzhuo, 2021. "Interaction between populations promotes cooperation in voluntary prisoner's dilemma," Applied Mathematics and Computation, Elsevier, vol. 392(C).
    10. Wang, Xianjia & Chen, Wenman, 2020. "Evolutionary dynamics in spatial threshold public goods game with the asymmetric return rate mechanism," Chaos, Solitons & Fractals, Elsevier, vol. 136(C).
    11. Gao, Hongyu & Wang, Juan & Zhang, Fan & Li, Xiaopeng & Xia, Chengyi, 2021. "Cooperation dynamics based on reputation in the mixed population with two species of strategists," Applied Mathematics and Computation, Elsevier, vol. 410(C).
    12. Geng, Yini & Liu, Yifan & Lu, Yikang & Shen, Chen & Shi, Lei, 2022. "Reinforcement learning explains various conditional cooperation," Applied Mathematics and Computation, Elsevier, vol. 427(C).
    13. Li, Bin-Quan & Wu, Zhi-Xi & Guan, Jian-Yue, 2022. "Critical thresholds of benefit distribution in an extended snowdrift game model," Chaos, Solitons & Fractals, Elsevier, vol. 157(C).
    14. Lu, Shounan & Zhu, Ge & Zhang, Lianzhong, 2023. "Antisocial behavior-based environmental feedback in spatial prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 174(C).
    15. Zhao, Xiaowei & Xia, Haoxiang, 2023. "Information accuracy of migration and imitation influences the evolution of cooperation in spatial prisoner's dilemma," Chaos, Solitons & Fractals, Elsevier, vol. 176(C).
    16. Li, Xiaopeng & Hao, Gang & Zhang, Zhipeng & Xia, Chengyi, 2021. "Evolution of cooperation in heterogeneously stochastic interactions," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    17. Jia, Danyang & Li, Tong & Zhao, Yang & Zhang, Xiaoqin & Wang, Zhen, 2022. "Empty nodes affect conditional cooperation under reinforcement learning," Applied Mathematics and Computation, Elsevier, vol. 413(C).
    18. Zhu, Peican & Wang, Xiaoyu & Jia, Danyang & Guo, Yangming & Li, Shudong & Chu, Chen, 2020. "Investigating the co-evolution of node reputation and edge-strategy in prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 386(C).
    19. Zhu, Wenqiang & Pan, Qiuhui & He, Mingfeng, 2022. "Exposure-based reputation mechanism promotes the evolution of cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).
    20. Duan, Yuxian & Huang, Jian & Zhang, Jiarui, 2023. "Evolutionary public good games based on the long-term payoff mechanism in heterogeneous networks," Chaos, Solitons & Fractals, Elsevier, vol. 174(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:164:y:2022:i:c:s0960077922008633. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.