IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v194y2025ics096007792500178x.html
   My bibliography  Save this article

The coevolution of cooperation: Integrating Q-learning and occasional social interactions in evolutionary games

Author

Listed:
  • Lin, Jiaying
  • Long, Pinduo
  • Liang, Jinfeng
  • Dai, Qionglin
  • Li, Haihong
  • Yang, Junzhong

Abstract

This study explores the emergence and maintenance of cooperation in evolutionary game theory by incorporating occasional social interactions into Q-learning algorithms. We model the dynamics on a square lattice, where individuals play the Prisoner’s Dilemma Game and update their strategies based on Q-learning and infrequent social interactions. Our main findings reveal a non-monotonic relationship between the game parameter c and cooperation levels, with cooperation re-emerging in adverse conditions. The interplay between Q-learning and social learning mechanisms is key, with social learning playing a more significant role in sustaining cooperation under challenging conditions. This work advances our understanding of cooperation maintenance in populations and has implications for designing strategies to foster cooperation in real-world scenarios.

Suggested Citation

  • Lin, Jiaying & Long, Pinduo & Liang, Jinfeng & Dai, Qionglin & Li, Haihong & Yang, Junzhong, 2025. "The coevolution of cooperation: Integrating Q-learning and occasional social interactions in evolutionary games," Chaos, Solitons & Fractals, Elsevier, vol. 194(C).
  • Handle: RePEc:eee:chsofr:v:194:y:2025:i:c:s096007792500178x
    DOI: 10.1016/j.chaos.2025.116165
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S096007792500178X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2025.116165?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Luo, Chao & Jiang, Zhipeng, 2017. "Coevolving allocation of resources and cooperation in spatial evolutionary games," Applied Mathematics and Computation, Elsevier, vol. 311(C), pages 47-57.
    2. Zhen Wang & Lin Wang & Zi-Yu Yin & Cheng-Yi Xia, 2012. "Inferring Reputation Promotes the Evolution of Cooperation in Spatial Social Dilemma Games," PLOS ONE, Public Library of Science, vol. 7(7), pages 1-9, July.
    3. Yang, Zhengzhi & Zheng, Lei & Perc, Matjaž & Li, Yumeng, 2024. "Interaction state Q-learning promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    4. Benjamin Allen & Gabor Lippner & Yu-Ting Chen & Babak Fotouhi & Naghmeh Momeni & Shing-Tung Yau & Martin A. Nowak, 2017. "Evolutionary dynamics on any population structure," Nature, Nature, vol. 544(7649), pages 227-230, April.
    5. Valerio Capraro & Roberto Di Paolo & Matjaz Perc & Veronica Pizziol, 2024. "Language-based game theory in the age of artificial intelligence," Papers 2403.08944, arXiv.org.
    6. Christoph Hauert & Michael Doebeli, 2004. "Spatial structure often inhibits the evolution of cooperation in the snowdrift game," Nature, Nature, vol. 428(6983), pages 643-646, April.
    7. Wang, Xianjia & Yang, Zhipeng & Chen, Guici & Liu, Yanli, 2024. "Enhancing cooperative evolution in spatial public goods game by particle swarm optimization based on exploration and q-learning," Applied Mathematics and Computation, Elsevier, vol. 469(C).
    8. Qi Shi & Shilin Xiao & Qionglin Dai & Haihong Li & Junzhong Yang, 2022. "Spatial structure might impede cooperation in evolutionary games with reinforcement learning," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 33(12), pages 1-13, December.
    9. Geng, Yini & Liu, Yifan & Lu, Yikang & Shen, Chen & Shi, Lei, 2022. "Reinforcement learning explains various conditional cooperation," Applied Mathematics and Computation, Elsevier, vol. 427(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Meng & Yang, Yanlong & Xiang, Shuwen, 2025. "Effect of community learning mechanism on cooperation in conflict societies," Chaos, Solitons & Fractals, Elsevier, vol. 192(C).
    2. Wang, Chengjie & Deng, Juan & Zhao, Hui & Li, Li, 2024. "Effect of Q-learning on the evolution of cooperation behavior in collective motion: An improved Vicsek model," Applied Mathematics and Computation, Elsevier, vol. 482(C).
    3. Lv, Shaojie & Li, Jiaying & Zhao, Changheng, 2025. "Reinforcement learning in spatial public goods games with environmental feedbacks," Chaos, Solitons & Fractals, Elsevier, vol. 195(C).
    4. Michael Foley & Rory Smead & Patrick Forber & Christoph Riedl, 2021. "Avoiding the bullies: The resilience of cooperation among unequals," PLOS Computational Biology, Public Library of Science, vol. 17(4), pages 1-19, April.
    5. Wang, Lei & Wang, Juan & Guo, Baohong & Ding, Shuai & Li, Yukun & Xia, Chengyi, 2014. "Effects of benefit-inspired network coevolution on spatial reciprocity in the prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 66(C), pages 9-16.
    6. Hu, Menglong & Wang, Juan & Kong, Lingcong & An, Kang & Bi, Tao & Guo, Baohong & Dong, Enzeng, 2015. "Incorporating the information from direct and indirect neighbors into fitness evaluation enhances the cooperation in the social dilemmas," Chaos, Solitons & Fractals, Elsevier, vol. 77(C), pages 47-52.
    7. Wu, Yu’e & Zhang, Zhipeng & Wang, Xinyu & Chang, Shuhua, 2019. "Impact of probabilistic incentives on the evolution of cooperation in complex topologies," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 307-314.
    8. Xiong, Xiaojin & Yao, Yichao & Feng, Minyu & Chica, Manuel, 2024. "Adaptive payoff-driven interaction in networked snowdrift games," Chaos, Solitons & Fractals, Elsevier, vol. 185(C).
    9. Benjamin Allen & Christine Sample & Robert Jencks & James Withers & Patricia Steinhagen & Lori Brizuela & Joshua Kolodny & Darren Parke & Gabor Lippner & Yulia A Dementieva, 2020. "Transient amplifiers of selection and reducers of fixation for death-Birth updating on graphs," PLOS Computational Biology, Public Library of Science, vol. 16(1), pages 1-20, January.
    10. Jin, Jiahua & Shen, Chen & Chu, Chen & Shi, Lei, 2017. "Incorporating dominant environment into individual fitness promotes cooperation in the spatial prisoners' dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 96(C), pages 70-75.
    11. Yang, Zhengzhi & Zheng, Lei & Perc, Matjaž & Li, Yumeng, 2024. "Interaction state Q-learning promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    12. Fulin Guo, 2023. "Experience-weighted attraction learning in network coordination games," Papers 2310.18835, arXiv.org.
    13. Sun, Jiaqin & Fan, Ruguo & Luo, Ming & Zhang, Yingqing & Dong, Lili, 2018. "The evolution of cooperation in spatial prisoner’s dilemma game with dynamic relationship-based preferential learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 512(C), pages 598-611.
    14. Chen, Ya-Shan & Yang, Han-Xin & Guo, Wen-Zhong & Liu, Geng-Geng, 2018. "Promotion of cooperation based on swarm intelligence in spatial public goods games," Applied Mathematics and Computation, Elsevier, vol. 320(C), pages 614-620.
    15. Ding, Zhen-Wei & Zhang, Ji-Qiang & Zheng, Guo-Zhong & Cai, Wei-Ran & Cai, Chao-Ran & Chen, Li & Wang, Xu-Ming, 2024. "Emergence of anti-coordinated patterns in snowdrift game by reinforcement learning," Chaos, Solitons & Fractals, Elsevier, vol. 184(C).
    16. Liu, Xuesong & Pan, Qiuhui & He, Mingfeng & Liu, Aizhi, 2019. "Promotion of cooperation in evolutionary game dynamics under asymmetric information," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 521(C), pages 258-266.
    17. Chen, Mei-huan & Wang, Li & Wang, Juan & Sun, Shi-wen & Xia, Cheng-yi, 2015. "Impact of individual response strategy on the spatial public goods game within mobile agents," Applied Mathematics and Computation, Elsevier, vol. 251(C), pages 192-202.
    18. Jin, Jiahua & Chu, Chen & Shen, Chen & Guo, Hao & Geng, Yini & Jia, Danyang & Shi, Lei, 2018. "Heterogeneous fitness promotes cooperation in the spatial prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 106(C), pages 141-146.
    19. Wang, Xu-Wen & Nie, Sen & Jiang, Luo-Luo & Wang, Bing-Hong & Chen, Shi-Ming, 2017. "Role of delay-based reward in the spatial cooperation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 153-158.
    20. Yan, Zeyuan & Zhao, Hui & Liang, Shu & Li, Li & Song, Yanjie, 2024. "Inter-layer feedback mechanism with reinforcement learning boosts the evolution of cooperation in multilayer network," Chaos, Solitons & Fractals, Elsevier, vol. 185(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:194:y:2025:i:c:s096007792500178x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.