IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v194y2025ics096007792500178x.html

The coevolution of cooperation: Integrating Q-learning and occasional social interactions in evolutionary games

Author

Listed:
  • Lin, Jiaying
  • Long, Pinduo
  • Liang, Jinfeng
  • Dai, Qionglin
  • Li, Haihong
  • Yang, Junzhong

Abstract

This study explores the emergence and maintenance of cooperation in evolutionary game theory by incorporating occasional social interactions into Q-learning algorithms. We model the dynamics on a square lattice, where individuals play the Prisoner’s Dilemma Game and update their strategies based on Q-learning and infrequent social interactions. Our main findings reveal a non-monotonic relationship between the game parameter c and cooperation levels, with cooperation re-emerging in adverse conditions. The interplay between Q-learning and social learning mechanisms is key, with social learning playing a more significant role in sustaining cooperation under challenging conditions. This work advances our understanding of cooperation maintenance in populations and has implications for designing strategies to foster cooperation in real-world scenarios.

Suggested Citation

  • Lin, Jiaying & Long, Pinduo & Liang, Jinfeng & Dai, Qionglin & Li, Haihong & Yang, Junzhong, 2025. "The coevolution of cooperation: Integrating Q-learning and occasional social interactions in evolutionary games," Chaos, Solitons & Fractals, Elsevier, vol. 194(C).
    • Handle: RePEc:eee:chsofr:v:194:y:2025:i:c:s096007792500178x
    DOI: 10.1016/j.chaos.2025.116165
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S096007792500178X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.chaos.2025.116165?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Benjamin Allen & Gabor Lippner & Yu-Ting Chen & Babak Fotouhi & Naghmeh Momeni & Shing-Tung Yau & Martin A. Nowak, 2017. "Evolutionary dynamics on any population structure," Nature, Nature, vol. 544(7649), pages 227-230, April.
    2. Valerio Capraro & Roberto Di Paolo & Matjaz Perc & Veronica Pizziol, 2024. "Language-based game theory in the age of artificial intelligence," Papers 2403.08944, arXiv.org.
    3. Christoph Hauert & Michael Doebeli, 2004. "Spatial structure often inhibits the evolution of cooperation in the snowdrift game," Nature, Nature, vol. 428(6983), pages 643-646, April.
    4. Luo, Chao & Jiang, Zhipeng, 2017. "Coevolving allocation of resources and cooperation in spatial evolutionary games," Applied Mathematics and Computation, Elsevier, vol. 311(C), pages 47-57.
    5. Zhen Wang & Lin Wang & Zi-Yu Yin & Cheng-Yi Xia, 2012. "Inferring Reputation Promotes the Evolution of Cooperation in Spatial Social Dilemma Games," PLOS ONE, Public Library of Science, vol. 7(7), pages 1-9, July.
    6. Wang, Xianjia & Yang, Zhipeng & Chen, Guici & Liu, Yanli, 2024. "Enhancing cooperative evolution in spatial public goods game by particle swarm optimization based on exploration and q-learning," Applied Mathematics and Computation, Elsevier, vol. 469(C).
    7. Qi Shi & Shilin Xiao & Qionglin Dai & Haihong Li & Junzhong Yang, 2022. "Spatial structure might impede cooperation in evolutionary games with reinforcement learning," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 33(12), pages 1-13, December.
    8. Yang, Zhengzhi & Zheng, Lei & Perc, Matjaž & Li, Yumeng, 2024. "Interaction state Q-learning promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    9. Geng, Yini & Liu, Yifan & Lu, Yikang & Shen, Chen & Shi, Lei, 2022. "Reinforcement learning explains various conditional cooperation," Applied Mathematics and Computation, Elsevier, vol. 427(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lu, Wen & Liang, Shu, 2025. "The role of strategy-affected emotions in the evolution of cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 199(P2).
    2. Lin, Jiaying & Yang, Junzhong, 2025. "Emotion-coupled Q-learning with cognitive bias enhances cooperation in evolutionary prisoner’s dilemma games," Chaos, Solitons & Fractals, Elsevier, vol. 200(P1).
    3. Xie, Kai & Szolnoki, Attila, 2026. "Reinforcement learning in evolutionary game theory: A brief review of recent developments," Applied Mathematics and Computation, Elsevier, vol. 510(C).
    4. Wang, Jiaoyuan & Yang, Yanlong, 2026. "Research on the resilience of reputation mechanism to the cooperative environment in the face of external shocks," Applied Mathematics and Computation, Elsevier, vol. 510(C).
    5. Wang, Xianjia & Wang, Linlin & Hu, Yaozhong, 2026. "Self-confirming Q-learning on unknown networks," Chaos, Solitons & Fractals, Elsevier, vol. 203(C).
    6. Kang, Hongwei & Jiang, Chao & Shen, Yong & Sun, Xingping & Chen, Qingyi, 2025. "Neighbor-aware reinforcement learning fosters cooperation in spatial public goods games," Chaos, Solitons & Fractals, Elsevier, vol. 199(P3).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Jiaying & Yang, Junzhong, 2025. "Emotion-coupled Q-learning with cognitive bias enhances cooperation in evolutionary prisoner’s dilemma games," Chaos, Solitons & Fractals, Elsevier, vol. 200(P1).
    2. Zhou, Meng & Yang, Yanlong & Xiang, Shuwen, 2025. "Effect of community learning mechanism on cooperation in conflict societies," Chaos, Solitons & Fractals, Elsevier, vol. 192(C).
    3. Huang, Yijie, 2025. "The evolution of cooperation in multi-games with reinforcement learning," Chaos, Solitons & Fractals, Elsevier, vol. 201(P2).
    4. Wang, Chengjie & Deng, Juan & Zhao, Hui & Li, Li, 2024. "Effect of Q-learning on the evolution of cooperation behavior in collective motion: An improved Vicsek model," Applied Mathematics and Computation, Elsevier, vol. 482(C).
    5. Yue, Hongyu & Xiong, Xiaojin & Feng, Minyu & Szolnoki, Attila, 2025. "Dynamic evolution of cooperation based on adaptive reputation threshold and game transition," Chaos, Solitons & Fractals, Elsevier, vol. 199(P1).
    6. Xie, Kai & Szolnoki, Attila, 2026. "Reinforcement learning in evolutionary game theory: A brief review of recent developments," Applied Mathematics and Computation, Elsevier, vol. 510(C).
    7. Sun, Chengbin & de Miguel-Arribas, Alfonso & Wang, Chaoqian & Xia, Haoxiang & Moreno, Yamir, 2025. "Co-evolution of cooperation and resource allocation in the advantageous environment-based spatial multi-game using adaptive control," Chaos, Solitons & Fractals, Elsevier, vol. 199(P1).
    8. Bi, Yan & Hao, Qingyi & Liu, Kui, 2025. "The influence of reputation levels and disparities on the evolution of cooperation in spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 501(C).
    9. Lee, Hsuan-Wei & Weng, Yi-Ning, 2025. "Granular Q-learning adaptation boosts collective welfare in multi-agent Prisoner’s Dilemma," Chaos, Solitons & Fractals, Elsevier, vol. 199(P1).
    10. Lv, Shaojie & Li, Jiaying & Zhao, Changheng, 2025. "Reinforcement learning in spatial public goods games with environmental feedbacks," Chaos, Solitons & Fractals, Elsevier, vol. 195(C).
    11. Wang, Lei & Wang, Juan & Guo, Baohong & Ding, Shuai & Li, Yukun & Xia, Chengyi, 2014. "Effects of benefit-inspired network coevolution on spatial reciprocity in the prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 66(C), pages 9-16.
    12. Hu, Menglong & Wang, Juan & Kong, Lingcong & An, Kang & Bi, Tao & Guo, Baohong & Dong, Enzeng, 2015. "Incorporating the information from direct and indirect neighbors into fitness evaluation enhances the cooperation in the social dilemmas," Chaos, Solitons & Fractals, Elsevier, vol. 77(C), pages 47-52.
    13. Wu, Yu’e & Zhang, Zhipeng & Wang, Xinyu & Chang, Shuhua, 2019. "Impact of probabilistic incentives on the evolution of cooperation in complex topologies," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 307-314.
    14. Xiong, Xiaojin & Yao, Yichao & Feng, Minyu & Chica, Manuel, 2024. "Adaptive payoff-driven interaction in networked snowdrift games," Chaos, Solitons & Fractals, Elsevier, vol. 185(C).
    15. Benjamin Allen & Christine Sample & Robert Jencks & James Withers & Patricia Steinhagen & Lori Brizuela & Joshua Kolodny & Darren Parke & Gabor Lippner & Yulia A Dementieva, 2020. "Transient amplifiers of selection and reducers of fixation for death-Birth updating on graphs," PLOS Computational Biology, Public Library of Science, vol. 16(1), pages 1-20, January.
    16. Jin, Jiahua & Shen, Chen & Chu, Chen & Shi, Lei, 2017. "Incorporating dominant environment into individual fitness promotes cooperation in the spatial prisoners' dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 96(C), pages 70-75.
    17. Yang, Zhengzhi & Zheng, Lei & Perc, Matjaž & Li, Yumeng, 2024. "Interaction state Q-learning promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    18. Fulin Guo, 2023. "Experience-weighted attraction learning in network coordination games," Papers 2310.18835, arXiv.org.
    19. Sun, Jiaqin & Fan, Ruguo & Luo, Ming & Zhang, Yingqing & Dong, Lili, 2018. "The evolution of cooperation in spatial prisoner’s dilemma game with dynamic relationship-based preferential learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 512(C), pages 598-611.
    20. Chen, Ya-Shan & Yang, Han-Xin & Guo, Wen-Zhong & Liu, Geng-Geng, 2018. "Promotion of cooperation based on swarm intelligence in spatial public goods games," Applied Mathematics and Computation, Elsevier, vol. 320(C), pages 614-620.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:194:y:2025:i:c:s096007792500178x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.