IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v194y2025ics096007792500178x.html
   My bibliography  Save this article

The coevolution of cooperation: Integrating Q-learning and occasional social interactions in evolutionary games

Author

Listed:
  • Lin, Jiaying
  • Long, Pinduo
  • Liang, Jinfeng
  • Dai, Qionglin
  • Li, Haihong
  • Yang, Junzhong

Abstract

This study explores the emergence and maintenance of cooperation in evolutionary game theory by incorporating occasional social interactions into Q-learning algorithms. We model the dynamics on a square lattice, where individuals play the Prisoner’s Dilemma Game and update their strategies based on Q-learning and infrequent social interactions. Our main findings reveal a non-monotonic relationship between the game parameter c and cooperation levels, with cooperation re-emerging in adverse conditions. The interplay between Q-learning and social learning mechanisms is key, with social learning playing a more significant role in sustaining cooperation under challenging conditions. This work advances our understanding of cooperation maintenance in populations and has implications for designing strategies to foster cooperation in real-world scenarios.

Suggested Citation

  • Lin, Jiaying & Long, Pinduo & Liang, Jinfeng & Dai, Qionglin & Li, Haihong & Yang, Junzhong, 2025. "The coevolution of cooperation: Integrating Q-learning and occasional social interactions in evolutionary games," Chaos, Solitons & Fractals, Elsevier, vol. 194(C).
    • Handle: RePEc:eee:chsofr:v:194:y:2025:i:c:s096007792500178x
    DOI: 10.1016/j.chaos.2025.116165
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S096007792500178X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.chaos.2025.116165?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Luo, Chao & Jiang, Zhipeng, 2017. "Coevolving allocation of resources and cooperation in spatial evolutionary games," Applied Mathematics and Computation, Elsevier, vol. 311(C), pages 47-57.
    2. Zhen Wang & Lin Wang & Zi-Yu Yin & Cheng-Yi Xia, 2012. "Inferring Reputation Promotes the Evolution of Cooperation in Spatial Social Dilemma Games," PLOS ONE, Public Library of Science, vol. 7(7), pages 1-9, July.
    3. Yang, Zhengzhi & Zheng, Lei & Perc, Matjaž & Li, Yumeng, 2024. "Interaction state Q-learning promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    4. Benjamin Allen & Gabor Lippner & Yu-Ting Chen & Babak Fotouhi & Naghmeh Momeni & Shing-Tung Yau & Martin A. Nowak, 2017. "Evolutionary dynamics on any population structure," Nature, Nature, vol. 544(7649), pages 227-230, April.
    5. Valerio Capraro & Roberto Di Paolo & Matjaz Perc & Veronica Pizziol, 2024. "Language-based game theory in the age of artificial intelligence," Papers 2403.08944, arXiv.org.
    6. Christoph Hauert & Michael Doebeli, 2004. "Spatial structure often inhibits the evolution of cooperation in the snowdrift game," Nature, Nature, vol. 428(6983), pages 643-646, April.
    7. Wang, Xianjia & Yang, Zhipeng & Chen, Guici & Liu, Yanli, 2024. "Enhancing cooperative evolution in spatial public goods game by particle swarm optimization based on exploration and q-learning," Applied Mathematics and Computation, Elsevier, vol. 469(C).
    8. Qi Shi & Shilin Xiao & Qionglin Dai & Haihong Li & Junzhong Yang, 2022. "Spatial structure might impede cooperation in evolutionary games with reinforcement learning," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 33(12), pages 1-13, December.
    9. Geng, Yini & Liu, Yifan & Lu, Yikang & Shen, Chen & Shi, Lei, 2022. "Reinforcement learning explains various conditional cooperation," Applied Mathematics and Computation, Elsevier, vol. 427(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Meng & Yang, Yanlong & Xiang, Shuwen, 2025. "Effect of community learning mechanism on cooperation in conflict societies," Chaos, Solitons & Fractals, Elsevier, vol. 192(C).
    2. Wang, Chengjie & Deng, Juan & Zhao, Hui & Li, Li, 2024. "Effect of Q-learning on the evolution of cooperation behavior in collective motion: An improved Vicsek model," Applied Mathematics and Computation, Elsevier, vol. 482(C).
    3. Lv, Shaojie & Li, Jiaying & Zhao, Changheng, 2025. "Reinforcement learning in spatial public goods games with environmental feedbacks," Chaos, Solitons & Fractals, Elsevier, vol. 195(C).
    4. Hu, Menglong & Wang, Juan & Kong, Lingcong & An, Kang & Bi, Tao & Guo, Baohong & Dong, Enzeng, 2015. "Incorporating the information from direct and indirect neighbors into fitness evaluation enhances the cooperation in the social dilemmas," Chaos, Solitons & Fractals, Elsevier, vol. 77(C), pages 47-52.
    5. Jin, Jiahua & Shen, Chen & Chu, Chen & Shi, Lei, 2017. "Incorporating dominant environment into individual fitness promotes cooperation in the spatial prisoners' dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 96(C), pages 70-75.
    6. Yang, Zhengzhi & Zheng, Lei & Perc, Matjaž & Li, Yumeng, 2024. "Interaction state Q-learning promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    7. Fulin Guo, 2023. "Experience-weighted attraction learning in network coordination games," Papers 2310.18835, arXiv.org.
    8. Sun, Jiaqin & Fan, Ruguo & Luo, Ming & Zhang, Yingqing & Dong, Lili, 2018. "The evolution of cooperation in spatial prisoner’s dilemma game with dynamic relationship-based preferential learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 512(C), pages 598-611.
    9. Chen, Ya-Shan & Yang, Han-Xin & Guo, Wen-Zhong & Liu, Geng-Geng, 2018. "Promotion of cooperation based on swarm intelligence in spatial public goods games," Applied Mathematics and Computation, Elsevier, vol. 320(C), pages 614-620.
    10. Jin, Jiahua & Chu, Chen & Shen, Chen & Guo, Hao & Geng, Yini & Jia, Danyang & Shi, Lei, 2018. "Heterogeneous fitness promotes cooperation in the spatial prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 106(C), pages 141-146.
    11. Yan, Zeyuan & Zhao, Hui & Liang, Shu & Li, Li & Song, Yanjie, 2024. "Inter-layer feedback mechanism with reinforcement learning boosts the evolution of cooperation in multilayer network," Chaos, Solitons & Fractals, Elsevier, vol. 185(C).
    12. Li, Xiaopeng & Han, Weiwei & Yang, Wenjun & Wang, Juan & Xia, Chengyi & Li, Hui-jia & Shi, Yong, 2022. "Impact of resource-based conditional interaction on cooperation in spatial social dilemmas," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 594(C).
    13. Fabio Della Rossa & Fabio Dercole & Anna Di Meglio, 2020. "Direct Reciprocity and Model-Predictive Strategy Update Explain the Network Reciprocity Observed in Socioeconomic Networks," Games, MDPI, vol. 11(1), pages 1-28, March.
    14. Sarkar, Bijan, 2021. "The cooperation–defection evolution on social networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 584(C).
    15. Li, Bin-Quan & Wu, Zhi-Xi & Guan, Jian-Yue, 2022. "Critical thresholds of benefit distribution in an extended snowdrift game model," Chaos, Solitons & Fractals, Elsevier, vol. 157(C).
    16. Sakiyama, Tomoko, 2021. "A power law network in an evolutionary hawk–dove game," Chaos, Solitons & Fractals, Elsevier, vol. 146(C).
    17. Qi Su & Lei Zhou & Long Wang, 2019. "Evolutionary multiplayer games on graphs with edge diversity," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-22, April.
    18. Wu, Chengxing & Deng, Hongzhong & Tu, Chengyi, 2024. "A general network complexity reduction method for cooperative evolution in structured populations," Chaos, Solitons & Fractals, Elsevier, vol. 188(C).
    19. Wang, Chaoqian & Lin, Zongzhe & Rothman, Dale S., 2022. "Public goods game on coevolving networks driven by the similarity and difference of payoff," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    20. Wang, Yi-Ling, 2013. "Asymmetric evaluation of fitness enhances spatial reciprocity in social dilemmas," Chaos, Solitons & Fractals, Elsevier, vol. 54(C), pages 76-81.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:194:y:2025:i:c:s096007792500178x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.