IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v200y2025ip1s0960077925009361.html

Emotion-coupled Q-learning with cognitive bias enhances cooperation in evolutionary prisoner’s dilemma games

Author

Listed:
  • Lin, Jiaying
  • Yang, Junzhong

Abstract

This study investigates how emotion-coupled Q-learning strategy updates and history-dependent cognitive biases influence cooperation in evolutionary games. We propose a Q-learning framework where agents dynamically adjust their strategies based on emotional states shaped by social interactions and intrinsic social value orientations (competitive vs. non-competitive). Emotional states govern agents’ propensity to learn from neighbors or rely on biased Q-tables. Cognitive biases, determined by neighbors’ historical actions and quantified as deviations from rational Q-values, further reshape decision-making by amplifying or suppressing cooperation. Through Monte Carlo simulations, we find that emotion-coupled Q-learning can significantly boost cooperation, particularly when individuals are sensitive to emotional differences. We also find that, moderate cognitive biases optimize cooperation under adverse conditions. Furthermore, we demonstrate that emotion-coupled learning fosters cooperator clusters dominated by non-competitive individuals. These results underscore the critical role of emotional–cognitive interplay in resolving social dilemmas and advancing adaptive collective dynamics.

Suggested Citation

  • Lin, Jiaying & Yang, Junzhong, 2025. "Emotion-coupled Q-learning with cognitive bias enhances cooperation in evolutionary prisoner’s dilemma games," Chaos, Solitons & Fractals, Elsevier, vol. 200(P1).
  • Handle: RePEc:eee:chsofr:v:200:y:2025:i:p1:s0960077925009361
    DOI: 10.1016/j.chaos.2025.116923
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077925009361
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2025.116923?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Xianjia & Yang, Zhipeng & Chen, Guici & Liu, Yanli, 2024. "Enhancing cooperative evolution in spatial public goods game by particle swarm optimization based on exploration and q-learning," Applied Mathematics and Computation, Elsevier, vol. 469(C).
    2. Qi Shi & Shilin Xiao & Qionglin Dai & Haihong Li & Junzhong Yang, 2022. "Spatial structure might impede cooperation in evolutionary games with reinforcement learning," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 33(12), pages 1-13, December.
    3. Chen, Wei & Wang, Huafeng & Sheng, Yukun, 2025. "The role of emotional expression in the evolution of cooperation in spatial prisoner’s dilemma games," Chaos, Solitons & Fractals, Elsevier, vol. 192(C).
    4. Zhao, Jinqiu & Luo, Chao, 2019. "The effect of preferential teaching and memory on cooperation clusters in interdependent networks," Applied Mathematics and Computation, Elsevier, vol. 363(C), pages 1-1.
    5. Fu, Xiao & Liu, Xuesong & Hu, Yuhan & Huang, Shaoxu, 2023. "Emotion-based renewal strategies to promote cooperation in spatial prisoner’s dilemma games," Applied Mathematics and Computation, Elsevier, vol. 455(C).
    6. Kaj-Kolja Kleineberg, 2017. "Metric clusters in evolutionary games on scale-free networks," Nature Communications, Nature, vol. 8(1), pages 1-8, December.
    7. Yang, Zhengzhi & Zheng, Lei & Perc, Matjaž & Li, Yumeng, 2024. "Interaction state Q-learning promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    8. Gao, Shun & Zhang, Wei & Zhang, Liming & Li Richter, Xiang-Yi & Zhang, Yi-Cheng & Dai, Qionglin, 2025. "Modified particle swarm strategies in spatial public goods games," Chaos, Solitons & Fractals, Elsevier, vol. 200(P3).
    9. Chen, Wei & Wang, Jianwei & Yu, Fengyuan & He, Jialu & Xu, Wenshu & Wang, Rong, 2021. "Effects of emotion on the evolution of cooperation in a spatial prisoner’s dilemma game," Applied Mathematics and Computation, Elsevier, vol. 411(C).
    10. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    11. Lin, Jiaying & Long, Pinduo & Liang, Jinfeng & Dai, Qionglin & Li, Haihong & Yang, Junzhong, 2025. "The coevolution of cooperation: Integrating Q-learning and occasional social interactions in evolutionary games," Chaos, Solitons & Fractals, Elsevier, vol. 194(C).
    12. Geng, Yini & Liu, Yifan & Lu, Yikang & Shen, Chen & Shi, Lei, 2022. "Reinforcement learning explains various conditional cooperation," Applied Mathematics and Computation, Elsevier, vol. 427(C).
    13. Zhang, Gui & Xiong, Xiaojin & Pi, Bin & Feng, Minyu & Perc, Matjaž, 2025. "Spatial public goods games with queueing and reputation," Applied Mathematics and Computation, Elsevier, vol. 505(C).
    14. Timothy E. J. Behrens & Laurence T. Hunt & Mark W. Woolrich & Matthew F. S. Rushworth, 2008. "Associative learning of social value," Nature, Nature, vol. 456(7219), pages 245-249, November.
    15. Jiawei Wang & Liming Zhang & Haihong Li & Qionglin Dai & Junzhong Yang, 2023. "Inequality-induced emotions might promote cooperation in evolutionary games," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 96(3), pages 1-9, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Liang & Wang, Jianwei, 2026. "The prerequisite for emotion-driven cooperation: The composition and transmissibility of social value orientations," Chaos, Solitons & Fractals, Elsevier, vol. 202(P1).
    2. Yao, Jingjing & Li, Dandan, 2025. "Evolutionary game analysis of individual behaviors with reputation-driven dynamics," Chaos, Solitons & Fractals, Elsevier, vol. 201(P1).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xie, Kai & Szolnoki, Attila, 2026. "Reinforcement learning in evolutionary game theory: A brief review of recent developments," Applied Mathematics and Computation, Elsevier, vol. 510(C).
    2. Lu, Wen & Liang, Shu, 2025. "The role of strategy-affected emotions in the evolution of cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 199(P2).
    3. Lin, Jiaying & Long, Pinduo & Liang, Jinfeng & Dai, Qionglin & Li, Haihong & Yang, Junzhong, 2025. "The coevolution of cooperation: Integrating Q-learning and occasional social interactions in evolutionary games," Chaos, Solitons & Fractals, Elsevier, vol. 194(C).
    4. Wang, Chengjie & Deng, Juan & Zhao, Hui & Li, Li, 2024. "Effect of Q-learning on the evolution of cooperation behavior in collective motion: An improved Vicsek model," Applied Mathematics and Computation, Elsevier, vol. 482(C).
    5. Zhang, Qianwei & Tang, Rui & Lu, Yilun & Wang, Xinyu, 2024. "The impact of anxiety on cooperative behavior: A network evolutionary game theory approach," Applied Mathematics and Computation, Elsevier, vol. 474(C).
    6. Kang, Hongwei & Jiang, Chao & Shen, Yong & Sun, Xingping & Chen, Qingyi, 2025. "Neighbor-aware reinforcement learning fosters cooperation in spatial public goods games," Chaos, Solitons & Fractals, Elsevier, vol. 199(P3).
    7. Liu, Xinyu & Jin, Wei & Chen, Guanrong & Tang, Changbing & Qian, Youhua & Jin, Weifeng, 2025. "Small groups nurturing collective wisdom: The punishment-prediction reinforcement learning mechanism for multi-group cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 201(P1).
    8. Zhang, Liang & Wang, Jianwei, 2026. "The prerequisite for emotion-driven cooperation: The composition and transmissibility of social value orientations," Chaos, Solitons & Fractals, Elsevier, vol. 202(P1).
    9. Bai, Xi & Ye, Ye & Chen, Tong & Xie, Nenggang, 2024. "The evolutionary game of emotions considering the influence of reputation," Applied Mathematics and Computation, Elsevier, vol. 474(C).
    10. Lee, Hsuan-Wei & Weng, Yi-Ning, 2025. "Granular Q-learning adaptation boosts collective welfare in multi-agent Prisoner’s Dilemma," Chaos, Solitons & Fractals, Elsevier, vol. 199(P1).
    11. Huang, Yijie, 2025. "The evolution of cooperation in multi-games with reinforcement learning," Chaos, Solitons & Fractals, Elsevier, vol. 201(P2).
    12. Chen, Wei & Wang, Jianwei & Chen, Yunteng, 2025. "The effect of emotional diffusion on the evolution of cooperation in multiplex networks," Chaos, Solitons & Fractals, Elsevier, vol. 199(P3).
    13. He, Jialu & Cui, Lei, 2024. "The persistence-based game transition resolves the social dilemma," Applied Mathematics and Computation, Elsevier, vol. 477(C).
    14. Lu, Wen & Liang, Shu, 2026. "Integrating emotion and expectation improves cooperation," Applied Mathematics and Computation, Elsevier, vol. 511(C).
    15. He, Siyu & Li, Qin & Feng, Minyu & Szolnoki, Attila, 2026. "Reputation assimilation mechanism for sustaining cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 202(P2).
    16. An, Tianbo & Zhang, Huizhen & Zhang, Zhanshuo & Liu, Guanghui & Li, Jiayu & Chen, Liangyu & Wang, Zhen, 2025. "Cooperation dynamics driven by reinforcement learning with interactive diversity in structured populations," Chaos, Solitons & Fractals, Elsevier, vol. 201(P2).
    17. Li, Xiaopeng & Guo, Shiyao & Li, Dongdong & Lin, Zhimin, 2026. "The evolution of cooperation shaped by asymmetric link-weight integration capabilities," Chaos, Solitons & Fractals, Elsevier, vol. 202(P2).
    18. Dan Bang & Rani Moran & Nathaniel D. Daw & Stephen M. Fleming, 2022. "Neurocomputational mechanisms of confidence in self and others," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    19. George I. Christopoulos & Xiao-Xiao Liu & Ying-yi Hong, 2017. "Toward an Understanding of Dynamic Moral Decision Making: Model-Free and Model-Based Learning," Journal of Business Ethics, Springer, vol. 144(4), pages 699-715, September.
    20. Xie, Kai & Liu, Yaojun & Liu, Tingjin, 2024. "Unveiling the masks: Deception and reputation in spatial prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 186(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:200:y:2025:i:p1:s0960077925009361. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.