IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v204y2026ics0960077925017606.html

Beyond the prisoner’s dilemma: Cooperation in repeated three-action games

Author

Listed:
  • Zhang, Feipeng
  • Chen, Fang
  • Zhou, Lei
  • Wang, Long

Abstract

Conflicts of interest arise across biology, social sciences, and artificial intelligence, where self-interested agents often struggle to resolve them, leading to socially inefficient outcomes. In game theory and evolutionary game theory, the iterated prisoner’s dilemma (IPD) has long served as the canonical model for studying such dilemmas. Yet, despite its central role, the two-action IPD oversimplifies real-world interactions. By contrast, multi-action models are better suited to capture the richness of adaptive behavior, but systematic theoretical work in this direction remains scarce, as extending the action space greatly complicates both theoretical and simulation analyses. We advance this line of research by extending the IPD framework to an n-player, three-action setting, through which we identify cooperative equilibria that emerge more readily—those sustaining fair outcomes as Nash equilibria over a wider parameter domain—and reveal a fundamental mechanism for conflict resolution. In particular, our analysis identifies conditions under which partner equilibria can be sustained more readily in three-action games than in two-action ones. We further conduct an evolutionary analysis in which agents learn by imitating higher-performing strategies, revealing how adaptive behavior enables them to align incentives with opponents and promote fair and efficient outcomes even when opponents pursue only their own payoffs. Taken together, our results advance the theoretical foundations of repeated multi-action games and offer insights into how fairness and cooperation can emerge in multiagent systems characterized by conflicting interests.

Suggested Citation

  • Zhang, Feipeng & Chen, Fang & Zhou, Lei & Wang, Long, 2026. "Beyond the prisoner’s dilemma: Cooperation in repeated three-action games," Chaos, Solitons & Fractals, Elsevier, vol. 204(C).
  • Handle: RePEc:eee:chsofr:v:204:y:2026:i:c:s0960077925017606
    DOI: 10.1016/j.chaos.2025.117747
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077925017606
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2025.117747?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Matjaž Perc & Zhen Wang, 2010. "Heterogeneous Aspirations Promote Cooperation in the Prisoner's Dilemma Game," PLOS ONE, Public Library of Science, vol. 5(12), pages 1-8, December.
    2. Fudenberg, Drew & Imhof, Lorens A., 2006. "Imitation processes with small mutations," Journal of Economic Theory, Elsevier, vol. 131(1), pages 251-262, November.
    3. Alex McAvoy & Benjamin Allen & Martin A. Nowak, 2020. "Social goods dilemmas in heterogeneous societies," Nature Human Behaviour, Nature, vol. 4(8), pages 819-831, August.
    4. Christian Hilbe & Krishnendu Chatterjee & Martin A. Nowak, 2018. "Publisher Correction: Partners and rivals in direct reciprocity," Nature Human Behaviour, Nature, vol. 2(7), pages 523-523, July.
    5. Peter S. Park & Martin A. Nowak & Christian Hilbe, 2022. "Cooperation in alternating interactions with memory constraints," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    6. Flávio L Pinheiro & Vítor V Vasconcelos & Francisco C Santos & Jorge M Pacheco, 2014. "Evolution of All-or-None Strategies in Repeated Public Goods Dilemmas," PLOS Computational Biology, Public Library of Science, vol. 10(11), pages 1-5, November.
    7. Christian Hilbe & Krishnendu Chatterjee & Martin A. Nowak, 2018. "Partners and rivals in direct reciprocity," Nature Human Behaviour, Nature, vol. 2(7), pages 469-477, July.
    8. Maria Kleshnina & Christian Hilbe & Štěpán Šimsa & Krishnendu Chatterjee & Martin A. Nowak, 2023. "The effect of environmental information on evolution of cooperation in stochastic games," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    9. Laura Schmid & Christian Hilbe & Krishnendu Chatterjee & Martin A Nowak, 2022. "Direct reciprocity between individuals that use different strategy spaces," PLOS Computational Biology, Public Library of Science, vol. 18(6), pages 1-29, June.
    10. Peter Duersch & Jörg Oechssler & Burkhard Schipper, 2014. "When is tit-for-tat unbeatable?," International Journal of Game Theory, Springer;Game Theory Society, vol. 43(1), pages 25-36, February.
    11. Anzhi Sheng & Aming Li & Long Wang, 2023. "Evolutionary dynamics on sequential temporal networks," PLOS Computational Biology, Public Library of Science, vol. 19(8), pages 1-19, August.
    12. Lei Zhou & Bin Wu & Jinming Du & Long Wang, 2021. "Aspiration dynamics generate robust predictions in heterogeneous populations," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    13. Maria Kleshnina & Christian Hilbe & Stepan Simsa & Krishnendu Chatterjee & Martin A. Nowak, 2023. "The effect of environmental information on evolution of cooperation in stochastic games," Post-Print hal-04210205, HAL.
    14. Oliver P. Hauser & Christian Hilbe & Krishnendu Chatterjee & Martin A. Nowak, 2019. "Social dilemmas among unequals," Nature, Nature, vol. 572(7770), pages 524-527, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maria Kleshnina & Christian Hilbe & Štěpán Šimsa & Krishnendu Chatterjee & Martin A. Nowak, 2023. "The effect of environmental information on evolution of cooperation in stochastic games," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    2. Charlotte S. L. Rossetti & Oliver P. Hauser & Christian Hilbe, 2025. "Dynamics of cooperation in concurrent games," Nature Communications, Nature, vol. 16(1), pages 1-11, December.
    3. Yu, Xiaotong & Liang, Haili & Ren, Xiaoqiang & Rong, Zhihai & Wang, Xiaofan & Cao, Ming, 2025. "The role of environmental feedback in promoting cooperation among unequal groups," Applied Mathematics and Computation, Elsevier, vol. 500(C).
    4. Zhou, Zhizhuo & Rong, Zhihai & Yang, Wen & Wu, Zhi-Xi, 2024. "Coevolution of extortion strategies with mixed imitation and aspiration learning dynamics in spatial Prisoner’s Dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 188(C).
    5. Zhou, Biheng & Rong, Zhihai & Yu, Xiang, 2025. "Equalizing payoffs of a structured population in repeated Prisoner’s Dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 192(C).
    6. Laura Schmid & Farbod Ekbatani & Christian Hilbe & Krishnendu Chatterjee, 2023. "Quantitative assessment can stabilize indirect reciprocity under imperfect information," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    7. Quan, Ji & Chen, Xinyue & Wang, Xianjia, 2024. "Repeated prisoner's dilemma games in multi-player structured populations with crosstalk," Applied Mathematics and Computation, Elsevier, vol. 473(C).
    8. Qi Su & Hongyu Wang & Yu Xia & Long Wang, 2026. "A multi-agent reinforcement learning framework for exploring dominant strategies in iterated and evolutionary games," Nature Communications, Nature, vol. 17(1), pages 1-14, December.
    9. Kang, Kai & Tian, Jinyan & Zhang, Boyu, 2024. "Cooperation and control in asymmetric repeated games," Applied Mathematics and Computation, Elsevier, vol. 470(C).
    10. Ma, Yin-Jie & Jiang, Zhi-Qiang & Podobnik, Boris, 2022. "Predictability of players’ actions as a mechanism to boost cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
    11. Wang, Jingyi & Zhu, Mengrui & Hua, Chenyu & Wang, Minggang & Tian, Lixin, 2026. "Emergence of cooperative behaviors in incomplete information networks: Evolutionary dynamics based on higher-order interactions and adaptive strategies," Chaos, Solitons & Fractals, Elsevier, vol. 204(C).
    12. Dai, Wenhui & Wang, Jianwei & Yu, Fengyuan & Xu, Wenshu & Li, Bofan, 2025. "The evolution of cooperation under falsified payoff information," Chaos, Solitons & Fractals, Elsevier, vol. 197(C).
    13. Li, Wen-Jing & Chen, Zhi & Jin, Ke-Zhong & Wang, Jun & Yuan, Lin & Gu, Changgui & Jiang, Luo-Luo & Perc, Matjaž, 2022. "Options for mobility and network reciprocity to jointly yield robust cooperation in social dilemmas," Applied Mathematics and Computation, Elsevier, vol. 435(C).
    14. Christian Hilbe & Maria Kleshnina & Kateřina Staňková, 2023. "Evolutionary Games and Applications: Fifty Years of ‘The Logic of Animal Conflict’," Dynamic Games and Applications, Springer, vol. 13(4), pages 1035-1048, December.
    15. Wang, Yang & Lu, Shounan, 2025. "Environmental-feedback-driven time-varying reputation update solve social dilemmas," Applied Mathematics and Computation, Elsevier, vol. 507(C).
    16. Peter S. Park & Martin A. Nowak & Christian Hilbe, 2022. "Cooperation in alternating interactions with memory constraints," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    17. Marta C. Couto & Saptarshi Pal, 2023. "Introspection Dynamics in Asymmetric Multiplayer Games," Dynamic Games and Applications, Springer, vol. 13(4), pages 1256-1285, December.
    18. Wickramaarachchi, Helani & Kirley, Michael, 2025. "Uncertainty driven decision making and perturbation dynamics in evolutionary games on small-world networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 674(C).
    19. Yang, Shike & Hu, Xincheng & Shi, Haobin & Chen, Qiang & Ma, Fei, 2026. "Cooperation dynamics in multilayer networks under recommendation and vigilance mechanisms," Chaos, Solitons & Fractals, Elsevier, vol. 202(P1).
    20. Yang, Guoli & Wu, Yu'e & Cavaliere, Matteo, 2024. "Information-driven cooperation on adaptive cyber-physical systems," Applied Mathematics and Computation, Elsevier, vol. 466(C).

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:204:y:2026:i:c:s0960077925017606. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.