IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v387y2008i22p5609-5615.html

Promoting cooperation by local contribution under stochastic win-stay-lose-shift mechanism

Author

Listed:
  • Chen, Xiaojie
  • Fu, Feng
  • Wang, Long

Abstract

We introduce a stochastic win-stay-lose-shift (WSLS) mechanism into evolutionary Prisoner’s Dilemma on small-world networks. At each time step, after playing with all its immediate neighbors, each individual gets a score to evaluate its performance in the game. The score is a linear combination of an individual’s total payoff (i.e., individual gain from the group) and local contribution to its neighbors (i.e., individual donation to the group). If one’s actual score is not larger than its desired score aspiration, it switches current strategy to the opposite one with the probability depending on the difference between the two scores. Under this stochastic WSLS regime, we assume that each focal individual gains its fixed score aspiration under the condition of full cooperation in its neighborhood, and find that cooperation is significantly enhanced under some certain parameters of the model by studying the evolution of cooperation. We also explore the influences of different values of learning rate and intensity of deterministic switch on the evolution of cooperation. Simulation results show that cooperation level monotonically increases with the relative weight of the local contribution to the score. For much low intensity of deterministic switch, cooperation is to a large extent independent of learning rate, and full cooperation can be reached when relative weight is not less than 0.5. Otherwise, cooperation level is affected by the value of learning rate. Besides, we find that the cooperation level is not sensitive to the topological parameters. To explain these simulation results, we provide corresponding analytical results based on mean-field approximation, and find out that simulation results are in close agreement with the analytical ones. Our work may be helpful in understanding the cooperative behavior in social systems based on this stochastic WSLS mechanism.

Suggested Citation

  • Chen, Xiaojie & Fu, Feng & Wang, Long, 2008. "Promoting cooperation by local contribution under stochastic win-stay-lose-shift mechanism," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(22), pages 5609-5615.
  • Handle: RePEc:eee:phsmap:v:387:y:2008:i:22:p:5609-5615
    DOI: 10.1016/j.physa.2008.05.043
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437108004925
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2008.05.043?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    2. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Tao & Chen, Zhigang & Li, Kenli & Deng, Xiaoheng & Li, Deng, 2014. "Memory does not necessarily promote cooperation in dilemma games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 395(C), pages 218-227.
    2. Bin Wu & Da Zhou & Feng Fu & Qingjun Luo & Long Wang & Arne Traulsen, 2010. "Evolution of Cooperation on Stochastic Dynamical Networks," PLOS ONE, Public Library of Science, vol. 5(6), pages 1-7, June.
    3. Quan, Ji & Dong, Xu & Wang, Xianjia, 2022. "Rational conformity behavior in social learning promotes cooperation in spatial public goods game," Applied Mathematics and Computation, Elsevier, vol. 425(C).
    4. Li, Ya & Lan, Xin & Deng, Xinyang & Sadiq, Rehan & Deng, Yong, 2014. "Comprehensive consideration of strategy updating promotes cooperation in the prisoner’s dilemma game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 403(C), pages 284-292.
    5. Su, Qi & Li, Aming & Wang, Long, 2017. "Spatial structure favors cooperative behavior in the snowdrift game with multiple interactive dynamics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 468(C), pages 299-306.
    6. Lee, Hsuan-Wei & Cleveland, Colin & Szolnoki, Attila, 2021. "Small fraction of selective cooperators can elevate general wellbeing significantly," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 582(C).
    7. Xu, Jiwei & Deng, Zhenghong & Gao, Bo & Song, Qun & Tian, Zhihong & Wang, Qiuling & Gao, Mingyu & Niu, Zhenxi, 2019. "Popularity-driven strategy updating rule promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 353(C), pages 82-87.
    8. Takahara, Akihiro & Sakiyama, Tomoko, 2025. "Leveraging surrounding past strategies to maintain cooperation in the perverse prisoner's dilemma," Applied Mathematics and Computation, Elsevier, vol. 493(C).
    9. Wang, Xu-Wen & Nie, Sen & Jiang, Luo-Luo & Wang, Bing-Hong & Chen, Shi-Ming, 2017. "Role of delay-based reward in the spatial cooperation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 153-158.
    10. Guo, Tian & Du, Chunpeng & Shi, Lei, 2024. "Evolution of cooperation on interdependent networks: The impact of asymmetric punishment," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    11. Quan, Ji & Zhou, Yawen & Wang, Xianjia & Yang, Jian-Bo, 2020. "Information fusion based on reputation and payoff promotes cooperation in spatial public goods game," Applied Mathematics and Computation, Elsevier, vol. 368(C).
    12. Quan, Ji & Zhou, Yawen & Wang, Xianjia & Yang, Jian-Bo, 2020. "Evidential reasoning based on imitation and aspiration information in strategy learning promotes cooperation in optional spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 133(C).
    13. Deng, Zhenghong & Ma, Chunmiao & Mao, Xudong & Wang, Shenglan & Niu, Zhenxi & Gao, Li, 2017. "Historical payoff promotes cooperation in the prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 104(C), pages 1-5.
    14. Chang, Shuhua & Zhang, Zhipeng & Wu, Yu’e & Xie, Yunya, 2018. "Cooperation is enhanced by inhomogeneous inertia in spatial prisoner’s dilemma game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 419-425.
    15. Shu, Gang & Du, Xia & Li, Ya, 2016. "Surrounding information consideration promotes cooperation in Prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 91(C), pages 689-694.
    16. Szolnoki, Attila & Chen, Xiaojie, 2020. "Gradual learning supports cooperation in spatial prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 130(C).
    17. Quan, Ji & Yang, Xiukang & Wang, Xianjia, 2018. "Spatial public goods game with continuous contributions based on Particle Swarm Optimization learning and the evolution of cooperation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 505(C), pages 973-983.
    18. Xia, Ke, 2021. "The characteristics of average abundance function of multi-player threshold public goods evolutionary game model under redistribution mechanism," Applied Mathematics and Computation, Elsevier, vol. 392(C).
    19. Xia, Ke, 2021. "Average abundance function of multi-player threshold public goods without initial endowment evolutionary game model under differential aspiration levels and redistribution mechanism," Chaos, Solitons & Fractals, Elsevier, vol. 142(C).
    20. Li, Yan & Ye, Hang & Zhang, Hong, 2016. "Evolution of cooperation driven by social-welfare-based migration," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 445(C), pages 48-56.
    21. Du, Jinming & Wu, Ziren, 2023. "Coevolutionary dynamics of strategy and network structure with publicity mechanism," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 623(C).
    22. Liu, Yongkui & Chen, Xiaojie & Zhang, Lin & Tao, Fei & Wang, Long, 2012. "Does migration cost influence cooperation among success-driven individuals?," Chaos, Solitons & Fractals, Elsevier, vol. 45(11), pages 1301-1308.
    23. Li, Cong & Xu, Hedong & Fan, Suohai, 2020. "Synergistic effects of self-optimization and imitation rules on the evolution of cooperation in the investor sharing game," Applied Mathematics and Computation, Elsevier, vol. 370(C).
    24. Kojo, Ken'ichi & Sakiyama, Tomoko, 2024. "Restructuring of neighborhood definition based on strategies will enhance the cooperation in a spatial prisoner's dilemma," Chaos, Solitons & Fractals, Elsevier, vol. 179(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Galbiati, Marco & Soramäki, Kimmo, 2011. "An agent-based model of payment systems," Journal of Economic Dynamics and Control, Elsevier, vol. 35(6), pages 859-875, June.
    2. Adriaan R. Soetevent, 2006. "Empirics of the Identification of Social Interactions; An Evaluation of the Approaches and Their Results," Journal of Economic Surveys, Wiley Blackwell, vol. 20(2), pages 193-228, April.
    3. Todd Guilfoos & Andreas Duus Pape, 2020. "Estimating Case-Based Learning," Games, MDPI, vol. 11(3), pages 1-25, September.
    4. I. Lubashevsky & S. Kanemoto, 2010. "Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 76(1), pages 69-85, July.
    5. Schipper, Burkhard C., 2021. "Discovery and equilibrium in games with unawareness," Journal of Economic Theory, Elsevier, vol. 198(C).
    6. Napel, Stefan & Widgrén, Mika, 2017. "Power measurement as sensitivity analysis: a unified approach," Center for Mathematical Economics Working Papers 345, Center for Mathematical Economics, Bielefeld University.
    7. Atanasios Mitropoulos, 2001. "Learning Under Little Information: An Experiment on Mutual Fate Control," Game Theory and Information 0110003, University Library of Munich, Germany.
    8. W. Hichri & A. Kirman, 2007. "The emergence of coordination in public good games," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 55(2), pages 149-159, January.
    9. Mathieu Faure & Gregory Roth, 2010. "Stochastic Approximations of Set-Valued Dynamical Systems: Convergence with Positive Probability to an Attractor," Mathematics of Operations Research, INFORMS, vol. 35(3), pages 624-640, August.
    10. Ingela Alger & Laurent Lehmann, 2023. "Evolution of Semi-Kantian Preferences in Two-Player Assortative Interactions with Complete and Incomplete Information and Plasticity," Dynamic Games and Applications, Springer, vol. 13(4), pages 1288-1319, December.
    11. Pierre Cardaliaguet & Charles-Albert Lehalle, 2016. "Mean Field Game of Controls and An Application To Trade Crowding," Papers 1610.09904, arXiv.org, revised Sep 2017.
    12. Elkind, Edith & Grandi, Umberto & Rossi, Francesca & Slinko, Arkadii, 2020. "Cognitive hierarchy and voting manipulation in k-approval voting," Mathematical Social Sciences, Elsevier, vol. 108(C), pages 193-205.
    13. Cabrales, Antonio & Serrano, Roberto, 2011. "Implementation in adaptive better-response dynamics: Towards a general theory of bounded rationality in mechanisms," Games and Economic Behavior, Elsevier, vol. 73(2), pages 360-374.
    14. Zheng Jiang & Luzhan Yuan & Wei Wang & Gaowei Zhang & Yi Wang, 2025. "Commitment & cooperation in social dilemmas with diverse individual preferences: An agent-based modeling approach," PLOS ONE, Public Library of Science, vol. 20(7), pages 1-25, July.
    15. Dürsch, Peter & Kolb, Albert & Oechssler, Jörg & Schipper, Burkhard C., 2005. "Rage Against the Machines: How Subjects Learn to Play Against Computers," Bonn Econ Discussion Papers 31/2005, University of Bonn, Bonn Graduate School of Economics (BGSE).
    16. Asim Ansari & Ricardo Montoya & Oded Netzer, 2012. "Dynamic learning in behavioral games: A hidden Markov mixture of experts approach," Quantitative Marketing and Economics (QME), Springer, vol. 10(4), pages 475-503, December.
    17. , & ,, 2010. "A theory of regular Markov perfect equilibria in dynamic stochastic games: genericity, stability, and purification," Theoretical Economics, Econometric Society, vol. 5(3), September.
    18. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    19. Geoffrey Heal & Howard Kunreuther, 2005. "IDS Models of Airline Security," Journal of Conflict Resolution, Peace Science Society (International), vol. 49(2), pages 201-217, April.
    20. Levine, David K. & Modica, Salvatore, 2013. "Anti-Malthus: Conflict and the evolution of societies," Research in Economics, Elsevier, vol. 67(4), pages 289-306.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:387:y:2008:i:22:p:5609-5615. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.