IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v193y2025ics0960077925000840.html
   My bibliography  Save this article

The combined effects of conformity and reinforcement learning on the evolution of cooperation in public goods games

Author

Listed:
  • Zhang, Lan
  • Li, Yuqin
  • Xie, Yuan
  • Feng, Yuee
  • Huang, Changwei

Abstract

The human social instinct makes people susceptible to social influences, notably the urge to conform. Conformity enables individuals to attain psychological balance, thereby facilitating the smooth functioning of society. Individuals can also adjust their behavioral strategies based on their personal experiences. Individuals who learn by reinforcement can acquire optimal behaviors through feedback from their social environment. Reinforcement learning allows individuals to adapt their behavioral strategy based on their experiences to maximize payoffs. In this paper, we investigate how cooperation evolves in a population by constructing public goods games that integrate the conformity mechanism and the Bush–Mosteller reinforcement-learning rule. In particular, we use the “free rider” characteristic of noise traders in economics to introduce the conformity mechanism. The population is divided into two types of individuals: noise traders and noise-contrarian traders. We introduce a weighting parameter λ to represent the level of an individual’s conformity. The results indicate that increasing the density of noise traders promotes cooperation. Furthermore, an optimal conformity weighting maximizes the cooperation level. Finally, dynamic evolution indicators, including time series, snapshots, and the expected probability distribution for cooperation, are provided to explain the results.

Suggested Citation

  • Zhang, Lan & Li, Yuqin & Xie, Yuan & Feng, Yuee & Huang, Changwei, 2025. "The combined effects of conformity and reinforcement learning on the evolution of cooperation in public goods games," Chaos, Solitons & Fractals, Elsevier, vol. 193(C).
    • Handle: RePEc:eee:chsofr:v:193:y:2025:i:c:s0960077925000840
    DOI: 10.1016/j.chaos.2025.116071
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077925000840
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.chaos.2025.116071?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Li, Xiaopeng & Hao, Gang & Zhang, Zhipeng & Xia, Chengyi, 2021. "Evolution of cooperation in heterogeneously stochastic interactions," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    2. Bai, Xi & Ye, Ye & Chen, Tong & Xie, Nenggang, 2024. "The evolutionary game of emotions considering the influence of reputation," Applied Mathematics and Computation, Elsevier, vol. 474(C).
    3. Li, Xiaopeng & Han, Weiwei & Yang, Wenjun & Wang, Juan & Xia, Chengyi & Li, Hui-jia & Shi, Yong, 2022. "Impact of resource-based conditional interaction on cooperation in spatial social dilemmas," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 594(C).
    4. Wu, Yu’e & Li, Zhiqiang & Liu, Zeyun & Yang, Guoli, 2024. "The impact of conditional coupling based on environment comparison between interdependent networks on the evolution of cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 187(C).
    5. Pan, Jianchen & Zhang, Lan & Han, Wenchen & Huang, Changwei, 2023. "Heterogeneous investment promotes cooperation in spatial public goods game on hypergraphs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 609(C).
    6. Yang, Han-Xin & Yang, Jing, 2019. "Reputation-based investment strategy promotes cooperation in public goods games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 523(C), pages 886-893.
    7. Kang, Hongwei & Li, Xin & Shen, Yong & Sun, Xingping & Chen, Qingyi, 2024. "Particle swarm optimization with historical return decay enhances cooperation in public goods games with investment risks," Chaos, Solitons & Fractals, Elsevier, vol. 189(P1).
    8. Xinmiao An & Yali Dong & Xiaomin Wang & Boyu Zhang, 2023. "Cooperation and Coordination in Threshold Public Goods Games with Asymmetric Players," Games, MDPI, vol. 14(6), pages 1-13, December.
    9. Jia, Danyang & Li, Tong & Zhao, Yang & Zhang, Xiaoqin & Wang, Zhen, 2022. "Empty nodes affect conditional cooperation under reinforcement learning," Applied Mathematics and Computation, Elsevier, vol. 413(C).
    10. Ken Binmore, 1994. "Game Theory and the Social Contract, Volume 1: Playing Fair," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262023636, December.
    11. Szolnoki, Attila & Perc, Matjaž & Danku, Zsuzsa, 2008. "Towards effective payoffs in the prisoner’s dilemma game on scale-free networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(8), pages 2075-2082.
    12. Quan, Ji & Dong, Xu & Wang, Xianjia, 2022. "Rational conformity behavior in social learning promotes cooperation in spatial public goods game," Applied Mathematics and Computation, Elsevier, vol. 425(C).
    13. Wang, Qun & Wang, Hanchen & Zhang, Zhuxi & Li, Yumeng & Liu, Yu & Perc, Matjaž, 2018. "Heterogeneous investments promote cooperation in evolutionary public goods games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 502(C), pages 570-575.
    14. Lv, Shaojie & Song, Feifei, 2022. "Particle swarm intelligence and the evolution of cooperation in the spatial public goods game with punishment," Applied Mathematics and Computation, Elsevier, vol. 412(C).
    15. Chen, Ya-Shan & Yang, Han-Xin & Guo, Wen-Zhong & Liu, Geng-Geng, 2018. "Promotion of cooperation based on swarm intelligence in spatial public goods games," Applied Mathematics and Computation, Elsevier, vol. 320(C), pages 614-620.
    16. Segismundo S. Izquierdo & Luis R. Izquierdo & Nicholas M. Gotts, 2008. "Reinforcement Learning Dynamics in Social Dilemmas," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-1.
    17. Mateus F. B. Granha & Andr'e L. M. Vilela & Chao Wang & Kenric P. Nelson & H. Eugene Stanley, 2022. "Opinion Dynamics in Financial Markets via Random Networks," Papers 2201.07214, arXiv.org.
    18. Lima, F.W.S. & Sousa, A.O. & Sumuor, M.A., 2008. "Majority-vote on directed Erdős–Rényi random graphs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(14), pages 3503-3510.
    19. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Gotts, Nicholas M. & Polhill, J. Gary, 2007. "Transient and asymptotic dynamics of reinforcement learning in games," Games and Economic Behavior, Elsevier, vol. 61(2), pages 259-276, November.
    20. Geng, Yini & Liu, Yifan & Lu, Yikang & Shen, Chen & Shi, Lei, 2022. "Reinforcement learning explains various conditional cooperation," Applied Mathematics and Computation, Elsevier, vol. 427(C).
    21. Yang, Han-Xin & Rong, Zhihai, 2015. "Mutual punishment promotes cooperation in the spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 77(C), pages 230-234.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Xianjia & Yang, Zhipeng & Liu, Yanli & Chen, Guici, 2023. "A reinforcement learning-based strategy updating model for the cooperative evolution," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 618(C).
    2. Bai, Pengzhou & Qiang, Bingzhuang & Zou, Kuan & Huang, Changwei, 2024. "Preferential selection based on adaptive attractiveness induce by reinforcement learning promotes cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 180(C).
    3. Xiaopeng Li & Zhonglin Wang & Jiuqiang Liu & Guihai Yu, 2023. "The Sense of Cooperation on Interdependent Networks Inspired by Influence-Based Self-Organization," Mathematics, MDPI, vol. 11(4), pages 1-16, February.
    4. Lv, Shaojie & Wang, Xianjia, 2020. "The impact of heterogeneous investments on the evolution of cooperation in public goods game with exclusion," Applied Mathematics and Computation, Elsevier, vol. 372(C).
    5. Yu, Fengyuan & Wang, Jianwei & He, Jialu, 2022. "Inequal dependence on members stabilizes cooperation in spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 165(P1).
    6. Zheng, Lei & Li, Youqi & Zhou, Jingsai & Li, Yumeng, 2022. "The effect of celebrity on the evolution of fairness in the ultimatum game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 585(C).
    7. Wang, Le & Chen, Tong & Wu, Zhenghong, 2021. "Promoting cooperation by reputation scoring mechanism based on historical donations in public goods game," Applied Mathematics and Computation, Elsevier, vol. 390(C).
    8. Guan, Kaixuan & Chen, Yuyou & Zheng, Wanjun & Zeng, Lulu & Ye, Hang, 2022. "Costly signals can facilitate cooperation and punishment in the prisoner’s dilemma," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 605(C).
    9. Quan, Ji & Yu, Junyu & Li, Xia & Wang, Xianjia, 2023. "Conditional switching between social excluders and loners promotes cooperation in spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 169(C).
    10. Zhang, Lan & Xie, Yuan & Huang, Changwei & Li, Haihong & Dai, Qionglin, 2020. "Heterogeneous investments induced by historical payoffs promote cooperation in spatial public goods games," Chaos, Solitons & Fractals, Elsevier, vol. 133(C).
    11. Zou, Kuan & Huang, Changwei, 2024. "Incorporating reputation into reinforcement learning can promote cooperation on hypergraphs," Chaos, Solitons & Fractals, Elsevier, vol. 186(C).
    12. Zou, Kuan & Han, Wenchen & Zhang, Lan & Huang, Changwei, 2024. "The spatial public goods game on hypergraphs with heterogeneous investment," Applied Mathematics and Computation, Elsevier, vol. 466(C).
    13. Tian, Yue & Gao, Shun & Li, Haihong & Dai, Qionglin & Yang, Junzhong, 2024. "Particle swarm intelligence promotes cooperation by adapting interaction radii in co-evolutionary games," Applied Mathematics and Computation, Elsevier, vol. 474(C).
    14. Lee, Hsuan-Wei & Cleveland, Colin & Szolnoki, Attila, 2023. "Group-size dependent synergy in heterogeneous populations," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).
    15. Wang, Xianjia & Lv, Shaojie, 2019. "The roles of particle swarm intelligence in the prisoner’s dilemma based on continuous and mixed strategy systems on scale-free networks," Applied Mathematics and Computation, Elsevier, vol. 355(C), pages 213-220.
    16. Hui Long & Rizhao Gong & Jiaqian Yao & Qian Li, 2023. "Effect of heterogeneous investment induced by payoff and emotion on cooperation in public goods games by considering memory decline effects," PLOS ONE, Public Library of Science, vol. 18(2), pages 1-21, February.
    17. Xie, Yunya & Bai, Yu & Zhang, Yankun & Peng, Zhengyin, 2024. "Trust-induced cooperation under the complex interaction of networks and emotions," Chaos, Solitons & Fractals, Elsevier, vol. 182(C).
    18. Zhou, Chen & Zhu, Yuying & Zhao, Dawei & Xia, Chengyi, 2024. "An evolutionary trust game model with group reputation within the asymmetric population," Chaos, Solitons & Fractals, Elsevier, vol. 184(C).
    19. Lee, Hsuan-Wei & Cleveland, Colin & Szolnoki, Attila, 2024. "Supporting punishment via taxation in a structured population," Chaos, Solitons & Fractals, Elsevier, vol. 178(C).
    20. Wang, Mie & Kang, HongWei & Shen, Yong & Sun, XingPing & Chen, QingYi, 2021. "The role of alliance cooperation in spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:193:y:2025:i:c:s0960077925000840. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.