IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v202y2026ip2s0960077925016364.html

The higher-order networked N-player trust game driven by reputation and reinforcement learning

Author

Listed:
  • Hu, Zhengyang
  • Zhu, Yuying
  • Zhao, Dawei
  • Xia, Chengyi

Abstract

Trust is a fundamental behavior in human interactions, yet its emergence and maintenance contradict Darwin’s natural selection principle. Existing studies fail to characterize higher-order interactions and overlook the relationship between reputation mechanisms and the environment in Q-learning, both of which hinder the realistic modeling of trust evolution. To address these gaps, this paper proposes a higher-order networked N-player trust game model that integrates reputation mechanisms and reinforcement learning, aiming to investigate how dynamic reputation environments influence trust behaviors. More precisely, we classify agents’ reputations into three levels to form their state set, and define their strategies as the action set. Besides, we introduce reputation correlation and redefine the reward function by integrating agents’ game payoff and reputation state. Simulation results indicate that a higher reputation correlation can effectively promote the evolution of trust and the growth of global wealth, and agent’s reputation evolve toward “Good” dominance. Reinforcement learning parameters (learning rate and discount factor) exert synergistic effects, with larger values of both promoting trust behaviors and global wealth accumulation. We also examine the impact of initial strategy distribution settings, and find that the model exhibits robustness under a high reputation correlation.

Suggested Citation

  • Hu, Zhengyang & Zhu, Yuying & Zhao, Dawei & Xia, Chengyi, 2026. "The higher-order networked N-player trust game driven by reputation and reinforcement learning," Chaos, Solitons & Fractals, Elsevier, vol. 202(P2).
  • Handle: RePEc:eee:chsofr:v:202:y:2026:i:p2:s0960077925016364
    DOI: 10.1016/j.chaos.2025.117623
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077925016364
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2025.117623?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Francisco C. Santos & Marta D. Santos & Jorge M. Pacheco, 2008. "Social diversity promotes the emergence of cooperation in public goods games," Nature, Nature, vol. 454(7201), pages 213-216, July.
    2. Iris Bohnet & Steffen Huck, 2004. "Repetition and Reputation: Implications for Trust and Trustworthiness When Institutions Change," American Economic Review, American Economic Association, vol. 94(2), pages 362-366, May.
    3. Christoph Hauert & Michael Doebeli, 2004. "Spatial structure often inhibits the evolution of cooperation in the snowdrift game," Nature, Nature, vol. 428(6983), pages 643-646, April.
    4. Unai Alvarez-Rodriguez & Federico Battiston & Guilherme Ferraz Arruda & Yamir Moreno & Matjaž Perc & Vito Latora, 2021. "Evolutionary dynamics of higher-order interactions in social networks," Nature Human Behaviour, Nature, vol. 5(5), pages 586-595, May.
    5. Zhang, Gui & Xiong, Xiaojin & Pi, Bin & Feng, Minyu & Perc, Matjaž, 2025. "Spatial public goods games with queueing and reputation," Applied Mathematics and Computation, Elsevier, vol. 505(C).
    6. Anzhi Sheng & Qi Su & Aming Li & Long Wang & Joshua B. Plotkin, 2023. "Constructing temporal networks with bursty activity patterns," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    7. Zou, Kuan & Huang, Changwei, 2024. "Incorporating reputation into reinforcement learning can promote cooperation on hypergraphs," Chaos, Solitons & Fractals, Elsevier, vol. 186(C).
    8. Valerio Capraro & Joseph Y. Halpern & Matjaž Perc, 2024. "From Outcome-Based to Language-Based Preferences," Journal of Economic Literature, American Economic Association, vol. 62(1), pages 115-154, March.
    9. Martin A. Nowak & Karl Sigmund, 1998. "Evolution of indirect reciprocity by image scoring," Nature, Nature, vol. 393(6685), pages 573-577, June.
    10. Martin A. Nowak & Akira Sasaki & Christine Taylor & Drew Fudenberg, 2004. "Emergence of cooperation and evolutionary stability in finite populations," Nature, Nature, vol. 428(6983), pages 646-650, April.
    11. van den Akker, Olmo R. & van Assen, Marcel A.L.M. & van Vugt, Mark & Wicherts, Jelte M., 2020. "Sex differences in trust and trustworthiness: A meta-analysis of the trust game and the gift-exchange game," Journal of Economic Psychology, Elsevier, vol. 81(C).
    12. M.A. Nowak & K. Sigmund, 1998. "Evolution of Indirect Reciprocity by Image Scoring/ The Dynamics of Indirect Reciprocity," Working Papers ir98040, International Institute for Applied Systems Analysis.
    13. Ernst Fehr & Urs Fischbacher, 2003. "The nature of human altruism," Nature, Nature, vol. 425(6960), pages 785-791, October.
    14. Zhu, Yuying & Xing, Bohua & Xia, Chengyi, 2025. "Q-learning update with second-order reputation promotes the evolution of trust within structured populations," Chaos, Solitons & Fractals, Elsevier, vol. 199(P1).
    15. Gao, Shun & Zhang, Wei & Zhang, Liming & Li Richter, Xiang-Yi & Zhang, Yi-Cheng & Dai, Qionglin, 2025. "Modified particle swarm strategies in spatial public goods games," Chaos, Solitons & Fractals, Elsevier, vol. 200(P3).
    16. Isoni, Andrea & Sugden, Robert, 2019. "Reciprocity and the Paradox of Trust in psychological game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 219-227.
    17. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    18. Zhou, Chen & Zhu, Yuying & Zhao, Dawei & Xia, Chengyi, 2024. "An evolutionary trust game model with group reputation within the asymmetric population," Chaos, Solitons & Fractals, Elsevier, vol. 184(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Jiaying & Lv, Shaojie & Zhao, Changheng, 2025. "Public goods games with environmental feedbacks in well-mixed and structured populations," Chaos, Solitons & Fractals, Elsevier, vol. 201(P2).
    2. Zhang, Jiliang & Wang, Yuhang & Zhou, Yinzuo & Zhang, Yi-Cheng & Meng, Fanyuan, 2025. "Threshold-based punishment mechanism in evolutionary public goods games on random hypergraphs," Chaos, Solitons & Fractals, Elsevier, vol. 200(P2).
    3. Chen, Qiao & Chen, Tong & Wang, Yongjie, 2019. "Cleverly handling the donation information can promote cooperation in public goods game," Applied Mathematics and Computation, Elsevier, vol. 346(C), pages 363-373.
    4. Zhu, Enqiang & Chen, Jia & Liu, Shiqi & Zhang, Xiaokai & Liu, Chanjuan, 2025. "The influence of heterogeneous investment on the evolution of trust in complex networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 677(C).
    5. Egas, Martijn & Riedl, Arno, 2005. "The Economics of Altruistic Punishment and the Demise of Cooperation," IZA Discussion Papers 1646, IZA Network @ LISER.
    6. Kang, Hongwei & Li, Xin & Shen, Yong & Sun, Xingping & Chen, Qingyi, 2024. "Particle swarm optimization with historical return decay enhances cooperation in public goods games with investment risks," Chaos, Solitons & Fractals, Elsevier, vol. 189(P1).
    7. Manapat, Michael L. & Nowak, Martin A. & Rand, David G., 2013. "Information, irrationality, and the evolution of trust," Journal of Economic Behavior & Organization, Elsevier, vol. 90(S), pages 57-75.
    8. Du, Faqi & Fu, Feng, 2013. "Quantifying the impact of noise on macroscopic organization of cooperation in spatial games," Chaos, Solitons & Fractals, Elsevier, vol. 56(C), pages 35-44.
    9. Xie, Kai & Szolnoki, Attila, 2025. "Reputation in public goods cooperation under double Q-learning protocol," Chaos, Solitons & Fractals, Elsevier, vol. 196(C).
    10. Yao Meng & Sean P. Cornelius & Yang-Yu Liu & Aming Li, 2024. "Dynamics of collective cooperation under personalised strategy updates," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    11. Charness, Gary & Du, Ninghua & Yang, Chun-Lei, 2011. "Trust and trustworthiness reputations in an investment game," Games and Economic Behavior, Elsevier, vol. 72(2), pages 361-375, June.
    12. Lv, Shaojie & Wang, Xianjia, 2020. "The impact of heterogeneous investments on the evolution of cooperation in public goods game with exclusion," Applied Mathematics and Computation, Elsevier, vol. 372(C).
    13. Sun, Xingping & Feng, Kaiyu & Kang, Hongwei & Shen, Yong & Chen, Qingyi, 2026. "Adaptive migration guided by reputation-pheromone dynamics in spatial games," Chaos, Solitons & Fractals, Elsevier, vol. 202(P1).
    14. Zou, Kuan & Huang, Changwei, 2024. "Incorporating reputation into reinforcement learning can promote cooperation on hypergraphs," Chaos, Solitons & Fractals, Elsevier, vol. 186(C).
    15. Jin, Jiahua & Shen, Chen & Chu, Chen & Shi, Lei, 2017. "Incorporating dominant environment into individual fitness promotes cooperation in the spatial prisoners' dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 96(C), pages 70-75.
    16. Bogliacino, Francesco & Codagnone, Cristiano, 2021. "Microfoundations, behaviour, and evolution: Evidence from experiments," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 372-385.
    17. Wang, Zhen & Chen, Tong & Wang, Yongjie, 2017. "Leadership by example promotes the emergence of cooperation in public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 101(C), pages 100-105.
    18. Glaubitz, Alina & Fu, Feng, 2026. "The other side of the coin: Recipient norms and their impact on indirect reciprocity and cooperation," Applied Mathematics and Computation, Elsevier, vol. 513(C).
    19. Sheen S. Levine & Michael J. Prietula, 2014. "Open Collaboration for Innovation: Principles and Performance," Organization Science, INFORMS, vol. 25(5), pages 1414-1433, October.
    20. He, Siyu & Li, Qin & Feng, Minyu & Szolnoki, Attila, 2026. "Reputation assimilation mechanism for sustaining cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 202(P2).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:202:y:2026:i:p2:s0960077925016364. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.