IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v16y2025i1d10.1038_s41467-025-58043-7.html
   My bibliography  Save this article

Deep reinforcement learning can promote sustainable human behaviour in a common-pool resource problem

Author

Listed:
  • Raphael Koster

    (Google DeepMind)

  • Miruna Pîslar

    (Google DeepMind)

  • Andrea Tacchetti

    (Google DeepMind)

  • Jan Balaguer

    (Google DeepMind)

  • Leqi Liu

    (Google DeepMind
    Princeton University)

  • Romuald Elie

    (Google DeepMind)

  • Oliver P. Hauser

    (University of Exeter)

  • Karl Tuyls

    (Google DeepMind)

  • Matt Botvinick

    (Google DeepMind
    Yale University)

  • Christopher Summerfield

    (University of Oxford)

Abstract

A canonical social dilemma arises when resources are allocated to people, who can either reciprocate with interest or keep the proceeds. The right resource allocation mechanisms can encourage levels of reciprocation that sustain the commons. Here, in an iterated multiplayer trust game, we use deep reinforcement learning (RL) to design a social planner that promotes sustainable contributions from human participants. We first trained neural networks to behave like human players, creating a stimulated economy that allows us to study the dynamics of receipt and reciprocation. We use RL to train a mechanism to maximise aggregate return to players. The RL mechanism discovers a redistributive policy that leads to a large but also more equal surplus. The mechanism outperforms baseline mechanisms by conditioning its generosity on available resources and temporarily sanctioning defectors. Examining the RL policy allows us to develop a similar but explainable mechanism that is more popular among players.

Suggested Citation

  • Raphael Koster & Miruna Pîslar & Andrea Tacchetti & Jan Balaguer & Leqi Liu & Romuald Elie & Oliver P. Hauser & Karl Tuyls & Matt Botvinick & Christopher Summerfield, 2025. "Deep reinforcement learning can promote sustainable human behaviour in a common-pool resource problem," Nature Communications, Nature, vol. 16(1), pages 1-13, December.
  • Handle: RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-58043-7
    DOI: 10.1038/s41467-025-58043-7
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-025-58043-7
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-025-58043-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Diego Daruich & Raquel Fernández, 2024. "Universal Basic Income: A Dynamic Assessment," American Economic Review, American Economic Association, vol. 114(1), pages 38-88, January.
    2. Falk, Armin & Fischbacher, Urs, 2006. "A theory of reciprocity," Games and Economic Behavior, Elsevier, vol. 54(2), pages 293-315, February.
    3. Winand Emons, 1997. "Credence Goods and Fraudelent Experts," RAND Journal of Economics, The RAND Corporation, vol. 28(1), pages 107-119, Spring.
    4. Maskin, Eric S., 2008. "Mechanism design: how to implement social objectives," Revista de Economía Política de Buenos Aires, Universidad de Buenos Aires. Facultad de Ciencias Económicas., issue 3-4, pages 9-19, December.
    5. Jan Balaguer & Raphael Koster & Christopher Summerfield & Andrea Tacchetti, 2022. "The Good Shepherd: An Oracle Agent for Mechanism Design," Papers 2202.10135, arXiv.org.
    6. Ross, Stephen A, 1973. "The Economic Theory of Agency: The Principal's Problem," American Economic Review, American Economic Association, vol. 63(2), pages 134-139, May.
    7. Eric S. Maskin, 2008. "Mechanism Design: How to Implement Social Goals," American Economic Review, American Economic Association, vol. 98(3), pages 567-576, June.
    8. Kocher, Martin G. & Martinsson, Peter & Persson, Emil & Wang, Xianghong, 2016. "Is there a hidden cost of imposing a minimum contribution level for public good contributions?," Journal of Economic Psychology, Elsevier, vol. 56(C), pages 74-84.
    9. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    10. Raphael Koster & Jan Balaguer & Andrea Tacchetti & Ari Weinstein & Tina Zhu & Oliver Hauser & Duncan Williams & Lucy Campbell-Gillingham & Phoebe Thacker & Matthew Botvinick & Christopher Summerfield, 2022. "Human-centred mechanism design with Democratic AI," Nature Human Behaviour, Nature, vol. 6(10), pages 1398-1407, October.
      • Raphael Koster & Jan Balaguer & Andrea Tacchetti & Ari Weinstein & Tina Zhu & Oliver Hauser & Duncan Williams & Lucy Campbell-Gillingham & Phoebe Thacker & Matthew Botvinick & Christopher Summerfield, 2022. "Human-centered mechanism design with Democratic AI," Papers 2201.11441, arXiv.org.
    11. Ernst Fehr & Simon Gächter, 2002. "Altruistic punishment in humans," Nature, Nature, vol. 415(6868), pages 137-140, January.
    12. Camerer, Colin & Weigelt, Keith, 1988. "Experimental Tests of a Sequential Equilibrium Reputation Model," Econometrica, Econometric Society, vol. 56(1), pages 1-36, January.
    13. Drew Fudenberg & David G. Rand & Anna Dreber, 2012. "Slow to Anger and Fast to Forgive: Cooperation in an Uncertain World," American Economic Review, American Economic Association, vol. 102(2), pages 720-749, April.
    14. Ernst Fehr & Ivo Schurtenberger, 2018. "Normative foundations of human cooperation," Nature Human Behaviour, Nature, vol. 2(7), pages 458-468, July.
    15. Astrid Dannenberg & Carlo Gallier, 2020. "The choice of institutions to solve cooperation problems: a survey of experimental research," Experimental Economics, Springer;Economic Science Association, vol. 23(3), pages 716-749, September.
    16. Alvin E. Roth, 2002. "The Economist as Engineer: Game Theory, Experimentation, and Computation as Tools for Design Economics," Econometrica, Econometric Society, vol. 70(4), pages 1341-1378, July.
    17. Palfrey, Thomas R. & Rosenthal, Howard, 1991. "Testing for effects of cheap talk in a public goods game with private information," Games and Economic Behavior, Elsevier, vol. 3(2), pages 183-220, May.
    18. Ananish Chaudhuri, 2011. "Sustaining cooperation in laboratory public goods experiments: a selective survey of the literature," Experimental Economics, Springer;Economic Science Association, vol. 14(1), pages 47-83, March.
    19. Kamei, Kenju & Putterman, Louis & Tyran, Jean-Robert, 2023. "Civic engagement, the leverage effect and the accountable state," European Economic Review, Elsevier, vol. 156(C).
    20. Astrid Dannenberg & Corina Haita-Falah & Sonja Zitzelsberger, 2020. "Voting on the threat of exclusion in a public goods experiment," Experimental Economics, Springer;Economic Science Association, vol. 23(1), pages 84-109, March.
    21. Reischmann, Andreas & Oechssler, Joerg, 2018. "The Binary Conditional Contribution Mechanism for public good provision in dynamic settings — Theory and experimental evidence," Journal of Public Economics, Elsevier, vol. 159(C), pages 104-115.
    22. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Markussen & Jean-Robert Tyran, 2023. "Is There a Dividend of Democracy? Experimental Evidence from Cooperation Games," CESifo Working Paper Series 10616, CESifo.
    2. Engel, Christoph & Kube, Sebastian & Kurschilgen, Michael, 2021. "Managing expectations: How selective information affects cooperation and punishment in social dilemma games," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 111-136.
    3. Simon Gächter & Esther Kaiser & Manfred Königstein, 2024. "Incentive contracts crowd out voluntary cooperation: Evidence from gift-exchange experiments," Discussion Papers 2024-02, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    4. Felix Kölle & Thomas Lauer, 2024. "Understanding Cooperation in an Intertemporal Context," Management Science, INFORMS, vol. 70(11), pages 7791-7810, November.
    5. LUNN Pete, 2024. "Perceived Fairness and the Green Transition," JRC Research Reports JRC139534, Joint Research Centre.
    6. Irlenbusch, Bernd, 2004. "Relying on a man's word?: An experimental study on non-binding contracts," International Review of Law and Economics, Elsevier, vol. 24(3), pages 299-332, September.
    7. Simon Gaechter, 2014. "Human Pro-Social Motivation and the Maintenance of Social Order," Discussion Papers 2014-02, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    8. Calabuig, Vicente & Fatas, Enrique & Olcina, Gonzalo & Rodriguez-Lara, Ismael, 2016. "Carry a big stick, or no stick at all," Journal of Economic Psychology, Elsevier, vol. 57(C), pages 153-171.
    9. Loerakker, Ben & Bault, Nadège & Hoyer, Maximilian & van Winden, Frans, 2022. "On the Development of Cooperative and Antagonistic Relationships in Public Good Environments. A Model-Based Experimental Study," OSF Preprints wur7c, Center for Open Science.
    10. Murnighan, J. Keith & Wang, Long, 2016. "The social world as an experimental game," Organizational Behavior and Human Decision Processes, Elsevier, vol. 136(C), pages 80-94.
    11. repec:osf:osfxxx:wur7c_v1 is not listed on IDEAS
    12. Ben-Ner, Avner & Putterman, Louis & Kong, Fanmin & Magan, Dan, 2004. "Reciprocity in a two-part dictator game," Journal of Economic Behavior & Organization, Elsevier, vol. 53(3), pages 333-352, March.
    13. Fluet, Claude & Galbiati, Rpbertp, 2016. "Lois et normes : les enseignements de l'économie comportementale," L'Actualité Economique, Société Canadienne de Science Economique, vol. 92(1-2), pages 191-215, Mars-Juin.
    14. Renan Goetz & Jorge Marco, 2025. "Social networks, norm-enforcing ties and cooperation," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 20(2), pages 371-412, April.
    15. Karakostas, Alexandros & Kocher, Martin G. & Matzat, Dominik & Rau, Holger A. & Riewe, Gerhard, 2023. "The team allocator game: Allocation power in public goods games," Games and Economic Behavior, Elsevier, vol. 140(C), pages 73-87.
    16. Antoni Bosch-Domènech & Joaquim Silvestre, 2017. "The role of frames, numbers and risk in the frequency of cooperation," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 64(3), pages 245-267, September.
    17. Kartal, Melis & Müller, Wieland & Tremewan, James, 2021. "Building trust: The costs and benefits of gradualism," Games and Economic Behavior, Elsevier, vol. 130(C), pages 258-275.
    18. John A. List, 2006. "The Behavioralist Meets the Market: Measuring Social Preferences and Reputation Effects in Actual Transactions," Journal of Political Economy, University of Chicago Press, vol. 114(1), pages 1-37, February.
    19. Bogliacino, Francesco & Codagnone, Cristiano, 2021. "Microfoundations, behaviour, and evolution: Evidence from experiments," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 372-385.
    20. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    21. Ernst Fehr & John A. List, 2004. "The Hidden Costs and Returns of Incentives-Trust and Trustworthiness Among CEOs," Journal of the European Economic Association, MIT Press, vol. 2(5), pages 743-771, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-58043-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.