IDEAS home Printed from https://ideas.repec.org/a/nat/nathum/v6y2022i10d10.1038_s41562-022-01383-x.html
   My bibliography  Save this article

Human-centred mechanism design with Democratic AI

Author

Listed:
  • Raphael Koster

    (Deepmind)

  • Jan Balaguer

    (Deepmind)

  • Andrea Tacchetti

    (Deepmind)

  • Ari Weinstein

    (Deepmind)

  • Tina Zhu

    (Deepmind)

  • Oliver Hauser

    (University of Exeter)

  • Duncan Williams

    (Deepmind)

  • Lucy Campbell-Gillingham

    (Deepmind)

  • Phoebe Thacker

    (Deepmind)

  • Matthew Botvinick

    (Deepmind
    University College London)

  • Christopher Summerfield

    (Deepmind
    University of Oxford)

Abstract

Building artificial intelligence (AI) that aligns with human values is an unsolved problem. Here we developed a human-in-the-loop research pipeline called Democratic AI, in which reinforcement learning is used to design a social mechanism that humans prefer by majority. A large group of humans played an online investment game that involved deciding whether to keep a monetary endowment or to share it with others for collective benefit. Shared revenue was returned to players under two different redistribution mechanisms, one designed by the AI and the other by humans. The AI discovered a mechanism that redressed initial wealth imbalance, sanctioned free riders and successfully won the majority vote. By optimizing for human preferences, Democratic AI offers a proof of concept for value-aligned policy innovation.

Suggested Citation

  • Raphael Koster & Jan Balaguer & Andrea Tacchetti & Ari Weinstein & Tina Zhu & Oliver Hauser & Duncan Williams & Lucy Campbell-Gillingham & Phoebe Thacker & Matthew Botvinick & Christopher Summerfield, 2022. "Human-centred mechanism design with Democratic AI," Nature Human Behaviour, Nature, vol. 6(10), pages 1398-1407, October.
    • Handle: RePEc:nat:nathum:v:6:y:2022:i:10:d:10.1038_s41562-022-01383-x
    DOI: 10.1038/s41562-022-01383-x
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41562-022-01383-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1038/s41562-022-01383-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    • Raphael Koster & Jan Balaguer & Andrea Tacchetti & Ari Weinstein & Tina Zhu & Oliver Hauser & Duncan Williams & Lucy Campbell-Gillingham & Phoebe Thacker & Matthew Botvinick & Christopher Summerfield, 2022. "Human-centered mechanism design with Democratic AI," Papers 2201.11441, arXiv.org.

    References listed on IDEAS

    as
    1. Julian Rauchdobler & Rupert Sausgruber & Jean-Robert Tyran, 2010. "Voting on Thresholds for Public Goods: Experimental Evidence," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 66(1), pages 34-64, March.
    2. Kathryn Tunyasuvunakool & Jonas Adler & Zachary Wu & Tim Green & Michal Zielinski & Augustin Žídek & Alex Bridgland & Andrew Cowie & Clemens Meyer & Agata Laydon & Sameer Velankar & Gerard J. Kleywegt, 2021. "Highly accurate protein structure prediction for the human proteome," Nature, Nature, vol. 596(7873), pages 590-596, August.
    3. Piotr Dworczak & Scott Duke Kominers & Mohammad Akbarpour, 2021. "Redistribution Through Markets," Econometrica, Econometric Society, vol. 89(4), pages 1665-1698, July.
    4. Journal of Economics Library, 2016. "New Economics Books," Journal of Economics Library, KSP Journals, vol. 3(2), pages 362-410, June.
    5. Cherry, Todd L. & Kroll, Stephan & Shogren, Jason F., 2005. "The impact of endowment heterogeneity and origin on public good contributions: evidence from the lab," Journal of Economic Behavior & Organization, Elsevier, vol. 57(3), pages 357-365, July.
    6. Hurwicz,Leonid & Reiter,Stanley, 2008. "Designing Economic Mechanisms," Cambridge Books, Cambridge University Press, number 9780521724104.
    7. Journal of Economics Library, 2016. "New Economics Books," Journal of Economics Library, KSP Journals, vol. 3(1), pages 165-213, March.
    8. Mark Isaac, R. & McCue, Kenneth F. & Plott, Charles R., 1985. "Public goods provision in an experimental environment," Journal of Public Economics, Elsevier, vol. 26(1), pages 51-74, February.
    9. John Jumper & Richard Evans & Alexander Pritzel & Tim Green & Michael Figurnov & Olaf Ronneberger & Kathryn Tunyasuvunakool & Russ Bates & Augustin Žídek & Anna Potapenko & Alex Bridgland & Clemens Me, 2021. "Highly accurate protein structure prediction with AlphaFold," Nature, Nature, vol. 596(7873), pages 583-589, August.
    10. Josef Falkinger, 2000. "A Simple Mechanism for the Efficient Provision of Public Goods: Experimental Evidence," American Economic Review, American Economic Association, vol. 90(1), pages 247-264, March.
    11. Ernst Fehr & Ivo Schurtenberger, 2018. "Normative foundations of human cooperation," Nature Human Behaviour, Nature, vol. 2(7), pages 458-468, July.
    12. repec:ksp:journ5:v:3:y:2016:i:1:p:150-198 is not listed on IDEAS
    13. R. J. Aumann & M. Kurz & A. Neyman, 1983. "Voting for Public Goods," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 50(4), pages 677-693.
    14. Journal of Economics Library, 2016. "New Economics Books," Journal of Economics Library, KSP Journals, vol. 3(4), pages 664-711, December.
    15. Brañas-Garza, Pablo & Molis, Elena & Neyse, Levent, 2021. "Exposure to inequality may cause under-provision of public goods: Experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 92(C).
    16. Astrid Dannenberg & Corina Haita-Falah & Sonja Zitzelsberger, 2020. "Voting on the threat of exclusion in a public goods experiment," Experimental Economics, Springer;Economic Science Association, vol. 23(1), pages 84-109, March.
    17. Buckley, Edward & Croson, Rachel, 2006. "Income and wealth heterogeneity in the voluntary provision of linear public goods," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 935-955, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leib, Margarita & Köbis, Nils & Rilke, Rainer Michael & Hagens, Marloes & Irlenbusch, Bernd, 2023. "Corrupted by Algorithms? How AI-Generated and Human-Written Advice Shape (Dis)Honesty," IZA Discussion Papers 16293, Institute of Labor Economics (IZA).
    2. Edwin Zhang & Sadie Zhao & Tonghan Wang & Safwan Hossain & Henry Gasztowtt & Stephan Zheng & David C. Parkes & Milind Tambe & Yiling Chen, 2024. "Social Environment Design," Papers 2402.14090, arXiv.org.
    3. Jan Balaguer & Raphael Koster & Christopher Summerfield & Andrea Tacchetti, 2022. "The Good Shepherd: An Oracle Agent for Mechanism Design," Papers 2202.10135, arXiv.org.
    4. Yang, Nanyin & Palma, Marco & Drichoutis, Andreas C., 2023. "Humanization of Virtual Assistants and Delegation Choices," MPRA Paper 119275, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andreas Löschel & Dirk Rübbelke, 2014. "On the Voluntary Provision of International Public Goods," Economica, London School of Economics and Political Science, vol. 81(322), pages 195-204, April.
    2. Fangfang Tan, 2008. "Punishment in a Linear Public Good Game with Productivity Heterogeneity," De Economist, Springer, vol. 156(3), pages 269-293, September.
    3. De Geest, Lawrence R. & Kingsley, David C., 2021. "Norm enforcement with incomplete information," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 403-430.
    4. Khadjavi, Menusch & Lange, Andreas & Nicklisch, Andreas, 2014. "The Social Value of Transparency and Accountability: Experimental Evidence from Asymmetric Public Good Games," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100512, Verein für Socialpolitik / German Economic Association.
    5. Fabio D'Orlando, 2018. "Problems, solutions and new problems with the third wave of technological unemployment," Working Papers 2018-02, Universita' di Cassino, Dipartimento di Economia e Giurisprudenza.
    6. Marianna Baggio & Luigi Mittone, 2016. "Experience and History: An Experimental Approach to Generational Heterogeneity," International Journal of Applied Behavioral Economics (IJABE), IGI Global, vol. 5(4), pages 1-23, October.
    7. Vasiliki A. Basdekidou, 2017. "Green Entrepreneurship & Corporate Social Responsibility: Comparative and Correlative Performance Analysis," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 9(12), pages 1-12, December.
    8. Bista, Raghu, 2019. "The impact of micro finance and skill training intervention on single women's vulnerability in Nepal," MPRA Paper 100089, University Library of Munich, Germany, revised 10 Oct 2019.
    9. Gangadharan, Lata & Nikiforakis, Nikos & Villeval, Marie Claire, 2017. "Normative conflict and the limits of self-governance in heterogeneous populations," European Economic Review, Elsevier, vol. 100(C), pages 143-156.
    10. Lars Boerner & Daniel Quint, 2023. "Medieval Matching Markets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(1), pages 23-56, February.
    11. Bista, Raghu, 2020. "The Impact of Vulnerability and Income distribution on Inequality and Poverty: Analysis of Flood and landslides in Vulnerable Locations of Nepal," MPRA Paper 98935, University Library of Munich, Germany, revised 03 Dec 2020.
    12. Katharine L. Bradbury, 2020. "The Roles of State Aid and Local Conditions in Elementary School Test-Score Gaps," Working Papers 21-2, Federal Reserve Bank of Boston.
    13. Detlef F. Sprinz & Bruce Bueno de Mesquita & Steffen Kallbekken & Frans Stokman & Håkon Sælen & Robert Thomson, 2016. "Predicting Paris: Multi-Method Approaches to Forecast the Outcomes of Global Climate Negotiations," Politics and Governance, Cogitatio Press, vol. 4(3), pages 172-187.
    14. Bista, Raghu, 2019. "Groping climate vulnerability in western mountainous Nepal: applying climate vulnerability index," MPRA Paper 99047, University Library of Munich, Germany, revised 04 Jan 2019.
    15. Daniel A. Brent & Lata Gangadharan & Anca Mihut & Marie Claire Villeval, 2019. "Taxation, redistribution, and observability in social dilemmas," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 21(5), pages 826-846, October.
    16. Bista, Raghu, 2019. "Push and Pull Factors of Urbanization in Nepal: Its impacts on Household Perspectives," MPRA Paper 100624, University Library of Munich, Germany, revised 17 Jun 2019.
    17. Bista, Raghu Bir, 2018. "Determinants of flood disaster household’s vulnerability in Nepal," MPRA Paper 98856, University Library of Munich, Germany, revised 04 Mar 2018.
    18. Dempsey, Mark & McBride, Keegan & Bryson, Joanna J., 2021. "The Current State of AI Governance – An EU Perspective," SocArXiv xu3jr, Center for Open Science.
    19. Rutkowski Ireneusz P., 2022. "How to Measure the Success or Failure Rate of a New Product Strategy in Competitive Markets," Marketing of Scientific and Research Organizations, Sciendo, vol. 45(3), pages 27-44, October.
    20. Christopher J. Boudreaux & Niklas Elert & Magnus Henrekson & David S. Lucas, 2022. "Entrepreneurial accessibility, eudaimonic well-being, and inequality," Small Business Economics, Springer, vol. 59(3), pages 1061-1079, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:nathum:v:6:y:2022:i:10:d:10.1038_s41562-022-01383-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.