IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2201.11441.html
   My bibliography  Save this paper

Human-centered mechanism design with Democratic AI

Author

Listed:
  • Raphael Koster
  • Jan Balaguer
  • Andrea Tacchetti
  • Ari Weinstein
  • Tina Zhu
  • Oliver Hauser
  • Duncan Williams
  • Lucy Campbell-Gillingham
  • Phoebe Thacker
  • Matthew Botvinick
  • Christopher Summerfield

Abstract

Building artificial intelligence (AI) that aligns with human values is an unsolved problem. Here, we developed a human-in-the-loop research pipeline called Democratic AI, in which reinforcement learning is used to design a social mechanism that humans prefer by majority. A large group of humans played an online investment game that involved deciding whether to keep a monetary endowment or to share it with others for collective benefit. Shared revenue was returned to players under two different redistribution mechanisms, one designed by the AI and the other by humans. The AI discovered a mechanism that redressed initial wealth imbalance, sanctioned free riders, and successfully won the majority vote. By optimizing for human preferences, Democratic AI may be a promising method for value-aligned policy innovation.

Suggested Citation

  • Raphael Koster & Jan Balaguer & Andrea Tacchetti & Ari Weinstein & Tina Zhu & Oliver Hauser & Duncan Williams & Lucy Campbell-Gillingham & Phoebe Thacker & Matthew Botvinick & Christopher Summerfield, 2022. "Human-centered mechanism design with Democratic AI," Papers 2201.11441, arXiv.org.
    • Handle: RePEc:arx:papers:2201.11441
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2201.11441
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ernst Fehr & Ivo Schurtenberger, 2018. "Normative foundations of human cooperation," Nature Human Behaviour, Nature, vol. 2(7), pages 458-468, July.
    2. Julian Rauchdobler & Rupert Sausgruber & Jean-Robert Tyran, 2010. "Voting on Thresholds for Public Goods: Experimental Evidence," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 66(1), pages 34-64, March.
    3. Kathryn Tunyasuvunakool & Jonas Adler & Zachary Wu & Tim Green & Michal Zielinski & Augustin Žídek & Alex Bridgland & Andrew Cowie & Clemens Meyer & Agata Laydon & Sameer Velankar & Gerard J. Kleywegt, 2021. "Highly accurate protein structure prediction for the human proteome," Nature, Nature, vol. 596(7873), pages 590-596, August.
    4. Hurwicz,Leonid & Reiter,Stanley, 2008. "Designing Economic Mechanisms," Cambridge Books, Cambridge University Press, number 9780521724104, September.
    5. Piotr Dworczak & Scott Duke Kominers & Mohammad Akbarpour, 2021. "Redistribution Through Markets," Econometrica, Econometric Society, vol. 89(4), pages 1665-1698, July.
    6. Journal of Economics Library, 2016. "New Economics Books," Journal of Economics Library, KSP Journals, vol. 3(2), pages 362-410, June.
    7. Cherry, Todd L. & Kroll, Stephan & Shogren, Jason F., 2005. "The impact of endowment heterogeneity and origin on public good contributions: evidence from the lab," Journal of Economic Behavior & Organization, Elsevier, vol. 57(3), pages 357-365, July.
    8. Brañas-Garza, Pablo & Molis, Elena & Neyse, Levent, 2021. "Exposure to inequality may cause under-provision of public goods: Experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 92(C).
    9. repec:ksp:journ5:v:3:y:2016:i:1:p:150-198 is not listed on IDEAS
    10. Astrid Dannenberg & Corina Haita-Falah & Sonja Zitzelsberger, 2020. "Voting on the threat of exclusion in a public goods experiment," Experimental Economics, Springer;Economic Science Association, vol. 23(1), pages 84-109, March.
    11. Mark Isaac, R. & McCue, Kenneth F. & Plott, Charles R., 1985. "Public goods provision in an experimental environment," Journal of Public Economics, Elsevier, vol. 26(1), pages 51-74, February.
    12. Journal of Economics Library, 2016. "New Economics Books," Journal of Economics Library, KSP Journals, vol. 3(1), pages 165-213, March.
    13. R. J. Aumann & M. Kurz & A. Neyman, 1983. "Voting for Public Goods," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 50(4), pages 677-693.
    14. Josef Falkinger, 2000. "A Simple Mechanism for the Efficient Provision of Public Goods: Experimental Evidence," American Economic Review, American Economic Association, vol. 90(1), pages 247-264, March.
    15. Journal of Economics Library, 2016. "New Economics Books," Journal of Economics Library, KSP Journals, vol. 3(4), pages 664-711, December.
    16. John Jumper & Richard Evans & Alexander Pritzel & Tim Green & Michael Figurnov & Olaf Ronneberger & Kathryn Tunyasuvunakool & Russ Bates & Augustin Žídek & Anna Potapenko & Alex Bridgland & Clemens Me, 2021. "Highly accurate protein structure prediction with AlphaFold," Nature, Nature, vol. 596(7873), pages 583-589, August.
    17. Buckley, Edward & Croson, Rachel, 2006. "Income and wealth heterogeneity in the voluntary provision of linear public goods," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 935-955, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Coeckelbergh, Mark & Sætra, Henrik Skaug, 2023. "Climate change and the political pathways of AI: The technocracy-democracy dilemma in light of artificial intelligence and human agency," Technology in Society, Elsevier, vol. 75(C).
    2. Leib, Margarita & Köbis, Nils & Rilke, Rainer Michael & Hagens, Marloes & Irlenbusch, Bernd, 2023. "Corrupted by Algorithms? How AI-Generated and Human-Written Advice Shape (Dis)Honesty," IZA Discussion Papers 16293, Institute of Labor Economics (IZA).
    3. Kshama Dwarakanath & Svitlana Vyetrenko & Tucker Balch, 2024. "Empirical Equilibria in Agent-based Economic systems with Learning agents," Papers 2408.12038, arXiv.org.
    4. Jan Balaguer & Raphael Koster & Christopher Summerfield & Andrea Tacchetti, 2022. "The Good Shepherd: An Oracle Agent for Mechanism Design," Papers 2202.10135, arXiv.org.
    5. Sætra, Henrik Skaug, 2023. "Generative AI: Here to stay, but for good?," Technology in Society, Elsevier, vol. 75(C).
    6. Edwin Zhang & Sadie Zhao & Tonghan Wang & Safwan Hossain & Henry Gasztowtt & Stephan Zheng & David C. Parkes & Milind Tambe & Yiling Chen, 2024. "Social Environment Design," Papers 2402.14090, arXiv.org, revised Jun 2024.
    7. Yang, Nanyin & Palma, Marco & Drichoutis, Andreas C., 2023. "Humanization of Virtual Assistants and Delegation Choices," MPRA Paper 119275, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andreas Löschel & Dirk Rübbelke, 2014. "On the Voluntary Provision of International Public Goods," Economica, London School of Economics and Political Science, vol. 81(322), pages 195-204, April.
    2. Fangfang Tan, 2008. "Punishment in a Linear Public Good Game with Productivity Heterogeneity," De Economist, Springer, vol. 156(3), pages 269-293, September.
    3. De Geest, Lawrence R. & Kingsley, David C., 2021. "Norm enforcement with incomplete information," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 403-430.
    4. Edina Berlinger & Katalin Dobránszky-Bartus & György Molnár, 2021. "Overdue Debts and Financial Exclusion," Risks, MDPI, vol. 9(9), pages 1-20, August.
    5. Khadjavi, Menusch & Lange, Andreas & Nicklisch, Andreas, 2014. "The Social Value of Transparency and Accountability: Experimental Evidence from Asymmetric Public Good Games," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100512, Verein für Socialpolitik / German Economic Association.
    6. Gangadharan, Lata & Nikiforakis, Nikos & Villeval, Marie Claire, 2015. "Equality Concerns and the Limits of Self-Governance in Heterogeneous Populations," IZA Discussion Papers 9384, Institute of Labor Economics (IZA).
    7. Fabio D'Orlando, 2018. "Problems, solutions and new problems with the third wave of technological unemployment," Working Papers 2018-02, Universita' di Cassino, Dipartimento di Economia e Giurisprudenza.
    8. Mustard, David B, 2001. "Racial, Ethnic, and Gender Disparities in Sentencing: Evidence from the U.S. Federal Courts," Journal of Law and Economics, University of Chicago Press, vol. 44(1), pages 285-314, April.
    9. Marianna Baggio & Luigi Mittone, 2016. "Experience and History: An Experimental Approach to Generational Heterogeneity," International Journal of Applied Behavioral Economics (IJABE), IGI Global, vol. 5(4), pages 1-23, October.
    10. Vasiliki A. Basdekidou, 2017. "Green Entrepreneurship & Corporate Social Responsibility: Comparative and Correlative Performance Analysis," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 9(12), pages 1-12, December.
    11. Bista, Raghu, 2019. "The impact of micro finance and skill training intervention on single women's vulnerability in Nepal," MPRA Paper 100089, University Library of Munich, Germany, revised 10 Oct 2019.
    12. Gangadharan, Lata & Nikiforakis, Nikos & Villeval, Marie Claire, 2017. "Normative conflict and the limits of self-governance in heterogeneous populations," European Economic Review, Elsevier, vol. 100(C), pages 143-156.
    13. Ross Gittell & Josh Stillwagon, 2016. "The Effects of US State-Level Energy and Environmental Policies on Clean Tech Innovation and Employment," Journal of Management and Sustainability, Canadian Center of Science and Education, vol. 6(2), pages 1-20, June.
    14. Lars Boerner & Daniel Quint, 2023. "Medieval Matching Markets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(1), pages 23-56, February.
    15. Bista, Raghu, 2020. "The Impact of Vulnerability and Income distribution on Inequality and Poverty: Analysis of Flood and landslides in Vulnerable Locations of Nepal," MPRA Paper 98935, University Library of Munich, Germany, revised 03 Dec 2020.
    16. Katharine L. Bradbury, 2020. "The Roles of State Aid and Local Conditions in Elementary School Test-Score Gaps," Working Papers 21-2, Federal Reserve Bank of Boston.
    17. Bista, Raghu, 2019. "Future Connectivity Chinese One Belt, One Road: Prospects and Implications to Nepal," MPRA Paper 100068, University Library of Munich, Germany, revised 05 Dec 2019.
    18. Detlef F. Sprinz & Bruce Bueno de Mesquita & Steffen Kallbekken & Frans Stokman & Håkon Sælen & Robert Thomson, 2016. "Predicting Paris: Multi-Method Approaches to Forecast the Outcomes of Global Climate Negotiations," Politics and Governance, Cogitatio Press, vol. 4(3), pages 172-187.
    19. Steven G. Medema, 2010. "Chicago Law and Economics," Chapters, in: Ross B. Emmett (ed.), The Elgar Companion to the Chicago School of Economics, chapter 11, Edward Elgar Publishing.
    20. Bista, Raghu, 2019. "Groping climate vulnerability in western mountainous Nepal: applying climate vulnerability index," MPRA Paper 99047, University Library of Munich, Germany, revised 04 Jan 2019.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2201.11441. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.