IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-38592-5.html
   My bibliography  Save this article

Trust within human-machine collectives depends on the perceived consensus about cooperative norms

Author

Listed:
  • Kinga Makovi

    (New York University Abu Dhabi)

  • Anahit Sargsyan

    (Technical University of Munich)

  • Wendi Li

    (New York University Abu Dhabi)

  • Jean-François Bonnefon

    (Toulouse School of Economics and Quantitative Social Sciences, CNRS (TSM-R))

  • Talal Rahwan

    (New York University Abu Dhabi)

Abstract

With the progress of artificial intelligence and the emergence of global online communities, humans and machines are increasingly participating in mixed collectives in which they can help or hinder each other. Human societies have had thousands of years to consolidate the social norms that promote cooperation; but mixed collectives often struggle to articulate the norms which hold when humans coexist with machines. In five studies involving 7917 individuals, we document the way people treat machines differently than humans in a stylized society of beneficiaries, helpers, punishers, and trustors. We show that a different amount of trust is gained by helpers and punishers when they follow norms over not doing so. We also demonstrate that the trust-gain of norm-followers is associated with trustors’ assessment about the consensual nature of cooperative norms over helping and punishing. Lastly, we establish that, under certain conditions, informing trustors about the norm-consensus over helping tends to decrease the differential treatment of both machines and people interacting with them. These results allow us to anticipate how humans may develop cooperative norms for human-machine collectives, specifically, by relying on already extant norms in human-only groups. We also demonstrate that this evolution may be accelerated by making people aware of their emerging consensus.

Suggested Citation

  • Kinga Makovi & Anahit Sargsyan & Wendi Li & Jean-François Bonnefon & Talal Rahwan, 2023. "Trust within human-machine collectives depends on the perceived consensus about cooperative norms," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-38592-5
    DOI: 10.1038/s41467-023-38592-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-38592-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-38592-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Eriksson, Kimmo & Strimling, Pontus & Andersson, Per A. & Aveyard, Mark & Brauer, Markus & Gritskov, Vladimir & Kiyonari, Toko & Kuhlman, David M. & Maitner, Angela T. & Manesi, Zoi & Molho, Catherine, 2017. "Cultural Universals and Cultural Differences in Meta-Norms about Peer Punishment," Management and Organization Review, Cambridge University Press, vol. 13(4), pages 851-870, December.
    2. Jon M. Jachimowicz & Oliver P. Hauser & Julia D. O’Brien & Erin Sherman & Adam D. Galinsky, 2018. "The critical role of second-order normative beliefs in predicting energy conservation," Nature Human Behaviour, Nature, vol. 2(10), pages 757-764, October.
    3. Henrich, Joseph, 2004. "Cultural group selection, coevolutionary processes and large-scale cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 53(1), pages 3-35, January.
    4. Cristina Bicchieri & Eugen Dimant, 2022. "Nudging with care: the risks and benefits of social information," Public Choice, Springer, vol. 191(3), pages 443-464, June.
    5. Allan Dafoe & Yoram Bachrach & Gillian Hadfield & Eric Horvitz & Kate Larson & Thore Graepel, 2021. "Cooperative AI: machines must learn to find common ground," Nature, Nature, vol. 593(7857), pages 33-36, May.
    6. Sohad Murrar & Mitchell R. Campbell & Markus Brauer, 2020. "Exposure to peers’ pro-diversity attitudes increases inclusion and reduces the achievement gap," Nature Human Behaviour, Nature, vol. 4(9), pages 889-897, September.
    7. Ernst Fehr & Ivo Schurtenberger, 2018. "Normative foundations of human cooperation," Nature Human Behaviour, Nature, vol. 2(7), pages 458-468, July.
    8. Daniel Houser & Robert Kurzban, 2002. "Revisiting Kindness and Confusion in Public Goods Experiments," American Economic Review, American Economic Association, vol. 92(4), pages 1062-1069, September.
    9. Edmond Awad & Sohan Dsouza & Richard Kim & Jonathan Schulz & Joseph Henrich & Azim Shariff & Jean-François Bonnefon & Iyad Rahwan, 2018. "The Moral Machine experiment," Nature, Nature, vol. 563(7729), pages 59-64, November.
    10. Erin L. Krupka & Roberto A. Weber, 2013. "Identifying Social Norms Using Coordination Games: Why Does Dictator Game Sharing Vary?," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 495-524, June.
    11. Delia Baldassarri, 2020. "Market integration accounts for local variation in generalized altruism in a nationwide lost-letter experiment," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(6), pages 2858-2863, February.
    12. Jillian J. Jordan & Moshe Hoffman & Paul Bloom & David G. Rand, 2016. "Third-party punishment as a costly signal of trustworthiness," Nature, Nature, vol. 530(7591), pages 473-476, February.
    13. Jean-François Bonnefon & Fatimah Ishowo-Oloko & Zakariyah Soroye & Jacob W. Crandall & Iyad Rahwan & Tahal Rahwan, 2019. "Behavioural evidence for a transparency-efficiency tradeoff in human-machine cooperation," Post-Print hal-04121730, HAL.
    14. Hirokazu Shirado & Nicholas A. Christakis, 2017. "Locally noisy autonomous agents improve global human coordination in network experiments," Nature, Nature, vol. 545(7654), pages 370-374, May.
    15. Chengcheng Shao & Giovanni Luca Ciampaglia & Onur Varol & Kai-Cheng Yang & Alessandro Flammini & Filippo Menczer, 2018. "The spread of low-credibility content by social bots," Nature Communications, Nature, vol. 9(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hensel, Lukas & Witte, Marc & Caria, A. Stefano & Fetzer, Thiemo & Fiorin, Stefano & Götz, Friedrich M. & Gomez, Margarita & Haushofer, Johannes & Ivchenko, Andriy & Kraft-Todd, Gordon & Reutskaja, El, 2022. "Global Behaviors, Perceptions, and the Emergence of Social Norms at the Onset of the COVID-19 Pandemic," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 473-496.
    2. Bicchieri, Cristina & Dimant, Eugen & Gächter, Simon & Nosenzo, Daniele, 2022. "Social proximity and the erosion of norm compliance," Games and Economic Behavior, Elsevier, vol. 132(C), pages 59-72.
    3. Kandul, Serhiy & Lanz, Bruno, 2021. "Public good provision, in-group cooperation and out-group descriptive norms: A lab experiment," Journal of Economic Psychology, Elsevier, vol. 85(C).
    4. Eugen Dimant & Tobias Gesche, 2021. "Nudging Enforcers: How Norm Perceptions and Motives for Lying Shape Sanctions," CESifo Working Paper Series 9385, CESifo.
    5. Eugen Dimant & Michele Gelfand & Anna Hochleitner & Silvia Sonderegger, 2022. "Strategic Behavior with Tight, Loose and Polarized Norms," ECONtribute Discussion Papers Series 198, University of Bonn and University of Cologne, Germany.
    6. Kölle, Felix & Quercia, Simone, 2021. "The influence of empirical and normative expectations on cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 691-703.
    7. Eugen Dimant & Michele Gelfand & Anna Hochleitner & Silvia Sonderegger, 2023. "Strategic Behavior with Tight, Loose and Polarized Norms," CESifo Working Paper Series 10233, CESifo.
    8. Pietro Guarnieri & Lorenzo Spadoni, 2024. "Norms and anti-coordination: elicitation and priming in an El Farol Bar Game experiment," Discussion Papers 2024/303, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.
    9. Cristina Bicchieri & Eugen Dimant & Simon Gächter & Daniele Nosenzo, 2020. "Observability, Social Proximity, and the Erosion of Norm Compliance," ECONtribute Discussion Papers Series 009, University of Bonn and University of Cologne, Germany.
    10. Gavrilets, Sergey & Tverskoi, Denis & Sánchez, Angel, 2023. "Modeling social norms: an integration of the norm-utility approach with beliefs dynamics," SocArXiv n934a, Center for Open Science.
    11. Cristina Bicchieri & Eugen Dimant & Silvia Sonderegger, 2020. "It's Not a Lie If You Believe the Norm Does Not Apply: Conditional Norm-Following with Strategic Beliefs," CESifo Working Paper Series 8059, CESifo.
    12. Maxwell N. Burton-Chellew & Victoire D’Amico & Claire Guérin, 2022. "The Strategy Method Risks Conflating Confusion with a Social Preference for Conditional Cooperation in Public Goods Games," Games, MDPI, vol. 13(6), pages 1-10, October.
    13. Gary Bolton & Eugen Dimant & Ulrich Schmidt, 2018. "When a Nudge Backfires. Using Observation with Social and Economic Incentives to Promote Pro-Social Behavior," PPE Working Papers 0017, Philosophy, Politics and Economics, University of Pennsylvania.
    14. De Geest, Lawrence R. & Kingsley, David C., 2021. "Norm enforcement with incomplete information," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 403-430.
    15. Martínez Villarreal, Déborah & Díaz, Lina M. & Maldonado, Stanislao, 2023. "Nudging the Trendsetters: Increasing Second-dose HPV Vaccination in Bogota, Colombia," IDB Publications (Working Papers) 13312, Inter-American Development Bank.
    16. Francesco Fallucchi & Daniele Nosenzo, 2022. "The coordinating power of social norms," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 1-25, February.
    17. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    18. Bartoš, Vojtěch, 2021. "Seasonal scarcity and sharing norms," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 303-316.
    19. Bicchieri, Cristina & Dimant, Eugen & Xiao, Erte, 2021. "Deviant or wrong? The effects of norm information on the efficacy of punishment," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 209-235.
    20. Denis Tverskoi & Andrea Guido & Giulia Andrighetto & Angel Sánchez & Sergey Gavrilets, 2023. "Disentangling material, social, and cognitive determinants of human behavior and beliefs," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-13, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-38592-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.