IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/129505.html

Is AI Becoming More Human? Evidence from LLMs and the Ultimatum Game

Author

Listed:
  • Gu, Gyun Cheol

Abstract

We replicate and extend the ultimatum game experiment of Araujo and Uhlig (2026) to five consumer-facing large language models (LLMs)—ChatGPT, Claude, Copilot, Gemini Flash, and Gemini Pro—across four scenario types (HH,HA, AH, AA), four stake levels ($10 to $10,000), and ten repetitions per configuration, yielding 6,832 proposer and 8,532 responder observations. Four findings emerge. First, all five models propose shares in the 30–47% range, squarely within the human empirical benchmark and absent the extreme behavioral modes documented in earlier research-grade models, suggesting that alignment training has compressed the behavioral distribution toward human norms. Second, every model exhibits twosided sensitivity to human presence: proposed shares rise when the Responder is human (+4 to +25 p.p.) and minimum acceptable thresholds rise when acting on behalf of a human (+11 to +26 p.p.), a pattern that survives even when no human principal is being served and is inconsistent with simple principal–agent alignment. Third, all five models forgo 25–63% of feasible payoff, confirming that consumer LLMs are not payoff-maximizing agents. Fourth, responder thresholds decline significantly with stake size across all models— consistent with rational expected-utility behavior—while proposer stake sensitivity is heterogeneous. We interpret these patterns as evidence of identity internalization: successive rounds of reinforcement learning with human feedback cause models to behave as if they are human rather than merely as if they prefer human-like outcomes.

Suggested Citation

  • Gu, Gyun Cheol, 2026. "Is AI Becoming More Human? Evidence from LLMs and the Ultimatum Game," MPRA Paper 129505, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:129505
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/129505/1/MPRA_paper_129505.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joseph Henrich, 2001. "In Search of Homo Economicus: Behavioral Experiments in 15 Small-Scale Societies," American Economic Review, American Economic Association, vol. 91(2), pages 73-78, May.
    2. Cochard, François & Le Gallo, Julie & Georgantzis, Nikolaos & Tisserand, Jean-Christian, 2021. "Social preferences across different populations: Meta-analyses on the ultimatum game and dictator game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    3. Steffen Andersen & Seda Ertac & Uri Gneezy & Moshe Hoffman & John A. List, 2011. "Stakes Matter in Ultimatum Games," American Economic Review, American Economic Association, vol. 101(7), pages 3427-3439, December.
    4. Douglas K.G. Araujo & Harald Uhlig, 2026. "How does AI distribute the pie? Large Language Models and the Ultimatum Game," Working Papers 2026-29, Becker Friedman Institute for Research In Economics.
    5. Hoffman, Elizabeth & McCabe, Kevin & Smith, Vernon L, 1996. "Social Distance and Other-Regarding Behavior in Dictator Games," American Economic Review, American Economic Association, vol. 86(3), pages 653-660, June.
    6. Robert Slonim & Alvin E. Roth, 1998. "Learning in High Stakes Ultimatum Games: An Experiment in the Slovak Republic," Econometrica, Econometric Society, vol. 66(3), pages 569-596, May.
    7. Ayato Kitadai & Sinndy Dayana Rico Lugo & Yudai Tsurusaki & Yusuke Fukasawa & Nariaki Nishino, 2024. "Can AI with High Reasoning Ability Replicate Human-like Decision Making in Economic Experiments?," Papers 2406.11426, arXiv.org.
    8. repec:feb:framed:0088 is not listed on IDEAS
    9. Bolton Gary E. & Zwick Rami, 1995. "Anonymity versus Punishment in Ultimatum Bargaining," Games and Economic Behavior, Elsevier, vol. 10(1), pages 95-121, July.
    10. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    11. Douglas KG. Araujo & Harald Uhlig, 2026. "How does AI Distribute the pie? Large Language Models and the Ultimatum Game," NBER Working Papers 34919, National Bureau of Economic Research, Inc.
    12. Cameron, Lisa A, 1999. "Raising the Stakes in the Ultimatum Game: Experimental Evidence from Indonesia," Economic Inquiry, Western Economic Association International, vol. 37(1), pages 47-59, January.
    13. Hessel Oosterbeek & Randolph Sloof & Gijs van de Kuilen, 2004. "Cultural Differences in Ultimatum Game Experiments: Evidence from a Meta-Analysis," Experimental Economics, Springer;Economic Science Association, vol. 7(2), pages 171-188, June.
    14. William Robert Nelson, 2001. "Incorporating Fairness into Game Theory and Economics: Comment," American Economic Review, American Economic Association, vol. 91(4), pages 1180-1183, September.
    15. Guth, Werner & Schmittberger, Rolf & Schwarze, Bernd, 1982. "An experimental analysis of ultimatum bargaining," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 367-388, December.
    16. Rabin, Matthew, 1993. "Incorporating Fairness into Game Theory and Economics," American Economic Review, American Economic Association, vol. 83(5), pages 1281-1302, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emin Karagözoğlu & Ümit Barış Urhan, 2017. "The Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey," Group Decision and Negotiation, Springer, vol. 26(2), pages 285-325, March.
    2. Murnighan, J. Keith & Wang, Long, 2016. "The social world as an experimental game," Organizational Behavior and Human Decision Processes, Elsevier, vol. 136(C), pages 80-94.
    3. Camerer, Colin F. & Ho, Teck-Hua, 2015. "Behavioral Game Theory Experiments and Modeling," Handbook of Game Theory with Economic Applications,, Elsevier.
    4. Barmettler, Franziska & Fehr, Ernst & Zehnder, Christian, 2012. "Big experimenter is watching you! Anonymity and prosocial behavior in the laboratory," Games and Economic Behavior, Elsevier, vol. 75(1), pages 17-34.
    5. Aina, Chiara & Battigalli, Pierpaolo & Gamba, Astrid, 2020. "Frustration and anger in the Ultimatum Game: An experiment," Games and Economic Behavior, Elsevier, vol. 122(C), pages 150-167.
    6. Aleksanyan, L.H. & Allahverdyan, A.E. & Bardakhchyan, V.G., 2025. "Ultimatum game: Regret or fairness?," Journal of Economic Behavior & Organization, Elsevier, vol. 233(C).
    7. Tobias Hahn & Noël Albert, 2017. "Strong Reciprocity in Consumer Boycotts," Journal of Business Ethics, Springer, vol. 145(3), pages 509-524, October.
    8. Heike Hennig-Schmidt & Zhuyu Li & Gari Walkowitz, 2024. "Fairness Deliberations and Fair Allocations in Symmetric and Asymmetric Bargaining–An Experimental Study on Group Decisions in Germany and China," Group Decision and Negotiation, Springer, vol. 33(6), pages 1429-1469, December.
    9. Damon Tomlin, 2015. "Rational Constraints and the Evolution of Fairness in the Ultimatum Game," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-17, July.
    10. Burnham, Terence C., 2013. "Toward a neo-Darwinian synthesis of neoclassical and behavioral economics," Journal of Economic Behavior & Organization, Elsevier, vol. 90(S), pages 113-127.
    11. Gagen, Michael, 2013. "Isomorphic Strategy Spaces in Game Theory," MPRA Paper 46176, University Library of Munich, Germany.
    12. Akdeniz, Aslıhan & van Veelen, Matthijs, 2023. "Evolution and the ultimatum game," Games and Economic Behavior, Elsevier, vol. 142(C), pages 570-612.
    13. David Cooper & E. Dutcher, 2011. "The dynamics of responder behavior in ultimatum games: a meta-study," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 519-546, November.
    14. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    15. Larney, Andrea & Rotella, Amanda & Barclay, Pat, 2019. "Stake size effects in ultimatum game and dictator game offers: A meta-analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 61-72.
    16. Güth, Werner & Kocher, Martin G., 2014. "More than thirty years of ultimatum bargaining experiments: Motives, variations, and a survey of the recent literature," Journal of Economic Behavior & Organization, Elsevier, vol. 108(C), pages 396-409.
    17. Cochard, François & Le Gallo, Julie & Georgantzis, Nikolaos & Tisserand, Jean-Christian, 2021. "Social preferences across different populations: Meta-analyses on the ultimatum game and dictator game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    18. Jeannette Brosig-Koch & Thomas Riechmann & Joachim Weimann, 2017. "The dynamics of behavior in modified dictator games," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-18, April.
    19. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    20. Fehr, Ernst & Schmidt, Klaus M., 2005. "The Economics of Fairness, Reciprocity and Altruism – Experimental Evidence and New Theories," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 66, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C70 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - General
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:129505. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.