IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2305.12763.html
   My bibliography  Save this paper

The Emergence of Economic Rationality of GPT

Author

Listed:
  • Yiting Chen
  • Tracy Xiao Liu
  • You Shan
  • Songfa Zhong

Abstract

As large language models (LLMs) like GPT become increasingly prevalent, it is essential that we assess their capabilities beyond language processing. This paper examines the economic rationality of GPT by instructing it to make budgetary decisions in four domains: risk, time, social, and food preferences. We measure economic rationality by assessing the consistency of GPT's decisions with utility maximization in classic revealed preference theory. We find that GPT's decisions are largely rational in each domain and demonstrate higher rationality score than those of human subjects in a parallel experiment and in the literature. Moreover, the estimated preference parameters of GPT are slightly different from human subjects and exhibit a lower degree of heterogeneity. We also find that the rationality scores are robust to the degree of randomness and demographic settings such as age and gender, but are sensitive to contexts based on the language frames of the choice situations. These results suggest the potential of LLMs to make good decisions and the need to further understand their capabilities, limitations, and underlying mechanisms.

Suggested Citation

  • Yiting Chen & Tracy Xiao Liu & You Shan & Songfa Zhong, 2023. "The Emergence of Economic Rationality of GPT," Papers 2305.12763, arXiv.org, revised Nov 2023.
  • Handle: RePEc:arx:papers:2305.12763
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2305.12763
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    2. Echenique, Federico & Imai, Taisuke & Saito, Kota, 2023. "Approximate Expected Utility Rationalization," Department of Economics, Working Paper Series qt8pt4287c, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    3. Kosinski, Michal, 2023. "Theory of Mind May Have Spontaneously Emerged in Large Language Models," Research Papers 4086, Stanford University, Graduate School of Business.
    4. Alex Davies & Petar Veličković & Lars Buesing & Sam Blackwell & Daniel Zheng & Nenad Tomašev & Richard Tanburn & Peter Battaglia & Charles Blundell & András Juhász & Marc Lackenby & Geordie Williamson, 2021. "Advancing mathematics by guiding human intuition with AI," Nature, Nature, vol. 600(7887), pages 70-74, December.
    5. Kagel, John H, et al, 1975. "Experimental Studies of Consumer Demand Behavior Using Laboratory Animals," Economic Inquiry, Western Economic Association International, vol. 13(1), pages 22-38, March.
    6. Fisman, Raymond & Jakiela, Pamela & Kariv, Shachar, 2017. "Distributional preferences and political behavior," Journal of Public Economics, Elsevier, vol. 155(C), pages 1-10.
    7. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    8. M. Keith Chen & Venkat Lakshminarayanan & Laurie R. Santos, 2006. "How Basic Are Behavioral Biases? Evidence from Capuchin Monkey Trading Behavior," Journal of Political Economy, University of Chicago Press, vol. 114(3), pages 517-537, June.
    9. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    10. Keshav Agrawal & Susan Athey & Ayush Kanodia & Emil Palikot, 2022. "Personalized Recommendations in EdTech: Evidence from a Randomized Controlled Trial," Papers 2208.13940, arXiv.org, revised Dec 2022.
    11. James Andreoni & John Miller, 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism," Econometrica, Econometric Society, vol. 70(2), pages 737-753, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nunzio Lor`e & Babak Heydari, 2023. "Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framing," Papers 2309.05898, arXiv.org.
    2. Jiafu An & Difang Huang & Chen Lin & Mingzhu Tai, 2024. "Measuring Gender and Racial Biases in Large Language Models," Papers 2403.15281, arXiv.org.
    3. Christoph Engel & Max R. P. Grossmann & Axel Ockenfels, 2023. "Integrating machine behavior into human subject experiments: A user-friendly toolkit and illustrations," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2024_01, Max Planck Institute for Research on Collective Goods.
    4. Bauer, Kevin & Liebich, Lena & Hinz, Oliver & Kosfeld, Michael, 2023. "Decoding GPT's hidden "rationality" of cooperation," SAFE Working Paper Series 401, Leibniz Institute for Financial Research SAFE.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Allen, Roy & Dziewulski, Paweł & Rehbeck, John, 2022. "Making sense of monkey business: Re-examining tests of animal rationality," Journal of Economic Behavior & Organization, Elsevier, vol. 196(C), pages 220-228.
    2. Roy Allen & Pawel Dziewulski & John Rehbeck, 2019. "Revealed statistical consumer theory," Working Paper Series 1119, Department of Economics, University of Sussex Business School.
    3. Gary Charness & Brian Jabarian & John List, 2023. "Generation Next: Experimentation with AI," Artefactual Field Experiments 00777, The Field Experiments Website.
    4. Bauer, Kevin & Liebich, Lena & Hinz, Oliver & Kosfeld, Michael, 2023. "Decoding GPT's hidden "rationality" of cooperation," SAFE Working Paper Series 401, Leibniz Institute for Financial Research SAFE.
    5. Roy Allen & Paweł Dziewulski & John Rehbeck, 2024. "Revealed statistical consumer theory," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 77(3), pages 823-847, May.
    6. Adrian Bruhin & Ernst Fehr & Daniel Schunk, 2019. "The many Faces of Human Sociality: Uncovering the Distribution and Stability of Social Preferences," Journal of the European Economic Association, European Economic Association, vol. 17(4), pages 1025-1069.
    7. Gauriot, Romain & Heger, Stephanie A. & Slonim, Robert, 2020. "Altruism or diminishing marginal utility?," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 24-48.
    8. Kevin Leyton-Brown & Paul Milgrom & Neil Newman & Ilya Segal, 2023. "Artificial Intelligence and Market Design: Lessons Learned from Radio Spectrum Reallocation," NBER Chapters, in: New Directions in Market Design, National Bureau of Economic Research, Inc.
    9. Kerschbamer, Rudolf & Müller, Daniel, 2020. "Social preferences and political attitudes: An online experiment on a large heterogeneous sample," Journal of Public Economics, Elsevier, vol. 182(C).
    10. Aluma Dembo & Shachar Kariv & Matthew Polisson & John Quah, 2021. "Ever since Allais," IFS Working Papers W21/15, Institute for Fiscal Studies.
    11. Müller, Daniel, 2019. "The anatomy of distributional preferences with group identity," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 785-807.
    12. Aleksander Rubinstein, 2013. "The theory of patronized goods in the optics of comparative methodology," International Journal of Entrepreneurial Knowledge, Center for International Scientific Research of VSO and VSPP, vol. 1(1), pages 4-32, December.
    13. Рубинштейн Александр Яковлевич, "undated". "Методологический Анализ Теории Опекаемых Благ: Научный Доклад [methodological analysis of the Theory of Patronized Goods. Research report]," Working papers a:pru175:ye:2014:1, Institute of Economics.
    14. Uttara Balakrishnan & Johannes Haushofer & Pamela Jakiela, 2020. "How soon is now? Evidence of present bias from convex time budget experiments," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 294-321, June.
    15. Zengqing Wu & Run Peng & Xu Han & Shuyuan Zheng & Yixin Zhang & Chuan Xiao, 2023. "Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulations," Papers 2311.06330, arXiv.org, revised Dec 2023.
    16. Bogliacino, Francesco & Codagnone, Cristiano, 2021. "Microfoundations, behaviour, and evolution: Evidence from experiments," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 372-385.
    17. Fehr, Ernst & Epper, Thomas & Senn, Julien, 2022. "Other-Regarding Preferences and Redistributive Politics," IZA Discussion Papers 15088, Institute of Labor Economics (IZA).
    18. Joshua C. Yang & Marcin Korecki & Damian Dailisan & Carina I. Hausladen & Dirk Helbing, 2024. "LLM Voting: Human Choices and AI Collective Decision Making," Papers 2402.01766, arXiv.org.
    19. Nir Chemaya & Daniel Martin, 2023. "Perceptions and Detection of AI Use in Manuscript Preparation for Academic Journals," Papers 2311.14720, arXiv.org, revised Jan 2024.
    20. Fehr Ernst & Epper Thomas & Senn Julien, 2020. "Social preferences and redistributive politics," ECON - Working Papers 339, Department of Economics - University of Zurich, revised Aug 2023.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2305.12763. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.