IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/102439.html

What Do LLMs Want?

Author

Abstract

Large language models (LLMs) are now used for economic reasoning, but their implicit "preferences" are poorly understood. We study these preferences by analyzing revealed choices in canonical allocation games and a sequential job-search environment. In dictator-style allocation games, most models favor equal splits, consistent with inequality aversion. Structural estimation of Fehr-Schmidt parameters suggests this aversion exceeds levels typically observed in human experiments. However, LLM preferences prove malleable. Interventions such as prompt framing (e.g., masking social context) and control vectors reliably shift models toward more payoff-maximizing behavior, while persona-based prompting has more limited impact. We then extend our analysis to a sequential decision-making environment based on the McCall job search model. Here, we recover implied discount factors from accept/reject behavior, but find that responses are less consistently rationalizable and preferences more fragile. Our findings highlight two core insights: (i) LLMs exhibit structured, latent preferences that often align with human behavioral norms, and (ii) these preferences can be steered, albeit more effectively in simple settings than in complex, dynamic ones.

Suggested Citation

  • Thomas R. Cook & Sophia Kazinnik & Zach Modig & Nathan M. Palmer, 2026. "What Do LLMs Want?," Finance and Economics Discussion Series 2026-006, Board of Governors of the Federal Reserve System (U.S.).
  • Handle: RePEc:fip:fedgfe:102439
    DOI: 10.17016/FEDS.2026.006
    as

    Download full text from publisher

    File URL: https://www.federalreserve.gov/econres/feds/files/2026006pap.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://libkey.io/10.17016/FEDS.2026.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yiting Chen & Tracy Xiao Liu & You Shan & Songfa Zhong, 2023. "The emergence of economic rationality of GPT," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 120(51), pages 2316205120-, December.
    2. Kinder, Donald R. & Kiewiet, D. Roderick, 1981. "Sociotropic Politics: The American Case," British Journal of Political Science, Cambridge University Press, vol. 11(2), pages 129-161, April.
    3. Bruno S. Frey & Iris Bohnet, 1999. "Social Distance and Other-Regarding Behavior in Dictator Games: Comment," American Economic Review, American Economic Association, vol. 89(1), pages 335-339, March.
    4. Christoph Engel, 2011. "Dictator games: a meta study," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 583-610, November.
    5. Jingru Jia & Zehua Yuan & Junhao Pan & Paul E. McNamara & Deming Chen, 2024. "Decision-Making Behavior Evaluation Framework for LLMs under Uncertain Context," Papers 2406.05972, arXiv.org, revised Oct 2024.
    6. Thomas R. Cook & Sophia Kazinnik & Anne Lundgaard Hansen & Peter McAdam, 2023. "Evaluating Local Language Models: An Application to Bank Earnings Calls," Research Working Paper RWP 23-12, Federal Reserve Bank of Kansas City.
    7. Gode, Dhananjay K & Sunder, Shyam, 1993. "Allocative Efficiency of Markets with Zero-Intelligence Traders: Market as a Partial Substitute for Individual Rationality," Journal of Political Economy, University of Chicago Press, vol. 101(1), pages 119-137, February.
    8. Gary Charness & Matthew Rabin, 2002. "Understanding Social Preferences with Simple Tests," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 817-869.
    9. Yuzhi Hao & Danyang Xie, 2025. "A Multi-LLM-Agent-Based Framework for Economic and Public Policy Analysis," Papers 2502.16879, arXiv.org.
    10. Argyle, Lisa P. & Busby, Ethan C. & Fulda, Nancy & Gubler, Joshua R. & Rytting, Christopher & Wingate, David, 2023. "Out of One, Many: Using Language Models to Simulate Human Samples," Political Analysis, Cambridge University Press, vol. 31(3), pages 337-351, July.
    11. J. J. McCall, 1970. "Economics of Information and Job Search," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 84(1), pages 113-126.
    12. Nick Huntington-Klein & Eleanor J. Murray, 2024. "Do LLMs Act as Repositories of Causal Knowledge?," Papers 2412.10635, arXiv.org.
    13. Fulin Guo, 2023. "GPT in Game Theory Experiments," Papers 2305.05516, arXiv.org, revised Dec 2023.
    14. Thomas R. Cook & Sophia Kazinnik, 2025. "Social Group Bias in AI Finance," Papers 2506.17490, arXiv.org.
    15. Forsythe Robert & Horowitz Joel L. & Savin N. E. & Sefton Martin, 1994. "Fairness in Simple Bargaining Experiments," Games and Economic Behavior, Elsevier, vol. 6(3), pages 347-369, May.
    16. Hoffman, Elizabeth & McCabe, Kevin & Smith, Vernon L, 1996. "Social Distance and Other-Regarding Behavior in Dictator Games," American Economic Review, American Economic Association, vol. 86(3), pages 653-660, June.
    17. Jiafu An & Difang Huang & Chen Lin & Mingzhu Tai, 2024. "Measuring Gender and Racial Biases in Large Language Models," Papers 2403.15281, arXiv.org.
    18. Charness, Gary & Gneezy, Uri, 2008. "What's in a name? Anonymity and social distance in dictator and ultimatum games," Journal of Economic Behavior & Organization, Elsevier, vol. 68(1), pages 29-35, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexander Morell, 2014. "The Short Arm of Guilt: Guilt Aversion Plays Out More Across a Short Social Distance," Discussion Paper Series of the Max Planck Institute for Behavioral Economics 2014_19, Max Planck Institute for Behavioral Economics, revised Dec 2016.
    2. Robson, Matthew, 2021. "Inequality aversion, self-interest and social connectedness," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 744-772.
    3. Heinrich, Timo & Weimann, Joachim, 2013. "A note on reciprocity and modified dictator games," Economics Letters, Elsevier, vol. 121(2), pages 202-205.
    4. Kittel, Bernhard & Kanitsar, Georg & Traub, Stefan, 2017. "Knowledge, power, and self-interest," Journal of Public Economics, Elsevier, vol. 150(C), pages 39-52.
    5. Hermstrüwer, Yoan & Dickert, Stephan, 2017. "Sharing is daring: An experiment on consent, chilling effects and a salient privacy nudge," International Review of Law and Economics, Elsevier, vol. 51(C), pages 38-49.
    6. Yoan Hermstrüwer & Stephan Dickert, 2013. "Tearing the Veil of Privacy Law: An Experiment on Chilling Effects and the Right to Be Forgotten," Discussion Paper Series of the Max Planck Institute for Behavioral Economics 2013_15, Max Planck Institute for Behavioral Economics.
    7. Eugen Dimant & Kyle Hyndman, 2019. "Becoming Friends or Foes? How Competitive Environments Shape Social Preferences," Discussion Papers 2019-18, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    8. Sun-Ki Chai & Dolgorsuren Dorj & Katerina Sherstyuk, 2018. "Cultural Values and Behavior in Dictator, Ultimatum, and Trust Games: An Experimental Study," Research in Experimental Economics, in: Experimental Economics and Culture, volume 20, pages 89-166, Emerald Group Publishing Limited.
    9. Barmettler, Franziska & Fehr, Ernst & Zehnder, Christian, 2012. "Big experimenter is watching you! Anonymity and prosocial behavior in the laboratory," Games and Economic Behavior, Elsevier, vol. 75(1), pages 17-34.
    10. Takanori Ida & Kazuhito Ogawa, 2012. "Inequality aversion, social discount, and time discount rates," International Journal of Social Economics, Emerald Group Publishing Limited, vol. 39(5), pages 314-329, April.
    11. Dorian Jullien, 2018. "Under Risk, Over Time, Regarding Other People: Language and Rationality within Three Dimensions," Research in the History of Economic Thought and Methodology, in: Including a Symposium on Latin American Monetary Thought: Two Centuries in Search of Originality, volume 36, pages 119-155, Emerald Group Publishing Limited.
    12. Erik O. Kimbrough & Alexander Vostroknutov, 2016. "Norms Make Preferences Social," Journal of the European Economic Association, European Economic Association, vol. 14(3), pages 608-638, June.
    13. Dimant, Eugen, 2015. "On Peer Effects: Behavioral Contagion of (Un)Ethical Behavior and the Role of Social Identity," MPRA Paper 68732, University Library of Munich, Germany.
    14. Natalia Montinari & Michela Rancan, 2013. "Social preferences under risk : the role of social distance," RSCAS Working Papers 2013/90, European University Institute.
    15. Ezquerra, Lara & Kujal, Praveen, 2020. "Self-selecting into being a dictator: Distributional consequences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 87(C).
    16. Ju-Young Kim & Katharina Kaufmann & Manuel Stegemann, 2014. "The impact of buyer–seller relationships and reference prices on the effectiveness of the pay what you want pricing mechanism," Marketing Letters, Springer, vol. 25(4), pages 409-423, December.
    17. Emin Karagözoglu & Arno Riedl, 2010. "Information, Uncertainty, and Subjective Entitlements in Bargaining," CESifo Working Paper Series 3133, CESifo.
    18. Frode Alfnes & Maren Bachke & Mette Wik, 2012. "Eliciting donor preferences," Artefactual Field Experiments 00098, The Field Experiments Website.
    19. Zultan, Ro’i, 2012. "Strategic and social pre-play communication in the ultimatum game," Journal of Economic Psychology, Elsevier, vol. 33(3), pages 425-434.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C68 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computable General Equilibrium Models
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • D14 - Microeconomics - - Household Behavior - - - Household Saving; Personal Finance
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • E20 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - General (includes Measurement and Data)
    • E21 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Consumption; Saving; Wealth

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:102439. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.