IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2401.07345.html

Can an LLM Learn Preferences from Choice Data?

Author

Listed:
  • Jeongbin Kim
  • Matthew Kovach
  • Kyu-Min Lee
  • Euncheol Shin
  • Hector Tzavellas

Abstract

Can large language models (LLMs) learn a decision maker's preferences from observed choices and generate preference-consistent recommendations in new situations? We propose a portable Simulate-Recommend-Evaluate framework that tests preference learning from revealed-choice data by comparing LLM recommendations with optimal choices implied by known preference primitives. We apply the framework to choice under uncertainty using the disappointment aversion model. Recommendation accuracy improves as models observe more choices, but learning is heterogeneous across preference types and LLMs: GPT learns risk aversion better than disappointment aversion, Gemini performs best in high disappointment-aversion regions, and Claude shows the broadest effective learning across parameter regions.

Suggested Citation

  • Jeongbin Kim & Matthew Kovach & Kyu-Min Lee & Euncheol Shin & Hector Tzavellas, 2024. "Can an LLM Learn Preferences from Choice Data?," Papers 2401.07345, arXiv.org, revised Apr 2026.
  • Handle: RePEc:arx:papers:2401.07345
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2401.07345
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Pawe{l} Niszczota & Sami Abbas, 2023. "GPT has become financially literate: Insights from financial literacy tests of GPT and a preliminary test of how people use it as a source of advice," Papers 2309.00649, arXiv.org, revised Sep 2024.
    2. Chambers,Christopher P. & Echenique,Federico, 2016. "Revealed Preference Theory," Cambridge Books, Cambridge University Press, number 9781107087804, November.
    3. Alejandro Lopez-Lira & Yuehua Tang, 2023. "Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models," Papers 2304.07619, arXiv.org, revised Oct 2025.
    4. Taylor Webb & Keith J. Holyoak & Hongjing Lu, 2023. "Emergent analogical reasoning in large language models," Nature Human Behaviour, Nature, vol. 7(9), pages 1526-1541, September.
    5. Federico Echenique & Taisuke Imai & Kota Saito, 2023. "Approximate Expected Utility Rationalization," Journal of the European Economic Association, European Economic Association, vol. 21(5), pages 1821-1864.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gillian K. Hadfield & Andrew Koh, 2025. "An Economy of AI Agents," Papers 2509.01063, arXiv.org.
    2. Bohan Zhang & Jiaxuan Li & Ali Hortac{c}su & Xiaoyang Ye & Victor Chernozhukov & Angelo Ni & Edward W Huang, 2025. "Agentic Economic Modeling," Papers 2510.25743, arXiv.org, revised Mar 2026.
    3. Herbert Dawid & Philipp Harting & Hankui Wang & Zhongli Wang & Jiachen Yi, 2025. "Agentic Workflows for Economic Research: Design and Implementation," Papers 2504.09736, arXiv.org.
    4. Christopher Kops & Elias Tsakas, 2026. "Choice via AI," Papers 2602.04526, arXiv.org.
    5. Benjamin S. Manning & John J. Horton, 2025. "General Social Agents," Papers 2508.17407, arXiv.org, revised Mar 2026.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roy Allen & John Rehbeck, 2021. "Measuring rationality: percentages vs expenditures," Theory and Decision, Springer, vol. 91(2), pages 265-277, September.
    2. Yuqi Nie & Yaxuan Kong & Xiaowen Dong & John M. Mulvey & H. Vincent Poor & Qingsong Wen & Stefan Zohren, 2024. "A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges," Papers 2406.11903, arXiv.org.
    3. Ko, Hyungjin & Lee, Jaewook, 2024. "Can ChatGPT improve investment decisions? From a portfolio management perspective," Finance Research Letters, Elsevier, vol. 64(C).
    4. Dziewulski, Paweł, 2025. "A revealed preference approach to approximate utility maximisation," Journal of Economic Theory, Elsevier, vol. 228(C).
    5. Pawel Dziewulski, 2021. "A comprehensive revealed preference approach to approximate utility maximisation," Working Paper Series 0621, Department of Economics, University of Sussex Business School.
    6. Thomas Demuynck & Tom Potoms, 2022. "Testing revealed preference models with unobserved randomness: a column generation approach," Working Papers ECARES 2022-42, ULB -- Universite Libre de Bruxelles.
    7. Samson Alva & Battal Dou{g}an, 2021. "Choice and Market Design," Papers 2110.15446, arXiv.org, revised Nov 2021.
    8. Christopher P. Chambers & Federico Echenique & Eran Shmaya, 2014. "The Axiomatic Structure of Empirical Content," American Economic Review, American Economic Association, vol. 104(8), pages 2303-2319, August.
    9. Changkuk Im & John Rehbeck, 2021. "Non-rationalizable Individuals, Stochastic Rationalizability, and Sampling," Papers 2102.03436, arXiv.org, revised Oct 2021.
    10. Cherchye, Laurens & Demuynck, Thomas & De Rock, Bram, 2018. "Transitivity of preferences: when does it matter?," Theoretical Economics, Econometric Society, vol. 13(3), September.
    11. Pawel Dziewulski, 2016. "Eliciting the just-noticeable difference," Economics Series Working Papers 798, University of Oxford, Department of Economics.
    12. Federico Echenique & SangMok Lee & Matthew Shum & M. Bumin Yenmez, 2021. "Stability and Median Rationalizability for Aggregate Matchings," Games, MDPI, vol. 12(2), pages 1-15, April.
    13. Keigo Inukai & Yuta Shimodaira & Kohei Shiozawa, 2022. "Revisiting CES Utility Functions for Distributional Preferences: Do People Face the Equality–efficiency Trade-off?," ISER Discussion Paper 1195, Institute of Social and Economic Research, The University of Osaka.
    14. Mingshi Chen & Tracy Xiao Liu & You Shan & Shu Wang & Songfa Zhong & Yanju Zhou, 2025. "How General Are Measures of Choice Consistency? Evidence from Experimental and Scanner Data," Papers 2505.05275, arXiv.org, revised Sep 2025.
    15. Sylvain Chassang & Kei Kawai & Jun Nakabayashi & Juan Ortner, 2019. "Data Driven Regulation: Theory and Application to Missing Bids," Boston University - Department of Economics - Working Papers Series WP2019-04, Boston University - Department of Economics.
    16. Domenico Cantone & Alfio Giarlotta & Stephen Watson, 2021. "Choice resolutions," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 56(4), pages 713-753, May.
    17. Aluma Dembo & Shachar Kariv & Matthew Polisson & John Quah, 2021. "Ever since Allais," IFS Working Papers W21/15, Institute for Fiscal Studies.
    18. Müller, Daniel, 2019. "The anatomy of distributional preferences with group identity," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 785-807.
    19. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    20. Shu Wang & Zijun Yao & Shuhuai Zhang & Jianuo Gai & Tracy Xiao Liu & Songfa Zhong, 2025. "When Experimental Economics Meets Large Language Models: Evidence-based Tactics," Papers 2505.21371, arXiv.org, revised Jul 2025.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2401.07345. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.