IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2503.06646.html
   My bibliography  Save this paper

Evaluating and Aligning Human Economic Risk Preferences in LLMs

Author

Listed:
  • Jiaxin Liu
  • Yi Yang
  • Kar Yan Tam

Abstract

Large Language Models (LLMs) are increasingly used in decision-making scenarios that involve risk assessment, yet their alignment with human economic rationality remains unclear. In this study, we investigate whether LLMs exhibit risk preferences consistent with human expectations across different personas. Specifically, we assess whether LLM-generated responses reflect appropriate levels of risk aversion or risk-seeking behavior based on individual's persona. Our results reveal that while LLMs make reasonable decisions in simplified, personalized risk contexts, their performance declines in more complex economic decision-making tasks. To address this, we propose an alignment method designed to enhance LLM adherence to persona-specific risk preferences. Our approach improves the economic rationality of LLMs in risk-related applications, offering a step toward more human-aligned AI decision-making.

Suggested Citation

  • Jiaxin Liu & Yi Yang & Kar Yan Tam, 2025. "Evaluating and Aligning Human Economic Risk Preferences in LLMs," Papers 2503.06646, arXiv.org.
  • Handle: RePEc:arx:papers:2503.06646
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2503.06646
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    2. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    3. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    4. Barberis, Nicholas & Thaler, Richard, 2003. "A survey of behavioral finance," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, edition 1, volume 1, chapter 18, pages 1053-1128, Elsevier.
    5. Sule Alan & Teodora Boneva & Seda Ertac, 2019. "Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1121-1162.
    6. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    7. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    8. Yi Yang & Yixuan Tang & Kar Yan Tam, 2023. "InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuning," Papers 2309.13064, arXiv.org.
    9. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    10. Shumiao Ouyang & Hayong Yun & Xingjian Zheng, 2024. "How Ethical Should AI Be? How AI Alignment Shapes the Risk Preferences of LLMs," Papers 2406.01168, arXiv.org, revised Aug 2024.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qian Wu & Monique Vanerum & Anouk Agten & Andrés Christiansen & Frank Vandenabeele & Jean-Michel Rigo & Rianne Janssen, 2021. "Certainty-Based Marking on Multiple-Choice Items: Psychometrics Meets Decision Theory," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 518-543, June.
    2. Paolo Crosetto & Antonio Filippin, 2013. "The “bomb” risk elicitation task," Journal of Risk and Uncertainty, Springer, vol. 47(1), pages 31-65, August.
    3. Thomas Dohmen & Simone Quercia & Jana Willrodt, 2023. "On the psychology of the relation between optimism and risk taking," Journal of Risk and Uncertainty, Springer, vol. 67(2), pages 193-214, October.
    4. Paolo Crosetto & Antonio Filippin, 2013. "A Theoretical and Experimental Appraisal of Five Risk Elicitation Methods," SOEPpapers on Multidisciplinary Panel Data Research 547, DIW Berlin, The German Socio-Economic Panel (SOEP).
    5. Giannikos, Christos I. & Kakolyris, Andreas & Suen, Tin Shan, 2023. "Prospect theory and a manager's decision to trade a blind principal bid basket," Global Finance Journal, Elsevier, vol. 55(C).
    6. Ferdinand M. Vieider & Peter Martinsson & Pham Khanh Nam & Nghi Truong, 2019. "Risk preferences and development revisited," Theory and Decision, Springer, vol. 86(1), pages 1-21, February.
    7. Jingru Jia & Zehua Yuan & Junhao Pan & Paul E. McNamara & Deming Chen, 2024. "Decision-Making Behavior Evaluation Framework for LLMs under Uncertain Context," Papers 2406.05972, arXiv.org, revised Oct 2024.
    8. Shumiao Ouyang & Hayong Yun & Xingjian Zheng, 2024. "How Ethical Should AI Be? How AI Alignment Shapes the Risk Preferences of LLMs," Papers 2406.01168, arXiv.org, revised Aug 2024.
    9. Botzen, W.J.W. & van den Bergh, J.C.J.M., 2012. "Risk attitudes to low-probability climate change risks: WTP for flood insurance," Journal of Economic Behavior & Organization, Elsevier, vol. 82(1), pages 151-166.
    10. Lasha Lanchava & Kyle Carlson & Blanka Šebánková & Jaroslav Flegr & Gideon Nave, 2015. "No Evidence of Association between Toxoplasma gondii Infection and Financial Risk Taking in Females," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-17, September.
    11. David Blake & Edmund Cannon & Douglas Wright, 2021. "Quantifying loss aversion: Evidence from a UK population survey," Journal of Risk and Uncertainty, Springer, vol. 63(1), pages 27-57, August.
    12. Waheed, Hassam, 2023. "Nudging smokers away from lighting up: A meta-analysis of framing effect in current smokers," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 104(C).
    13. Marc Oliver Rieger & Mei Wang & Thorsten Hens, 2015. "Risk Preferences Around the World," Management Science, INFORMS, vol. 61(3), pages 637-648, March.
    14. Colasante, Annarita & Riccetti, Luca, 2020. "Risk aversion, prudence and temperance: It is a matter of gap between moments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 25(C).
    15. Andrea Coletta & Kshama Dwarakanath & Penghang Liu & Svitlana Vyetrenko & Tucker Balch, 2024. "LLM-driven Imitation of Subrational Behavior : Illusion or Reality?," Papers 2402.08755, arXiv.org.
    16. Martin Fochmann & Martin Jacob, 2011. "Behavioral Explanation of Tax Asymmetries," FEMM Working Papers 110021, Otto-von-Guericke University Magdeburg, Faculty of Economics and Management.
    17. Lovric, M. & Kaymak, U. & Spronk, J., 2008. "A Conceptual Model of Investor Behavior," ERIM Report Series Research in Management ERS-2008-030-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    18. Goytom Abraha Kahsay & Daniel Osberghaus, 2018. "Storm Damage and Risk Preferences: Panel Evidence from Germany," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 71(1), pages 301-318, September.
    19. Hamza Bahaji, 2011. "Incentives from stock option grants: a behavioral approach," Post-Print halshs-00681607, HAL.
    20. Schmidt, Ulrich & Friedl, Andreas & Lima de Miranda, Katharina, 2015. "Social comparison and gender differences in risk taking," Kiel Working Papers 2011, Kiel Institute for the World Economy (IfW Kiel).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2503.06646. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.