IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2406.01168.html

AI as Decision-Maker: Ethics and Risk Preferences of LLMs

Author

Listed:
  • Shumiao Ouyang
  • Hayong Yun
  • Xingjian Zheng

Abstract

Large Language Models (LLMs) exhibit surprisingly diverse risk preferences when acting as AI decision makers, a crucial characteristic whose origins remain poorly understood despite their expanding economic roles. We analyze 50 LLMs using behavioral tasks, finding stable but diverse risk profiles. Alignment tuning for harmlessness, helpfulness, and honesty significantly increases risk aversion, causally increasing risk aversion confirmed via comparative difference analysis: a ten percent ethics increase cuts risk appetite two to eight percent. This induced caution persists against prompts and affects economic forecasts. Alignment enhances safety but may also suppress valuable risk taking, revealing a tradeoff risking suboptimal economic outcomes. With AI models becoming more powerful and influential in economic decisions while alignment grows increasingly critical, our empirical framework serves as an adaptable and enduring benchmark to track risk preferences and monitor this crucial tension between ethical alignment and economically valuable risk-taking.

Suggested Citation

  • Shumiao Ouyang & Hayong Yun & Xingjian Zheng, 2024. "AI as Decision-Maker: Ethics and Risk Preferences of LLMs," Papers 2406.01168, arXiv.org, revised Jun 2025.
  • Handle: RePEc:arx:papers:2406.01168
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2406.01168
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Uri Gneezy & Kenneth L. Leonard & John A. List, 2009. "Gender Differences in Competition: Evidence From a Matrilineal and a Patriarchal Society," Econometrica, Econometric Society, vol. 77(5), pages 1637-1664, September.
    2. Uri Gneezy & Jan Potters, 1997. "An Experiment on Risk Taking and Evaluation Periods," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 631-645.
    3. Anton Korinek, 2023. "Generative AI for Economic Research: Use Cases and Implications for Economists," Journal of Economic Literature, American Economic Association, vol. 61(4), pages 1281-1317, December.
    4. Markus K. Brunnermeier & Stefan Nagel, 2008. "Do Wealth Fluctuations Generate Time-Varying Risk Aversion? Micro-evidence on Individuals," American Economic Review, American Economic Association, vol. 98(3), pages 713-736, June.
    5. Gürdal, Mehmet Y. & Kuzubaş, Tolga U. & Saltoğlu, Burak, 2017. "Measures of individual risk attitudes and portfolio choice: Evidence from pension participants," Journal of Economic Psychology, Elsevier, vol. 62(C), pages 186-203.
    6. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    7. Barberis, Nicholas & Thaler, Richard, 2003. "A survey of behavioral finance," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, edition 1, volume 1, chapter 18, pages 1053-1128, Elsevier.
    8. Antonio Filippin, 2022. "Gender differences in risk attitudes," World of Labour, LISER, pages 100-100, October.
    9. John J. Horton & Apostolos Filippas & Benjamin S. Manning, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    10. Antonio Filippin & Paolo Crosetto, 2016. "A Reconsideration of Gender Differences in Risk Attitudes," Management Science, INFORMS, vol. 62(11), pages 3138-3160, November.
    11. Isil Erel & Léa H Stern & Chenhao Tan & Michael S Weisbach, 2021. "Selecting Directors Using Machine Learning," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3226-3264, National Bureau of Economic Research, Inc.
    12. Ulrike Malmendier & Stefan Nagel, 2011. "Depression Babies: Do Macroeconomic Experiences Affect Risk Taking?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 373-416.
    13. John J. Horton & Apostolos Filippas & Benjamin S. Manning, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org, revised Feb 2026.
    14. Sule Alan & Teodora Boneva & Seda Ertac, 2019. "Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1121-1162.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jiaxin Liu & Yixuan Tang & Yi Yang & Kar Yan Tam, 2025. "Evaluating and Aligning Human Economic Risk Preferences in LLMs," Papers 2503.06646, arXiv.org, revised Sep 2025.
    2. Anand, Kartik & Kazinnik, Sophia & Leonello, Agnese & Panetti, Ettore, 2025. "Ex Machina: Financial Stability in the Age of Artificial Intelligence," CEPR Discussion Papers 20681, Centre for Economic Policy Research.
    3. Herbert Dawid & Philipp Harting & Hankui Wang & Zhongli Wang & Jiachen Yi, 2025. "Agentic Workflows for Economic Research: Design and Implementation," Papers 2504.09736, arXiv.org.
    4. Manish Jha & Jialin Qian & Michael Weber & Baozhong Yang, 2024. "Generative AI, Managerial Expectations, and Economic Activity," Papers 2410.03897, arXiv.org, revised Nov 2025.
    5. Eléonore Dodivers & Ismaël Rafaï, 2025. "Uncovering the Fairness of AI: Exploring Focal Point, Inequality Aversion, and Altruism in ChatGPT's Dictator Game Decisions," GREDEG Working Papers 2025-09, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beine, Michel & Charness, Gary & Dupuy, Arnaud & Joxhe, Majlinda, 2020. "Shaking Things Up: On the Stability of Risk and Time Preferences," IZA Discussion Papers 13084, IZA Network @ LISER.
    2. Jiaxin Liu & Yixuan Tang & Yi Yang & Kar Yan Tam, 2025. "Evaluating and Aligning Human Economic Risk Preferences in LLMs," Papers 2503.06646, arXiv.org, revised Sep 2025.
    3. Catherine Eckel & Lata Gangadharan & Philip J. Grossman & Nina Xue, 2021. "The gender leadership gap: insights from experiments," Chapters, in: Ananish Chaudhuri (ed.), A Research Agenda for Experimental Economics, chapter 7, pages 137-162, Edward Elgar Publishing.
    4. Markowsky, Eva & Beblo, Miriam, 2022. "When do we observe a gender gap in competition entry? A meta-analysis of the experimental literature," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 139-163.
    5. Giuseppe Matera, 2025. "Corporate Earnings Calls and Analyst Beliefs," Papers 2511.15214, arXiv.org, revised Nov 2025.
    6. Drupp, Moritz A. & Khadjavi, Menusch & Riekhof, Marie-Catherine & Voss, Rudi, 2020. "Professional identity and the gender gap in risk-taking. Evidence from field experiments with scientists," Journal of Economic Behavior & Organization, Elsevier, vol. 170(C), pages 418-432.
    7. Holden, Stein T. & Tilahun, Mesfin, 2020. "Endowment Effects and Loss Aversion in the Risky Investment Game," CLTS Working Papers 1/20, Norwegian University of Life Sciences, Centre for Land Tenure Studies.
    8. Stein T. Holden & Mesfin Tilahun, 2022. "Endowment effects in the risky investment game?," Theory and Decision, Springer, vol. 92(1), pages 259-274, February.
    9. Ranganathan, Kavitha & Lejarraga, Tomás, 2021. "Elicitation of risk preferences through satisficing," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    10. Kessel, Dany & Mollerstrom, Johanna & van Veldhuizen, Roel, 2021. "Can simple advice eliminate the gender gap in willingness to compete?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 138, pages 1-1.
    11. Iñaki Aldasoro & Ajit Desai, 2025. "Money Talks: AI Agents for Cash Management in Payment Systems," Staff Working Papers 25-35, Bank of Canada.
    12. Laudenbach, Christine & Loos, Benjamin & Pirschel, Jenny & Wohlfart, Johannes, 2021. "The trading response of individual investors to local bankruptcies," Journal of Financial Economics, Elsevier, vol. 142(2), pages 928-953.
    13. Iñaki Aldasoro & Ajit Desai, 2025. "AI agents for cash management in payment systems," BIS Working Papers 1310, Bank for International Settlements.
    14. Blake, David & Duffield, Mel & Tonks, Ian & Haig, Alistair & Blower, Dean & MacPhee, Laura, 2022. "Smart defaults: Determining the number of default funds in a pension scheme," The British Accounting Review, Elsevier, vol. 54(4).
    15. Hadar Gafni & Dan Marom & Alicia Robb & Orly Sade, 0. "Gender Dynamics in Crowdfunding (Kickstarter): Evidence on Entrepreneurs, Backers, and Taste-Based Discrimination," Review of Finance, European Finance Association, vol. 25(2), pages 235-274.
    16. repec:osf:osfxxx:r3qng_v1 is not listed on IDEAS
    17. Zexuan Wang & Ismaël Rafaï & Marc Willinger, 2023. "Does age affect the relation between risk and time preferences? Evidence from a representative sample," Southern Economic Journal, John Wiley & Sons, vol. 90(2), pages 341-368, October.
    18. Della Giusta, Marina & Di Girolamo, Amalia, 2018. "Have your cake and eat it too: real effort and risk aversion in schoolchildren," MPRA Paper 89528, University Library of Munich, Germany.
    19. Boschini, Anne & Dreber, Anna & von Essen, Emma & Muren, Astri & Ranehill, Eva, 2019. "Gender, risk preferences and willingness to compete in a random sample of the Swedish population✰," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 83(C).
    20. Umberto Collodel, 2025. "Interpreting the Interpreter: Can We Model post-ECB Conferences Volatility with LLM Agents?," Papers 2508.13635, arXiv.org, revised May 2026.
    21. Khor, Ling Yee & Sariyev, Orkhan & Loos, Tim, 2020. "Gender differences in risk behavior and the link to household effects and individual wealth," Journal of Economic Psychology, Elsevier, vol. 80(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2406.01168. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.