IDEAS home Printed from https://ideas.repec.org/p/kyo/wpaper/1103.html

How good are LLMs in risk profiling?

Author

Listed:
  • Thorsten Hens

    (Department of Finance, University of Zurich, Department of Finance, Norwegian School of Economics, NHH, Institute of Economic Research, Kyoto University)

  • Trine Nordlie

    (Department of Finance, Norwegian School of Economics, NHH, Bergen)

Abstract

This study compares OpenAI's ChatGPT-4 and Google's Bard with bank experts in determining investors'risk profiles. We find that for half of the client cases used, there are no statistically significant differences in the risk profiles. Moreover, the economic relevance of the differences is small.

Suggested Citation

  • Thorsten Hens & Trine Nordlie, 2024. "How good are LLMs in risk profiling?," KIER Working Papers 1103, Kyoto University, Institute of Economic Research.
    • Handle: RePEc:kyo:wpaper:1103
    as

    Download full text from publisher

    File URL: https://www.kier.kyoto-u.ac.jp/wp/wp-content/uploads/2024/04/DP1103.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Graeme D. Ruxton, 2006. "The unequal variance t-test is an underused alternative to Student's t-test and the Mann--Whitney U test," Behavioral Ecology, International Society for Behavioral Ecology, vol. 17(4), pages 688-690, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kang, Wenjin & Tang, Ke & Wang, Ningli, 2023. "Financialization of commodity markets ten years later," Journal of Commodity Markets, Elsevier, vol. 30(C).
    2. Ling Jia & Queena K. Qian & Frits Meijer & Henk Visscher, 2020. "Stakeholders’ Risk Perception: A Perspective for Proactive Risk Management in Residential Building Energy Retrofits in China," Sustainability, MDPI, vol. 12(7), pages 1-25, April.
    3. Laurent Penet & Denis Cornet & Jean-Marc Blazy & Angela Alleyne & Emilie Simone Barthe & François Bussière & Sébastien Guyader & Claudie Pavis & Dalila Pétro, 2016. "Varietal Dynamics and Yam Agro-Diversity Demonstrate Complex Trajectories Intersecting Farmers’ Strategies, Networks, and Disease Experience," Post-Print hal-01608280, HAL.
    4. Kim Young Joo & Skibniewski Miroslaw J., 2020. "Unsuccessful bids: Coefficient of variation of bids as indicator of project risk," Organization, Technology and Management in Construction, Sciendo, vol. 12(1), pages 2193-2199, January.
    5. Wallert, John & Ekman, Urban & Westman, Eric & Madison, Guy, 2017. "The worst performance rule with elderly in abnormal cognitive decline," Intelligence, Elsevier, vol. 64(C), pages 9-17.
    6. Menusch Khadjavi & Andreas Lange, 2015. "Doing good or doing harm: experimental evidence on giving and taking in public good games," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 432-441, September.
    7. Zhengnan Zhu & Zhe Zhang & Fangqing Liu & Zewei Chen & Yuxin Ren & Qingfu Guo, 2023. "Study on Accuracy Evaluation of MCD19A2 and Spatiotemporal Distribution of AOD in Arid Zones of Central Asia," Sustainability, MDPI, vol. 15(18), pages 1-16, September.
    8. Matías Cabrera & Gerald P. Dwyer & María J. Nieto, 2018. "The G-20 regulatory agenda and bank risk," Working Papers 1829, Banco de España.
    9. Ma, Qiuhui & Zheng, Ying & Yang, Weidong & Zhang, Yong & Zhang, Hong, 2021. "Remaining useful life prediction of lithium battery based on capacity regeneration point detection," Energy, Elsevier, vol. 234(C).
    10. Tamar Balgiashvili, 2017. "Comparing Entrepreneurial Passion of Social and Commercial Entrepreneurs in the Czech Republic," Central European Business Review, Prague University of Economics and Business, vol. 2017(4), pages 45-61.
    11. Vlaeminck, Pieter & Vranken, Liesbet, 2015. "Do labels capture consumers’ actual willingness to pay for Fair Trade characteristics?," Working Papers 206438, Katholieke Universiteit Leuven, Centre for Agricultural and Food Economics.
    12. Yiyi Sulaeman & Eni Maftuáh & Sukarman Sukarman & Risma Neswati & Nurdin Nurdin & Tony Basuki & Ahmad Suriadi & Ivan Vasenev, 2025. "Influence of Land-Use Type on Black Soil Features in Indonesia Based on Soil Survey Data," Land, MDPI, vol. 14(3), pages 1-15, March.
    13. Timothy J. Fullman & Erin L. Bunting, 2014. "Analyzing Vegetation Change in an Elephant-Impacted Landscape Using the Moving Standard Deviation Index," Land, MDPI, vol. 3(1), pages 1-31, January.
    14. Cong Cao & Markus Pauly & Frank Konietschke, 2020. "The Behrens–Fisher problem with covariates and baseline adjustments," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 83(2), pages 197-215, February.
    15. Hens, Thorsten & Nordlie, Trine, 2025. "How good are LLMs in risk profiling?," Finance Research Letters, Elsevier, vol. 85(PD).
    16. Patrizia Gazzola & Audrey Paterson & Stefano Amelio & Daniele Grechi & Stefano Cristina, 2023. "The role of individual social responsibility and corporate social responsibility in the tax fraud war: A comparison between the priorities of Italian and Romanian consumers," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(5), pages 2265-2277, September.
    17. repec:plo:pone00:0090468 is not listed on IDEAS
    18. Bernd W. Wirtz & Oliver Tuna Kurtz, 2016. "Local e-government and user satisfaction with city portals – the citizens’ service preference perspective," International Review on Public and Nonprofit Marketing, Springer;International Association of Public and Non-Profit Marketing, vol. 13(3), pages 265-287, October.
    19. Jozef Švajlenka & Mária Kozlovská & Miroslav Badida & Marek Moravec & Tibor Dzuro & František Vranay, 2020. "Analysis of the Characteristics of External Walls of Wooden Prefab Cross Laminated Timber," Energies, MDPI, vol. 13(22), pages 1-14, November.
    20. Bernd W. Wirtz & Oliver Tuna Kurtz, 2017. "Determinants of Citizen Usage Intentions in e-Government: An Empirical Analysis," Public Organization Review, Springer, vol. 17(3), pages 353-372, September.
    21. Charles Bettembourg & Christian Diot & Olivier Dameron, 2015. "Optimal Threshold Determination for Interpreting Semantic Similarity and Particularity: Application to the Comparison of Gene Sets and Metabolic Pathways Using GO and ChEBI," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-30, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • D8 - Microeconomics - - Information, Knowledge, and Uncertainty
    • D14 - Microeconomics - - Household Behavior - - - Household Saving; Personal Finance
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • G51 - Financial Economics - - Household Finance - - - Household Savings, Borrowing, Debt, and Wealth

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kyo:wpaper:1103. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Makoto Watanabe (email available below). General contact details of provider: https://edirc.repec.org/data/iekyojp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.