IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2311.10723.html
   My bibliography  Save this paper

Large Language Models in Finance: A Survey

Author

Listed:
  • Yinheng Li
  • Shaofei Wang
  • Han Ding
  • Hang Chen

Abstract

Recent advances in large language models (LLMs) have opened new possibilities for artificial intelligence applications in finance. In this paper, we provide a practical survey focused on two key aspects of utilizing LLMs for financial tasks: existing solutions and guidance for adoption. First, we review current approaches employing LLMs in finance, including leveraging pretrained models via zero-shot or few-shot learning, fine-tuning on domain-specific data, and training custom LLMs from scratch. We summarize key models and evaluate their performance improvements on financial natural language processing tasks. Second, we propose a decision framework to guide financial professionals in selecting the appropriate LLM solution based on their use case constraints around data, compute, and performance needs. The framework provides a pathway from lightweight experimentation to heavy investment in customized LLMs. Lastly, we discuss limitations and challenges around leveraging LLMs in financial applications. Overall, this survey aims to synthesize the state-of-the-art and provide a roadmap for responsibly applying LLMs to advance financial AI.

Suggested Citation

  • Yinheng Li & Shaofei Wang & Han Ding & Hang Chen, 2023. "Large Language Models in Finance: A Survey," Papers 2311.10723, arXiv.org.
  • Handle: RePEc:arx:papers:2311.10723
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2311.10723
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ahmet Murat Ozbayoglu & Mehmet Ugur Gudelek & Omer Berat Sezer, 2020. "Deep Learning for Financial Applications : A Survey," Papers 2002.05786, arXiv.org.
    2. Aaryan Gupta & Vinya Dengre & Hamza Abubakar Kheruwala & Manan Shah, 2020. "Comprehensive review of text-mining applications in finance," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 6(1), pages 1-25, December.
    3. Goodell, John W. & Kumar, Satish & Lim, Weng Marc & Pattnaik, Debidutta, 2021. "Artificial intelligence and machine learning in finance: Identifying foundations, themes, and research clusters from bibliometric analysis," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    4. Bledar Fazlija & Pedro Harder, 2022. "Using Financial News Sentiment for Stock Price Direction Prediction," Mathematics, MDPI, vol. 10(13), pages 1-20, June.
    5. Yinheng Li & Junhao Wang & Yijie Cao, 2019. "A General Framework on Enhancing Portfolio Management with Reinforcement Learning," Papers 1911.11880, arXiv.org, revised Oct 2023.
    6. Boyu Zhang & Hongyang Yang & Xiao-Yang Liu, 2023. "Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Models," Papers 2306.12659, arXiv.org.
    7. Shijie Wu & Ozan Irsoy & Steven Lu & Vadim Dabravolski & Mark Dredze & Sebastian Gehrmann & Prabhanjan Kambadur & David Rosenberg & Gideon Mann, 2023. "BloombergGPT: A Large Language Model for Finance," Papers 2303.17564, arXiv.org, revised Dec 2023.
    8. Ekaterina Zolotareva, 2021. "Aiding Long-Term Investment Decisions with XGBoost Machine Learning Model," Papers 2104.09341, arXiv.org.
    9. Hongyang Yang & Xiao-Yang Liu & Christina Dan Wang, 2023. "FinGPT: Open-Source Financial Large Language Models," Papers 2306.06031, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thanos Konstantinidis & Giorgos Iacovides & Mingxue Xu & Tony G. Constantinides & Danilo Mandic, 2024. "FinLlama: Financial Sentiment Classification for Algorithmic Trading Applications," Papers 2403.12285, arXiv.org.
    2. Wentao Zhang & Lingxuan Zhao & Haochong Xia & Shuo Sun & Jiaze Sun & Molei Qin & Xinyi Li & Yuqing Zhao & Yilei Zhao & Xinyu Cai & Longtao Zheng & Xinrun Wang & Bo An, 2024. "A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist," Papers 2402.18485, arXiv.org, revised Feb 2024.
    3. Kanzari, Dalel & Nakhli, Mohamed Sahbi & Gaies, Brahim & Sahut, Jean-Michel, 2023. "Predicting macro-financial instability – How relevant is sentiment? Evidence from long short-term memory networks," Research in International Business and Finance, Elsevier, vol. 65(C).
    4. Ahmed, Shamima & Alshater, Muneer M. & Ammari, Anis El & Hammami, Helmi, 2022. "Artificial intelligence and machine learning in finance: A bibliometric review," Research in International Business and Finance, Elsevier, vol. 61(C).
    5. Hoang, Daniel & Wiegratz, Kevin, 2022. "Machine learning methods in finance: Recent applications and prospects," Working Paper Series in Economics 158, Karlsruhe Institute of Technology (KIT), Department of Economics and Management.
    6. Yuwei Yin & Yazheng Yang & Jian Yang & Qi Liu, 2023. "FinPT: Financial Risk Prediction with Profile Tuning on Pretrained Foundation Models," Papers 2308.00065, arXiv.org.
    7. Wenlu Zhao & Guanghu Jin & Chenyue Huang & Jinji Zhang, 2023. "Attention and Sentiment of the Chinese Public toward a 3D Greening System Based on Sina Weibo," IJERPH, MDPI, vol. 20(5), pages 1-20, February.
    8. Carolina Camassa, 2023. "Legal NLP Meets MiCAR: Advancing the Analysis of Crypto White Papers," Papers 2310.10333, arXiv.org, revised Oct 2023.
    9. Adebayo Oshingbesan & Eniola Ajiboye & Peruth Kamashazi & Timothy Mbaka, 2022. "Model-Free Reinforcement Learning for Asset Allocation," Papers 2209.10458, arXiv.org.
    10. Anup Kumar & Santosh Kumar Shrivastav & Avinash K. Shrivastava & Rashmi Ranjan Panigrahi & Abbas Mardani & Fausto Cavallaro, 2023. "Sustainable Supply Chain Management, Performance Measurement, and Management: A Review," Sustainability, MDPI, vol. 15(6), pages 1-25, March.
    11. Lezhi Li & Ting-Yu Chang & Hai Wang, 2023. "Multimodal Gen-AI for Fundamental Investment Research," Papers 2401.06164, arXiv.org.
    12. Christopher Gerling & Stefan Lessmann, 2023. "Multimodal Document Analytics for Banking Process Automation," Papers 2307.11845, arXiv.org, revised Nov 2023.
    13. Tomoshiro Ochiai & Jose C. Nacher, 2020. "Unveiling the directional network behind the financial statements data using volatility constraint correlation," Papers 2008.07836, arXiv.org, revised Jun 2023.
    14. Afaq Khattak & Hamad Almujibah & Ahmed Elamary & Caroline Mongina Matara, 2022. "Interpretable Dynamic Ensemble Selection Approach for the Prediction of Road Traffic Injury Severity: A Case Study of Pakistan’s National Highway N-5," Sustainability, MDPI, vol. 14(19), pages 1-18, September.
    15. Naeem, Muhammad Abubakr & Karim, Sitara & Tiwari, Aviral Kumar, 2022. "Quantifying systemic risk in US industries using neural network quantile regression," Research in International Business and Finance, Elsevier, vol. 61(C).
    16. Amin Aminimehr & Ali Raoofi & Akbar Aminimehr & Amirhossein Aminimehr, 2022. "A Comprehensive Study of Market Prediction from Efficient Market Hypothesis up to Late Intelligent Market Prediction Approaches," Computational Economics, Springer;Society for Computational Economics, vol. 60(2), pages 781-815, August.
    17. Kumar, Satish & Chavan, Meena & Pandey, Nitesh, 2023. "Journal of International Management: A 25-year review using bibliometric analysis," Journal of International Management, Elsevier, vol. 29(1).
    18. Xiao-Yang Liu & Guoxuan Wang & Hongyang Yang & Daochen Zha, 2023. "FinGPT: Democratizing Internet-scale Data for Financial Large Language Models," Papers 2307.10485, arXiv.org, revised Nov 2023.
    19. Chen, Xun-Qi & Ma, Chao-Qun & Ren, Yi-Shuai & Lei, Yu-Tian & Huynh, Ngoc Quang Anh & Narayan, Seema, 2023. "Explainable artificial intelligence in finance: A bibliometric review," Finance Research Letters, Elsevier, vol. 56(C).
    20. Frank Xing, 2024. "Designing Heterogeneous LLM Agents for Financial Sentiment Analysis," Papers 2401.05799, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2311.10723. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.