IDEAS home Printed from https://ideas.repec.org/a/gam/jijfss/v12y2024i3p60-d1423687.html

AI-Driven Financial Analysis: Exploring ChatGPT’s Capabilities and Challenges

Author

Listed:
  • Li Xian Liu

    (College of Business, Law & Governance, James Cook University, 1 James Cook Drive, Douglas, QLD 4811, Australia)

  • Zhiyue Sun

    (School of Accounting, Economics & Finance, Curtin University, Kent Street, Perth, WA 6102, Australia)

  • Kunpeng Xu

    (School of Statistics and Information, Shanghai University of International Business and Economics, 1900 Wenxiang Rd, Songjiang District, Shanghai 201613, China)

  • Chao Chen

    (Accounting, Information System and Supply Chain, RMIT University, 124 La Trobe St, Melbourne, VIC 3000, Australia)

Abstract

The transformative impact of AI technologies on the financial sector has been a topic of increasing interest. This study investigates ChatGPT’s applications in financial reasoning and analysis and evaluates ChatGPT-4o’s effectiveness and limitations in conducting both basic and complex financial analysis tasks. By designing a series of multi-step, advanced reasoning tasks and establishing task-specific evaluation metrics, we assessed ChatGPT-4o’s performance compared to human analysts. Results indicate that while ChatGPT-4o demonstrates proficiency in basic and some complex financial tasks, it struggles with deep analytical and critical thinking tasks, especially in specialized finance areas. This study underscores the need for meticulous task formulation and robust evaluation in AI financial applications. While ChatGPT enhances efficiency, integrating it with human expertise is crucial for effective decision-making. Our findings highlight both the potential and limitations of ChatGPT-4o in financial analysis, providing valuable insights for future AI integration in the finance sector.

Suggested Citation

  • Li Xian Liu & Zhiyue Sun & Kunpeng Xu & Chao Chen, 2024. "AI-Driven Financial Analysis: Exploring ChatGPT’s Capabilities and Challenges," IJFS, MDPI, vol. 12(3), pages 1-35, June.
    • Handle: RePEc:gam:jijfss:v:12:y:2024:i:3:p:60-:d:1423687
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7072/12/3/60/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7072/12/3/60/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Martin Jullum & Anders Løland & Ragnar Bang Huseby & Geir Ånonsen & Johannes Lorentzen, 2020. "Detecting money laundering transactions with machine learning," Journal of Money Laundering Control, Emerald Group Publishing Limited, vol. 23(1), pages 173-186, January.
    2. Ahmed, Shamima & Alshater, Muneer M. & Ammari, Anis El & Hammami, Helmi, 2022. "Artificial intelligence and machine learning in finance: A bibliometric review," Research in International Business and Finance, Elsevier, vol. 61(C).
    3. Leippold, Markus, 2023. "Sentiment spin: Attacking financial sentiment with GPT-3," Finance Research Letters, Elsevier, vol. 55(PB).
    4. Dowling, Michael & Lucey, Brian, 2023. "ChatGPT for (Finance) research: The Bananarama Conjecture," Finance Research Letters, Elsevier, vol. 53(C).
    5. Markus Leippold, 2023. "Sentiment Spin: Attacking Financial Sentiment with GPT-3," Swiss Finance Institute Research Paper Series 23-11, Swiss Finance Institute.
    6. Hartmann, Jochen & Heitmann, Mark & Siebert, Christian & Schamp, Christina, 2023. "More than a Feeling: Accuracy and Application of Sentiment Analysis," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 75-87.
    7. Li Xian Liu & Shuangzhe Liu & Milind Sathye, 2021. "Predicting Bank Failures: A Synthesis of Literature and Directions for Future Research," JRFM, MDPI, vol. 14(10), pages 1-24, October.
    8. Paul C. Tetlock & Maytal Saar‐Tsechansky & Sofus Macskassy, 2008. "More Than Words: Quantifying Language to Measure Firms' Fundamentals," Journal of Finance, American Finance Association, vol. 63(3), pages 1437-1467, June.
    9. Luiz Félix & Roman Kräussl & Philip Stork, 2020. "Implied volatility sentiment: a tale of two tails," Quantitative Finance, Taylor & Francis Journals, vol. 20(5), pages 823-849, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ali, Hassnian & Zafar, Muhammad Bilal & Aysan, Ahmet Faruk, 2025. "Generative AI in finance: Replicability, methodological contingencies, and future research directions," Finance Research Letters, Elsevier, vol. 86(PF).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ali, Hassnian & Zafar, Muhammad Bilal & Aysan, Ahmet Faruk, 2025. "Generative AI in finance: Replicability, methodological contingencies, and future research directions," Finance Research Letters, Elsevier, vol. 86(PF).
    2. Smales, Lee A., 2023. "Classification of RBA monetary policy announcements using ChatGPT," Finance Research Letters, Elsevier, vol. 58(PC).
    3. Li, Xiaoyu & Jia, Shuyang & Xue, Fujing & Hu, Nan, 2025. "How investors’ ChatGPT attention influence stock market? A liquidity perspective," Research in International Business and Finance, Elsevier, vol. 77(PB).
    4. Dong, Mengming Michael & Stratopoulos, Theophanis C. & Wang, Victor Xiaoqi, 2024. "A scoping review of ChatGPT research in accounting and finance," International Journal of Accounting Information Systems, Elsevier, vol. 55(C).
    5. Sui, Cong & Wang, Shuhan & Zheng, Wei, 2024. "Sentiment as a shipping market predictor: Testing market-specific language models," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 189(C).
    6. Song, Piaopeng & Lu, Hanglin & Zhang, Yongjie, 2024. "Unveiling tone manipulation in MD&A: Evidence from ChatGPT experiments," Finance Research Letters, Elsevier, vol. 67(PA).
    7. Bingler, Julia Anna & Kraus, Mathias & Leippold, Markus & Webersinke, Nicolas, 2024. "How cheap talk in climate disclosures relates to climate initiatives, corporate emissions, and reputation risk," Journal of Banking & Finance, Elsevier, vol. 164(C).
    8. Darko B. Vuković & Senanu Dekpo-Adza & Stefana Matović, 2025. "AI integration in financial services: a systematic review of trends and regulatory challenges," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-29, December.
    9. Julian Junyan Wang & Victor Xiaoqi Wang, 2025. "Assessing Consistency and Reproducibility in the Outputs of Large Language Models: Evidence Across Diverse Finance and Accounting Tasks," Papers 2503.16974, arXiv.org, revised Sep 2025.
    10. Fu, Tong & Yu, Shuyi & Tan, Shiyu, 2025. "Peer effect matters for the adoption of new energy vehicles: Evidence from consumer sentiment analysis using Chat-GPT," Energy Economics, Elsevier, vol. 148(C).
    11. Enmao Liu & Cong Sui, 2026. "Does Sentiment Measured Through Language Models Encompass a Broader Expanse of Information From the Options Market?," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 46(3), pages 489-510, March.
    12. Olamilekan Shobayo & Sidikat Adeyemi-Longe & Olusogo Popoola & Bayode Ogunleye, 2024. "Innovative Sentiment Analysis and Prediction of Stock Price Using FinBERT, GPT-4 and Logistic Regression: A Data-Driven Approach," Papers 2412.06837, arXiv.org.
    13. Yuqi Nie & Yaxuan Kong & Xiaowen Dong & John M. Mulvey & H. Vincent Poor & Qingsong Wen & Stefan Zohren, 2024. "A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges," Papers 2406.11903, arXiv.org.
    14. Zhang, Cheng & Gao, Bin & Xu, Xiangrong & Qin, Mimi, 2025. "MFA RPC news sentiment and stock returns," Pacific-Basin Finance Journal, Elsevier, vol. 92(C).
    15. Mohit Beniwal, 2025. "Adaptive Weighted Genetic Algorithm-Optimized SVR for Robust Long-Term Forecasting of Global Stock Indices for investment decisions," Papers 2512.15113, arXiv.org.
    16. Rick Steinert & Saskia Altmann, 2023. "Linking microblogging sentiments to stock price movement: An application of GPT-4," Papers 2308.16771, arXiv.org.
    17. Stolowy, Hervé & Jeanjean, Thomas & Erkens, Michael, 2011. "The economic consequences of increasing the international visibility of financial reports," HEC Research Papers Series 957, HEC Paris.
    18. Gao, Xin & Xu, Weidong & Li, Donghui, 2025. "Media coverage and managerial investment learning from stock markets: International evidence," Research in International Business and Finance, Elsevier, vol. 76(C).
    19. David E. Allen & Michael McAleer & Abhay K. Singh, 2019. "Daily market news sentiment and stock prices," Applied Economics, Taylor & Francis Journals, vol. 51(30), pages 3212-3235, June.
    20. Yousaf, Imran & Youssef, Manel & Goodell, John W., 2022. "Quantile connectedness between sentiment and financial markets: Evidence from the S&P 500 twitter sentiment index," International Review of Financial Analysis, Elsevier, vol. 83(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijfss:v:12:y:2024:i:3:p:60-:d:1423687. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.