IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2306.11025.html
   My bibliography  Save this paper

Temporal Data Meets LLM -- Explainable Financial Time Series Forecasting

Author

Listed:
  • Xinli Yu
  • Zheng Chen
  • Yuan Ling
  • Shujing Dong
  • Zongyi Liu
  • Yanbin Lu

Abstract

This paper presents a novel study on harnessing Large Language Models' (LLMs) outstanding knowledge and reasoning abilities for explainable financial time series forecasting. The application of machine learning models to financial time series comes with several challenges, including the difficulty in cross-sequence reasoning and inference, the hurdle of incorporating multi-modal signals from historical news, financial knowledge graphs, etc., and the issue of interpreting and explaining the model results. In this paper, we focus on NASDAQ-100 stocks, making use of publicly accessible historical stock price data, company metadata, and historical economic/financial news. We conduct experiments to illustrate the potential of LLMs in offering a unified solution to the aforementioned challenges. Our experiments include trying zero-shot/few-shot inference with GPT-4 and instruction-based fine-tuning with a public LLM model Open LLaMA. We demonstrate our approach outperforms a few baselines, including the widely applied classic ARMA-GARCH model and a gradient-boosting tree model. Through the performance comparison results and a few examples, we find LLMs can make a well-thought decision by reasoning over information from both textual news and price time series and extracting insights, leveraging cross-sequence information, and utilizing the inherent knowledge embedded within the LLM. Additionally, we show that a publicly available LLM such as Open-LLaMA, after fine-tuning, can comprehend the instruction to generate explainable forecasts and achieve reasonable performance, albeit relatively inferior in comparison to GPT-4.

Suggested Citation

  • Xinli Yu & Zheng Chen & Yuan Ling & Shujing Dong & Zongyi Liu & Yanbin Lu, 2023. "Temporal Data Meets LLM -- Explainable Financial Time Series Forecasting," Papers 2306.11025, arXiv.org.
  • Handle: RePEc:arx:papers:2306.11025
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2306.11025
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Drost, Feike C & Nijman, Theo E, 1993. "Temporal Aggregation of GARCH Processes," Econometrica, Econometric Society, vol. 61(4), pages 909-927, July.
    2. Wolfgang Härdle & Helmut Lütkepohl & Rong Chen, 1997. "A Review of Nonparametric Time Series Analysis," International Statistical Review, International Statistical Institute, vol. 65(1), pages 49-72, April.
    3. Altaf Hossain & Mohammed Nasser, 2011. "Comparison of the finite mixture of ARMA-GARCH, back propagation neural networks and support-vector machines in forecasting financial returns," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(3), pages 533-551, November.
    4. M. Ghahramani & A. Thavaneswaran, 2006. "Financial applications of ARMA models with GARCH errors," Journal of Risk Finance, Emerald Group Publishing Limited, vol. 7(5), pages 525-543, October.
    5. M. Ghahramani & A. Thavaneswaran, 2006. "Financial applications of ARMA models with GARCH errors," Journal of Risk Finance, Emerald Group Publishing, vol. 7(5), pages 525-543, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Deborah Miori & Constantin Petrov, 2023. "Narratives from GPT-derived Networks of News, and a link to Financial Markets Dislocations," Papers 2311.14419, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bansal, Ravi & Kiku, Dana & Yaron, Amir, 2016. "Risks for the long run: Estimation with time aggregation," Journal of Monetary Economics, Elsevier, vol. 82(C), pages 52-69.
    2. Ayse Yilmaz & Ufuk Yolcu, 2022. "Dendritic neuron model neural network trained by modified particle swarm optimization for time‐series forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(4), pages 793-809, July.
    3. SILVESTRINI, Andrea & VEREDAS, David, 2005. "Temporal aggregation of univariate linear time series models," LIDAM Discussion Papers CORE 2005059, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. John M. Maheu & Thomas H. McCurdy, 2002. "Nonlinear Features of Realized FX Volatility," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 668-681, November.
    5. Doornik, Jurgen A. & Ooms, Marius, 2008. "Multimodality in GARCH regression models," International Journal of Forecasting, Elsevier, vol. 24(3), pages 432-448.
    6. Alexandre Petkovic & David Veredas, 2009. "Aggregation of linear models for panel data," Working Papers ECARES 2009-012, ULB -- Universite Libre de Bruxelles.
    7. Denisa Banulescu-Radu & Christophe Hurlin & Bertrand Candelon & Sébastien Laurent, 2016. "Do We Need High Frequency Data to Forecast Variances?," Annals of Economics and Statistics, GENES, issue 123-124, pages 135-174.
    8. Eleni Constantinou & Robert Georgiades & Avo Kazandjian & George Kouretas, 2005. "Mean and variance causality between the Cyprus Stock Exchange and major equity markets," Working Papers 0501, University of Crete, Department of Economics.
    9. Buccheri, Giuseppe & Corsi, Fulvio & Flandoli, Franco & Livieri, Giulia, 2021. "The continuous-time limit of score-driven volatility models," Journal of Econometrics, Elsevier, vol. 221(2), pages 655-675.
    10. Patrick Saart & Jiti Gao & Nam Hyun Kim, 2014. "Semiparametric methods in nonlinear time series analysis: a selective review," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(1), pages 141-169, March.
    11. Bauer, Rob M M J & Nieuwland, Frederick G M C & Verschoor, Willem F C, 1994. "German Stock Market Dynamics," Empirical Economics, Springer, vol. 19(3), pages 397-418.
    12. Prosper Dovonon, 2013. "Conditionally Heteroskedastic Factor Models With Skewness And Leverage Effects," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(7), pages 1110-1137, November.
    13. Nour Meddahi, 2002. "A theoretical comparison between integrated and realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 479-508.
    14. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    15. Mishra, Sasmita & Padhy, Sudarsan, 2019. "An efficient portfolio construction model using stock price predicted by support vector regression," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    16. McMillan, David G. & Speight, Alan E. H., 2001. "Non-ferrous metals price volatility: a component analysis," Resources Policy, Elsevier, vol. 27(3), pages 199-207, September.
    17. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Estimation of Generalized Impulse Response Functions," Econometric Society World Congress 2000 Contributed Papers 1417, Econometric Society.
    18. Darmoul Mokhtar & Nizar Harrathi, 2007. "Monetary information arrivals and intraday exchange rate volatility: a comparison of the GARCH and the EGARCH models," Post-Print halshs-00174996, HAL.
    19. Peter Malec, 2016. "A Semiparametric Intraday GARCH Model," Cambridge Working Papers in Economics 1633, Faculty of Economics, University of Cambridge.
    20. Weron, Rafal & Misiorek, Adam, 2008. "Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 744-763.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2306.11025. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.