IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2311.07513.html
   My bibliography  Save this paper

A Hypothesis on Good Practices for AI-based Systems for Financial Time Series Forecasting: Towards Domain-Driven XAI Methods

Author

Listed:
  • Branka Hadji Misheva
  • Joerg Osterrieder

Abstract

Machine learning and deep learning have become increasingly prevalent in financial prediction and forecasting tasks, offering advantages such as enhanced customer experience, democratising financial services, improving consumer protection, and enhancing risk management. However, these complex models often lack transparency and interpretability, making them challenging to use in sensitive domains like finance. This has led to the rise of eXplainable Artificial Intelligence (XAI) methods aimed at creating models that are easily understood by humans. Classical XAI methods, such as LIME and SHAP, have been developed to provide explanations for complex models. While these methods have made significant contributions, they also have limitations, including computational complexity, inherent model bias, sensitivity to data sampling, and challenges in dealing with feature dependence. In this context, this paper explores good practices for deploying explainability in AI-based systems for finance, emphasising the importance of data quality, audience-specific methods, consideration of data properties, and the stability of explanations. These practices aim to address the unique challenges and requirements of the financial industry and guide the development of effective XAI tools.

Suggested Citation

  • Branka Hadji Misheva & Joerg Osterrieder, 2023. "A Hypothesis on Good Practices for AI-based Systems for Financial Time Series Forecasting: Towards Domain-Driven XAI Methods," Papers 2311.07513, arXiv.org.
    • Handle: RePEc:arx:papers:2311.07513
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2311.07513
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Deniz Can Yıldırım & Ismail Hakkı Toroslu & Ugo Fiore, 2021. "Forecasting directional movement of Forex data using LSTM with technical and macroeconomic indicators," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-36, December.
    2. Parley Ruogu Yang, 2021. "Forecasting high-frequency financial time series: an adaptive learning approach with the order book data," Papers 2103.00264, arXiv.org.
    3. Marc Wildi & Branka Hadji Misheva, 2022. "A Time Series Approach to Explainability for Neural Nets with Applications to Risk-Management and Fraud Detection," Papers 2212.02906, arXiv.org.
    4. Zexin Hu & Yiqi Zhao & Matloob Khushi, 2021. "A Survey of Forex and Stock Price Prediction Using Deep Learning," Papers 2103.09750, arXiv.org.
    5. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    6. Jaydip Sen & Sidra Mehtab, 2021. "Design and Analysis of Robust Deep Learning Models for Stock Price Prediction," Papers 2106.09664, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marc Wildi & Branka Hadji Misheva, 2022. "A Time Series Approach to Explainability for Neural Nets with Applications to Risk-Management and Fraud Detection," Papers 2212.02906, arXiv.org.
    2. Yunze Li & Yanan Xie & Chen Yu & Fangxing Yu & Bo Jiang & Matloob Khushi, 2021. "Feature importance recap and stacking models for forex price prediction," Papers 2107.14092, arXiv.org.
    3. Mimansa Rana & Nanxiang Mao & Ming Ao & Xiaohui Wu & Poning Liang & Matloob Khushi, 2021. "Clustering and attention model based for intelligent trading," Papers 2107.06782, arXiv.org, revised Aug 2021.
    4. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    5. Tsoumalis, Georgios I. & Bampos, Zafeirios N. & Biskas, Pandelis N. & Keranidis, Stratos D. & Symeonidis, Polychronis A. & Voulgarakis, Dimitrios K., 2022. "A novel system for providing explicit demand response from domestic natural gas boilers," Applied Energy, Elsevier, vol. 317(C).
    6. Jian Guo & Saizhuo Wang & Lionel M. Ni & Heung-Yeung Shum, 2022. "Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence," Papers 2301.04020, arXiv.org.
    7. Bojer, Casper Solheim & Meldgaard, Jens Peder, 2021. "Kaggle forecasting competitions: An overlooked learning opportunity," International Journal of Forecasting, Elsevier, vol. 37(2), pages 587-603.
    8. Alroomi, Azzam & Karamatzanis, Georgios & Nikolopoulos, Konstantinos & Tilba, Anna & Xiao, Shujun, 2022. "Fathoming empirical forecasting competitions’ winners," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1519-1525.
    9. Aspremont Alexandre & Ben Arous Simon & Bricongne Jean-Charles & Lietti Benjamin & Meunier Baptiste, 2023. "Satellites Turn “Concrete”: Tracking Cement with Satellite Data and Neural Networks," Working papers 916, Banque de France.
    10. Fantazzini, Dean, 2020. "Short-term forecasting of the COVID-19 pandemic using Google Trends data: Evidence from 158 countries," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 59, pages 33-54.
    11. Winita Sulandari & Yudho Yudhanto & Sri Subanti & Crisma Devika Setiawan & Riskhia Hapsari & Paulo Canas Rodrigues, 2023. "Comparing the Simple to Complex Automatic Methods with the Ensemble Approach in Forecasting Electrical Time Series Data," Energies, MDPI, vol. 16(22), pages 1-16, November.
    12. Van Belle, Jente & Guns, Tias & Verbeke, Wouter, 2021. "Using shared sell-through data to forecast wholesaler demand in multi-echelon supply chains," European Journal of Operational Research, Elsevier, vol. 288(2), pages 466-479.
    13. Nghia Chu & Binh Dao & Nga Pham & Huy Nguyen & Hien Tran, 2022. "Predicting Mutual Funds' Performance using Deep Learning and Ensemble Techniques," Papers 2209.09649, arXiv.org, revised Jul 2023.
    14. Yuze Lu & Hailong Zhang & Qiwen Guo, 2023. "Stock and market index prediction using Informer network," Papers 2305.14382, arXiv.org.
    15. Liping Wang & Jiawei Li & Lifan Zhao & Zhizhuo Kou & Xiaohan Wang & Xinyi Zhu & Hao Wang & Yanyan Shen & Lei Chen, 2023. "Methods for Acquiring and Incorporating Knowledge into Stock Price Prediction: A Survey," Papers 2308.04947, arXiv.org.
    16. Sprangers, Olivier & Schelter, Sebastian & de Rijke, Maarten, 2023. "Parameter-efficient deep probabilistic forecasting," International Journal of Forecasting, Elsevier, vol. 39(1), pages 332-345.
    17. Hakan Pabuccu & Adrian Barbu, 2023. "Feature Selection with Annealing for Forecasting Financial Time Series," Papers 2303.02223, arXiv.org, revised Feb 2024.
    18. Barkan, Oren & Benchimol, Jonathan & Caspi, Itamar & Cohen, Eliya & Hammer, Allon & Koenigstein, Noam, 2023. "Forecasting CPI inflation components with Hierarchical Recurrent Neural Networks," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1145-1162.
    19. Jaydip Sen & Arpit Awad & Aaditya Raj & Gourav Ray & Pusparna Chakraborty & Sanket Das & Subhasmita Mishra, 2022. "Stock Performance Evaluation for Portfolio Design from Different Sectors of the Indian Stock Market," Papers 2208.07166, arXiv.org.
    20. Anton Gerunov, 2023. "Modern Approaches To Forecasting Firm Default Rates Over The Short To Medium Term: An Application To A Panel Of Polish Companies," Yearbook of the Faculty of Economics and Business Administration, Sofia University, Faculty of Economics and Business Administration, Sofia University St Kliment Ohridski - Bulgaria, vol. 22(1), pages 5-15, October.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2311.07513. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.