IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2311.07513.html
   My bibliography  Save this paper

A Hypothesis on Good Practices for AI-based Systems for Financial Time Series Forecasting: Towards Domain-Driven XAI Methods

Author

Listed:
  • Branka Hadji Misheva
  • Joerg Osterrieder

Abstract

Machine learning and deep learning have become increasingly prevalent in financial prediction and forecasting tasks, offering advantages such as enhanced customer experience, democratising financial services, improving consumer protection, and enhancing risk management. However, these complex models often lack transparency and interpretability, making them challenging to use in sensitive domains like finance. This has led to the rise of eXplainable Artificial Intelligence (XAI) methods aimed at creating models that are easily understood by humans. Classical XAI methods, such as LIME and SHAP, have been developed to provide explanations for complex models. While these methods have made significant contributions, they also have limitations, including computational complexity, inherent model bias, sensitivity to data sampling, and challenges in dealing with feature dependence. In this context, this paper explores good practices for deploying explainability in AI-based systems for finance, emphasising the importance of data quality, audience-specific methods, consideration of data properties, and the stability of explanations. These practices aim to address the unique challenges and requirements of the financial industry and guide the development of effective XAI tools.

Suggested Citation

  • Branka Hadji Misheva & Joerg Osterrieder, 2023. "A Hypothesis on Good Practices for AI-based Systems for Financial Time Series Forecasting: Towards Domain-Driven XAI Methods," Papers 2311.07513, arXiv.org.
    • Handle: RePEc:arx:papers:2311.07513
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2311.07513
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Deniz Can Yıldırım & Ismail Hakkı Toroslu & Ugo Fiore, 2021. "Forecasting directional movement of Forex data using LSTM with technical and macroeconomic indicators," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-36, December.
    2. Parley Ruogu Yang, 2021. "Forecasting high-frequency financial time series: an adaptive learning approach with the order book data," Papers 2103.00264, arXiv.org.
    3. Daníelsson, Jón & Macrae, Robert & Uthemann, Andreas, 2022. "Artificial intelligence and systemic risk," Journal of Banking & Finance, Elsevier, vol. 140(C).
    4. Marc Wildi & Branka Hadji Misheva, 2022. "A Time Series Approach to Explainability for Neural Nets with Applications to Risk-Management and Fraud Detection," Papers 2212.02906, arXiv.org.
    5. Aslam, Faheem & Hunjra, Ahmed Imran & Ftiti, Zied & Louhichi, Wael & Shams, Tahira, 2022. "Insurance fraud detection: Evidence from artificial intelligence and machine learning," Research in International Business and Finance, Elsevier, vol. 62(C).
    6. Zexin Hu & Yiqi Zhao & Matloob Khushi, 2021. "A Survey of Forex and Stock Price Prediction Using Deep Learning," Papers 2103.09750, arXiv.org.
    7. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    8. Jaydip Sen & Sidra Mehtab, 2021. "Design and Analysis of Robust Deep Learning Models for Stock Price Prediction," Papers 2106.09664, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marc Wildi & Branka Hadji Misheva, 2022. "A Time Series Approach to Explainability for Neural Nets with Applications to Risk-Management and Fraud Detection," Papers 2212.02906, arXiv.org.
    2. Yunze Li & Yanan Xie & Chen Yu & Fangxing Yu & Bo Jiang & Matloob Khushi, 2021. "Feature importance recap and stacking models for forex price prediction," Papers 2107.14092, arXiv.org.
    3. Mimansa Rana & Nanxiang Mao & Ming Ao & Xiaohui Wu & Poning Liang & Matloob Khushi, 2021. "Clustering and attention model based for intelligent trading," Papers 2107.06782, arXiv.org, revised Aug 2021.
    4. Abedin, Mohammad Zoynul & Hajek, Petr & Sharif, Taimur & Satu, Md. Shahriare & Khan, Md. Imran, 2023. "Modelling bank customer behaviour using feature engineering and classification techniques," Research in International Business and Finance, Elsevier, vol. 65(C).
    5. Hongcheng Ding & Xuanze Zhao & Zixiao Jiang & Shamsul Nahar Abdullah & Deshinta Arrova Dewi, 2024. "EUR-USD Exchange Rate Forecasting Based on Information Fusion with Large Language Models and Deep Learning Methods," Papers 2408.13214, arXiv.org.
    6. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    7. Tiantian Tu, 2025. "Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting," Papers 2504.19309, arXiv.org.
    8. Jian Guo & Saizhuo Wang & Lionel M. Ni & Heung-Yeung Shum, 2022. "Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence," Papers 2301.04020, arXiv.org.
    9. Alroomi, Azzam & Karamatzanis, Georgios & Nikolopoulos, Konstantinos & Tilba, Anna & Xiao, Shujun, 2022. "Fathoming empirical forecasting competitions’ winners," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1519-1525.
    10. d'Aspremont, Alexandre & Ben Arous, Simon & Bricongne, Jean-Charles & Lietti, Benjamin & Meunier, Baptiste, 2025. "Satellites turn “concrete”: Tracking cement with satellite data and neural networks," Journal of Econometrics, Elsevier, vol. 249(PC).
    11. Spiliotis, Evangelos & Petropoulos, Fotios, 2024. "On the update frequency of univariate forecasting models," European Journal of Operational Research, Elsevier, vol. 314(1), pages 111-121.
    12. Fantazzini, Dean, 2020. "Short-term forecasting of the COVID-19 pandemic using Google Trends data: Evidence from 158 countries," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 59, pages 33-54.
    13. Van Belle, Jente & Guns, Tias & Verbeke, Wouter, 2021. "Using shared sell-through data to forecast wholesaler demand in multi-echelon supply chains," European Journal of Operational Research, Elsevier, vol. 288(2), pages 466-479.
    14. Gupta, Somya & Hassen, Majdi & Pandey, Dharen Kumar & Sahu, Ganesh P., 2024. "Cognitive, affective, and normative factors affecting digital insurance adoption among persons with disabilities: A two-stage SEM-ANN analysis," Global Finance Journal, Elsevier, vol. 63(C).
    15. Mohammad Zoynul Abedin & Mahmudul Hasan Moon & M. Kabir Hassan & Petr Hajek, 2025. "Deep learning-based exchange rate prediction during the COVID-19 pandemic," Annals of Operations Research, Springer, vol. 345(2), pages 1335-1386, February.
    16. Hakan Pabuccu & Adrian Barbu, 2023. "Feature Selection with Annealing for Forecasting Financial Time Series," Papers 2303.02223, arXiv.org, revised Feb 2024.
    17. Barkan, Oren & Benchimol, Jonathan & Caspi, Itamar & Cohen, Eliya & Hammer, Allon & Koenigstein, Noam, 2023. "Forecasting CPI inflation components with Hierarchical Recurrent Neural Networks," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1145-1162.
    18. Anton Gerunov, 2023. "Modern Approaches To Forecasting Firm Default Rates Over The Short To Medium Term: An Application To A Panel Of Polish Companies," Yearbook of the Faculty of Economics and Business Administration, Sofia University, Faculty of Economics and Business Administration, Sofia University St Kliment Ohridski - Bulgaria, vol. 22(1), pages 5-15, October.
    19. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    20. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2311.07513. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.