IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2603.01820.html

How do standard time series forecasting benchmarks translate to finance? A broad study of risk adjusted performance

Author

Listed:
  • Adir Saly-Kaufmann
  • Kieran Wood
  • Jan-Peter Calliess
  • Stefan Zohren

Abstract

Forecasting financial asset returns is challenging due to low signal-to-noise ratios, non-stationarity and heavy-tailed distributions. We benchmark 16 deep learning architectures for time series forecasting, including Transformers, State Space Models (SSMs), xLSTMs and recurrent hybrids, on a 15-year daily futures dataset using an end-to-end volatility-targeted Sharpe ratio optimisation task. Our results challenge prevailing assumptions in the literature. Several widely used 'state-of-the-art' architectures, including generic Transformers and SSMs, underperformed a simple AR(1) benchmark in a realistic financial forecasting task. The strongest results came from comparatively simple hybrid approaches using recurrent structures: a Variable Selection Network combined with an LSTM achieved the highest Sharpe ratio, while xLSTM showed the greatest robustness to transaction costs. These findings suggest that success on standard time-series benchmarks does not reliably transfer to finance, and that architectures tailored to the unique properties of asset returns may remain more effective than generic attention-based approaches for financial forecasting.

Suggested Citation

  • Adir Saly-Kaufmann & Kieran Wood & Jan-Peter Calliess & Stefan Zohren, 2026. "How do standard time series forecasting benchmarks translate to finance? A broad study of risk adjusted performance," Papers 2603.01820, arXiv.org, revised Oct 2026.
  • Handle: RePEc:arx:papers:2603.01820
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2603.01820
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    2. Xinhe Liu & Wenmin Wang, 2024. "Deep Time Series Forecasting Models: A Comprehensive Survey," Mathematics, MDPI, vol. 12(10), pages 1-33, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aktaş Bozkurt, Melike, 2026. "Energy transition and geopolitical risk in clean and fossil energy with multiscale time-varying connectedness and deep learning forecasts," Applied Energy, Elsevier, vol. 413(C).
    2. Frederick Nsambu Kijjambu & Benjamin Musiita & Asaph Kaburura Katarangi & Geoffrey Kahangane & Sheilla Akampwera, 2023. "Determinants of Uganda’s Debt Sustainability: The Public Debt Dynamics Model in Perspective," Journal of Economics and Behavioral Studies, AMH International, vol. 15(4), pages 106-124.
    3. Hoang Anh Nguyen & Nhat Hoang Bach, 2026. "QI-HRNN: a quantum-inspired hybrid framework for resilient currency forecasting under extreme market conditions," Digital Finance, Springer, vol. 8(2), pages 1-40, June.
    4. Jang, Junkyu, 2025. "Selective news selection model for explainable stock prediction via cross-attention integration," Finance Research Letters, Elsevier, vol. 85(PD).
    5. Ali Atiah Alzahrani, 2026. "Verify Claims, Not Scores: Evidence-Based Verification of Modular Agents," Papers 2610.01348, arXiv.org.
    6. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    7. He, Miao & Jiang, Weiwei & Gu, Weixi, 2024. "TriChronoNet: Advancing electricity price prediction with Multi-module fusion," Applied Energy, Elsevier, vol. 371(C).
    8. Shovon Sengupta & Tanujit Chakraborty & Sunny Kumar Singh, 2024. "Forecasting CPI inflation under economic policy and geopolitical uncertainties," Post-Print hal-05056934, HAL.
    9. Pedro Reis & Ana Paula Serra & Jo~ao Gama, 2025. "The Role of Deep Learning in Financial Asset Management: A Systematic Review," Papers 2503.01591, arXiv.org.
    10. Tiantian Tu, 2025. "Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting," Papers 2504.19309, arXiv.org.
    11. Ali Atiah Alzahrani, 2025. "Multi-Agent Regime-Conditioned Diffusion (MARCD) for CVaR-Constrained Portfolio Decisions," Papers 2510.10807, arXiv.org, revised Nov 2025.
    12. Sengupta, Shovon & Chakraborty, Tanujit & Singh, Sunny Kumar, 2025. "Forecasting CPI inflation under economic policy and geopolitical uncertainties," International Journal of Forecasting, Elsevier, vol. 41(3), pages 953-981.
    13. Jiaze Sun & Kelvin J. L. Koa & Ruiyang Ni & Yize Liu & Haonan Chen & Ke-Wei Huang, 2026. "FinStressTS: A Parametric Synthetic Benchmark for Time-Series Forecasting in Finance," Papers 2606.03184, arXiv.org.
    14. Vegard H. Larsen & Leif Anders Thorsrud, 2026. "Using Transformers and Reinforcement Learning as Narrative Filters in Macroeconomics," Working Papers No 02/2026, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    15. Dong, Hanjiang & Zhu, Jizhong & Li, Shenglin & Wu, Wanli & Zhu, Haohao & Fan, Junwei, 2023. "Short-term residential household reactive power forecasting considering active power demand via deep Transformer sequence-to-sequence networks," Applied Energy, Elsevier, vol. 329(C).
    16. Ma, Tian & Wang, Wanwan & Jiang, Fuwei, 2025. "Machine learning the performance of hedge fund," Journal of International Money and Finance, Elsevier, vol. 155(C).
    17. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    18. Liu, Liang & Liu, Bolan & Zhong, Dawei & Hu, Zhenjin, 2026. "Thermal safety oriented energy management study for a P2 hybrid diesel-electric powertrain," Energy, Elsevier, vol. 351(C).
    19. Gerg, Isaac D. & Tashie, Arik M. & Patanaik, Amiya & Koester, Evan & Gupta, Himanshu & Farnham, David J., 2026. "The substantial role of weather data in consumer spending prediction: A robust machine learning assessment," Journal of Retailing and Consumer Services, Elsevier, vol. 90(C).
    20. Kate Murray & Andrea Rossi & Diego Carraro & Andrea Visentin, 2023. "On Forecasting Cryptocurrency Prices: A Comparison of Machine Learning, Deep Learning, and Ensembles," Forecasting, MDPI, vol. 5(1), pages 1-14, January.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2603.01820. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.