IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2603.16886.html

A Controlled Comparison of Deep Learning Architectures for Multi-Horizon Financial Forecasting: Evidence from 918 Experiments

Author

Listed:
  • Nabeel Ahmad Saidd

Abstract

Multi-horizon price forecasting is central to portfolio allocation, risk management, and algorithmic trading, yet deep learning architectures have proliferated faster than rigorous financial benchmarks can evaluate them. This study provides a controlled comparison of nine architectures (Autoformer, DLinear, iTransformer, LSTM, ModernTCN, N-HiTS, PatchTST, TimesNet, and TimeXer) spanning Transformer, MLP, CNN, and RNN families across cryptocurrency, forex, and equity index markets at 4-hour and 24-hour horizons. A total of 918 experiments were conducted under a strict five-stage protocol including fixed-seed Bayesian hyperparameter optimization, configuration freezing per asset class, multi-seed retraining, uncertainty aggregation, and statistical validation. ModernTCN achieves the best mean rank (1.333) with a 75 percent first-place rate, followed by PatchTST (2.000). Results reveal a clear three-tier ranking structure and show that architecture explains nearly all performance variance, while seed randomness is negligible. Rankings remain stable across horizons despite 2 to 2.5 times error amplification. Directional accuracy remains near 50 percent across all configurations, indicating that MSE-trained models lack directional skill at hourly resolution. The findings highlight the importance of architectural inductive bias over raw parameter count and provide reproducible guidance for multi-step financial forecasting.

Suggested Citation

  • Nabeel Ahmad Saidd, 2026. "A Controlled Comparison of Deep Learning Architectures for Multi-Horizon Financial Forecasting: Evidence from 918 Experiments," Papers 2603.16886, arXiv.org.
  • Handle: RePEc:arx:papers:2603.16886
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2603.16886
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    2. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    3. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    4. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    5. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    6. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    7. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    8. Guillaume Chevillon, 2007. "Direct Multi‐Step Estimation And Forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 21(4), pages 746-785, September.
    9. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kei Nakagawa & Masanori Hirano & Kentaro Minami & Takanobu Mizuta, 2024. "A Multi-agent Market Model Can Explain the Impact of AI Traders in Financial Markets -- A New Microfoundations of GARCH model," Papers 2409.12516, arXiv.org.
    2. Yudong Wang & Chongfeng Wu, 2013. "Efficiency of Crude Oil Futures Markets: New Evidence from Multifractal Detrending Moving Average Analysis," Computational Economics, Springer;Society for Computational Economics, vol. 42(4), pages 393-414, December.
    3. Abdulrahman Alswaidan & Jeffrey D. Varner, 2026. "Hybrid Hidden Markov Model for Modeling Equity Excess Growth Rate Dynamics: A Discrete-State Approach with Jump-Diffusion," Papers 2603.10202, arXiv.org, revised Apr 2026.
    4. Tetsuya Takaishi, 2021. "Time-varying properties of asymmetric volatility and multifractality in Bitcoin," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-21, February.
    5. Arvid Oskar Ivar Hoffmann & Wander Jager & J. H. Von Eije, 2007. "Social Simulation of Stock Markets: Taking It to the Next Level," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-7.
    6. Héctor Raúl Olivares-Sánchez & Carlos Manuel Rodríguez-Martínez & Héctor Francisco Coronel-Brizio & Enrico Scalas & Thomas Henry Seligman & Alejandro Raúl Hernández-Montoya, 2022. "An empirical data analysis of “price runs” in daily financial indices: Dynamically assessing market geometric distributional behavior," PLOS ONE, Public Library of Science, vol. 17(7), pages 1-25, July.
    7. Claudeci Da Silva & Hugo Agudelo Murillo & Joaquim Miguel Couto, 2014. "Early Warning Systems: Análise De Ummodelo Probit De Contágio De Crise Dos Estados Unidos Para O Brasil(2000-2010)," Anais do XL Encontro Nacional de Economia [Proceedings of the 40th Brazilian Economics Meeting] 110, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics].
    8. Borkowski, Bolesław & Krawiec, Monika & Shachmurove, Yochanan, 2013. "Impact of volatility estimation method on theoretical option values," Global Finance Journal, Elsevier, vol. 24(2), pages 119-128.
    9. Inoua, Sabiou M. & Smith, Vernon L., 2023. "A classical model of speculative asset price dynamics," Journal of Behavioral and Experimental Finance, Elsevier, vol. 37(C).
    10. Muhammad Anas & Syed Jawad Hussain Shahzad & Larisa Yarovaya, 2024. "The use of high-frequency data in cryptocurrency research: a meta-review of literature with bibliometric analysis," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-31, December.
    11. Boleslaw Borkowski & Monika Krawiec & Yochanan Shachmurove, 2013. "Modeling and Estimating Volatility of Options on Standard & Poor’s 500 Index," PIER Working Paper Archive 13-015, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    12. Terence Tai-Leung Chong & Siqi Hou, 2021. "Will stock rise on Valentine’s Day?," Review of Behavioral Finance, Emerald Group Publishing Limited, vol. 14(5), pages 646-667, May.
    13. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    14. Samet Günay & Yanlin Shi, 2016. "Long-Memory in Volatilities of CDS Spreads: Evidences from the Emerging Markets," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(1), pages 122-137, March.
    15. Wang, Yudong & Wu, Chongfeng, 2012. "Long memory in energy futures markets: Further evidence," Resources Policy, Elsevier, vol. 37(3), pages 261-272.
    16. Tetsuya Takaishi, 2021. "Time-varying properties of asymmetric volatility and multifractality in Bitcoin," Papers 2102.07425, arXiv.org.
    17. Godahewa, Rakshitha & Bergmeir, Christoph & Erkin Baz, Zeynep & Zhu, Chengjun & Song, Zhangdi & García, Salvador & Benavides, Dario, 2025. "On forecast stability," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1539-1558.
    18. Kakade, Kshitij & Jain, Ishan & Mishra, Aswini Kumar, 2022. "Value-at-Risk forecasting: A hybrid ensemble learning GARCH-LSTM based approach," Resources Policy, Elsevier, vol. 78(C).
    19. Boudewijn de Bruin & Christian Walter, 2017. "Research Habits in Financial Modelling: The Case of Non-normality of Market Returns in the 1970s and the 1980s," Post-Print hal-04561125, HAL.
    20. Alexandre Subbotin, 2009. "Volatility Models: from Conditional Heteroscedasticity to Cascades at Multiple Horizons," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 15(3), pages 94-138.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2603.16886. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.