IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2505.19617.html
   My bibliography  Save this paper

Hybrid Models for Financial Forecasting: Combining Econometric, Machine Learning, and Deep Learning Models

Author

Listed:
  • Dominik Stempie'n
  • Robert 'Slepaczuk

Abstract

This research systematically develops and evaluates various hybrid modeling approaches by combining traditional econometric models (ARIMA and ARFIMA models) with machine learning and deep learning techniques (SVM, XGBoost, and LSTM models) to forecast financial time series. The empirical analysis is based on two distinct financial assets: the S&P 500 index and Bitcoin. By incorporating over two decades of daily data for the S&P 500 and almost ten years of Bitcoin data, the study provides a comprehensive evaluation of forecasting methodologies across different market conditions and periods of financial distress. Models' training and hyperparameter tuning procedure is performed using a novel three-fold dynamic cross-validation method. The applicability of applied models is evaluated using both forecast error metrics and trading performance indicators. The obtained findings indicate that the proper construction process of hybrid models plays a crucial role in developing profitable trading strategies, outperforming their individual components and the benchmark Buy&Hold strategy. The most effective hybrid model architecture was achieved by combining the econometric ARIMA model with either SVM or LSTM, under the assumption of a non-additive relationship between the linear and nonlinear components.

Suggested Citation

  • Dominik Stempie'n & Robert 'Slepaczuk, 2025. "Hybrid Models for Financial Forecasting: Combining Econometric, Machine Learning, and Deep Learning Models," Papers 2505.19617, arXiv.org.
  • Handle: RePEc:arx:papers:2505.19617
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2505.19617
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christos Floros & Shabbar Jaffry & Goncalo Valle Lima, 2007. "Long memory in the Portuguese stock market," Studies in Economics and Finance, Emerald Group Publishing Limited, vol. 24(3), pages 220-232, August.
    2. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Working Papers 111, Princeton University, Department of Economics, Center for Economic Policy Studies..
    3. Terui, Nobuhiko & van Dijk, Herman K., 2002. "Combined forecasts from linear and nonlinear time series models," International Journal of Forecasting, Elsevier, vol. 18(3), pages 421-438.
    4. Manish Kumar & M. Thenmozhi, 2014. "Forecasting stock index returns using ARIMA-SVM, ARIMA-ANN, and ARIMA-random forest hybrid models," International Journal of Banking, Accounting and Finance, Inderscience Enterprises Ltd, vol. 5(3), pages 284-308.
    5. Bhardwaj, Geetesh & Swanson, Norman R., 2006. "An empirical investigation of the usefulness of ARFIMA models for predicting macroeconomic and financial time series," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 539-578.
    6. Jinan Liu & Apostolos Serletis, 2019. "Volatility in the Cryptocurrency Market," Open Economies Review, Springer, vol. 30(4), pages 779-811, September.
    7. repec:pri:cepsud:91malkiel is not listed on IDEAS
    8. Hudson, Robert S. & Gregoriou, Andros, 2015. "Calculating and comparing security returns is harder than you think: A comparison between logarithmic and simple returns," International Review of Financial Analysis, Elsevier, vol. 38(C), pages 151-162.
    9. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    10. Bartosz Bieganowski & Robert Slepaczuk, 2024. "Supervised Autoencoder MLP for Financial Time Series Forecasting," Papers 2404.01866, arXiv.org, revised Jun 2024.
    11. Hibon, Michele & Evgeniou, Theodoros, 2005. "To combine or not to combine: selecting among forecasts and their combinations," International Journal of Forecasting, Elsevier, vol. 21(1), pages 15-24.
    12. Bouteska, Ahmed & Abedin, Mohammad Zoynul & Hajek, Petr & Yuan, Kunpeng, 2024. "Cryptocurrency price forecasting – A comparative analysis of ensemble learning and deep learning methods," International Review of Financial Analysis, Elsevier, vol. 92(C).
    13. Sergio Castellano Gómez & Robert Ślepaczuk, 2021. "Robust optimisation in algorithmic investment strategies," Working Papers 2021-27, Faculty of Economic Sciences, University of Warsaw.
    14. Erdinc Akyildirim & Oguzhan Cepni & Shaen Corbet & Gazi Salah Uddin, 2023. "Forecasting mid-price movement of Bitcoin futures using machine learning," Annals of Operations Research, Springer, vol. 330(1), pages 553-584, November.
    15. Xiang Wu & Liang Wu & Shujuan Chen, 2022. "Long memory and efficiency of Bitcoin during COVID-19," Applied Economics, Taylor & Francis Journals, vol. 54(4), pages 375-389, January.
    16. Chlebus Marcin & Dyczko Michał & Woźniak Michał, 2021. "Nvidia's Stock Returns Prediction Using Machine Learning Techniques for Time Series Forecasting Problem," Central European Economic Journal, Sciendo, vol. 8(55), pages 44-62, January.
    17. repec:eme:sef000:10867370710817400 is not listed on IDEAS
    18. Jinan Liu & Apostolos Serletis, 2019. "Volatility in the Cryptocurrency Market," Open Economies Review, Springer, vol. 30(4), pages 779-811, September.
    19. Wei Bao & Jun Yue & Yulei Rao, 2017. "A deep learning framework for financial time series using stacked autoencoders and long-short term memory," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-24, July.
    20. Lo, Andrew W, 1991. "Long-Term Memory in Stock Market Prices," Econometrica, Econometric Society, vol. 59(5), pages 1279-1313, September.
    21. Harvey,Andrew C., 1991. "Forecasting, Structural Time Series Models and the Kalman Filter," Cambridge Books, Cambridge University Press, number 9780521405737, September.
    22. Ambreen Khursheed & Muhammad Naeem & Sheraz Ahmed & Faisal Mustafa & David McMillan, 2020. "Adaptive market hypothesis: An empirical analysis of time –varying market efficiency of cryptocurrencies," Cogent Economics & Finance, Taylor & Francis Journals, vol. 8(1), pages 1719574-171, January.
    23. Granger, Clive W. J. & Ding, Zhuanxin, 1996. "Varieties of long memory models," Journal of Econometrics, Elsevier, vol. 73(1), pages 61-77, July.
    24. Pai, Ping-Feng & Lin, Chih-Sheng, 2005. "A hybrid ARIMA and support vector machines model in stock price forecasting," Omega, Elsevier, vol. 33(6), pages 497-505, December.
    25. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    26. John Barkoulas & Christopher Baum & Nickolaos Travlos, 2000. "Long memory in the Greek stock market," Applied Financial Economics, Taylor & Francis Journals, vol. 10(2), pages 177-184.
    27. Cheung, Yin-Wong & Lai, Kon S., 1995. "A search for long memory in international stock market returns," Journal of International Money and Finance, Elsevier, vol. 14(4), pages 597-615, August.
    28. Jiang, Yonghong & Nie, He & Ruan, Weihua, 2018. "Time-varying long-term memory in Bitcoin market," Finance Research Letters, Elsevier, vol. 25(C), pages 280-284.
    29. Koustas, Zisimos & Serletis, Apostolos, 2005. "Rational bubbles or persistent deviations from market fundamentals?," Journal of Banking & Finance, Elsevier, vol. 29(10), pages 2523-2539, October.
    30. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    31. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Journal of Economic Perspectives, American Economic Association, vol. 17(1), pages 59-82, Winter.
    32. C. W. J. Granger & Roselyne Joyeux, 1980. "An Introduction To Long‐Memory Time Series Models And Fractional Differencing," Journal of Time Series Analysis, Wiley Blackwell, vol. 1(1), pages 15-29, January.
    33. Wang, Ju-Jie & Wang, Jian-Zhou & Zhang, Zhe-George & Guo, Shu-Po, 2012. "Stock index forecasting based on a hybrid model," Omega, Elsevier, vol. 40(6), pages 758-766.
    34. Carmen López-Martín & Sonia Benito Muela & Raquel Arguedas, 2021. "Efficiency in cryptocurrency markets: new evidence," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 11(3), pages 403-431, September.
    35. Christos Floros & Shabbar Jaffry & Goncalo Valle Lima, 2007. "Long memory in the Portuguese stock market," Studies in Economics and Finance, Emerald Group Publishing Limited, vol. 24(3), pages 220-232, August.
    36. Sami Ben Jabeur & Salma Mefteh-Wali & Jean-Laurent Viviani, 2024. "Forecasting gold price with the XGBoost algorithm and SHAP interaction values," Annals of Operations Research, Springer, vol. 334(1), pages 679-699, March.
    37. Dev Shah & Haruna Isah & Farhana Zulkernine, 2019. "Stock Market Analysis: A Review and Taxonomy of Prediction Techniques," IJFS, MDPI, vol. 7(2), pages 1-22, May.
    38. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Working Papers 111, Princeton University, Department of Economics, Center for Economic Policy Studies..
    39. Fischer, Thomas & Krauss, Christopher, 2018. "Deep learning with long short-term memory networks for financial market predictions," European Journal of Operational Research, Elsevier, vol. 270(2), pages 654-669.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominik Stempie'n & Janusz Gajda, 2025. "Comparative analysis of financial data differentiation techniques using LSTM neural network," Papers 2505.19243, arXiv.org.
    2. Heni Boubaker & Giorgio Canarella & Rangan Gupta & Stephen M. Miller, 2023. "A Hybrid ARFIMA Wavelet Artificial Neural Network Model for DJIA Index Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 62(4), pages 1801-1843, December.
    3. Fayssal Jamhamed & Franck Martin & Fabien Rondeau & Josué Thélissaint & Stéphane Tufféry, 2024. "Regime-Specific Dynamics and Informational Efficiency in Cryptomarkets: Evidence from Gaussian Mixture Models," Economics Working Paper Archive (University of Rennes & University of Caen) 2024-13, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS.
    4. Chaker Aloui & Duc Khuong Nguyen, 2014. "On the detection of extreme movements and persistent behaviour in Mediterranean stock markets: a wavelet-based approach," Applied Economics, Taylor & Francis Journals, vol. 46(22), pages 2611-2622, August.
    5. Golinski, Adam & Madeira, Joao & Rambaccussing, Dooruj, 2014. "Fractional Integration of the Price-Dividend Ratio in a Present-Value Model," MPRA Paper 58554, University Library of Munich, Germany.
    6. Ashok Chanabasangouda Patil & Shailesh Rastogi, 2019. "Time-Varying Price–Volume Relationship and Adaptive Market Efficiency: A Survey of the Empirical Literature," JRFM, MDPI, vol. 12(2), pages 1-18, June.
    7. Shalini Sharma & Víctor Elvira & Emilie Chouzenoux & Angshul Majumdar, 2021. "Recurrent Dictionary Learning for State-Space Models with an Application in Stock Forecasting," Post-Print hal-03184841, HAL.
    8. Montserrat Reyna Miranda & Ricardo Massa Roldán & Vicente Gómez Salcido, 2022. "Neuro-wavelet Model for price prediction in high-frequency data in the Mexican Stock market," Remef - Revista Mexicana de Economía y Finanzas Nueva Época REMEF (The Mexican Journal of Economics and Finance), Instituto Mexicano de Ejecutivos de Finanzas, IMEF, vol. 17(1), pages 1-23, Enero - M.
    9. Kasman, Adnan & Kasman, Saadet & Torun, Erdost, 2009. "Dual long memory property in returns and volatility: Evidence from the CEE countries' stock markets," Emerging Markets Review, Elsevier, vol. 10(2), pages 122-139, June.
    10. Dushmanta Kumar Padhi & Neelamadhab Padhy & Akash Kumar Bhoi & Jana Shafi & Muhammad Fazal Ijaz, 2021. "A Fusion Framework for Forecasting Financial Market Direction Using Enhanced Ensemble Models and Technical Indicators," Mathematics, MDPI, vol. 9(21), pages 1-31, October.
    11. Sensoy, Ahmet & Tabak, Benjamin M., 2015. "Time-varying long term memory in the European Union stock markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 436(C), pages 147-158.
    12. Adnan Kasman & Erdost Torun, 2007. "Long Memory in the Turkish Stock Market Return and Volatility," Central Bank Review, Research and Monetary Policy Department, Central Bank of the Republic of Turkey, vol. 7(2), pages 13-27.
    13. Saqib Farid & Rubeena Tashfeen & Tahseen Mohsan & Arsal Burhan, 2023. "Forecasting stock prices using a data mining method: Evidence from emerging market," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 1911-1917, April.
    14. Basak, Suryoday & Kar, Saibal & Saha, Snehanshu & Khaidem, Luckyson & Dey, Sudeepa Roy, 2019. "Predicting the direction of stock market prices using tree-based classifiers," The North American Journal of Economics and Finance, Elsevier, vol. 47(C), pages 552-567.
    15. Rasim Özcan & Asad ul Islam KHAN & Sundas Iftikhar, 2024. "Whether The Cr Whether The Crypto Market Is Efficient? E et Is Efficient? Evidence F vidence From Testing The Validity Of The Efficient Market Hypothesis," Bulletin of Monetary Economics and Banking, Bank Indonesia, vol. 27(1), pages 113-132, March.
    16. Rocha Filho, Tareísio M. & Rocha, Paulo M.M., 2020. "Evidence of inefficiency of the Brazilian stock market: The IBOVESPA future contracts," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 543(C).
    17. Firat Melih Yilmaz & Engin Yildiztepe, 2024. "Statistical Evaluation of Deep Learning Models for Stock Return Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 63(1), pages 221-244, January.
    18. Irfan Javid & Rozaida Ghazali & Irteza Syed & Muhammad Zulqarnain & Noor Aida Husaini, 2022. "Study on the Pakistan stock market using a new stock crisis prediction method," PLOS ONE, Public Library of Science, vol. 17(10), pages 1-24, October.
    19. Patrick Bisciari & Alain Durré & Alain Nyssens, 2003. "Stock market valuation in the United States," Working Paper Document 41, National Bank of Belgium.
    20. Ignacio Escanuela Romana & Clara Escanuela Nieves, 2023. "A spectral approach to stock market performance," Papers 2305.05762, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2505.19617. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.