IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v63y2024i1d10.1007_s10614-022-10338-3.html
   My bibliography  Save this article

Statistical Evaluation of Deep Learning Models for Stock Return Forecasting

Author

Listed:
  • Firat Melih Yilmaz

    (Dokuz Eylul University)

  • Engin Yildiztepe

    (Dokuz Eylul University)

Abstract

Artificial intelligence applications, including algorithmic training, portfolio allocation, and stock return forecasting in the financial industry, are rapidly developing research fields. Particularly, the forecasting of stock return has received considerable attention. Selecting the most promising model to forecast stock return has always been the most prominent task in the literature. Several studies have reported the prediction ability of recurrent neural network (RNN) models, whereas only a few studies have rigorously evaluated the prediction performance of temporal convolution networks (TCNs) for stock return forecasting settings. Moreover, although most studies are focused on comparing the performance of deep learning models at a single horizon forecasting, the multi-horizon forecasting applications of stock return have been studied only limitedly. In this study, we aim to evaluate the forecasting performance of state-of-the-art deep learning models at multi-horizon forecasting paths in stock return forecasting tasks. Specifically, we focus on TCNs, RNNs, long short-term memory, and gated recurrent unit models in terms of forecasting performance and direction accuracy. Our evaluation framework based on the model confidence set shows which model(s) is (are) better, with statistical significance, for forecasting stock return at multi-horizon forecasting. The empirical results assert that the TCN model has the best out-of-sample forecasting performance at all forecasting horizons on three financial datasets compared to other models.

Suggested Citation

  • Firat Melih Yilmaz & Engin Yildiztepe, 2024. "Statistical Evaluation of Deep Learning Models for Stock Return Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 63(1), pages 221-244, January.
  • Handle: RePEc:kap:compec:v:63:y:2024:i:1:d:10.1007_s10614-022-10338-3
    DOI: 10.1007/s10614-022-10338-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-022-10338-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-022-10338-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gabriel Perez‐Quiros & Allan Timmermann, 2000. "Firm Size and Cyclical Variations in Stock Returns," Journal of Finance, American Finance Association, vol. 55(3), pages 1229-1262, June.
    2. Liam A. Gallagher & Mark P. Taylor, 2002. "Permanent and Temporary Components of Stock Prices: Evidence from Assessing Macroeconomic Shocks," Southern Economic Journal, John Wiley & Sons, vol. 69(2), pages 345-362, October.
    3. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    4. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    5. Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-565, October.
    6. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    7. Andersen, Torben G. & Bollerslev, Tim & Meddahi, Nour, 2011. "Realized volatility forecasting and market microstructure noise," Journal of Econometrics, Elsevier, vol. 160(1), pages 220-234, January.
    8. Ahmet Murat Ozbayoglu & Mehmet Ugur Gudelek & Omer Berat Sezer, 2020. "Deep Learning for Financial Applications : A Survey," Papers 2002.05786, arXiv.org.
    9. Epaminondas Panas, 2001. "Estimating fractal dimension using stable distributions and exploring long memory through ARFIMA models in Athens Stock Exchange," Applied Financial Economics, Taylor & Francis Journals, vol. 11(4), pages 395-402.
    10. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Working Papers 111, Princeton University, Department of Economics, Center for Economic Policy Studies..
    11. Perez-Rodriguez, Jorge V. & Torra, Salvador & Andrada-Felix, Julian, 2005. "STAR and ANN models: forecasting performance on the Spanish "Ibex-35" stock index," Journal of Empirical Finance, Elsevier, vol. 12(3), pages 490-509, June.
    12. Fama, Eugene F, 1991. "Efficient Capital Markets: II," Journal of Finance, American Finance Association, vol. 46(5), pages 1575-1617, December.
    13. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Working Papers 111, Princeton University, Department of Economics, Center for Economic Policy Studies..
    14. Jun Zhang & Lan Li & Wei Chen, 2021. "Predicting Stock Price Using Two-Stage Machine Learning Techniques," Computational Economics, Springer;Society for Computational Economics, vol. 57(4), pages 1237-1261, April.
    15. Timmermann, Allan & Granger, Clive W. J., 2004. "Efficient market hypothesis and forecasting," International Journal of Forecasting, Elsevier, vol. 20(1), pages 15-27.
    16. repec:pri:cepsud:91malkiel is not listed on IDEAS
    17. Peter F. Christoffersen & Francis X. Diebold, 2006. "Financial Asset Returns, Direction-of-Change Forecasting, and Volatility Dynamics," Management Science, INFORMS, vol. 52(8), pages 1273-1287, August.
    18. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    19. Sarantis, Nicholas, 2001. "Nonlinearities, cyclical behaviour and predictability in stock markets: international evidence," International Journal of Forecasting, Elsevier, vol. 17(3), pages 459-482.
    20. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    21. Burton G. Malkiel, 2003. "The Efficient Market Hypothesis and Its Critics," Journal of Economic Perspectives, American Economic Association, vol. 17(1), pages 59-82, Winter.
    22. Fischer, Thomas & Krauss, Christopher, 2018. "Deep learning with long short-term memory networks for financial market predictions," European Journal of Operational Research, Elsevier, vol. 270(2), pages 654-669.
    23. Brandt, Michael W. & Jones, Christopher S., 2006. "Volatility Forecasting With Range-Based EGARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 470-486, October.
    24. Mauro Bernardi & Leopoldo Catania, 2018. "The model confidence set package for R," International Journal of Computational Economics and Econometrics, Inderscience Enterprises Ltd, vol. 8(2), pages 144-158.
    25. Rogier Quaedvlieg, 2021. "Multi-Horizon Forecast Comparison," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 40-53, January.
    26. Imad Moosa & John Vaz, 2015. "Why is it so difficult to outperform the random walk? An application of the Meese-Rogoff puzzle to stock prices," Applied Economics, Taylor & Francis Journals, vol. 47(4), pages 398-407, January.
    27. #Name#, 2001. "Non-Linear Predictability of Stock Market Returns: Evidence from Non-Parametric and Threshold Models," Discussion Paper Series, School of Economics and Finance 200102, School of Economics and Finance, University of St Andrews.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roland Rothenstein, 2018. "Quantification of market efficiency based on informational-entropy," Papers 1812.02371, arXiv.org.
    2. Kristoufek, Ladislav & Vosvrda, Miloslav, 2013. "Measuring capital market efficiency: Global and local correlations structure," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(1), pages 184-193.
    3. Cheol‐Ho Park & Scott H. Irwin, 2010. "A reality check on technical trading rule profits in the U.S. futures markets," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 30(7), pages 633-659, July.
    4. Aatola, Piia & Ollikka, Kimmo & Ollikainen, Markku, 2012. "Informational Efficiency of the EU ETS market – a study of price predictability and profitable trading," Working Papers 28, VATT Institute for Economic Research.
    5. Taufiq Choudhry & Ranadeva Jayasekera, 2015. "Level of efficiency in the UK equity market: empirical study of the effects of the global financial crisis," Review of Quantitative Finance and Accounting, Springer, vol. 44(2), pages 213-242, February.
    6. Basak, Suryoday & Kar, Saibal & Saha, Snehanshu & Khaidem, Luckyson & Dey, Sudeepa Roy, 2019. "Predicting the direction of stock market prices using tree-based classifiers," The North American Journal of Economics and Finance, Elsevier, vol. 47(C), pages 552-567.
    7. Kamal, Mona, 2014. "Studying the Validity of the Efficient Market Hypothesis (EMH) in the Egyptian Exchange (EGX) after the 25th of January Revolution," MPRA Paper 54708, University Library of Munich, Germany.
    8. Ignacio Escanuela Romana & Clara Escanuela Nieves, 2023. "A spectral approach to stock market performance," Papers 2305.05762, arXiv.org.
    9. Ashok Chanabasangouda Patil & Shailesh Rastogi, 2019. "Time-Varying Price–Volume Relationship and Adaptive Market Efficiency: A Survey of the Empirical Literature," JRFM, MDPI, vol. 12(2), pages 1-18, June.
    10. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    11. Stefanescu, Razvan & Dumitriu, Ramona, 2016. "Particularitǎţi ale evoluţiei variabilelor financiare [Some particularities of the financial variables evolution]," MPRA Paper 73481, University Library of Munich, Germany, revised 02 Sep 2016.
    12. Kwan, Yum K. & Leung, Charles Ka Yui & Dong, Jinyue, 2015. "Comparing consumption-based asset pricing models: The case of an Asian city," Journal of Housing Economics, Elsevier, vol. 28(C), pages 18-41.
    13. Rompotis, Gerasimos G., 2011. "Testing weak-form efficiency of exchange traded funds market," MPRA Paper 36020, University Library of Munich, Germany.
    14. Felicia Ramona Birau, 2011. "An Analysis Of Weak-Form Efficiency On The Bucharest Stock Exchange," Annals of University of Craiova - Economic Sciences Series, University of Craiova, Faculty of Economics and Business Administration, vol. 3(39), pages 194-205.
    15. Shmilovici Armin & Ben-Gal Irad, 2012. "Predicting Stock Returns Using a Variable Order Markov Tree Model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(5), pages 1-33, December.
    16. Kristoufek, Ladislav, 2018. "Fractality in market risk structure: Dow Jones Industrial components case," Chaos, Solitons & Fractals, Elsevier, vol. 110(C), pages 69-75.
    17. Park, Cheol-Ho & Irwin, Scott H., 2004. "The Profitability Of Technical Trading Rules In Us Futures Markets: A Data Snooping Free Test," 2004 Conference, April 19-20, 2004, St. Louis, Missouri 19011, NCR-134 Conference on Applied Commodity Price Analysis, Forecasting, and Market Risk Management.
    18. Qianwei Ying & Tahir Yousaf & Qurat ul Ain & Yasmeen Akhtar & Muhammad Shahid Rasheed, 2019. "Stock Investment and Excess Returns: A Critical Review in the Light of the Efficient Market Hypothesis," JRFM, MDPI, vol. 12(2), pages 1-22, June.
    19. Elzbieta Kacperska & Jakub Kraciuk, 2021. "The Effect of COVID-19 Pandemic on the Stock Market of Agri-food Companies in Poland," European Research Studies Journal, European Research Studies Journal, vol. 0(Special 3), pages 274-290.
    20. Akber, Ushna & Muhammad, Nabeel, 2013. "Is Pakistan Stock Market moving towards Weak-form efficiency? Evidence from the Karachi Stock Exchange and the Random Walk Nature of free-float of shares of KSE 30 Index," MPRA Paper 49128, University Library of Munich, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:63:y:2024:i:1:d:10.1007_s10614-022-10338-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.