IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1906.07786.html
   My bibliography  Save this paper

Evaluating the Performance of Machine Learning Algorithms in Financial Market Forecasting: A Comprehensive Survey

Author

Listed:
  • Lukas Ryll
  • Sebastian Seidens

Abstract

With increasing competition and pace in the financial markets, robust forecasting methods are becoming more and more valuable to investors. While machine learning algorithms offer a proven way of modeling non-linearities in time series, their advantages against common stochastic models in the domain of financial market prediction are largely based on limited empirical results. The same holds true for determining advantages of certain machine learning architectures against others. This study surveys more than 150 related articles on applying machine learning to financial market forecasting. Based on a comprehensive literature review, we build a table across seven main parameters describing the experiments conducted in these studies. Through listing and classifying different algorithms, we also introduce a simple, standardized syntax for textually representing machine learning algorithms. Based on performance metrics gathered from papers included in the survey, we further conduct rank analyses to assess the comparative performance of different algorithm classes. Our analysis shows that machine learning algorithms tend to outperform most traditional stochastic methods in financial market forecasting. We further find evidence that, on average, recurrent neural networks outperform feed forward neural networks as well as support vector machines which implies the existence of exploitable temporal dependencies in financial time series across multiple asset classes and geographies.

Suggested Citation

  • Lukas Ryll & Sebastian Seidens, 2019. "Evaluating the Performance of Machine Learning Algorithms in Financial Market Forecasting: A Comprehensive Survey," Papers 1906.07786, arXiv.org, revised Jul 2019.
  • Handle: RePEc:arx:papers:1906.07786
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1906.07786
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Panda, Chakradhara & Narasimhan, V., 2007. "Forecasting exchange rate better with artificial neural network," Journal of Policy Modeling, Elsevier, vol. 29(2), pages 227-236.
    2. Krauss, Christopher & Do, Xuan Anh & Huck, Nicolas, 2017. "Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on the S&P 500," European Journal of Operational Research, Elsevier, vol. 259(2), pages 689-702.
    3. T. D. Stanley & Stephen B. Jarrell, 2005. "Meta‐Regression Analysis: A Quantitative Method of Literature Surveys," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 299-308, July.
    4. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost Heckemeyer & Robert Johnston & Patrice Laroche & Jon Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall Rosenberger & Katja Rost, 2013. "Meta-analysis of economics research reporting guidelines," Post-Print hal-02137661, HAL.
    5. Fernandez-Rodriguez, Fernando & Gonzalez-Martel, Christian & Sosvilla-Rivero, Simon, 2000. "On the profitability of technical trading rules based on artificial neural networks:: Evidence from the Madrid stock market," Economics Letters, Elsevier, vol. 69(1), pages 89-94, October.
    6. Qi, Min, 1999. "Nonlinear Predictability of Stock Returns Using Financial and Economic Variables," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(4), pages 419-429, October.
    7. Ou, Jane A. & Penman, Stephen H., 1989. "Financial statement analysis and the prediction of stock returns," Journal of Accounting and Economics, Elsevier, vol. 11(4), pages 295-329, November.
    8. Gary Grudnitski & Larry Osburn, 1993. "Forecasting S&P and gold futures prices: An application of neural networks," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 13(6), pages 631-643, September.
    9. Wun-Hua Chen & Jen-Ying Shih & Soushan Wu, 2006. "Comparison of support-vector machines and back propagation neural networks in forecasting the six major Asian stock markets," International Journal of Electronic Finance, Inderscience Enterprises Ltd, vol. 1(1), pages 49-67.
    10. Eleni Constantinou & Robert Georgiades & Avo Kazandjian & Georgios P. Kouretas, 2006. "Regime switching and artificial neural network forecasting of the Cyprus Stock Exchange daily returns," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 11(4), pages 371-383.
    11. Tseng, Chih-Hsiung & Cheng, Sheng-Tzong & Wang, Yi-Hsien & Peng, Jin-Tang, 2008. "Artificial neural network model of the hybrid EGARCH volatility of the Taiwan stock index option prices," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(13), pages 3192-3200.
    12. Polterovich, Victor & Popov, Vladimir, 2006. "Эволюционная Теория Экономической Политики: Часть I: Опыт Быстрого Развития [An Evolutionary Theory of Economic Policy: Part I: The Experience of Fast Development]," MPRA Paper 22168, University Library of Munich, Germany.
    13. Stephen B. Jarrell & T. D. Stanley, 1990. "A Meta-Analysis of the Union-Nonunion Wage Gap," ILR Review, Cornell University, ILR School, vol. 44(1), pages 54-67, October.
    14. Pai, Ping-Feng & Lin, Chih-Sheng, 2005. "A hybrid ARIMA and support vector machines model in stock price forecasting," Omega, Elsevier, vol. 33(6), pages 497-505, December.
    15. Andrew K. Rose & T. D. Stanley, 2005. "A Meta‐Analysis of the Effect of Common Currencies on International Trade," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 347-365, July.
    16. Chin-Tsai Lin & Hsin-Yi Yeh, 2009. "Empirical of the Taiwan stock index option price forecasting model - applied artificial neural network," Applied Economics, Taylor & Francis Journals, vol. 41(15), pages 1965-1972.
    17. G P Zhang & V L Berardi, 2001. "Time series forecasting with neural network ensembles: an application for exchange rate prediction," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 52(6), pages 652-664, June.
    18. Bodyanskiy, Yevgeniy & Popov, Sergiy, 2006. "Neural network approach to forecasting of quasiperiodic financial time series," European Journal of Operational Research, Elsevier, vol. 175(3), pages 1357-1366, December.
    19. Olson, Dennis & Mossman, Charles, 2003. "Neural network forecasts of Canadian stock returns using accounting ratios," International Journal of Forecasting, Elsevier, vol. 19(3), pages 453-465.
    20. Tay, Francis E. H. & Cao, Lijuan, 2001. "Application of support vector machines in financial time series forecasting," Omega, Elsevier, vol. 29(4), pages 309-317, August.
    21. Leigh, W. & Paz, M. & Purvis, R., 2002. "An analysis of a hybrid neural network and pattern recognition technique for predicting short-term increases in the NYSE composite index," Omega, Elsevier, vol. 30(2), pages 69-76, April.
    22. Christopher Krauss & Anh Do & Nicolas Huck, 2017. "Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on the S&P 500," Post-Print hal-01768895, HAL.
    23. Chiang, W. -C. & Urban, T. L. & Baldridge, G. W., 1996. "A neural network approach to mutual fund net asset value forecasting," Omega, Elsevier, vol. 24(2), pages 205-215, April.
    24. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost H. Heckemeyer & Robert J. Johnston & Patrice Laroche & Jon P. Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall S. Rosenberger & , 2013. "Meta-Analysis Of Economics Research Reporting Guidelines," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 390-394, April.
    25. Katarína Danišková & Jarko Fidrmuc, 2012. "Meta-Analysis of the New Keynesian Phillips Curve," Working Papers 314, Leibniz Institut für Ost- und Südosteuropaforschung (Institute for East and Southeast European Studies).
    26. Christian Dunis & Jason Laws & Georgios Sermpinis, 2010. "Higher order and recurrent neural architectures for trading the EUR/USD exchange rate," Quantitative Finance, Taylor & Francis Journals, vol. 11(4), pages 615-629.
    27. Wittkemper, Hans-Georg & Steiner, Manfred, 1996. "Using neural networks to forecast the systematic risk of stocks," European Journal of Operational Research, Elsevier, vol. 90(3), pages 577-588, May.
    28. Perez-Rodriguez, Jorge V. & Torra, Salvador & Andrada-Felix, Julian, 2005. "STAR and ANN models: forecasting performance on the Spanish "Ibex-35" stock index," Journal of Empirical Finance, Elsevier, vol. 12(3), pages 490-509, June.
    29. Steiner, Manfred & Wittkemper, Hans-Georg, 1997. "Portfolio optimization with a neural network implementation of the coherent market hypothesis," European Journal of Operational Research, Elsevier, vol. 100(1), pages 27-40, July.
    30. Fischer, Thomas & Krauss, Christopher, 2018. "Deep learning with long short-term memory networks for financial market predictions," European Journal of Operational Research, Elsevier, vol. 270(2), pages 654-669.
    31. Kanas, Angelos & Yannopoulos, Andreas, 2001. "Comparing linear and nonlinear forecasts for stock returns," International Review of Economics & Finance, Elsevier, vol. 10(4), pages 383-398, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Witold Orzeszko, 2021. "Nonlinear Causality between Crude Oil Prices and Exchange Rates: Evidence and Forecasting," Energies, MDPI, vol. 14(19), pages 1-16, September.
    2. Berislav Žmuk & Hrvoje Jošiæ, 2020. "Forecasting stock market indices using machine learning algorithms," Interdisciplinary Description of Complex Systems - scientific journal, Croatian Interdisciplinary Society Provider Homepage: http://indecs.eu, vol. 18(4), pages 471-489.
    3. Longbing Cao, 2021. "AI in Finance: Challenges, Techniques and Opportunities," Papers 2107.09051, arXiv.org.
    4. Georges, Christophre & Pereira, Javier, 2021. "Market stability with machine learning agents," Journal of Economic Dynamics and Control, Elsevier, vol. 122(C).
    5. J. C. Garza Sepúlveda & F. Lopez-Irarragorri & S. E. Schaeffer, 2023. "Forecasting Forex Trend Indicators with Fuzzy Rough Sets," Computational Economics, Springer;Society for Computational Economics, vol. 62(1), pages 229-287, June.
    6. Sabyasachi Kar & Amaani Bashir & Mayank Jain, 2021. "New Approaches to Forecasting Growth and Inflation: Big Data and Machine Learning," IEG Working Papers 446, Institute of Economic Growth.
    7. Sevcan Uzun & Ahmet Sensoy & Duc Khuong Nguyen, 2023. "Jump forecasting in foreign exchange markets: A high‐frequency analysis," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(3), pages 578-624, April.
    8. Kim, Jong-Min & Kim, Dong H. & Jung, Hojin, 2021. "Applications of machine learning for corporate bond yield spread forecasting," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    9. Philip Ndikum, 2020. "Machine Learning Algorithms for Financial Asset Price Forecasting," Papers 2004.01504, arXiv.org.
    10. Darrold Cordes & Shahram Latifi & Gregory M. Morrison, 2022. "Systematic literature review of the performance characteristics of Chebyshev polynomials in machine learning applications for economic forecasting in low-income communities in sub-Saharan Africa," SN Business & Economics, Springer, vol. 2(12), pages 1-33, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kizilaslan, Recep & Freund, Steven & Iseri, Ali, 2016. "A data analytic approach to forecasting daily stock returns in an emerging marketAuthor-Name: Oztekin, Asil," European Journal of Operational Research, Elsevier, vol. 253(3), pages 697-710.
    2. Gradojevic, Nikola & Kukolj, Dragan & Adcock, Robert & Djakovic, Vladimir, 2023. "Forecasting Bitcoin with technical analysis: A not-so-random forest?," International Journal of Forecasting, Elsevier, vol. 39(1), pages 1-17.
    3. Kamaladdin Fataliyev & Aneesh Chivukula & Mukesh Prasad & Wei Liu, 2021. "Stock Market Analysis with Text Data: A Review," Papers 2106.12985, arXiv.org, revised Jul 2021.
    4. Petr Polák, 2019. "The Euro'S Trade Effect: A Meta‐Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 33(1), pages 101-124, February.
    5. Thierry Warin & Aleksandar Stojkov, 2021. "Machine Learning in Finance: A Metadata-Based Systematic Review of the Literature," JRFM, MDPI, vol. 14(7), pages 1-31, July.
    6. ?enol Emir & Hasan Din?er & Mehpare Timor, 2012. "A Stock Selection Model Based on Fundamental and Technical Analysis Variables by Using Artificial Neural Networks and Support Vector Machines," Review of Economics & Finance, Better Advances Press, Canada, vol. 2, pages 106-122, August.
    7. Petra Valickova & Tomas Havranek & Roman Horvath, 2015. "Financial Development And Economic Growth: A Meta-Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 29(3), pages 506-526, July.
    8. Chen, Rui & Ren, Jinjuan, 2022. "Do AI-powered mutual funds perform better?," Finance Research Letters, Elsevier, vol. 47(PA).
    9. Duan, Wen-Qi & Stanley, H. Eugene, 2011. "Cross-correlation and the predictability of financial return series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(2), pages 290-296.
    10. Fernau, Erik & Hirsch, Stefan, 2019. "What drives dividend smoothing? A meta regression analysis of the Lintner model," International Review of Financial Analysis, Elsevier, vol. 61(C), pages 255-273.
    11. Marco Colagrossi & Domenico Rossignoli & Mario A. Maggioni, 2017. "Does democracy cause growth? A meta-analysis perspective," DISEIS - Quaderni del Dipartimento di Economia internazionale, delle istituzioni e dello sviluppo dis1703, Università Cattolica del Sacro Cuore, Dipartimento di Economia internazionale, delle istituzioni e dello sviluppo (DISEIS).
    12. Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
    13. Mishra, Sasmita & Padhy, Sudarsan, 2019. "An efficient portfolio construction model using stock price predicted by support vector regression," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    14. Klomp, Jeroen, 2023. "Political budget cycles in military expenditures: A meta-analysis," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 1083-1102.
    15. Dimitrios Kartsonakis Mademlis & Nikolaos Dritsakis, 2021. "Volatility Forecasting using Hybrid GARCH Neural Network Models: The Case of the Italian Stock Market," International Journal of Economics and Financial Issues, Econjournals, vol. 11(1), pages 49-60.
    16. Nicolas Fleury & Fabrice Gilles, 2015. "A meta-regression analysis on intergenerational transmission of education: publication bias and genuine empirical effect," TEPP Working Paper 2015-02, TEPP.
    17. Kentaro Imajo & Kentaro Minami & Katsuya Ito & Kei Nakagawa, 2020. "Deep Portfolio Optimization via Distributional Prediction of Residual Factors," Papers 2012.07245, arXiv.org.
    18. Tseng, Chih-Hsiung & Cheng, Sheng-Tzong & Wang, Yi-Hsien & Peng, Jin-Tang, 2008. "Artificial neural network model of the hybrid EGARCH volatility of the Taiwan stock index option prices," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(13), pages 3192-3200.
    19. Ugur, Mehmet & Trushin, Eshref & Solomon, Edna & Guidi, Francesco, 2016. "R&D and productivity in OECD firms and industries: A hierarchical meta-regression analysis," Research Policy, Elsevier, vol. 45(10), pages 2069-2086.
    20. Stefan Hirsch, 2018. "Successful In The Long Run: A Meta†Regression Analysis Of Persistent Firm Profits," Journal of Economic Surveys, Wiley Blackwell, vol. 32(1), pages 23-49, February.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1906.07786. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.