IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1907.09452.html
   My bibliography  Save this paper

Mid-price Prediction Based on Machine Learning Methods with Technical and Quantitative Indicators

Author

Listed:
  • Adamantios Ntakaris
  • Juho Kanniainen
  • Moncef Gabbouj
  • Alexandros Iosifidis

Abstract

Stock price prediction is a challenging task, but machine learning methods have recently been used successfully for this purpose. In this paper, we extract over 270 hand-crafted features (factors) inspired by technical and quantitative analysis and tested their validity on short-term mid-price movement prediction. We focus on a wrapper feature selection method using entropy, least-mean squares, and linear discriminant analysis. We also build a new quantitative feature based on adaptive logistic regression for online learning, which is constantly selected first among the majority of the proposed feature selection methods. This study examines the best combination of features using high frequency limit order book data from Nasdaq Nordic. Our results suggest that sorting methods and classifiers can be used in such a way that one can reach the best performance with a combination of only very few advanced hand-crafted features.

Suggested Citation

  • Adamantios Ntakaris & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2019. "Mid-price Prediction Based on Machine Learning Methods with Technical and Quantitative Indicators," Papers 1907.09452, arXiv.org.
    • Handle: RePEc:arx:papers:1907.09452
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1907.09452
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dat Thanh Tran & Martin Magris & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2017. "Tensor Representation in High-Frequency Financial Data for Price Change Prediction," Papers 1709.01268, arXiv.org, revised Nov 2017.
    2. Engle, Robert & Granger, Clive, 2015. "Co-integration and error correction: Representation, estimation, and testing," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 39(3), pages 106-135.
    3. Peter Bank & Dietmar Baum, 2004. "Hedging and Portfolio Optimization in Financial Markets with a Large Trader," Mathematical Finance, Wiley Blackwell, vol. 14(1), pages 1-18, January.
    4. Ross, Stephen A, 1977. "The Capital Asset Pricing Model (CAPM), Short-Sale Restrictions and Related Issues," Journal of Finance, American Finance Association, vol. 32(1), pages 177-183, March.
    5. Baetje, Fabian & Menkhoff, Lukas, 2016. "Equity premium prediction: Are economic and technical indicators unstable?," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1193-1207.
    6. Martin D. Gould & Mason A. Porter & Stacy Williams & Mark McDonald & Daniel J. Fenn & Sam D. Howison, 2010. "Limit Order Books," Papers 1012.0349, arXiv.org, revised Apr 2013.
    7. repec:bla:jfinan:v:55:y:2000:i:4:p:1705-1770 is not listed on IDEAS
    8. Alec N. Kercheval & Yuan Zhang, 2015. "Modelling high-frequency limit order book dynamics with support vector machines," Quantitative Finance, Taylor & Francis Journals, vol. 15(8), pages 1315-1329, August.
    9. Andrew W. Lo & Harry Mamaysky & Jiang Wang, 2000. "Foundations of Technical Analysis: Computational Algorithms, Statistical Inference, and Empirical Implementation," Journal of Finance, American Finance Association, vol. 55(4), pages 1705-1765, August.
    10. Martin D. Gould & Mason A. Porter & Stacy Williams & Mark McDonald & Daniel J. Fenn & Sam D. Howison, 2013. "Limit order books," Quantitative Finance, Taylor & Francis Journals, vol. 13(11), pages 1709-1742, November.
    11. Louis K.C. Chan & Jason Karceski & Josef Lakonishok, 1999. "On Portfolio Optimization: Forecasting Covariances and Choosing the Risk Model," NBER Working Papers 7039, National Bureau of Economic Research, Inc.
    12. Andre F. Perold, 1984. "Large-Scale Portfolio Optimization," Management Science, INFORMS, vol. 30(10), pages 1143-1160, October.
    13. Walter Dolde, 1993. "The Trajectory Of Corporate Financial Risk Management," Journal of Applied Corporate Finance, Morgan Stanley, vol. 6(3), pages 33-41, September.
    14. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    15. Fang, Yue & Xu, Daming, 2003. "The predictability of asset returns: an approach combining technical analysis and time series forecasts," International Journal of Forecasting, Elsevier, vol. 19(3), pages 369-385.
    16. Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-547, August.
    17. Justin Sirignano, 2016. "Deep Learning for Limit Order Books," Papers 1601.01987, arXiv.org, revised Jul 2016.
    18. Chan, Louis K C & Karceski, Jason & Lakonishok, Josef, 1999. "On Portfolio Optimization: Forecasting Covariances and Choosing the Risk Model," The Review of Financial Studies, Society for Financial Studies, vol. 12(5), pages 937-974.
    19. Eugene F. Fama, 1968. "Risk, Return And Equilibrium: Some Clarifying Comments," Journal of Finance, American Finance Association, vol. 23(1), pages 29-40, March.
    20. Adamantios Ntakaris & Giorgio Mirone & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2019. "Feature Engineering for Mid-Price Prediction with Deep Learning," Papers 1904.05384, arXiv.org, revised Jun 2019.
    21. Poterba, James M. & Summers, Lawrence H., 1988. "Mean reversion in stock prices : Evidence and Implications," Journal of Financial Economics, Elsevier, vol. 22(1), pages 27-59, October.
    22. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
    23. Lubnau, Thorben & Todorova, Neda, 2015. "Trading on mean-reversion in energy futures markets," Energy Economics, Elsevier, vol. 51(C), pages 312-319.
    24. Batchelor, Roy & Kwan, Tai Yeong, 2007. "Judgemental bootstrapping of technical traders in the bond market," International Journal of Forecasting, Elsevier, vol. 23(3), pages 427-445.
    25. Clifford W. Smith & Charles W. Smithson & D. Sykes Wilford, 1989. "Managing Financial Risk," Journal of Applied Corporate Finance, Morgan Stanley, vol. 1(4), pages 27-48, January.
    26. Martin Scholtus & Dick van Dijk, 2012. "High-Frequency Technical Trading: The Importance of Speed," Tinbergen Institute Discussion Papers 12-018/4, Tinbergen Institute.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adamantios Ntakaris & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2020. "Mid-price prediction based on machine learning methods with technical and quantitative indicators," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-39, June.
    2. Adam Zaremba & Jacob Koby Shemer, 2018. "Price-Based Investment Strategies," Springer Books, Springer, number 978-3-319-91530-2, December.
    3. Jian Guo & Saizhuo Wang & Lionel M. Ni & Heung-Yeung Shum, 2022. "Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence," Papers 2301.04020, arXiv.org.
    4. Adamantios Ntakaris & Martin Magris & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2017. "Benchmark Dataset for Mid-Price Forecasting of Limit Order Book Data with Machine Learning Methods," Papers 1705.03233, arXiv.org, revised Mar 2020.
    5. Qing Zhou & Robert Faff, 2017. "The complementary role of cross-sectional and time-series information in forecasting stock returns," Australian Journal of Management, Australian School of Business, vol. 42(1), pages 113-139, February.
    6. Mishra, Anil V., 2016. "Foreign bias in Australian-domiciled mutual fund holdings," Pacific-Basin Finance Journal, Elsevier, vol. 39(C), pages 101-123.
    7. Wang, Christina Dan & Chen, Zhao & Lian, Yimin & Chen, Min, 2022. "Asset selection based on high frequency Sharpe ratio," Journal of Econometrics, Elsevier, vol. 227(1), pages 168-188.
    8. David E. Allen & Michael McAleer & Robert J. Powell & Abhay K. Singh, 2015. "Down-side Risk Metrics as Portfolio Diversification Strategies across the GFC," Documentos de Trabajo del ICAE 2015-19, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico.
    9. Pat Wilson & John Okunev & Guy Ta, 1994. "Are Real Estate and Securities Markets Integrated? Some Australian Evidence," Working Paper Series 42, Finance Discipline Group, UTS Business School, University of Technology, Sydney.
    10. Lütkepohl,Helmut & Krätzig,Markus (ed.), 2004. "Applied Time Series Econometrics," Cambridge Books, Cambridge University Press, number 9780521547871, January.
    11. Zihao Zhang & Stefan Zohren & Stephen Roberts, 2018. "DeepLOB: Deep Convolutional Neural Networks for Limit Order Books," Papers 1808.03668, arXiv.org, revised Jan 2020.
    12. Mishra, Anil V., 2015. "Measures of equity home bias puzzle," Journal of Empirical Finance, Elsevier, vol. 34(C), pages 293-312.
    13. Víctor Adame-García & Fernando Fernández-Rodríguez & Simón Sosvilla-Rivero, 2017. "“Resolution of optimization problems and construction of efficient portfolios: An application to the Euro Stoxx 50 index"," IREA Working Papers 201702, University of Barcelona, Research Institute of Applied Economics, revised Feb 2017.
    14. Eom, Cheoljun, 2017. "Two-faced property of a market factor in asset pricing and diversification effect," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 471(C), pages 190-199.
    15. Penaranda, Francisco, 2007. "Portfolio choice beyond the traditional approach," LSE Research Online Documents on Economics 24481, London School of Economics and Political Science, LSE Library.
    16. Tim Bollerslev & Robert J. Hodrick, 1992. "Financial Market Efficiency Tests," NBER Working Papers 4108, National Bureau of Economic Research, Inc.
    17. Arzandeh, Mehdi & Frank, Julieta, 2017. "The Information Content of the Limit Order Book," 7th Annual Canadian Agri-Food Policy Conference, January 11-13, 2017, Ottawa, ON 253251, Canadian Agricultural Economics Society.
    18. Erindi Allaj, 2020. "The Black–Litterman model and views from a reverse optimization procedure: an out-of-sample performance evaluation," Computational Management Science, Springer, vol. 17(3), pages 465-492, October.
    19. Yan, Cheng & Zhang, Huazhu, 2017. "Mean-variance versus naïve diversification: The role of mispricing," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 48(C), pages 61-81.
    20. Du, Ding & Hu, Ou, 2012. "Foreign exchange volatility and stock returns," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 22(5), pages 1202-1216.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1907.09452. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.