IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2110.11751.html
   My bibliography  Save this paper

Forecasting Financial Market Structure from Network Features using Machine Learning

Author

Listed:
  • Douglas Castilho
  • Tharsis T. P. Souza
  • Soong Moon Kang
  • Jo~ao Gama
  • Andr'e C. P. L. F. de Carvalho

Abstract

We propose a model that forecasts market correlation structure from link- and node-based financial network features using machine learning. For such, market structure is modeled as a dynamic asset network by quantifying time-dependent co-movement of asset price returns across company constituents of major global market indices. We provide empirical evidence using three different network filtering methods to estimate market structure, namely Dynamic Asset Graph (DAG), Dynamic Minimal Spanning Tree (DMST) and Dynamic Threshold Networks (DTN). Experimental results show that the proposed model can forecast market structure with high predictive performance with up to $40\%$ improvement over a time-invariant correlation-based benchmark. Non-pair-wise correlation features showed to be important compared to traditionally used pair-wise correlation measures for all markets studied, particularly in the long-term forecasting of stock market structure. Evidence is provided for stock constituents of the DAX30, EUROSTOXX50, FTSE100, HANGSENG50, NASDAQ100 and NIFTY50 market indices. Findings can be useful to improve portfolio selection and risk management methods, which commonly rely on a backward-looking covariance matrix to estimate portfolio risk.

Suggested Citation

  • Douglas Castilho & Tharsis T. P. Souza & Soong Moon Kang & Jo~ao Gama & Andr'e C. P. L. F. de Carvalho, 2021. "Forecasting Financial Market Structure from Network Features using Machine Learning," Papers 2110.11751, arXiv.org.
    • Handle: RePEc:arx:papers:2110.11751
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2110.11751
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Barfuss, Wolfram & Massara, Guido Previde & Di Matteo, T. & Aste, Tomaso, 2016. "Parsimonious modeling with information filtering networks," LSE Research Online Documents on Economics 68860, London School of Economics and Political Science, LSE Library.
    2. Onnela, J.-P. & Chakraborti, A. & Kaski, K. & Kertész, J., 2003. "Dynamic asset trees and Black Monday," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 324(1), pages 247-252.
    3. R. Mantegna, 1999. "Hierarchical structure in financial markets," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 11(1), pages 193-197, September.
    4. David Liben‐Nowell & Jon Kleinberg, 2007. "The link‐prediction problem for social networks," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(7), pages 1019-1031, May.
    5. Giacomo Livan & Jun-ichi Inoue & Enrico Scalas, 2012. "On the non-stationarity of financial time series: impact on optimal portfolio selection," Papers 1205.0877, arXiv.org, revised Jul 2012.
    6. Raffaello Morales & T. Di Matteo & Tomaso Aste, 2012. "Non stationary multifractality in stock returns," Papers 1212.3195, arXiv.org, revised May 2013.
    7. Zan Huang & Dennis K. J. Lin, 2009. "The Time-Series Link Prediction Problem with Applications in Communication Surveillance," INFORMS Journal on Computing, INFORMS, vol. 21(2), pages 286-303, May.
    8. M. Tumminello & T. Di Matteo & T. Aste & R. N. Mantegna, 2007. "Correlation based networks of equity returns sampled at different time horizons," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 55(2), pages 209-217, January.
    9. Mantegna,Rosario N. & Stanley,H. Eugene, 2007. "Introduction to Econophysics," Cambridge Books, Cambridge University Press, number 9780521039871.
    10. J.-P. Onnela & K. Kaski & J. Kertész, 2004. "Clustering and information in correlation based financial networks," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 38(2), pages 353-362, March.
    11. Yang, Yue & Yang, Huijie, 2008. "Complex network-based time series analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(5), pages 1381-1386.
    12. Morales, Raffaello & Di Matteo, T. & Aste, Tomaso, 2013. "Non-stationary multifractality in stock returns," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(24), pages 6470-6483.
    13. Musmeci, Nicoló & Nicosia, Vincenzo & Aste, Tomaso & Di Matteo, Tiziana & Latora, Vito, 2017. "The multiplex dependency structure of financial markets," LSE Research Online Documents on Economics 85337, London School of Economics and Political Science, LSE Library.
    14. Gautier Marti & Philippe Very & Philippe Donnat & Frank Nielsen, 2015. "A proposal of a methodological framework with experimental guidelines to investigate clustering stability on financial time series," Papers 1509.05475, arXiv.org.
    15. Park, Ji Hwan & Chang, Woojin & Song, Jae Wook, 2020. "Link prediction in the Granger causality network of the global currency market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 553(C).
    16. Tumminello, Michele & Lillo, Fabrizio & Mantegna, Rosario N., 2010. "Correlation, hierarchies, and networks in financial markets," Journal of Economic Behavior & Organization, Elsevier, vol. 75(1), pages 40-58, July.
    17. Souza, Thársis T.P. & Aste, Tomaso, 2019. "Predicting future stock market structure by combining social and financial network information," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 535(C).
    18. Tao Zhou & Linyuan Lü & Yi-Cheng Zhang, 2009. "Predicting missing links via local information," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 71(4), pages 623-630, October.
    19. Morales, Raffaello & Di Matteo, T. & Gramatica, Ruggero & Aste, Tomaso, 2012. "Dynamical generalized Hurst exponent as a tool to monitor unstable periods in financial time series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(11), pages 3180-3189.
    20. Nicolò Musmeci & Vincenzo Nicosia & Tomaso Aste & Tiziana Di Matteo & Vito Latora, 2017. "The Multiplex Dependency Structure of Financial Markets," Complexity, Hindawi, vol. 2017, pages 1-13, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vishwas Kukreti & Hirdesh K. Pharasi & Priya Gupta & Sunil Kumar, 2020. "A perspective on correlation-based financial networks and entropy measures," Papers 2004.09448, arXiv.org.
    2. Pang, Raymond Ka-Kay & Granados, Oscar M. & Chhajer, Harsh & Legara, Erika Fille T., 2021. "An analysis of network filtering methods to sovereign bond yields during COVID-19," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 574(C).
    3. Millington, Tristan & Niranjan, Mahesan, 2021. "Construction of minimum spanning trees from financial returns using rank correlation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 566(C).
    4. Gautier Marti & Frank Nielsen & Miko{l}aj Bi'nkowski & Philippe Donnat, 2017. "A review of two decades of correlations, hierarchies, networks and clustering in financial markets," Papers 1703.00485, arXiv.org, revised Nov 2020.
    5. Tristan Millington & Mahesan Niranjan, 2020. "Construction of Minimum Spanning Trees from Financial Returns using Rank Correlation," Papers 2005.03963, arXiv.org, revised Nov 2020.
    6. Sandoval, Leonidas, 2014. "To lag or not to lag? How to compare indices of stock markets that operate on different times," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 403(C), pages 227-243.
    7. Teh, Boon Kin & Goo, Yik Wen & Lian, Tong Wei & Ong, Wei Guang & Choi, Wen Ting & Damodaran, Mridula & Cheong, Siew Ann, 2015. "The Chinese Correction of February 2007: How financial hierarchies change in a market crash," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 424(C), pages 225-241.
    8. Coletti, Paolo, 2016. "Comparing minimum spanning trees of the Italian stock market using returns and volumes," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 463(C), pages 246-261.
    9. Sensoy, Ahmet & Tabak, Benjamin M., 2014. "Dynamic spanning trees in stock market networks: The case of Asia-Pacific," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 414(C), pages 387-402.
    10. Leonidas Sandoval Junior, 2011. "A Map of the Brazilian Stock Market," Papers 1107.4146, arXiv.org, revised Mar 2013.
    11. Leonidas Sandoval Junior & Italo De Paula Franca, 2011. "Correlation of financial markets in times of crisis," Papers 1102.1339, arXiv.org, revised Mar 2011.
    12. Lu, Ya-Nan & Li, Sai-Ping & Zhong, Li-Xin & Jiang, Xiong-Fei & Ren, Fei, 2018. "A clustering-based portfolio strategy incorporating momentum effect and market trend prediction," Chaos, Solitons & Fractals, Elsevier, vol. 117(C), pages 1-15.
    13. Kaizheng Wang & Xiao Xu & Xun Yu Zhou, 2022. "Variable Clustering via Distributionally Robust Nodewise Regression," Papers 2212.07944, arXiv.org, revised Dec 2022.
    14. Sandoval, Leonidas, 2012. "Pruning a minimum spanning tree," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(8), pages 2678-2711.
    15. Sandoval, Leonidas & Franca, Italo De Paula, 2012. "Correlation of financial markets in times of crisis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(1), pages 187-208.
    16. Huang, Wei-Qiang & Yao, Shuang & Zhuang, Xin-Tian & Yuan, Ying, 2017. "Dynamic asset trees in the US stock market: Structure variation and market phenomena," Chaos, Solitons & Fractals, Elsevier, vol. 94(C), pages 44-53.
    17. Raymond Ka-Kay Pang & Oscar Granados & Harsh Chhajer & Erika Fille Legara, 2020. "An analysis of network filtering methods to sovereign bond yields during COVID-19," Papers 2009.13390, arXiv.org, revised Feb 2021.
    18. Nicoló Musmeci & Tomaso Aste & T Di Matteo, 2015. "Relation between Financial Market Structure and the Real Economy: Comparison between Clustering Methods," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-24, March.
    19. Giuseppe Brandi & Ruggero Gramatica & Tiziana Di Matteo, 2019. "Unveil stock correlation via a new tensor-based decomposition method," Papers 1911.06126, arXiv.org, revised Apr 2020.
    20. Nava, Noemi & Di Matteo, T. & Aste, Tomaso, 2018. "Dynamic correlations at different time-scales with empirical mode decomposition," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 502(C), pages 534-544.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2110.11751. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.