IDEAS home Printed from https://ideas.repec.org/a/spr/jeicoo/v20y2025i2d10.1007_s11403-024-00426-y.html
   My bibliography  Save this article

Mesoscopic structure of the stock market and portfolio optimization

Author

Listed:
  • Sebastiano Michele Zema

    (Scuola Normale Superiore
    Scuola Superiore Sant’Anna)

  • Giorgio Fagiolo

    (Scuola Superiore Sant’Anna)

  • Tiziano Squartini

    (IMT Institute for Advanced Studies)

  • Diego Garlaschelli

    (IMT Institute for Advanced Studies
    University of Leiden)

Abstract

The idiosyncratic and systemic components of market structure have been shown to be responsible for the departure of the optimal mean-variance allocation from the heuristic ‘equally weighted’ portfolio. In this paper, we exploit clustering techniques derived from Random Matrix Theory to study a third, intermediate (mesoscopic) market structure that turns out to be the most stable over time and provides important practical insights from a portfolio management perspective. First, we illustrate the benefits, in terms of predicted and realized risk profiles, of constructing portfolios by filtering out both random and systemic co-movements from the correlation matrix. Second, we redefine the portfolio optimization problem in terms of stock clusters that emerge after filtering. Finally, we propose a new wealth allocation scheme that attaches equal importance to stocks belonging to the same community and show that it further increases the reliability of the constructed portfolios. Results are robust across different time spans, cross sectional dimensions and set of constraints defining the optimization problem.

Suggested Citation

  • Sebastiano Michele Zema & Giorgio Fagiolo & Tiziano Squartini & Diego Garlaschelli, 2025. "Mesoscopic structure of the stock market and portfolio optimization," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 20(2), pages 307-333, April.
  • Handle: RePEc:spr:jeicoo:v:20:y:2025:i:2:d:10.1007_s11403-024-00426-y
    DOI: 10.1007/s11403-024-00426-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11403-024-00426-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11403-024-00426-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ajay Singh & Dinghai Xu, 2016. "Random matrix application to correlations amongst the volatility of assets," Quantitative Finance, Taylor & Francis Journals, vol. 16(1), pages 69-83, January.
    2. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," The Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    3. G. L. Zitelli, 2020. "Random matrix models for datasets with fixed time horizons," Quantitative Finance, Taylor & Francis Journals, vol. 20(5), pages 769-781, May.
    4. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    5. Billio, Monica & Getmansky, Mila & Lo, Andrew W. & Pelizzon, Loriana, 2012. "Econometric measures of connectedness and systemic risk in the finance and insurance sectors," Journal of Financial Economics, Elsevier, vol. 104(3), pages 535-559.
    6. A. Verma & R. J. Buonocore & T. Di Matteo, 2019. "A cluster driven log-volatility factor model: a deepening on the source of the volatility clustering," Quantitative Finance, Taylor & Francis Journals, vol. 19(6), pages 981-996, June.
    7. R. Mantegna, 1999. "Hierarchical structure in financial markets," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 11(1), pages 193-197, September.
    8. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    9. Ivailo I. Dimov & Petter N. Kolm & Lee Maclin & Dan Y. C. Shiber, 2012. "Hidden noise structure and random matrix models of stock correlations," Quantitative Finance, Taylor & Francis Journals, vol. 12(4), pages 567-572, November.
    10. Laurent Laloux & Pierre Cizeau & Marc Potters & Jean-Philippe Bouchaud, 2000. "Random Matrix Theory And Financial Correlations," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 3(03), pages 391-397.
    11. Mark Britten‐Jones, 1999. "The Sampling Error in Estimates of Mean‐Variance Efficient Portfolio Weights," Journal of Finance, American Finance Association, vol. 54(2), pages 655-671, April.
    12. I. Anagnostou & T. Squartini & D. Kandhai & D. Garlaschelli, 2021. "Uncovering the mesoscale structure of the credit default swap market to improve portfolio risk modelling," Quantitative Finance, Taylor & Francis Journals, vol. 21(9), pages 1501-1518, September.
    13. Kristin J. Forbes & Roberto Rigobon, 2002. "No Contagion, Only Interdependence: Measuring Stock Market Comovements," Journal of Finance, American Finance Association, vol. 57(5), pages 2223-2261, October.
    14. Di Matteo, T. & Aste, T. & Mantegna, R.N., 2004. "An interest rates cluster analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 339(1), pages 181-188.
    15. repec:bla:jfinan:v:58:y:2003:i:4:p:1651-1684 is not listed on IDEAS
    16. Ester Pantaleo & Michele Tumminello & Fabrizio Lillo & Rosario Mantegna, 2011. "When do improved covariance matrix estimators enhance portfolio optimization? An empirical comparative study of nine estimators," Quantitative Finance, Taylor & Francis Journals, vol. 11(7), pages 1067-1080.
    17. Tu, Jun & Zhou, Guofu, 2011. "Markowitz meets Talmud: A combination of sophisticated and naive diversification strategies," Journal of Financial Economics, Elsevier, vol. 99(1), pages 204-215, January.
    18. Christian Borghesi & Matteo Marsili & Salvatore Miccich`e, 2007. "Emergence of time-horizon invariant correlation structure in financial returns by subtraction of the market mode," Papers physics/0702106, arXiv.org.
    19. Daniel J. Fenn & Mason A. Porter & Peter J. Mucha & Mark McDonald & Stacy Williams & Neil F. Johnson & Nick S. Jones, 2012. "Dynamical clustering of exchange rates," Quantitative Finance, Taylor & Francis Journals, vol. 12(10), pages 1493-1520, October.
    20. G. Bonanno & G. Caldarelli & F. Lillo & S. Micciché & N. Vandewalle & R. Mantegna, 2004. "Networks of equities in financial markets," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 38(2), pages 363-371, March.
    21. Christoly Biely & Stefan Thurner, 2008. "Random matrix ensembles of time-lagged correlation matrices: derivation of eigenvalue spectra and analysis of financial time-series," Quantitative Finance, Taylor & Francis Journals, vol. 8(7), pages 705-722.
    22. Pflug, Georg Ch. & Pichler, Alois & Wozabal, David, 2012. "The 1/N investment strategy is optimal under high model ambiguity," Journal of Banking & Finance, Elsevier, vol. 36(2), pages 410-417.
    23. Tola, Vincenzo & Lillo, Fabrizio & Gallegati, Mauro & Mantegna, Rosario N., 2008. "Cluster analysis for portfolio optimization," Journal of Economic Dynamics and Control, Elsevier, vol. 32(1), pages 235-258, January.
    24. J.-P. Onnela & K. Kaski & J. Kertész, 2004. "Clustering and information in correlation based financial networks," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 38(2), pages 353-362, March.
    25. Ioannis Anagnostou & Tiziano Squartini & Drona Kandhai & Diego Garlaschelli, 2020. "Uncovering the mesoscale structure of the credit default swap market to improve portfolio risk modelling," Papers 2006.03014, arXiv.org, revised Apr 2021.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sebastiano Michele Zema & Giorgio Fagiolo & Tiziano Squartini & Diego Garlaschelli, 2021. "Mesoscopic Structure of the Stock Market and Portfolio Optimization," Papers 2112.06544, arXiv.org.
    2. Gautier Marti & Frank Nielsen & Miko{l}aj Bi'nkowski & Philippe Donnat, 2017. "A review of two decades of correlations, hierarchies, networks and clustering in financial markets," Papers 1703.00485, arXiv.org, revised Nov 2020.
    3. Sandoval, Leonidas & Franca, Italo De Paula, 2012. "Correlation of financial markets in times of crisis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(1), pages 187-208.
    4. Leonidas Sandoval Junior & Italo De Paula Franca, 2011. "Correlation of financial markets in times of crisis," Papers 1102.1339, arXiv.org, revised Mar 2011.
    5. Sensoy, Ahmet & Tabak, Benjamin M., 2014. "Dynamic spanning trees in stock market networks: The case of Asia-Pacific," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 414(C), pages 387-402.
    6. Yong Tang & Jason Jie Xiong & Zi-Yang Jia & Yi-Cheng Zhang, 2018. "Complexities in Financial Network Topological Dynamics: Modeling of Emerging and Developed Stock Markets," Complexity, Hindawi, vol. 2018, pages 1-31, November.
    7. Zhang, Yiting & Lee, Gladys Hui Ting & Wong, Jian Cheng & Kok, Jun Liang & Prusty, Manamohan & Cheong, Siew Ann, 2011. "Will the US economy recover in 2010? A minimal spanning tree study," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(11), pages 2020-2050.
    8. Nicoló Musmeci & Tomaso Aste & T Di Matteo, 2015. "Relation between Financial Market Structure and the Real Economy: Comparison between Clustering Methods," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-24, March.
    9. Maillet, Bertrand & Tokpavi, Sessi & Vaucher, Benoit, 2015. "Global minimum variance portfolio optimisation under some model risk: A robust regression-based approach," European Journal of Operational Research, Elsevier, vol. 244(1), pages 289-299.
    10. Thomas Trier Bjerring & Omri Ross & Alex Weissensteiner, 2017. "Feature selection for portfolio optimization," Annals of Operations Research, Springer, vol. 256(1), pages 21-40, September.
    11. Hjalmarsson, Erik & Manchev, Petar, 2012. "Characteristic-based mean-variance portfolio choice," Journal of Banking & Finance, Elsevier, vol. 36(5), pages 1392-1401.
    12. Lassance, Nathan & Vanderveken, Rodolphe & Vrins, Frédéric, 2022. "On the optimal combination of naive and mean-variance portfolio strategies," LIDAM Discussion Papers LFIN 2022006, Université catholique de Louvain, Louvain Finance (LFIN).
    13. Nicolo Musmeci & Tomaso Aste & Tiziana Di Matteo, 2014. "Relation between Financial Market Structure and the Real Economy: Comparison between Clustering Methods," Papers 1406.0496, arXiv.org, revised Jan 2015.
    14. Immo Stadtmüller & Benjamin R. Auer & Frank Schuhmacher, 2024. "Core-satellite investing with commodity futures momentum," Journal of Asset Management, Palgrave Macmillan, vol. 25(3), pages 261-287, May.
    15. DeMiguel, Victor & Martin-Utrera, Alberto & Nogales, Francisco J., 2013. "Size matters: Optimal calibration of shrinkage estimators for portfolio selection," Journal of Banking & Finance, Elsevier, vol. 37(8), pages 3018-3034.
    16. Michele Costola & Bertrand Maillet & Zhining Yuan & Xiang Zhang, 2024. "Mean–variance efficient large portfolios: a simple machine learning heuristic technique based on the two-fund separation theorem," Annals of Operations Research, Springer, vol. 334(1), pages 133-155, March.
    17. Musmeci, Nicoló & Aste, Tomaso & Di Matteo, T., 2015. "Relation between financial market structure and the real economy: comparison between clustering methods," LSE Research Online Documents on Economics 61644, London School of Economics and Political Science, LSE Library.
    18. Han, Chulwoo, 2020. "A nonparametric approach to portfolio shrinkage," Journal of Banking & Finance, Elsevier, vol. 120(C).
    19. Cheong, Siew Ann & Fornia, Robert Paulo & Lee, Gladys Hui Ting & Kok, Jun Liang & Yim, Woei Shyr & Xu, Danny Yuan & Zhang, Yiting, 2011. "The Japanese economy in crises: A time series segmentation study," Economics Discussion Papers 2011-24, Kiel Institute for the World Economy (IfW Kiel).
    20. Marco Bardoscia & Paolo Barucca & Stefano Battiston & Fabio Caccioli & Giulio Cimini & Diego Garlaschelli & Fabio Saracco & Tiziano Squartini & Guido Caldarelli, 2021. "The Physics of Financial Networks," Papers 2103.05623, arXiv.org.

    More about this item

    Keywords

    Random matrix theory; Community detection; Mesoscopic structures; Portfolio optimization;
    All these keywords.

    JEL classification:

    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics
    • D85 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Network Formation
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jeicoo:v:20:y:2025:i:2:d:10.1007_s11403-024-00426-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.