IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2604.23833.html

Beyond De Prado and Cotton: Hierarchical and Iterative Methods for General Mean-Variance Portfolios

Author

Listed:
  • Bernd Johannes Wuebben

Abstract

Hierarchical Risk Parity (De Pardo) and the Schur-complement generalization of Cotton are among the most widely adopted regularised portfolio construction methods, yet both are signal-blind: they solve only the minimum-variance problem and cannot accommodate an arbitrary expected-return forecast. This paper introduces three methods that incorporate alpha signals into hierarchical and regularised portfolio construction. HRP-$\mu$ is a hierarchical allocator that accepts an arbitrary signal $\mu$ and nests standard HRP when $\gamma = 0$ and $\mu=\mathbf{1}$. It preserves the tree-based structure of HRP while extending it beyond the minimum-variance setting. HRP-$\Sigma\mu$ strengthens this construction by replacing inverse-variance representatives with recursive local mean-variance optima, thereby using richer within-cluster covariance information at the same $O(N^2)$ asymptotic cost. CRISP (Correlation-Regularised Iterative Shrinkage Portfolios) is an iterative solver for $P_\gamma w = \mu$ with $P_\gamma = (1-\gamma)\operatorname{diag}(\Sigma) + \gamma \Sigma$, so that $\gamma$ interpolates between a diagonal portfolio rule and full Markowitz. At convergence, CRISP is Markowitz applied to a variance-preserving shrunk covariance-diagonal variances unchanged, off-diagonal correlations shrunk-with $\gamma$ tuned for out-of-sample Sharpe rather than covariance-estimation loss. In Monte Carlo experiments across multiple covariance regimes and estimation ratios, HRP-$\mu$ and HRP-$\Sigma\mu$ both outperform plain HRP with HRP-$\Sigma\mu$ consistently improving on HRP-$\mu$. CRISP at intermediate $\gamma$ is the dominant method in both regimes, outperforming HRP, Cotton, Ledoit-Wolf shrinkage, direct Markowitz, and the signal-aware hierarchical methods.

Suggested Citation

  • Bernd Johannes Wuebben, 2026. "Beyond De Prado and Cotton: Hierarchical and Iterative Methods for General Mean-Variance Portfolios," Papers 2604.23833, arXiv.org.
  • Handle: RePEc:arx:papers:2604.23833
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2604.23833
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Michael W. Brandt & Pedro Santa-Clara & Rossen Valkanov, 2009. "Parametric Portfolio Policies: Exploiting Characteristics in the Cross-Section of Equity Returns," The Review of Financial Studies, Society for Financial Studies, vol. 22(9), pages 3411-3447, September.
    2. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    3. Marcos López de Prado & Michael J. Lewis, 2019. "Detection of false investment strategies using unsupervised learning methods," Quantitative Finance, Taylor & Francis Journals, vol. 19(9), pages 1555-1565, September.
    4. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," The Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    5. Olivier Ledoit & Michael Wolf, 2017. "Nonlinear Shrinkage of the Covariance Matrix for Portfolio Selection: Markowitz Meets Goldilocks," The Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4349-4388.
    6. Nicolae Gârleanu & Lasse Heje Pedersen, 2013. "Dynamic Trading with Predictable Returns and Transaction Costs," Journal of Finance, American Finance Association, vol. 68(6), pages 2309-2340, December.
    7. repec:bla:jfinan:v:58:y:2003:i:4:p:1651-1684 is not listed on IDEAS
    8. Peter Cotton, 2024. "Schur Complementary Allocation: A Unification of Hierarchical Risk Parity and Minimum Variance Portfolios," Papers 2411.05807, arXiv.org.
    9. Shumway, Tyler, 1997. "The Delisting Bias in CRSP Data," Journal of Finance, American Finance Association, vol. 52(1), pages 327-340, March.
    10. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    11. Kozak, Serhiy & Nagel, Stefan & Santosh, Shrihari, 2020. "Shrinking the cross-section," Journal of Financial Economics, Elsevier, vol. 135(2), pages 271-292.
    12. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    13. Barroso, Pedro & Santa-Clara, Pedro, 2015. "Beyond the Carry Trade: Optimal Currency Portfolios," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 50(5), pages 1037-1056, October.
    14. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. De Nard, Gianluca & Zhao, Zhao, 2023. "Using, taming or avoiding the factor zoo? A double-shrinkage estimator for covariance matrices," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 23-35.
    2. Ni, Xuanming & Zheng, Tiantian & Zhao, Huimin & Zhu, Shushang, 2023. "High-dimensional portfolio optimization based on tree-structured factor model," Pacific-Basin Finance Journal, Elsevier, vol. 81(C).
    3. Johannes Bock, 2018. "An updated review of (sub-)optimal diversification models," Papers 1811.08255, arXiv.org.
    4. Penaranda, Francisco & Sentana, Enrique, 2024. "Portfolio management with big data," CEPR Discussion Papers 19314, Centre for Economic Policy Research.
    5. Aït-Sahalia, Yacine & Xiu, Dacheng, 2017. "Using principal component analysis to estimate a high dimensional factor model with high-frequency data," Journal of Econometrics, Elsevier, vol. 201(2), pages 384-399.
    6. Mörstedt, Torsten & Lutz, Bernhard & Neumann, Dirk, 2024. "Cross validation based transfer learning for cross-sectional non-linear shrinkage: A data-driven approach in portfolio optimization," European Journal of Operational Research, Elsevier, vol. 318(2), pages 670-685.
    7. Qingliang Fan & Ruike Wu & Yanrong Yang, 2024. "Shocks-adaptive Robust Minimum Variance Portfolio for a Large Universe of Assets," Papers 2410.01826, arXiv.org.
    8. Seyoung Park & Eun Ryung Lee & Sungchul Lee & Geonwoo Kim, 2019. "Dantzig Type Optimization Method with Applications to Portfolio Selection," Sustainability, MDPI, vol. 11(11), pages 1-32, June.
    9. Gianluca De Nard & Olivier Ledoit & Michael Wolf, 2021. "Factor Models for Portfolio Selection in Large Dimensions: The Good, the Better and the Ugly [Using Principal Component Analysis to Estimate a High Dimensional Factor Model with High-frequency Data]," Journal of Financial Econometrics, Oxford University Press, vol. 19(2), pages 236-257.
    10. Moorman, Theodore, 2014. "An empirical investigation of methods to reduce transaction costs," Journal of Empirical Finance, Elsevier, vol. 29(C), pages 230-246.
    11. Constantinos Kardaras & Hyeng Keun Koo & Johannes Ruf, 2022. "Estimation of growth in fund models," Papers 2208.02573, arXiv.org.
    12. De Nard, Gianluca & Zhao, Zhao, 2022. "A large-dimensional test for cross-sectional anomalies:Efficient sorting revisited," International Review of Economics & Finance, Elsevier, vol. 80(C), pages 654-676.
    13. Thomas Conlon & John Cotter & Iason Kynigakis, 2021. "Machine Learning and Factor-Based Portfolio Optimization," Papers 2107.13866, arXiv.org.
    14. Qiao, W. & Bu, D. & Gibberd, A. & Liao, Y. & Wen, T. & Li, E., 2023. "When “time varying” volatility meets “transaction cost” in portfolio selection," Journal of Empirical Finance, Elsevier, vol. 73(C), pages 220-237.
    15. Jiang, Chonghui & Du, Jiangze & An, Yunbi & Zhang, Jinqing, 2021. "Factor tracking: A new smart beta strategy that outperforms naïve diversification," Economic Modelling, Elsevier, vol. 96(C), pages 396-408.
    16. Shi, Fangquan & Shu, Lianjie & Gu, Xinhua, 2025. "A robust latent factor model for high-dimensional portfolio selection," Journal of Empirical Finance, Elsevier, vol. 83(C).
    17. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2022. "Sparsity and stability for minimum-variance portfolios," Risk Management, Palgrave Macmillan, vol. 24(3), pages 214-235, September.
    18. Wu, Ruike & Yang, Yanrong & Shang, Han Lin & Zhu, Huanjun, 2025. "Making distributionally robust portfolios feasible in high dimension," Journal of Econometrics, Elsevier, vol. 252(PA).
    19. Raymond Kan & Xiaolu Wang & Guofu Zhou, 2022. "Optimal Portfolio Choice with Estimation Risk: No Risk-Free Asset Case," Management Science, INFORMS, vol. 68(3), pages 2047-2068, March.
    20. Ahmed, Shamim & Bu, Ziwen & Symeonidis, Lazaros & Tsvetanov, Daniel, 2023. "Which factor model? A systematic return covariation perspective," Journal of International Money and Finance, Elsevier, vol. 136(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2604.23833. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.