IDEAS home Printed from https://ideas.repec.org/p/zur/econwp/470.html
   My bibliography  Save this paper

AI shrinkage: a data-driven approach for risk-optimized portfolios

Author

Listed:
  • Gianluca De Nard
  • Damjan Kostovic

Abstract

The paper introduces a new type of shrinkage estimation that is not based on asymptotic optimality but uses artificial intelligence (AI) techniques to shrink the sample eigenvalues. The proposed AI Shrinkage estimator applies to both linear and nonlinear shrinkage, demonstrating improved performance compared to the classic shrinkage estimators. Our results demonstrate that reinforcement learning solutions identify a downward bias in classic shrinkage intensity estimates derived under the i.i.d. assumption and automatically correct for it in response to prevailing market conditions. Additionally, our data-driven approach enables more efficient implementation of risk-optimized portfolios and is well-suited for real-world investment applications including various optimization constraints.

Suggested Citation

  • Gianluca De Nard & Damjan Kostovic, 2025. "AI shrinkage: a data-driven approach for risk-optimized portfolios," ECON - Working Papers 470, Department of Economics - University of Zurich.
    • Handle: RePEc:zur:econwp:470
    as

    Download full text from publisher

    File URL: https://www.zora.uzh.ch/id/eprint/277803/1/econwp470.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Olivier Ledoit & Michael Wolf, 2022. "The Power of (Non-)Linear Shrinking: A Review and Guide to Covariance Matrix Estimation [Design-Free Estimation of Variance Matrices]," Journal of Financial Econometrics, Oxford University Press, vol. 20(1), pages 187-218.
    3. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    4. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," The Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    5. Olivier Ledoit & Michael Wolf, 2017. "Nonlinear Shrinkage of the Covariance Matrix for Portfolio Selection: Markowitz Meets Goldilocks," The Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4349-4388.
    6. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    7. Gianluca De Nard & Robert F. Engle & Bryan Kelly, 2024. "Factor-Mimicking Portfolios for Climate Risk," Financial Analysts Journal, Taylor & Francis Journals, vol. 80(3), pages 37-58, July.
    8. Gianluca De Nard, 2022. "Oops! I Shrunk the Sample Covariance Matrix Again: Blockbuster Meets Shrinkage [Eigenvalue Ratio Test for the Number of Factors]," Journal of Financial Econometrics, Oxford University Press, vol. 20(4), pages 569-611.
    9. Gerard Hoberg & Gordon Phillips, 2016. "Text-Based Network Industries and Endogenous Product Differentiation," Journal of Political Economy, University of Chicago Press, vol. 124(5), pages 1423-1465.
    10. Taras Bodnar & Yarema Okhrin & Nestor Parolya, 2022. "Optimal Shrinkage-Based Portfolio Selection in High Dimensions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(1), pages 140-156, December.
    11. Rafael Alves & Diego S. de Brito & Marcelo C. Medeiros & Ruy M. Ribeiro, 2023. "Forecasting Large Realized Covariance Matrices: The Benefits of Factor Models and Shrinkage," Papers 2303.16151, arXiv.org.
    12. De Nard, Gianluca & Zhao, Zhao, 2023. "Using, taming or avoiding the factor zoo? A double-shrinkage estimator for covariance matrices," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 23-35.
    13. Sancetta, Alessio, 2008. "Sample covariance shrinkage for high dimensional dependent data," Journal of Multivariate Analysis, Elsevier, vol. 99(5), pages 949-967, May.
    14. Elton, Edwin J & Gruber, Martin J, 1973. "Estimating the Dependence Structure of Share Prices-Implications for Portfolio Selection," Journal of Finance, American Finance Association, vol. 28(5), pages 1203-1232, December.
    15. Frost, Peter A. & Savarino, James E., 1986. "An Empirical Bayes Approach to Efficient Portfolio Selection," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 293-305, September.
    16. De Nard, Gianluca & Engle, Robert F. & Ledoit, Olivier & Wolf, Michael, 2022. "Large dynamic covariance matrices: Enhancements based on intraday data," Journal of Banking & Finance, Elsevier, vol. 138(C).
    17. Robert F. Engle & Olivier Ledoit & Michael Wolf, 2019. "Large Dynamic Covariance Matrices," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 363-375, April.
    18. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    19. repec:bla:jfinan:v:58:y:2003:i:4:p:1651-1684 is not listed on IDEAS
    20. Gianluca De Nard & Olivier Ledoit & Michael Wolf, 2021. "Factor Models for Portfolio Selection in Large Dimensions: The Good, the Better and the Ugly [Using Principal Component Analysis to Estimate a High Dimensional Factor Model with High-frequency Data," Journal of Financial Econometrics, Oxford University Press, vol. 19(2), pages 236-257.
    21. William F. Sharpe, 1963. "A Simplified Model for Portfolio Analysis," Management Science, INFORMS, vol. 9(2), pages 277-293, January.
    22. Laurent A. F. Callot & Anders B. Kock & Marcelo C. Medeiros, 2017. "Modeling and Forecasting Large Realized Covariance Matrices and Portfolio Choice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 140-158, January.
    23. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    24. M. Sipke Dom & Clint Howard & Maarten Jansen & Harald Lohre, 2025. "Beyond GMV: the relevance of covariance matrix estimation for risk-based portfolio construction," Quantitative Finance, Taylor & Francis Journals, vol. 25(3), pages 403-419, March.
    25. David Silver & Aja Huang & Chris J. Maddison & Arthur Guez & Laurent Sifre & George van den Driessche & Julian Schrittwieser & Ioannis Antonoglou & Veda Panneershelvam & Marc Lanctot & Sander Dieleman, 2016. "Mastering the game of Go with deep neural networks and tree search," Nature, Nature, vol. 529(7587), pages 484-489, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. De Nard, Gianluca & Zhao, Zhao, 2023. "Using, taming or avoiding the factor zoo? A double-shrinkage estimator for covariance matrices," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 23-35.
    2. Mörstedt, Torsten & Lutz, Bernhard & Neumann, Dirk, 2024. "Cross validation based transfer learning for cross-sectional non-linear shrinkage: A data-driven approach in portfolio optimization," European Journal of Operational Research, Elsevier, vol. 318(2), pages 670-685.
    3. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2019. "Cross-validated covariance estimators for high-dimensional minimum-variance portfolios," Papers 1910.13960, arXiv.org, revised Oct 2020.
    4. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2021. "Cross-validated covariance estimators for high-dimensional minimum-variance portfolios," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 35(3), pages 309-352, September.
    5. Gianluca De Nard & Robert F. Engle & Bryan Kelly, 2024. "Factor-Mimicking Portfolios for Climate Risk," Financial Analysts Journal, Taylor & Francis Journals, vol. 80(3), pages 37-58, July.
    6. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2022. "Sparsity and stability for minimum-variance portfolios," Risk Management, Palgrave Macmillan, vol. 24(3), pages 214-235, September.
    7. Ding, Yi & Li, Yingying & Zheng, Xinghua, 2021. "High dimensional minimum variance portfolio estimation under statistical factor models," Journal of Econometrics, Elsevier, vol. 222(1), pages 502-515.
    8. Härdle, Wolfgang & Klochkov, Yegor & Petukhina, Alla & Zhivotovskiy, Nikita, 2021. "Robustifying Markowitz," IRTG 1792 Discussion Papers 2021-018, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    9. Jean-David Fermanian & Benjamin Poignard & Panos Xidonas, 2025. "Model-based vs. agnostic methods for the prediction of time-varying covariance matrices," Annals of Operations Research, Springer, vol. 346(1), pages 511-548, March.
    10. Wolfgang Karl Hardle & Yegor Klochkov & Alla Petukhina & Nikita Zhivotovskiy, 2022. "Robustifying Markowitz," Papers 2212.13996, arXiv.org.
    11. Plachel, Lukas, 2019. "A unified model for regularized and robust portfolio optimization," Journal of Economic Dynamics and Control, Elsevier, vol. 109(C).
    12. Petukhina, Alla & Klochkov, Yegor & Härdle, Wolfgang Karl & Zhivotovskiy, Nikita, 2024. "Robustifying Markowitz," Journal of Econometrics, Elsevier, vol. 239(2).
    13. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2019. "Sparsity and Stability for Minimum-Variance Portfolios," Papers 1910.11840, arXiv.org.
    14. Lu, Cheng & Ndiaye, Papa Momar & Simaan, Majeed, 2024. "Improved estimation of the correlation matrix using reinforcement learning and text-based networks," International Review of Financial Analysis, Elsevier, vol. 96(PA).
    15. Gianluca De Nard & Olivier Ledoit & Michael Wolf, 2018. "Factor models for portfolio selection in large dimensions: the good, the better and the ugly," ECON - Working Papers 290, Department of Economics - University of Zurich, revised Dec 2018.
    16. Chen, Jia & Li, Degui & Linton, Oliver, 2019. "A new semiparametric estimation approach for large dynamic covariance matrices with multiple conditioning variables," Journal of Econometrics, Elsevier, vol. 212(1), pages 155-176.
    17. Hafner, Christian M. & Wang, Linqi, 2024. "Dynamic portfolio selection with sector-specific regularization," Econometrics and Statistics, Elsevier, vol. 32(C), pages 17-33.
    18. Kourtis, Apostolos & Dotsis, George & Markellos, Raphael N., 2012. "Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2522-2531.
    19. Ruili Sun & Tiefeng Ma & Shuangzhe Liu & Milind Sathye, 2019. "Improved Covariance Matrix Estimation for Portfolio Risk Measurement: A Review," JRFM, MDPI, vol. 12(1), pages 1-34, March.
    20. Luger, Richard, 2025. "Regularizing stock return covariance matrices via multiple testing of correlations," Journal of Econometrics, Elsevier, vol. 248(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zur:econwp:470. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Severin Oswald (email available below). General contact details of provider: https://edirc.repec.org/data/seizhch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.