IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2305.11298.html
   My bibliography  Save this paper

Precision versus Shrinkage: A Comparative Analysis of Covariance Estimation Methods for Portfolio Allocation

Author

Listed:
  • Sumanjay Dutta
  • Shashi Jain

Abstract

In this paper, we perform a comprehensive study of different covariance and precision matrix estimation methods in the context of minimum variance portfolio allocation. The set of models studied by us can be broadly categorized as: Gaussian Graphical Model (GGM) based methods, Shrinkage Methods, Thresholding and Random Matrix Theory (RMT) based methods. Among these, GGM methods estimate the precision matrix directly while the other approaches estimate the covariance matrix. We perform a synthetic experiment to study the network learning and sample complexity performance of GGM methods. Thereafter, we compare all the covariance and precision matrix estimation methods in terms of their predictive ability for daily, weekly and monthly horizons. We consider portfolio risk as an indicator of estimation error and employ it as a loss function for comparison of the methods under consideration. We find that GGM methods outperform shrinkage and other approaches. Our observations for the performance of GGM methods are consistent with the synthetic experiment. We also propose a new criterion for the hyperparameter tuning of GGM methods. Our tuning approach outperforms the existing methodology in the synthetic setup. We further perform an empirical experiment where we study the properties of the estimated precision matrix. The properties of the estimated precision matrices calculated using our tuning approach are in agreement with the algorithm performances observed in the synthetic experiment and the empirical experiment for predictive ability performance comparison. Apart from this, we perform another synthetic experiment which demonstrates the direct relation between estimation error of the precision matrix and portfolio risk.

Suggested Citation

  • Sumanjay Dutta & Shashi Jain, 2023. "Precision versus Shrinkage: A Comparative Analysis of Covariance Estimation Methods for Portfolio Allocation," Papers 2305.11298, arXiv.org.
  • Handle: RePEc:arx:papers:2305.11298
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2305.11298
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    3. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    4. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    5. Taras Bodnar & Arjun K. Gupta & Nestor Parolya, 2013. "Optimal Linear Shrinkage Estimator for Large Dimensional Precision Matrix," Papers 1308.0931, arXiv.org, revised Mar 2014.
    6. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    7. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    8. Gabriele Torri & Rosella Giacometti & Sandra Paterlini, 2019. "Sparse precision matrices for minimum variance portfolios," Computational Management Science, Springer, vol. 16(3), pages 375-400, July.
    9. Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2014. "On the strong convergence of the optimal linear shrinkage estimator for large dimensional covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 215-228.
    10. Schäfer Juliane & Strimmer Korbinian, 2005. "A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 4(1), pages 1-32, November.
    11. Laurent Callot & Mehmet Caner & A. Özlem Önder & Esra Ulaşan, 2021. "A Nodewise Regression Approach to Estimating Large Portfolios," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 520-531, March.
    12. Cai, Tony & Liu, Weidong, 2011. "Adaptive Thresholding for Sparse Covariance Matrix Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 672-684.
    13. Joël Bun & Jean-Philippe Bouchaud & Marc Potters, 2017. "Cleaning large correlation matrices: tools from random matrix theory," Post-Print hal-01491304, HAL.
    14. Frost, Peter A. & Savarino, James E., 1986. "An Empirical Bayes Approach to Efficient Portfolio Selection," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 293-305, September.
    15. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1684, August.
    16. Antoniadis A. & Fan J., 2001. "Regularization of Wavelet Approximations," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 939-967, September.
    17. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    18. Joel Bun & Romain Allez & Jean-Philippe Bouchaud & Marc Potters, 2015. "Rotational invariant estimator for general noisy matrices," Papers 1502.06736, arXiv.org, revised Oct 2016.
    19. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    20. Prayut Jain & Shashi Jain, 2019. "Can Machine Learning-Based Portfolios Outperform Traditional Risk-Based Portfolios? The Need to Account for Covariance Misspecification," Risks, MDPI, vol. 7(3), pages 1-27, July.
    21. Jorion, Philippe, 1986. "Bayes-Stein Estimation for Portfolio Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 279-292, September.
    22. Cai, T. Tony & Hu, Jianchang & Li, Yingying & Zheng, Xinghua, 2020. "High-dimensional minimum variance portfolio estimation based on high-frequency data," Journal of Econometrics, Elsevier, vol. 214(2), pages 482-494.
    23. Cai, Tony & Liu, Weidong & Luo, Xi, 2011. "A Constrained â„“1 Minimization Approach to Sparse Precision Matrix Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 594-607.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2019. "Cross-validated covariance estimators for high-dimensional minimum-variance portfolios," Papers 1910.13960, arXiv.org, revised Oct 2020.
    2. Dichtl, Hubert & Drobetz, Wolfgang & Neuhierl, Andreas & Wendt, Viktoria-Sophie, 2021. "Data snooping in equity premium prediction," International Journal of Forecasting, Elsevier, vol. 37(1), pages 72-94.
    3. Bailey, Natalia & Pesaran, M. Hashem & Smith, L. Vanessa, 2019. "A multiple testing approach to the regularisation of large sample correlation matrices," Journal of Econometrics, Elsevier, vol. 208(2), pages 507-534.
    4. Ruili Sun & Tiefeng Ma & Shuangzhe Liu & Milind Sathye, 2019. "Improved Covariance Matrix Estimation for Portfolio Risk Measurement: A Review," JRFM, MDPI, vol. 12(1), pages 1-34, March.
    5. Jianqing Fan & Alex Furger & Dacheng Xiu, 2016. "Incorporating Global Industrial Classification Standard Into Portfolio Allocation: A Simple Factor-Based Large Covariance Matrix Estimator With High-Frequency Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 489-503, October.
    6. Donggyu Kim & Minseog Oh, 2023. "Dynamic Realized Minimum Variance Portfolio Models," Papers 2310.13511, arXiv.org.
    7. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2021. "Cross-validated covariance estimators for high-dimensional minimum-variance portfolios," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 35(3), pages 309-352, September.
    8. Choi, Young-Geun & Lim, Johan & Roy, Anindya & Park, Junyong, 2019. "Fixed support positive-definite modification of covariance matrix estimators via linear shrinkage," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 234-249.
    9. Ding, Yi & Li, Yingying & Zheng, Xinghua, 2021. "High dimensional minimum variance portfolio estimation under statistical factor models," Journal of Econometrics, Elsevier, vol. 222(1), pages 502-515.
    10. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    11. Fan, Jianqing & Liao, Yuan & Shi, Xiaofeng, 2015. "Risks of large portfolios," Journal of Econometrics, Elsevier, vol. 186(2), pages 367-387.
    12. Wang, Christina Dan & Chen, Zhao & Lian, Yimin & Chen, Min, 2022. "Asset selection based on high frequency Sharpe ratio," Journal of Econometrics, Elsevier, vol. 227(1), pages 168-188.
    13. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    14. Bollerslev, Tim & Patton, Andrew J. & Quaedvlieg, Rogier, 2018. "Modeling and forecasting (un)reliable realized covariances for more reliable financial decisions," Journal of Econometrics, Elsevier, vol. 207(1), pages 71-91.
    15. Roccazzella, Francesco & Gambetti, Paolo & Vrins, Frédéric, 2022. "Optimal and robust combination of forecasts via constrained optimization and shrinkage," International Journal of Forecasting, Elsevier, vol. 38(1), pages 97-116.
    16. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2014. "$L_p$ regularized portfolio optimization," Papers 1404.4040, arXiv.org.
    17. Gabriel Frahm & Tobias Wickern & Christof Wiechers, 2012. "Multiple tests for the performance of different investment strategies," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(3), pages 343-383, July.
    18. Long Zhao & Deepayan Chakrabarti & Kumar Muthuraman, 2019. "Portfolio Construction by Mitigating Error Amplification: The Bounded-Noise Portfolio," Operations Research, INFORMS, vol. 67(4), pages 965-983, July.
    19. Chen, Xin & Yang, Dan & Xu, Yan & Xia, Yin & Wang, Dong & Shen, Haipeng, 2023. "Testing and support recovery of correlation structures for matrix-valued observations with an application to stock market data," Journal of Econometrics, Elsevier, vol. 232(2), pages 544-564.
    20. Hsu, Po-Hsuan & Han, Qiheng & Wu, Wensheng & Cao, Zhiguang, 2018. "Asset allocation strategies, data snooping, and the 1 / N rule," Journal of Banking & Finance, Elsevier, vol. 97(C), pages 257-269.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2305.11298. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.