IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v146y2016icp223-236.html
   My bibliography  Save this article

Direct shrinkage estimation of large dimensional precision matrix

Author

Listed:
  • Bodnar, Taras
  • Gupta, Arjun K.
  • Parolya, Nestor

Abstract

In this work we construct an optimal shrinkage estimator for the precision matrix in high dimensions. We consider the general asymptotics when the number of variables p→∞ and the sample size n→∞ so that p/n→c∈(0,+∞). The precision matrix is estimated directly, without inverting the corresponding estimator for the covariance matrix. The recent results from random matrix theory allow us to find the asymptotic deterministic equivalents of the optimal shrinkage intensities and estimate them consistently. The resulting distribution-free estimator has almost surely the minimum Frobenius loss. Additionally, we prove that the Frobenius norms of the inverse and of the pseudo-inverse sample covariance matrices tend almost surely to deterministic quantities and estimate them consistently. Using this result, we construct a bona fide optimal linear shrinkage estimator for the precision matrix in case c<1. At the end, a simulation is provided where the suggested estimator is compared with the estimators proposed in the literature. The optimal shrinkage estimator shows significant improvement even for non-normally distributed data.

Suggested Citation

  • Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2016. "Direct shrinkage estimation of large dimensional precision matrix," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 223-236.
  • Handle: RePEc:eee:jmvana:v:146:y:2016:i:c:p:223-236
    DOI: 10.1016/j.jmva.2015.09.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X15002249
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2015.09.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Kubokawa, Tatsuya & Srivastava, Muni S., 2008. "Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 1906-1928, October.
    3. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    4. Tsukuma, Hisayuki & Konno, Yoshihiko, 2006. "On improved estimation of normal precision matrix and discriminant coefficients," Journal of Multivariate Analysis, Elsevier, vol. 97(7), pages 1477-1500, August.
    5. Friesen, Olga & Löwe, Matthias & Stolz, Michael, 2013. "Gaussian fluctuations for sample covariance matrices with dependent data," Journal of Multivariate Analysis, Elsevier, vol. 114(C), pages 270-287.
    6. Amadou Sarr & Arjun Gupta & Anwar Joarder, 2009. "Estimation of the precision matrix of multivariate Pearson type II model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 69(1), pages 31-44, January.
    7. Sarr, Amadou & Gupta, Arjun K., 2009. "Estimation of the precision matrix of multivariate Kotz type model," Journal of Multivariate Analysis, Elsevier, vol. 100(4), pages 742-752, April.
    8. Germán Aneiros & Philippe Vieu, 2015. "Partial linear modelling with multi-functional covariates," Computational Statistics, Springer, vol. 30(3), pages 647-671, September.
    9. Yin, Y. Q., 1986. "Limiting spectral distribution for a class of random matrices," Journal of Multivariate Analysis, Elsevier, vol. 20(1), pages 50-68, October.
    10. Jianqing Fan & Jingjin Zhang & Ke Yu, 2012. "Vast Portfolio Selection With Gross-Exposure Constraints," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 592-606, June.
    11. Jushan Bai & Shuzhong Shi, 2011. "Estimating High Dimensional Covariance Matrices and its Applications," Annals of Economics and Finance, Society for AEF, vol. 12(2), pages 199-215, November.
    12. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    13. Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2014. "On the strong convergence of the optimal linear shrinkage estimator for large dimensional covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 215-228.
    14. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    15. Silverstein, J. W., 1995. "Strong Convergence of the Empirical Distribution of Eigenvalues of Large Dimensional Random Matrices," Journal of Multivariate Analysis, Elsevier, vol. 55(2), pages 331-339, November.
    16. Aneiros, Germán & Vieu, Philippe, 2014. "Variable selection in infinite-dimensional problems," Statistics & Probability Letters, Elsevier, vol. 94(C), pages 12-20.
    17. Fan, Jianqing & Fan, Yingying & Lv, Jinchi, 2008. "High dimensional covariance matrix estimation using a factor model," Journal of Econometrics, Elsevier, vol. 147(1), pages 186-197, November.
    18. Srivastava, Muni S. & Du, Meng, 2008. "A test for the mean vector with fewer observations than the dimension," Journal of Multivariate Analysis, Elsevier, vol. 99(3), pages 386-402, March.
    19. Rubio, Francisco & Mestre, Xavier, 2011. "Spectral convergence for a general class of random matrices," Statistics & Probability Letters, Elsevier, vol. 81(5), pages 592-602, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Taras Bodnar & Solomiia Dmytriv & Nestor Parolya & Wolfgang Schmid, 2017. "Tests for the weights of the global minimum variance portfolio in a high-dimensional setting," Papers 1710.09587, arXiv.org, revised Jul 2019.
    2. Bodnar, Taras & Reiß, Markus, 2016. "Exact and asymptotic tests on a factor model in low and large dimensions with applications," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 125-151.
    3. Bodnar, Olha & Bodnar, Taras & Parolya, Nestor, 2022. "Recent advances in shrinkage-based high-dimensional inference," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    4. Olivier Ledoit & Michael Wolf, 2019. "Quadratic shrinkage for large covariance matrices," ECON - Working Papers 335, Department of Economics - University of Zurich, revised Dec 2020.
    5. Taras Bodnar & Stepan Mazur & Nestor Parolya, 2019. "Central limit theorems for functionals of large sample covariance matrix and mean vector in matrix‐variate location mixture of normal distributions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 46(2), pages 636-660, June.
    6. N'Golo Kone, 2021. "Efficient mean-variance portfolio selection by double regularization," Working Paper 1453, Economics Department, Queen's University.
    7. Bodnar, Taras & Dette, Holger & Parolya, Nestor, 2016. "Spectral analysis of the Moore–Penrose inverse of a large dimensional sample covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 160-172.
    8. Taras Bodnar & Nestor Parolya & Erik Thorsen, 2021. "Dynamic Shrinkage Estimation of the High-Dimensional Minimum-Variance Portfolio," Papers 2106.02131, arXiv.org, revised Nov 2021.
    9. Taras Bodnar & Holger Dette & Nestor Parolya & Erik Thors'en, 2019. "Sampling Distributions of Optimal Portfolio Weights and Characteristics in Low and Large Dimensions," Papers 1908.04243, arXiv.org, revised Apr 2023.
    10. Taras Bodnar & Solomiia Dmytriv & Yarema Okhrin & Nestor Parolya & Wolfgang Schmid, 2020. "Statistical inference for the EU portfolio in high dimensions," Papers 2005.04761, arXiv.org.
    11. Tsubasa Ito & Tatsuya Kubokawa, 2015. "Linear Ridge Estimator of High-Dimensional Precision Matrix Using Random Matrix Theory ," CIRJE F-Series CIRJE-F-995, CIRJE, Faculty of Economics, University of Tokyo.
    12. Bodnar, Taras & Mazur, Stepan & Ngailo, Edward & Parolya, Nestor, 2017. "Discriminant analysis in small and large dimensions," Working Papers 2017:6, Örebro University, School of Business.
    13. Bodnar, Taras & Dette, Holger & Parolya, Nestor, 2019. "Testing for independence of large dimensional vectors," MPRA Paper 97997, University Library of Munich, Germany, revised May 2019.
    14. N'Golo Kone, 2020. "A Multi-Period Portfolio Selection in a Large Financial Market," Working Paper 1439, Economics Department, Queen's University.
    15. Carroll, Rachael & Conlon, Thomas & Cotter, John & Salvador, Enrique, 2017. "Asset allocation with correlation: A composite trade-off," European Journal of Operational Research, Elsevier, vol. 262(3), pages 1164-1180.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bodnar, Taras & Parolya, Nestor & Schmid, Wolfgang, 2018. "Estimation of the global minimum variance portfolio in high dimensions," European Journal of Operational Research, Elsevier, vol. 266(1), pages 371-390.
    2. Bodnar, Olha & Bodnar, Taras & Parolya, Nestor, 2022. "Recent advances in shrinkage-based high-dimensional inference," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    3. Taras Bodnar & Yarema Okhrin & Nestor Parolya, 2022. "Optimal Shrinkage-Based Portfolio Selection in High Dimensions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(1), pages 140-156, December.
    4. Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2014. "On the strong convergence of the optimal linear shrinkage estimator for large dimensional covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 215-228.
    5. Taras Bodnar & Arjun K. Gupta & Nestor Parolya, 2013. "Optimal Linear Shrinkage Estimator for Large Dimensional Precision Matrix," Papers 1308.0931, arXiv.org, revised Mar 2014.
    6. Bodnar, Taras & Okhrin, Ostap & Parolya, Nestor, 2019. "Optimal shrinkage estimator for high-dimensional mean vector," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 63-79.
    7. Jianqing Fan & Alex Furger & Dacheng Xiu, 2016. "Incorporating Global Industrial Classification Standard Into Portfolio Allocation: A Simple Factor-Based Large Covariance Matrix Estimator With High-Frequency Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 489-503, October.
    8. Taras Bodnar & Nestor Parolya & Erik Thorsen, 2021. "Dynamic Shrinkage Estimation of the High-Dimensional Minimum-Variance Portfolio," Papers 2106.02131, arXiv.org, revised Nov 2021.
    9. Taras Bodnar & Stepan Mazur & Nestor Parolya, 2019. "Central limit theorems for functionals of large sample covariance matrix and mean vector in matrix‐variate location mixture of normal distributions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 46(2), pages 636-660, June.
    10. Bodnar, Taras & Reiß, Markus, 2016. "Exact and asymptotic tests on a factor model in low and large dimensions with applications," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 125-151.
    11. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    12. Aït-Sahalia, Yacine & Xiu, Dacheng, 2017. "Using principal component analysis to estimate a high dimensional factor model with high-frequency data," Journal of Econometrics, Elsevier, vol. 201(2), pages 384-399.
    13. Chen, Binbin & Huang, Shih-Feng & Pan, Guangming, 2015. "High dimensional mean–variance optimization through factor analysis," Journal of Multivariate Analysis, Elsevier, vol. 133(C), pages 140-159.
    14. Jianqing Fan & Yuan Liao & Han Liu, 2016. "An overview of the estimation of large covariance and precision matrices," Econometrics Journal, Royal Economic Society, vol. 19(1), pages 1-32, February.
    15. Ding, Yi & Li, Yingying & Zheng, Xinghua, 2021. "High dimensional minimum variance portfolio estimation under statistical factor models," Journal of Econometrics, Elsevier, vol. 222(1), pages 502-515.
    16. Tae-Hwy Lee & Ekaterina Seregina, 2020. "Optimal Portfolio Using Factor Graphical Lasso," Working Papers 202025, University of California at Riverside, Department of Economics.
    17. Chen, Jia & Li, Degui & Linton, Oliver, 2019. "A new semiparametric estimation approach for large dynamic covariance matrices with multiple conditioning variables," Journal of Econometrics, Elsevier, vol. 212(1), pages 155-176.
    18. Choi, Sung Hoon & Kim, Donggyu, 2023. "Large volatility matrix analysis using global and national factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1917-1933.
    19. Gautam Sabnis & Debdeep Pati & Anirban Bhattacharya, 2019. "Compressed Covariance Estimation with Automated Dimension Learning," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 81(2), pages 466-481, December.
    20. Li, Hua & Bai, Zhidong & Wong, Wing-Keung & McAleer, Michael, 2022. "Spectrally-Corrected Estimation for High-Dimensional Markowitz Mean-Variance Optimization," Econometrics and Statistics, Elsevier, vol. 24(C), pages 133-150.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:146:y:2016:i:c:p:223-236. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.