IDEAS home Printed from https://ideas.repec.org/p/tky/fseres/2012cf855.html
   My bibliography  Save this paper

Estimation of Covariance and Precision Matrices in High Dimension

Author

Listed:
  • Tatsuya Kubokawa

    (Faculty of Economics, University of Tokyo)

  • Akira Inoue

    (Graduate School of Economics, University of Tokyo)

Abstract

The problem of estimating covariance and precision matrices of multivariate normal distributions is addressed when both the sample size and the dimension of variables are large. The estimation of the precision matrix is important in various statistical inference including the Fisher linear discriminant analysis, confidence region based on the Mahalanobis distance and others. A standard estimator is the inverse of the sample covariance matrix, but it may be instable or can not be defined in the high dimension. Although (adaptive) ridge type estimators are alternative procedures which are useful and stable for large dimension. However, we are faced with questions about how to choose ridge parameters and their estimators and how to set up asymptotic order in ridge functions in high dimensional cases. In this paper, we consider general types of ridge estimators for covariance and precision matrices, and derive asymptotic expansions of their risk functions. Then we suggest the ridge functions so that the second order terms of risks of ridge estimators are smaller than those of risks of the standard estimators.

Suggested Citation

  • Tatsuya Kubokawa & Akira Inoue, 2012. "Estimation of Covariance and Precision Matrices in High Dimension," CIRJE F-Series CIRJE-F-855, CIRJE, Faculty of Economics, University of Tokyo.
  • Handle: RePEc:tky:fseres:2012cf855
    as

    Download full text from publisher

    File URL: http://www.cirje.e.u-tokyo.ac.jp/research/dp/2012/2012cf855.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    3. Kubokawa, Tatsuya & Srivastava, Muni S., 2008. "Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 1906-1928, October.
    4. Konno, Yoshihiko, 2009. "Shrinkage estimators for large covariance matrices in multivariate real and complex normal distributions under an invariant quadratic loss," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2237-2253, November.
    5. Jushan Bai & Shuzhong Shi, 2011. "Estimating High Dimensional Covariance Matrices and its Applications," Annals of Economics and Finance, Society for AEF, vol. 12(2), pages 199-215, November.
    6. Tatsuya Kubokawa & Masashi Hyodo & Muni S. Srivastava, 2011. "Asymptotic Expansion and Estimation of EPMC for Linear Classification Rules in High Dimension," CIRJE F-Series CIRJE-F-818, CIRJE, Faculty of Economics, University of Tokyo.
    7. Fisher, Thomas J. & Sun, Xiaoqian, 2011. "Improved Stein-type shrinkage estimators for the high-dimensional multivariate normal covariance matrix," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1909-1918, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruili Sun & Tiefeng Ma & Shuangzhe Liu & Milind Sathye, 2019. "Improved Covariance Matrix Estimation for Portfolio Risk Measurement: A Review," JRFM, MDPI, vol. 12(1), pages 1-34, March.
    2. Ikeda, Yuki & Kubokawa, Tatsuya & Srivastava, Muni S., 2016. "Comparison of linear shrinkage estimators of a large covariance matrix in normal and non-normal distributions," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 95-108.
    3. Tatsuya Kubokawa & Muni S. Srivastava, 2013. "Optimal Ridge-type Estimators of Covariance Matrix in High Dimension," CIRJE F-Series CIRJE-F-906, CIRJE, Faculty of Economics, University of Tokyo.
    4. Yuki Ikeda & Tatsuya Kubokawa & Muni S. Srivastava, 2015. "Comparison of Linear Shrinkage Estimators of a Large Covariance Matrix in Normal and Non-normal Distributions," CIRJE F-Series CIRJE-F-970, CIRJE, Faculty of Economics, University of Tokyo.
    5. Ruili Sun & Tiefeng Ma & Shuangzhe Liu, 2018. "A Stein-type shrinkage estimator of the covariance matrix for portfolio selections," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 81(8), pages 931-952, November.
    6. Ikeda, Yuki & Kubokawa, Tatsuya, 2016. "Linear shrinkage estimation of large covariance matrices using factor models," Journal of Multivariate Analysis, Elsevier, vol. 152(C), pages 61-81.
    7. Nhat Minh Nguyen & Trung Duc Nguyen & Eleftherios I. Thalassinos & Hoang Anh Le, 2022. "The Performance of Shrinkage Estimator for Stock Portfolio Selection in Case of High Dimensionality," JRFM, MDPI, vol. 15(6), pages 1-12, June.
    8. Tsukuma, Hisayuki, 2016. "Estimation of a high-dimensional covariance matrix with the Stein loss," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 1-17.
    9. Hannart, Alexis & Naveau, Philippe, 2014. "Estimating high dimensional covariance matrices: A new look at the Gaussian conjugate framework," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 149-162.
    10. Yuki Ikeda & Tatsuya Kubokawa, 2015. "Linear Shrinkage Estimation of Large Covariance Matrices with Use of Factor Models," CIRJE F-Series CIRJE-F-958, CIRJE, Faculty of Economics, University of Tokyo.
    11. Ruili Sun & Tiefeng Ma & Shuangzhe Liu, 2020. "Portfolio selection: shrinking the time-varying inverse conditional covariance matrix," Statistical Papers, Springer, vol. 61(6), pages 2583-2604, December.
    12. Kourtis, Apostolos & Dotsis, George & Markellos, Raphael N., 2012. "Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2522-2531.
    13. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    14. Haddouche, Anis M. & Fourdrinier, Dominique & Mezoued, Fatiha, 2021. "Scale matrix estimation of an elliptically symmetric distribution in high and low dimensions," Journal of Multivariate Analysis, Elsevier, vol. 181(C).
    15. Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2016. "Direct shrinkage estimation of large dimensional precision matrix," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 223-236.
    16. Fourdrinier, Dominique & Mezoued, Fatiha & Wells, Martin T., 2016. "Estimation of the inverse scatter matrix of an elliptically symmetric distribution," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 32-55.
    17. Tsubasa Ito & Tatsuya Kubokawa, 2015. "Linear Ridge Estimator of High-Dimensional Precision Matrix Using Random Matrix Theory ," CIRJE F-Series CIRJE-F-995, CIRJE, Faculty of Economics, University of Tokyo.
    18. Bodnar, Taras & Parolya, Nestor & Schmid, Wolfgang, 2018. "Estimation of the global minimum variance portfolio in high dimensions," European Journal of Operational Research, Elsevier, vol. 266(1), pages 371-390.
    19. Jonathan Gillard & Emily O’Riordan & Anatoly Zhigljavsky, 2023. "Polynomial whitening for high-dimensional data," Computational Statistics, Springer, vol. 38(3), pages 1427-1461, September.
    20. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tky:fseres:2012cf855. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CIRJE administrative office (email available below). General contact details of provider: https://edirc.repec.org/data/ritokjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.