IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v188y2022ics0047259x21001044.html
   My bibliography  Save this article

Recent advances in shrinkage-based high-dimensional inference

Author

Listed:
  • Bodnar, Olha
  • Bodnar, Taras
  • Parolya, Nestor

Abstract

Recently, the shrinkage approach has increased its popularity in theoretical and applied statistics, especially, when point estimators for high-dimensional quantities have to be constructed. A shrinkage estimator is usually obtained by shrinking the sample estimator towards a deterministic target. This allows to reduce the high volatility that is commonly present in the sample estimator by introducing a bias such that the mean-square error of the shrinkage estimator becomes smaller than the one of the corresponding sample estimator. The procedure has shown great advantages especially in the high-dimensional problems where, in general case, the sample estimators are not consistent without imposing structural assumptions on model parameters.

Suggested Citation

  • Bodnar, Olha & Bodnar, Taras & Parolya, Nestor, 2022. "Recent advances in shrinkage-based high-dimensional inference," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    • Handle: RePEc:eee:jmvana:v:188:y:2022:i:c:s0047259x21001044
    DOI: 10.1016/j.jmva.2021.104826
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X21001044
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2021.104826?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. repec:hal:journl:peer-00741629 is not listed on IDEAS
    3. Kubokawa, Tatsuya & Srivastava, Muni S., 2008. "Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 1906-1928, October.
    4. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    5. Gupta, Arjun K. & Bodnar, Taras, 2014. "An exact test about the covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 125(C), pages 176-189.
    6. Haff, L. R., 1979. "An identity for the Wishart distribution with applications," Journal of Multivariate Analysis, Elsevier, vol. 9(4), pages 531-544, December.
    7. Kourtis, Apostolos & Dotsis, George & Markellos, Raphael N., 2012. "Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2522-2531.
    8. Taras Bodnar & Solomiia Dmytriv & Nestor Parolya & Wolfgang Schmid, 2017. "Tests for the weights of the global minimum variance portfolio in a high-dimensional setting," Papers 1710.09587, arXiv.org, revised Jul 2019.
    9. Sheena, Yo & Takemura, Akimichi, 1992. "Inadmissibility of non-order-preserving orthogonally invariant estimators of the covariance matrix in the case of Stein's loss," Journal of Multivariate Analysis, Elsevier, vol. 41(1), pages 117-131, April.
    10. Bodnar, Taras & Reiß, Markus, 2016. "Exact and asymptotic tests on a factor model in low and large dimensions with applications," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 125-151.
    11. Bodnar, Olha & Bodnar, Taras & Okhrin, Yarema, 2009. "Surveillance of the covariance matrix based on the properties of the singular Wishart distribution," Computational Statistics & Data Analysis, Elsevier, vol. 53(9), pages 3372-3385, July.
    12. Olha Bodnar, 2009. "Sequential Surveillance Of The Tangency Portfolio Weights," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 12(06), pages 797-810.
    13. Bodnar, Taras & Parolya, Nestor & Schmid, Wolfgang, 2013. "On the equivalence of quadratic optimization problems commonly used in portfolio theory," European Journal of Operational Research, Elsevier, vol. 229(3), pages 637-644.
    14. Bodnar, Taras & Parolya, Nestor & Schmid, Wolfgang, 2018. "Estimation of the global minimum variance portfolio in high dimensions," European Journal of Operational Research, Elsevier, vol. 266(1), pages 371-390.
    15. David Bauder & Taras Bodnar & Nestor Parolya & Wolfgang Schmid, 2021. "Bayesian mean–variance analysis: optimal portfolio selection under parameter uncertainty," Quantitative Finance, Taylor & Francis Journals, vol. 21(2), pages 221-242, February.
    16. Taras Bodnar & Wolfgang Schmid, 2009. "Econometrical analysis of the sample efficient frontier," The European Journal of Finance, Taylor & Francis Journals, vol. 15(3), pages 317-335.
    17. Thomas Holgersson & Peter Karlsson & Andreas Stephan, 2020. "A risk perspective of estimating portfolio weights of the global minimum-variance portfolio," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(1), pages 59-80, March.
    18. Jianqing Fan & Jingjin Zhang & Ke Yu, 2012. "Vast Portfolio Selection With Gross-Exposure Constraints," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 592-606, June.
    19. Bodnar, Taras & Dette, Holger & Parolya, Nestor, 2019. "Testing for independence of large dimensional vectors," MPRA Paper 97997, University Library of Munich, Germany, revised May 2019.
    20. Frahm, Gabriel & Memmel, Christoph, 2010. "Dominating estimators for minimum-variance portfolios," Journal of Econometrics, Elsevier, vol. 159(2), pages 289-302, December.
    21. Taras Bodnar & Yarema Okhrin & Nestor Parolya, 2022. "Optimal Shrinkage-Based Portfolio Selection in High Dimensions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(1), pages 140-156, December.
    22. Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2016. "Direct shrinkage estimation of large dimensional precision matrix," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 223-236.
    23. Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2014. "On the strong convergence of the optimal linear shrinkage estimator for large dimensional covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 215-228.
    24. Wang, Cheng & Tong, Tiejun & Cao, Longbing & Miao, Baiqi, 2014. "Non-parametric shrinkage mean estimation for quadratic loss functions with unknown covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 125(C), pages 222-232.
    25. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    26. Raymond Kan & Daniel R. Smith, 2008. "The Distribution of the Sample Minimum-Variance Frontier," Management Science, INFORMS, vol. 54(7), pages 1364-1380, July.
    27. Taras Bodnar & Wolfgang Schmid, 2008. "A test for the weights of the global minimum variance portfolio in an elliptical model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 67(2), pages 127-143, March.
    28. Silverstein, J. W., 1995. "Strong Convergence of the Empirical Distribution of Eigenvalues of Large Dimensional Random Matrices," Journal of Multivariate Analysis, Elsevier, vol. 55(2), pages 331-339, November.
    29. Okhrin, Yarema & Schmid, Wolfgang, 2006. "Distributional properties of portfolio weights," Journal of Econometrics, Elsevier, vol. 134(1), pages 235-256, September.
    30. Vasyl Golosnoy & Yarema Okhrin, 2007. "Multivariate Shrinkage for Optimal Portfolio Weights," The European Journal of Finance, Taylor & Francis Journals, vol. 13(5), pages 441-458.
    31. Chen, Song Xi & Zhang, Li-Xin & Zhong, Ping-Shou, 2010. "Tests for High-Dimensional Covariance Matrices," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 810-819.
    32. Silverstein, J. W. & Choi, S. I., 1995. "Analysis of the Limiting Spectral Distribution of Large Dimensional Random Matrices," Journal of Multivariate Analysis, Elsevier, vol. 54(2), pages 295-309, August.
    33. Bodnar, Taras & Dette, Holger & Parolya, Nestor, 2016. "Spectral analysis of the Moore–Penrose inverse of a large dimensional sample covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 160-172.
    34. Wang, Luheng & Chen, Zhao & Wang, Christina Dan & Li, Runze, 2020. "Ultrahigh dimensional precision matrix estimation via refitted cross validation," Journal of Econometrics, Elsevier, vol. 215(1), pages 118-130.
    35. Cai, T. Tony & Hu, Jianchang & Li, Yingying & Zheng, Xinghua, 2020. "High-dimensional minimum variance portfolio estimation based on high-frequency data," Journal of Econometrics, Elsevier, vol. 214(2), pages 482-494.
    36. Ding, Yi & Li, Yingying & Zheng, Xinghua, 2021. "High dimensional minimum variance portfolio estimation under statistical factor models," Journal of Econometrics, Elsevier, vol. 222(1), pages 502-515.
    37. Taras Bodnar & Nestor Parolya & Erik Thorsen, 2021. "Dynamic Shrinkage Estimation of the High-Dimensional Minimum-Variance Portfolio," Papers 2106.02131, arXiv.org, revised Nov 2021.
    38. Bodnar, Taras & Okhrin, Ostap & Parolya, Nestor, 2019. "Optimal shrinkage estimator for high-dimensional mean vector," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 63-79.
    39. Fisher, Thomas J. & Sun, Xiaoqian & Gallagher, Colin M., 2010. "A new test for sphericity of the covariance matrix for high dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 101(10), pages 2554-2570, November.
    40. Olha Bodnar & Taras Bodnar, 2010. "On The Unbiased Estimator Of The Efficient Frontier," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 13(07), pages 1065-1073.
    41. Silverstein, J. W. & Bai, Z. D., 1995. "On the Empirical Distribution of Eigenvalues of a Class of Large Dimensional Random Matrices," Journal of Multivariate Analysis, Elsevier, vol. 54(2), pages 175-192, August.
    42. Merton, Robert C., 1980. "On estimating the expected return on the market : An exploratory investigation," Journal of Financial Economics, Elsevier, vol. 8(4), pages 323-361, December.
    43. Fan, Jianqing & Fan, Yingying & Lv, Jinchi, 2008. "High dimensional covariance matrix estimation using a factor model," Journal of Econometrics, Elsevier, vol. 147(1), pages 186-197, November.
    44. Fourdrinier, Dominique & Strawderman, William E. & Wells, Martin T., 2003. "Robust shrinkage estimation for elliptically symmetric distributions with unknown covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 85(1), pages 24-39, April.
    45. Rubio, Francisco & Mestre, Xavier, 2011. "Spectral convergence for a general class of random matrices," Statistics & Probability Letters, Elsevier, vol. 81(5), pages 592-602, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bodnar, Taras & Mazur, Stepan & Nguyen, Hoang, 2022. "Estimation of optimal portfolio compositions for small sampleand singular covariance matrix," Working Papers 2022:15, Örebro University, School of Business.
    2. Bodnar, Taras & Parolya, Nestor & Thorsén, Erik, 2023. "Is the empirical out-of-sample variance an informative risk measure for the high-dimensional portfolios?," Finance Research Letters, Elsevier, vol. 54(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Taras Bodnar & Nestor Parolya & Erik Thorsen, 2021. "Dynamic Shrinkage Estimation of the High-Dimensional Minimum-Variance Portfolio," Papers 2106.02131, arXiv.org, revised Nov 2021.
    2. Taras Bodnar & Solomiia Dmytriv & Yarema Okhrin & Nestor Parolya & Wolfgang Schmid, 2020. "Statistical inference for the EU portfolio in high dimensions," Papers 2005.04761, arXiv.org.
    3. Bodnar, Taras & Parolya, Nestor & Schmid, Wolfgang, 2018. "Estimation of the global minimum variance portfolio in high dimensions," European Journal of Operational Research, Elsevier, vol. 266(1), pages 371-390.
    4. Bodnar, Taras & Parolya, Nestor & Thorsén, Erik, 2023. "Is the empirical out-of-sample variance an informative risk measure for the high-dimensional portfolios?," Finance Research Letters, Elsevier, vol. 54(C).
    5. Taras Bodnar & Holger Dette & Nestor Parolya & Erik Thors'en, 2019. "Sampling Distributions of Optimal Portfolio Weights and Characteristics in Low and Large Dimensions," Papers 1908.04243, arXiv.org, revised Apr 2023.
    6. Taras Bodnar & Yarema Okhrin & Nestor Parolya, 2022. "Optimal Shrinkage-Based Portfolio Selection in High Dimensions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(1), pages 140-156, December.
    7. Mårten Gulliksson & Stepan Mazur, 2020. "An Iterative Approach to Ill-Conditioned Optimal Portfolio Selection," Computational Economics, Springer;Society for Computational Economics, vol. 56(4), pages 773-794, December.
    8. Taras Bodnar & Mathias Lindholm & Vilhelm Niklasson & Erik Thors'en, 2020. "Bayesian Quantile-Based Portfolio Selection," Papers 2012.01819, arXiv.org.
    9. Bodnar, Taras & Okhrin, Ostap & Parolya, Nestor, 2019. "Optimal shrinkage estimator for high-dimensional mean vector," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 63-79.
    10. Taras Bodnar & Solomiia Dmytriv & Nestor Parolya & Wolfgang Schmid, 2017. "Tests for the weights of the global minimum variance portfolio in a high-dimensional setting," Papers 1710.09587, arXiv.org, revised Jul 2019.
    11. Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2016. "Direct shrinkage estimation of large dimensional precision matrix," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 223-236.
    12. Bodnar, Taras & Mazur, Stepan & Nguyen, Hoang, 2022. "Estimation of optimal portfolio compositions for small sampleand singular covariance matrix," Working Papers 2022:15, Örebro University, School of Business.
    13. Bodnar, Taras & Mazur, Stepan & Ngailo, Edward & Parolya, Nestor, 2017. "Discriminant analysis in small and large dimensions," Working Papers 2017:6, Örebro University, School of Business.
    14. Taras Bodnar & Nestor Parolya & Erik Thors'en, 2022. "Two is better than one: Regularized shrinkage of large minimum variance portfolio," Papers 2202.06666, arXiv.org.
    15. Bodnar, Taras & Gupta, Arjun K. & Parolya, Nestor, 2014. "On the strong convergence of the optimal linear shrinkage estimator for large dimensional covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 215-228.
    16. Taras Bodnar & Arjun K. Gupta & Nestor Parolya, 2013. "Optimal Linear Shrinkage Estimator for Large Dimensional Precision Matrix," Papers 1308.0931, arXiv.org, revised Mar 2014.
    17. Yuasa, Ryota & Kubokawa, Tatsuya, 2020. "Ridge-type linear shrinkage estimation of the mean matrix of a high-dimensional normal distribution," Journal of Multivariate Analysis, Elsevier, vol. 178(C).
    18. Taras Bodnar & Stepan Mazur & Nestor Parolya, 2019. "Central limit theorems for functionals of large sample covariance matrix and mean vector in matrix‐variate location mixture of normal distributions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 46(2), pages 636-660, June.
    19. Bodnar, Taras & Lindholm, Mathias & Niklasson, Vilhelm & Thorsén, Erik, 2022. "Bayesian portfolio selection using VaR and CVaR," Applied Mathematics and Computation, Elsevier, vol. 427(C).
    20. Ruili Sun & Tiefeng Ma & Shuangzhe Liu & Milind Sathye, 2019. "Improved Covariance Matrix Estimation for Portfolio Risk Measurement: A Review," JRFM, MDPI, vol. 12(1), pages 1-34, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:188:y:2022:i:c:s0047259x21001044. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.