IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v111y2012icp120-135.html
   My bibliography  Save this article

The singular values and vectors of low rank perturbations of large rectangular random matrices

Author

Listed:
  • Benaych-Georges, Florent
  • Nadakuditi, Raj Rao

Abstract

In this paper, we consider the singular values and singular vectors of finite, low rank perturbations of large rectangular random matrices. Specifically, we prove almost sure convergence of the extreme singular values and appropriate projections of the corresponding singular vectors of the perturbed matrix.

Suggested Citation

  • Benaych-Georges, Florent & Nadakuditi, Raj Rao, 2012. "The singular values and vectors of low rank perturbations of large rectangular random matrices," Journal of Multivariate Analysis, Elsevier, vol. 111(C), pages 120-135.
    • Handle: RePEc:eee:jmvana:v:111:y:2012:i:c:p:120-135
    DOI: 10.1016/j.jmva.2012.04.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X12001108
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2012.04.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michael E. Tipping & Christopher M. Bishop, 1999. "Probabilistic Principal Component Analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(3), pages 611-622.
    2. Li, Baibing & Martin, Elaine B. & Morris, A. Julian, 2002. "On principal component analysis in L1," Computational Statistics & Data Analysis, Elsevier, vol. 40(3), pages 471-474, September.
    3. Silverstein, J. W., 1995. "Strong Convergence of the Empirical Distribution of Eigenvalues of Large Dimensional Random Matrices," Journal of Multivariate Analysis, Elsevier, vol. 55(2), pages 331-339, November.
    4. Baik, Jinho & Silverstein, Jack W., 2006. "Eigenvalues of large sample covariance matrices of spiked population models," Journal of Multivariate Analysis, Elsevier, vol. 97(6), pages 1382-1408, July.
    5. Carl Eckart & Gale Young, 1936. "The approximation of one matrix by another of lower rank," Psychometrika, Springer;The Psychometric Society, vol. 1(3), pages 211-218, September.
    6. Silverstein, J. W. & Bai, Z. D., 1995. "On the Empirical Distribution of Eigenvalues of a Class of Large Dimensional Random Matrices," Journal of Multivariate Analysis, Elsevier, vol. 54(2), pages 175-192, August.
    7. Pan, Guangming, 2010. "Strong convergence of the empirical distribution of eigenvalues of sample covariance matrices with a perturbation matrix," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1330-1338, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ding, Xiucai & Yang, Fan, 2022. "Edge statistics of large dimensional deformed rectangular matrices," Journal of Multivariate Analysis, Elsevier, vol. 192(C).
    2. Kamil Jurczak, 2015. "A Universal Expectation Bound on Empirical Projections of Deformed Random Matrices," Journal of Theoretical Probability, Springer, vol. 28(2), pages 650-666, June.
    3. Barigozzi, Matteo & Trapani, Lorenzo, 2020. "Sequential testing for structural stability in approximate factor models," Stochastic Processes and their Applications, Elsevier, vol. 130(8), pages 5149-5187.
    4. Kargin, Vladislav, 2015. "On estimation in the reduced-rank regression with a large number of responses and predictors," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 377-394.
    5. Philippe Loubaton, 2016. "On the Almost Sure Location of the Singular Values of Certain Gaussian Block-Hankel Large Random Matrices," Journal of Theoretical Probability, Springer, vol. 29(4), pages 1339-1443, December.
    6. Joel Bun & Jean-Philippe Bouchaud & Marc Potters, 2016. "Cleaning large correlation matrices: tools from random matrix theory," Papers 1610.08104, arXiv.org.
    7. Anna Bykhovskaya & Vadim Gorin, 2023. "High-Dimensional Canonical Correlation Analysis," Papers 2306.16393, arXiv.org, revised Aug 2023.
    8. Xinyi Zhong & Chang Su & Zhou Fan, 2022. "Empirical Bayes PCA in high dimensions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(3), pages 853-878, July.
    9. Hong, David & Balzano, Laura & Fessler, Jeffrey A., 2018. "Asymptotic performance of PCA for high-dimensional heteroscedastic data," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 435-452.
    10. Lin, Wei & Li, Min & Zhou, Shuming & Liu, Jiafei & Chen, Gaolin & Zhou, Qianru, 2021. "Phase transition in spectral clustering based on resistance matrix," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 566(C).
    11. Jean Rochet, 2017. "Complex Outliers of Hermitian Random Matrices," Journal of Theoretical Probability, Springer, vol. 30(4), pages 1624-1654, December.
    12. Feldman, Michael J., 2023. "Spiked singular values and vectors under extreme aspect ratios," Journal of Multivariate Analysis, Elsevier, vol. 196(C).
    13. Leeb, William, 2022. "Optimal singular value shrinkage for operator norm loss: Extending to non-square matrices," Statistics & Probability Letters, Elsevier, vol. 186(C).
    14. Ding, Xiucai & Ji, Hong Chang, 2023. "Spiked multiplicative random matrices and principal components," Stochastic Processes and their Applications, Elsevier, vol. 163(C), pages 25-60.
    15. Couillet, Romain, 2015. "Robust spiked random matrices and a robust G-MUSIC estimator," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 139-161.
    16. Monika Bhattacharjee & Arup Bose, 2017. "Matrix polynomial generalizations of the sample variance-covariance matrix when pn−1 → y ∈ (0, ∞)," Indian Journal of Pure and Applied Mathematics, Springer, vol. 48(4), pages 575-607, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Couillet, Romain, 2015. "Robust spiked random matrices and a robust G-MUSIC estimator," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 139-161.
    2. Wang, Cheng & Yang, Jing & Miao, Baiqi & Cao, Longbing, 2013. "Identity tests for high dimensional data using RMT," Journal of Multivariate Analysis, Elsevier, vol. 118(C), pages 128-137.
    3. Weiming Li & Jianfeng Yao, 2015. "On generalized expectation-based estimation of a population spectral distribution from high-dimensional data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(2), pages 359-373, April.
    4. Landgraf, Andrew J. & Lee, Yoonkyung, 2020. "Dimensionality reduction for binary data through the projection of natural parameters," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    5. Mo, M.Y., 2010. "Universality in complex Wishart ensembles for general covariance matrices with 2 distinct eigenvalues," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1203-1225, May.
    6. Paul, Debashis & Silverstein, Jack W., 2009. "No eigenvalues outside the support of the limiting empirical spectral distribution of a separable covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 100(1), pages 37-57, January.
    7. M. Capitaine, 2013. "Additive/Multiplicative Free Subordination Property and Limiting Eigenvectors of Spiked Additive Deformations of Wigner Matrices and Spiked Sample Covariance Matrices," Journal of Theoretical Probability, Springer, vol. 26(3), pages 595-648, September.
    8. Bai, Zhidong & Wang, Chen, 2015. "A note on the limiting spectral distribution of a symmetrized auto-cross covariance matrix," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 333-340.
    9. Ledoit, Olivier & Wolf, Michael, 2015. "Spectrum estimation: A unified framework for covariance matrix estimation and PCA in large dimensions," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 360-384.
    10. Couillet, Romain & Pascal, Frédéric & Silverstein, Jack W., 2015. "The random matrix regime of Maronna’s M-estimator with elliptically distributed samples," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 56-78.
    11. Marwa Banna & Florence Merlevède, 2015. "Limiting Spectral Distribution of Large Sample Covariance Matrices Associated with a Class of Stationary Processes," Journal of Theoretical Probability, Springer, vol. 28(2), pages 745-783, June.
    12. Merlevède, F. & Peligrad, M., 2016. "On the empirical spectral distribution for matrices with long memory and independent rows," Stochastic Processes and their Applications, Elsevier, vol. 126(9), pages 2734-2760.
    13. Dorota Toczydlowska & Gareth W. Peters & Man Chung Fung & Pavel V. Shevchenko, 2017. "Stochastic Period and Cohort Effect State-Space Mortality Models Incorporating Demographic Factors via Probabilistic Robust Principal Components," Risks, MDPI, vol. 5(3), pages 1-77, July.
    14. Chen, Tao & Martin, Elaine & Montague, Gary, 2009. "Robust probabilistic PCA with missing data and contribution analysis for outlier detection," Computational Statistics & Data Analysis, Elsevier, vol. 53(10), pages 3706-3716, August.
    15. Huanchao Zhou & Zhidong Bai & Jiang Hu, 2023. "The Limiting Spectral Distribution of Large-Dimensional General Information-Plus-Noise-Type Matrices," Journal of Theoretical Probability, Springer, vol. 36(2), pages 1203-1226, June.
    16. Pan, Guangming, 2010. "Strong convergence of the empirical distribution of eigenvalues of sample covariance matrices with a perturbation matrix," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1330-1338, July.
    17. Marconi, Gabriele, 2014. "European higher education policies and the problem of estimating a complex model with a small cross-section," MPRA Paper 87600, University Library of Munich, Germany.
    18. Merola, Giovanni Maria & Chen, Gemai, 2019. "Projection sparse principal component analysis: An efficient least squares method," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 366-382.
    19. Matteo Barigozzi, 2023. "Asymptotic equivalence of Principal Components and Quasi Maximum Likelihood estimators in Large Approximate Factor Models," Papers 2307.09864, arXiv.org, revised Sep 2023.
    20. Pavel Yaskov, 2018. "LLN for Quadratic Forms of Long Memory Time Series and Its Applications in Random Matrix Theory," Journal of Theoretical Probability, Springer, vol. 31(4), pages 2032-2055, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:111:y:2012:i:c:p:120-135. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.