IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v196y2023ics0047259x23000301.html
   My bibliography  Save this article

Tyler’s and Maronna’s M-estimators: Non-asymptotic concentration results

Author

Listed:
  • Romanov, Elad
  • Kur, Gil
  • Nadler, Boaz

Abstract

Tyler’s and Maronna’s M-estimators, as well as their regularized variants, are popular robust methods to estimate the scatter or covariance matrix of a multivariate distribution. In this work, we study the non-asymptotic behavior of these estimators, for data sampled from a distribution that satisfies one of the following properties: (1) independent sub-Gaussian entries, up to a linear transformation; (2) log-concave distributions; (3) distributions satisfying a convex concentration property. Our main contribution is the derivation of tight non-asymptotic concentration bounds of these M-estimators around a suitably scaled version of the data sample covariance matrix. Prior to our work, non-asymptotic bounds were derived only for Elliptical and Gaussian distributions. Our proof uses a variety of tools from non asymptotic random matrix theory and high dimensional geometry. Finally, we illustrate the utility of our results on two examples of practical interest: sparse covariance and sparse precision matrix estimation.

Suggested Citation

  • Romanov, Elad & Kur, Gil & Nadler, Boaz, 2023. "Tyler’s and Maronna’s M-estimators: Non-asymptotic concentration results," Journal of Multivariate Analysis, Elsevier, vol. 196(C).
    • Handle: RePEc:eee:jmvana:v:196:y:2023:i:c:s0047259x23000301
    DOI: 10.1016/j.jmva.2023.105184
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X23000301
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2023.105184?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mark Bagnoli & Ted Bergstrom, 2006. "Log-concave probability and its applications," Studies in Economic Theory, in: Charalambos D. Aliprantis & Rosa L. Matzkin & Daniel L. McFadden & James C. Moore & Nicholas C. Yann (ed.), Rationality and Equilibrium, pages 217-241, Springer.
    2. Couillet, Romain & McKay, Matthew, 2014. "Large dimensional analysis and optimization of robust shrinkage covariance matrix estimators," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 99-120.
    3. Couillet, Romain & Pascal, Frédéric & Silverstein, Jack W., 2015. "The random matrix regime of Maronna’s M-estimator with elliptically distributed samples," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 56-78.
    4. Dümbgen, Lutz & Nordhausen, Klaus & Schuhmacher, Heike, 2016. "New algorithms for M-estimation of multivariate scatter and location," Journal of Multivariate Analysis, Elsevier, vol. 144(C), pages 200-217.
    5. Couillet, Romain & Kammoun, Abla & Pascal, Frédéric, 2016. "Second order statistics of robust estimators of scatter. Application to GLRT detection for elliptical signals," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 249-274.
    6. Cambanis, Stamatis & Huang, Steel & Simons, Gordon, 1981. "On the theory of elliptically contoured distributions," Journal of Multivariate Analysis, Elsevier, vol. 11(3), pages 368-385, September.
    7. Cai, Tony & Liu, Weidong & Luo, Xi, 2011. "A Constrained â„“1 Minimization Approach to Sparse Precision Matrix Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 594-607.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Couillet, Romain, 2015. "Robust spiked random matrices and a robust G-MUSIC estimator," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 139-161.
    2. Couillet, Romain & Kammoun, Abla & Pascal, Frédéric, 2016. "Second order statistics of robust estimators of scatter. Application to GLRT detection for elliptical signals," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 249-274.
    3. Frahm, Gabriel & Nordhausen, Klaus & Oja, Hannu, 2020. "M-estimation with incomplete and dependent multivariate data," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    4. Zhang, Teng & Cheng, Xiuyuan & Singer, Amit, 2016. "Marčenko–Pastur law for Tyler’s M-estimator," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 114-123.
    5. Joel Bun & Jean-Philippe Bouchaud & Marc Potters, 2016. "Cleaning large correlation matrices: tools from random matrix theory," Papers 1610.08104, arXiv.org.
    6. Ciobotaru, Corina & Mazza, Christian, 2022. "Consistency and asymptotic normality of M-estimates of scatter on Grassmann manifolds," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    7. Juan Pablo Atal & José Ignacio Cuesta & Felipe González & Cristóbal Otero, 2024. "The Economics of the Public Option: Evidence from Local Pharmaceutical Markets," American Economic Review, American Economic Association, vol. 114(3), pages 615-644, March.
    8. Péter Eso & Balázs Szentes, 2004. "The Price of Advice," Discussion Papers 1416, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    9. Arve, Malin & Zwart, Gijsbert, 2023. "Optimal procurement and investment in new technologies under uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 147(C).
    10. Ana-Maria Staicu & Yingxing Li & Ciprian M. Crainiceanu & David Ruppert, 2014. "Likelihood Ratio Tests for Dependent Data with Applications to Longitudinal and Functional Data Analysis," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(4), pages 932-949, December.
    11. Moraga-González, José L. & Sándor, Zsolt & Wildenbeest, Matthijs R., 2014. "Prices, Product Differentiation, And Heterogeneous Search Costs," IESE Research Papers D/1097, IESE Business School.
    12. Leandro Arozamena & Estelle Cantillon, 2004. "Investment Incentives in Procurement Auctions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 71(1), pages 1-18.
    13. Avagyan, Vahe & Alonso Fernández, Andrés Modesto & Nogales, Francisco J., 2015. "D-trace Precision Matrix Estimation Using Adaptive Lasso Penalties," DES - Working Papers. Statistics and Econometrics. WS 21775, Universidad Carlos III de Madrid. Departamento de Estadística.
    14. Falk, Michael, 1998. "A Note on the Comedian for Elliptical Distributions," Journal of Multivariate Analysis, Elsevier, vol. 67(2), pages 306-317, November.
    15. Kume, Alfred & Hashorva, Enkelejd, 2012. "Calculation of Bayes premium for conditional elliptical risks," Insurance: Mathematics and Economics, Elsevier, vol. 51(3), pages 632-635.
    16. Byrd, Michael & Nghiem, Linh H. & McGee, Monnie, 2021. "Bayesian regularization of Gaussian graphical models with measurement error," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    17. Jacob, P. & Suquet, Ch., 1997. "Regression and asymptotical location of a multivariate sample," Statistics & Probability Letters, Elsevier, vol. 35(2), pages 173-179, September.
    18. Liusha Yang & Romain Couillet & Matthew R. McKay, 2015. "A Robust Statistics Approach to Minimum Variance Portfolio Optimization," Papers 1503.08013, arXiv.org.
    19. Bobkova, Nina, 2020. "Asymmetric budget constraints in a first-price auction," Journal of Economic Theory, Elsevier, vol. 186(C).
    20. Alexandre de Corniere, 2013. "Search Advertising," Economics Series Working Papers 649, University of Oxford, Department of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:196:y:2023:i:c:s0047259x23000301. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.