IDEAS home Printed from https://ideas.repec.org/a/eee/spapps/v129y2019i11p4385-4410.html
   My bibliography  Save this article

Learning from MOM’s principles: Le Cam’s approach

Author

Listed:
  • Lecué, Guillaume
  • Lerasle, Matthieu

Abstract

New robust estimators are introduced, derived from median-of-means principle and Le Cam’s aggregation of tests. Minimax sparse rates of convergence are obtained with exponential probability, under weak moment’s assumptions and possible contamination of the dataset. These derive from general risk bounds of the following informal structure maxminimax rate in the i.i.d. setup,number of outliersnumber of observations.In this result, the number of outliers may be as large as (number of data)×(minimax rate) without affecting the rates. As an example, minimax rates slog(ed∕s)∕N of recovery of s-sparse vectors in Rd holding with exponentially large probability, are deduced for median-of-means versions of the LASSO when the noise has q0 moments for some q0>2, the entries of the design matrix have C0log(ed) moments and the dataset is corrupted by up to C1slog(ed∕s) outliers.

Suggested Citation

  • Lecué, Guillaume & Lerasle, Matthieu, 2019. "Learning from MOM’s principles: Le Cam’s approach," Stochastic Processes and their Applications, Elsevier, vol. 129(11), pages 4385-4410.
    • Handle: RePEc:eee:spapps:v:129:y:2019:i:11:p:4385-4410
    DOI: 10.1016/j.spa.2018.11.024
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304414918306999
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.spa.2018.11.024?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Baraud, Y. & Birgé, L., 2016. "Rho-estimators for shape restricted density estimation," Stochastic Processes and their Applications, Elsevier, vol. 126(12), pages 3888-3912.
    2. Jianqing Fan & Quefeng Li & Yuyan Wang, 2017. "Estimation of high dimensional mean regression in the absence of symmetry and light tail assumptions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 247-265, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. P Alquier & M Gerber, 2024. "Universal robust regression via maximum mean discrepancy," Biometrika, Biometrika Trust, vol. 111(1), pages 71-92.
    2. Brunet-Saumard, Camille & Genetay, Edouard & Saumard, Adrien, 2022. "K-bMOM: A robust Lloyd-type clustering algorithm based on bootstrap median-of-means," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guillaume Lecué & Mathieu Lerasle, 2017. "Robust machine learning by median-of-means : theory and practice," Working Papers 2017-32, Center for Research in Economics and Statistics.
    2. Umberto Amato & Anestis Antoniadis & Italia De Feis & Irene Gijbels, 2021. "Penalised robust estimators for sparse and high-dimensional linear models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(1), pages 1-48, March.
    3. Fan, Jianqing & Guo, Yongyi & Jiang, Bai, 2022. "Adaptive Huber regression on Markov-dependent data," Stochastic Processes and their Applications, Elsevier, vol. 150(C), pages 802-818.
    4. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    5. Andrii Babii & Eric Ghysels & Jonas Striaukas, 2022. "Machine Learning Time Series Regressions With an Application to Nowcasting," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1094-1106, June.
    6. Xing, Li-Min & Zhang, Yue-Jun, 2022. "Forecasting crude oil prices with shrinkage methods: Can nonconvex penalty and Huber loss help?," Energy Economics, Elsevier, vol. 110(C).
    7. Sung Hoon Choi & Donggyu Kim, 2023. "Large Global Volatility Matrix Analysis Based on Observation Structural Information," Papers 2305.01464, arXiv.org, revised Feb 2024.
    8. Han, Dongxiao & Huang, Jian & Lin, Yuanyuan & Shen, Guohao, 2022. "Robust post-selection inference of high-dimensional mean regression with heavy-tailed asymmetric or heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 230(2), pages 416-431.
    9. Sung Hoon Choi & Donggyu Kim, 2022. "Large Volatility Matrix Analysis Using Global and National Factor Models," Papers 2208.12323, arXiv.org, revised Dec 2022.
    10. Zhao, Jun & Chen, Yingyu & Zhang, Yi, 2018. "Expectile regression for analyzing heteroscedasticity in high dimension," Statistics & Probability Letters, Elsevier, vol. 137(C), pages 304-311.
    11. Choi, Sung Hoon & Kim, Donggyu, 2023. "Large volatility matrix analysis using global and national factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1917-1933.
    12. Chen, Likai & Wang, Weining & Wu, Wei Biao, 2019. "Inference of Break-Points in High-Dimensional Time Series," IRTG 1792 Discussion Papers 2019-013, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    13. Beyhum, Jad, 2019. "Inference robust to outliers with L1‐norm penalization," TSE Working Papers 19-1032, Toulouse School of Economics (TSE).
    14. Fan, Jianqing & Wang, Weichen & Zhong, Yiqiao, 2019. "Robust covariance estimation for approximate factor models," Journal of Econometrics, Elsevier, vol. 208(1), pages 5-22.
    15. Jun Zhao & Guan’ao Yan & Yi Zhang, 2022. "Robust estimation and shrinkage in ultrahigh dimensional expectile regression with heavy tails and variance heterogeneity," Statistical Papers, Springer, vol. 63(1), pages 1-28, February.
    16. Xiao, Xuan & Xu, Xingbai & Zhong, Wei, 2023. "Huber estimation for the network autoregressive model," Statistics & Probability Letters, Elsevier, vol. 203(C).
    17. Christis Katsouris, 2023. "High Dimensional Time Series Regression Models: Applications to Statistical Learning Methods," Papers 2308.16192, arXiv.org.
    18. Jad Beyhum, 2020. "Inference robust to outliers with L1‐norm penalization," Post-Print hal-03235868, HAL.
    19. Hao, Xianfeng & Zhao, Yuyang & Wang, Yudong, 2020. "Forecasting the real prices of crude oil using robust regression models with regularization constraints," Energy Economics, Elsevier, vol. 86(C).
    20. Yue Wang & Baobin Wang & Chaoquan Peng & Xuefeng Li & Hong Yin, 2022. "Huber Regression Analysis with a Semi-Supervised Method," Mathematics, MDPI, vol. 10(20), pages 1-12, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:spapps:v:129:y:2019:i:11:p:4385-4410. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/505572/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.