IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v50y2023i4p1590-1615.html

Robust inference for high‐dimensional single index models

Author

Listed:
  • Dongxiao Han
  • Miao Han
  • Jian Huang
  • Yuanyuan Lin

Abstract

We propose a robust inference method for high‐dimensional single index models with an unknown link function and elliptically symmetrically distributed covariates, focusing on signal recovery and inference. The proposed method is built on the Huber loss and the estimation of the unknown link function is avoided. The ℓ1$$ {\ell}_1 $$ and ℓ2$$ {\ell}_2 $$ consistency of a Lasso estimator up to a multiplicative scalar is established. When the covariance matrix of the predictors satisfies the irrepresentable condition, our method is shown to recover the signed support of the true parameter under mild conditions. Based on a debiased Lasso estimator, we study component‐wise and group inference for the high‐dimensional index parameter. The finite‐sample performance of our method is evaluated through extensive simulation studies. An application to a riboflavin production dataset is provided to illustrate the proposed method.

Suggested Citation

  • Dongxiao Han & Miao Han & Jian Huang & Yuanyuan Lin, 2023. "Robust inference for high‐dimensional single index models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 50(4), pages 1590-1615, December.
  • Handle: RePEc:bla:scjsta:v:50:y:2023:i:4:p:1590-1615
    DOI: 10.1111/sjos.12638
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/sjos.12638
    Download Restriction: no

    File URL: https://libkey.io/10.1111/sjos.12638?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Qiang Sun & Wen-Xin Zhou & Jianqing Fan, 2020. "Adaptive Huber Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 254-265, January.
    2. He, Xuming & Shao, Qi-Man, 2000. "On Parameters of Increasing Dimensions," Journal of Multivariate Analysis, Elsevier, vol. 73(1), pages 120-135, April.
    3. Yanyuan Ma & Liping Zhu, 2013. "Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(2), pages 305-322, March.
    4. Stoker, Thomas M, 1986. "Consistent Estimation of Scaled Coefficients," Econometrica, Econometric Society, vol. 54(6), pages 1461-1481, November.
    5. Wang, Hansheng & Li, Guodong & Jiang, Guohua, 2007. "Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 347-355, July.
    6. Jianqing Fan & Quefeng Li & Yuyan Wang, 2017. "Estimation of high dimensional mean regression in the absence of symmetry and light tail assumptions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 247-265, January.
    7. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    8. Hansheng Wang & Runze Li & Chih-Ling Tsai, 2007. "Tuning parameter selectors for the smoothly clipped absolute deviation method," Biometrika, Biometrika Trust, vol. 94(3), pages 553-568.
    9. T. Tony Cai & Zijian Guo, 2020. "Semisupervised inference for explained variance in high dimensional linear regression and its applications," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(2), pages 391-419, April.
    10. Claudio Agostinelli & Ana M. Bianco & Graciela Boente, 2020. "Robust estimation in single-index models when the errors have a unimodal density with unknown nuisance parameter," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 855-893, June.
    11. Cun-Hui Zhang & Stephanie S. Zhang, 2014. "Confidence intervals for low dimensional parameters in high dimensional linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 217-242, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Han, Dongxiao & Huang, Jian & Lin, Yuanyuan & Shen, Guohao, 2022. "Robust post-selection inference of high-dimensional mean regression with heavy-tailed asymmetric or heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 230(2), pages 416-431.
    2. Luo, Jiyu & Sun, Qiang & Zhou, Wen-Xin, 2022. "Distributed adaptive Huber regression," Computational Statistics & Data Analysis, Elsevier, vol. 169(C).
    3. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Yang, Xuzhi & Wang, Tengyao, 2024. "Multiple-output composite quantile regression through an optimal transport lens," LSE Research Online Documents on Economics 125589, London School of Economics and Political Science, LSE Library.
    5. Jianqing Fan & Donggyu Kim & Minseok Shin & Yazhen Wang, 2024. "Factor and Idiosyncratic VAR-Ito Volatility Models for Heavy-Tailed High-Frequency Financial Data," Working Papers 202415, University of California at Riverside, Department of Economics.
    6. Umberto Amato & Anestis Antoniadis & Italia De Feis & Irene Gijbels, 2021. "Penalised robust estimators for sparse and high-dimensional linear models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(1), pages 1-48, March.
    7. Lu Xia & Bin Nan & Yi Li, 2023. "Debiased lasso for generalized linear models with a diverging number of covariates," Biometrics, The International Biometric Society, vol. 79(1), pages 344-357, March.
    8. Yuyang Liu & Pengfei Pi & Shan Luo, 2023. "A semi-parametric approach to feature selection in high-dimensional linear regression models," Computational Statistics, Springer, vol. 38(2), pages 979-1000, June.
    9. Gueuning, Thomas & Claeskens, Gerda, 2016. "Confidence intervals for high-dimensional partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 13-29.
    10. Donggyu Kim & Minseok Shin, 2024. "Robust High-Dimensional Time-Varying Coefficient Estimation," Working Papers 202417, University of California at Riverside, Department of Economics.
    11. Fan, Jianqing & Guo, Yongyi & Jiang, Bai, 2022. "Adaptive Huber regression on Markov-dependent data," Stochastic Processes and their Applications, Elsevier, vol. 150(C), pages 802-818.
    12. Guang Cheng & Hao Zhang & Zuofeng Shang, 2015. "Sparse and efficient estimation for partial spline models with increasing dimension," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(1), pages 93-127, February.
    13. Xing, Li-Min & Zhang, Yue-Jun, 2022. "Forecasting crude oil prices with shrinkage methods: Can nonconvex penalty and Huber loss help?," Energy Economics, Elsevier, vol. 110(C).
    14. Jiang, Rong & Qian, Wei-Min, 2016. "Quantile regression for single-index-coefficient regression models," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 305-317.
    15. Hao, Meiling & Lin, Yunyuan & Zhao, Xingqiu, 2016. "A relative error-based approach for variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 250-262.
    16. Shin, Minseok & Kim, Donggyu & Wang, Yazhen & Fan, Jianqing, 2025. "Factor and idiosyncratic VAR volatility matrix models for heavy-tailed high-frequency financial observations," Journal of Econometrics, Elsevier, vol. 252(PA).
    17. Huang, Zhensheng & Lin, Bingqing & Feng, Fan & Pang, Zhen, 2013. "Efficient penalized estimating method in the partially varying-coefficient single-index model," Journal of Multivariate Analysis, Elsevier, vol. 114(C), pages 189-200.
    18. Pötscher, Benedikt M. & Schneider, Ulrike, 2007. "On the distribution of the adaptive LASSO estimator," MPRA Paper 6913, University Library of Munich, Germany.
    19. Muhammad Amin & Lixin Song & Milton Abdul Thorlie & Xiaoguang Wang, 2015. "SCAD-penalized quantile regression for high-dimensional data analysis and variable selection," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 69(3), pages 212-235, August.
    20. Tianxi Cai & T. Tony Cai & Zijian Guo, 2021. "Optimal statistical inference for individualized treatment effects in high‐dimensional models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(4), pages 669-719, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:50:y:2023:i:4:p:1590-1615. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.