IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v33y2024i4d10.1007_s11749-024-00935-9.html
   My bibliography  Save this article

Oracle-efficient M-estimation for single-index models with a smooth simultaneous confidence band

Author

Listed:
  • Li Cai

    (Zhejiang Gongshang University)

  • Lei Jin

    (Texas A &M University)

  • Jiuzhou Miao

    (Zhejiang Gongshang University)

  • Suojin Wang

    (Texas A &M University)

Abstract

Single-index models are important and popular semiparametric models, as they can handle the problem of the “curse of dimensionality” and enjoy the flexibility of nonparametric modeling and the interpretability of parametric modeling. Most existing methods for single-index models are sensitive to outliers or heavy-tailed distributions because they use the least squares criterion. An oracle-efficient M-estimator is proposed for single-index models, and a smooth simultaneous confidence band is constructed by treating the index coefficients as nuisance parameters. Under general assumptions it is shown that the M-estimator for the nonparametric link function, based on any $$\sqrt{n}$$ n -consistent coefficient index parameter estimators, is oracle-efficient. This means that it is uniformly as efficient as the infeasible one obtained by M-regression using the true single-index coefficient parameters. As a result, the asymptotic distribution of the maximal deviation between the M-type kernel estimator and the true link function is derived, and an asymptotically accurate simultaneous confidence band is established as a global inference tool for the link function. The proposed method generalizes the desirable uniform convergence property of ordinary least squares to the M-estimation. Meanwhile, it is a general approach that allows any $$\sqrt{n}$$ n -consistent coefficient parameter estimators to be applied in the procedure to make global inferences for the link function. Simulation studies with commonly encountered sample sizes are reported to support the theoretical findings. These numerical results show certain desirable robustness properties against heavy-tailed errors and outliers. As an illustration, the proposed method is applied to the analysis of a car purchasing dataset.

Suggested Citation

  • Li Cai & Lei Jin & Jiuzhou Miao & Suojin Wang, 2024. "Oracle-efficient M-estimation for single-index models with a smooth simultaneous confidence band," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 33(4), pages 1041-1061, December.
  • Handle: RePEc:spr:testjl:v:33:y:2024:i:4:d:10.1007_s11749-024-00935-9
    DOI: 10.1007/s11749-024-00935-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11749-024-00935-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11749-024-00935-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhou Zhou & Wei Biao Wu, 2010. "Simultaneous inference of linear models with time varying coefficients," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 513-531, September.
    2. Xia, Yingcun & Härdle, Wolfgang, 2006. "Semi-parametric estimation of partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 97(5), pages 1162-1184, May.
    3. Qiongxia Song & Lijian Yang, 2009. "Spline confidence bands for variance functions," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(5), pages 589-609.
    4. Li Cai & Lijian Yang, 2015. "A smooth simultaneous confidence band for conditional variance function," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 632-655, September.
    5. Härdle, Wolfgang, 1989. "Asymptotic maximal deviation of M-smoothers," Journal of Multivariate Analysis, Elsevier, vol. 29(2), pages 163-179, May.
    6. Guanqun Cao & Lijian Yang & David Todem, 2012. "Simultaneous inference for the mean function based on dense functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(2), pages 359-377.
    7. Shuzhuan Zheng & Lijian Yang & Wolfgang K. Härdle, 2014. "A Smooth Simultaneous Confidence Corridor for the Mean of Sparse Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 661-673, June.
    8. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    9. Qingming Zou & Zhongyi Zhu, 2014. "M-estimators for single-index model using B-spline," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 77(2), pages 225-246, February.
    10. Y. Xia, 1998. "Bias‐corrected confidence bands in nonparametric regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(4), pages 797-811.
    11. Liu, Jicai & Zhang, Riquan & Zhao, Weihua & Lv, Yazhao, 2013. "A robust and efficient estimation method for single index models," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 226-238.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lijie Gu & Suojin Wang & Lijian Yang, 2019. "Simultaneous confidence bands for the distribution function of a finite population in stratified sampling," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(4), pages 983-1005, August.
    2. Yuanyuan Zhang & Lijian Yang, 2018. "A smooth simultaneous confidence band for correlation curve," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(2), pages 247-269, June.
    3. Chen Zhong & Lijian Yang, 2021. "Simultaneous confidence bands for comparing variance functions of two samples based on deterministic designs," Computational Statistics, Springer, vol. 36(2), pages 1197-1218, June.
    4. Li Cai & Suojin Wang, 2021. "Global statistical inference for the difference between two regression mean curves with covariates possibly partially missing," Statistical Papers, Springer, vol. 62(6), pages 2573-2602, December.
    5. Li Cai & Lijie Gu & Qihua Wang & Suojin Wang, 2021. "Simultaneous confidence bands for nonparametric regression with missing covariate data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(6), pages 1249-1279, December.
    6. Jie Li & Jiangyan Wang & Lijian Yang, 2022. "Kolmogorov–Smirnov simultaneous confidence bands for time series distribution function," Computational Statistics, Springer, vol. 37(3), pages 1015-1039, July.
    7. Gu, Lijie & Wang, Suojin & Yang, Lijian, 2021. "Smooth simultaneous confidence band for the error distribution function in nonparametric regression," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    8. Li Cai & Lisha Li & Simin Huang & Liang Ma & Lijian Yang, 2020. "Oracally efficient estimation for dense functional data with holiday effects," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(1), pages 282-306, March.
    9. Wang, Jiangyan & Gu, Lijie & Yang, Lijian, 2022. "Oracle-efficient estimation for functional data error distribution with simultaneous confidence band," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    10. Zhong, Chen, 2024. "Oracle-efficient estimation and trend inference in non-stationary time series with trend and heteroscedastic ARMA error," Computational Statistics & Data Analysis, Elsevier, vol. 193(C).
    11. Li Cai & Lijian Yang, 2015. "A smooth simultaneous confidence band for conditional variance function," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 632-655, September.
    12. Zhou, Ling & Lin, Huazhen & Chen, Kani & Liang, Hua, 2019. "Efficient estimation and computation of parameters and nonparametric functions in generalized semi/non-parametric regression models," Journal of Econometrics, Elsevier, vol. 213(2), pages 593-607.
    13. Jiangyan Wang & Suojin Wang & Lijian Yang, 2016. "Simultaneous confidence bands for the distribution function of a finite population and of its superpopulation," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(4), pages 692-709, December.
    14. Shuzhuan Zheng & Rong Liu & Lijian Yang & Wolfgang K. Härdle, 2016. "Statistical inference for generalized additive models: simultaneous confidence corridors and variable selection," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(4), pages 607-626, December.
    15. Han, Jinyue & Wang, Jun & Gao, Wei & Tang, Man-Lai, 2023. "Estimation of the directions for unknown parameters in semiparametric models," MPRA Paper 116365, University Library of Munich, Germany.
    16. Kun Huang & Sijie Zheng & Lijian Yang, 2022. "Inference for dependent error functional data with application to event-related potentials," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(4), pages 1100-1120, December.
    17. Jiang, Rong & Qian, Wei-Min & Zhou, Zhan-Gong, 2016. "Weighted composite quantile regression for single-index models," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 34-48.
    18. Degui Li & Bin Peng & Songqiao Tang & Weibiao Wu, 2023. "Estimation of Grouped Time-Varying Network Vector Autoregression Models," Papers 2303.10117, arXiv.org, revised Mar 2024.
    19. Ali Al-Sharadqah & Majid Mojirsheibani, 2020. "A simple approach to construct confidence bands for a regression function with incomplete data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(1), pages 81-99, March.
    20. Degui Li & Bin Peng & Songqiao Tang & Weibiao Wu, 2023. "Inference of Grouped Time-Varying Network Vector Autoregression Models," Monash Econometrics and Business Statistics Working Papers 5/23, Monash University, Department of Econometrics and Business Statistics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:33:y:2024:i:4:d:10.1007_s11749-024-00935-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.