IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v149y2016icp13-29.html
   My bibliography  Save this article

Confidence intervals for high-dimensional partially linear single-index models

Author

Listed:
  • Gueuning, Thomas
  • Claeskens, Gerda

Abstract

We study partially linear single-index models where both model parts may contain high-dimensional variables. While the single-index part is of fixed dimension, the dimension of the linear part is allowed to grow with the sample size. Due to the addition of penalty terms to the loss function in order to provide sparse estimators, such as obtained by lasso or smoothly clipped absolute deviation, the construction of confidence intervals for the model parameters is not as straightforward as in the classical low-dimensional data framework. By adding a correction term to the penalized estimator a desparsified estimator is obtained for which asymptotic normality is proven. We study the construction of confidence intervals and hypothesis tests for such models. The simulation results show that the method performs well for high-dimensional single-index models.

Suggested Citation

  • Gueuning, Thomas & Claeskens, Gerda, 2016. "Confidence intervals for high-dimensional partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 13-29.
    • Handle: RePEc:eee:jmvana:v:149:y:2016:i:c:p:13-29
    DOI: 10.1016/j.jmva.2016.03.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X16300033
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2016.03.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Lixing Zhu & Liugen Xue, 2006. "Empirical likelihood confidence regions in a partially linear single‐index model," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 549-570, June.
    3. Paul Kabaila, 2009. "The Coverage Properties of Confidence Regions After Model Selection," International Statistical Review, International Statistical Institute, vol. 77(3), pages 405-414, December.
    4. Yu Y. & Ruppert D., 2002. "Penalized Spline Estimation for Partially Linear Single-Index Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1042-1054, December.
    5. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    6. Yanyuan Ma & Liping Zhu, 2013. "Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(2), pages 305-322, March.
    7. Tingni Sun & Cun-Hui Zhang, 2012. "Scaled sparse linear regression," Biometrika, Biometrika Trust, vol. 99(4), pages 879-898.
    8. Xia, Yingcun & Härdle, Wolfgang, 2006. "Semi-parametric estimation of partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 97(5), pages 1162-1184, May.
    9. Cun-Hui Zhang & Stephanie S. Zhang, 2014. "Confidence intervals for low dimensional parameters in high dimensional linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 217-242, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pircalabelu, Eugen & Artemiou, Andreas, 2020. "The LassoPSVM approach for sufficient dimension reduction using principal projections," LIDAM Discussion Papers ISBA 2020008, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    2. Rong Jiang & Mengxian Sun, 2022. "Single-index composite quantile regression for ultra-high-dimensional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(2), pages 443-460, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lai, Peng & Wang, Qihua & Lian, Heng, 2012. "Bias-corrected GEE estimation and smooth-threshold GEE variable selection for single-index models with clustered data," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 422-432.
    2. Lai, Peng & Wang, Qihua & Zhou, Xiao-Hua, 2014. "Variable selection and semiparametric efficient estimation for the heteroscedastic partially linear single-index model," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 241-256.
    3. Lian, Heng & Liang, Hua, 2016. "Separation of linear and index covariates in partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 56-70.
    4. Yazhao Lv & Riquan Zhang & Weihua Zhao & Jicai Liu, 2015. "Quantile regression and variable selection of partial linear single-index model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(2), pages 375-409, April.
    5. Lai, Peng & Wang, Qihua, 2014. "Semiparametric efficient estimation for partially linear single-index models with responses missing at random," Journal of Multivariate Analysis, Elsevier, vol. 128(C), pages 33-50.
    6. Yang, Hu & Yang, Jing, 2014. "A robust and efficient estimation and variable selection method for partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 227-242.
    7. Jianglin Fang & Wanrong Liu & Xuewen Lu, 2018. "Empirical likelihood for heteroscedastic partially linear single-index models with growing dimensional data," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 81(3), pages 255-281, April.
    8. Feng, Sanying & Xue, Liugen, 2015. "Model detection and estimation for single-index varying coefficient model," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 227-244.
    9. Qi Zhang, 2022. "High-Dimensional Mediation Analysis with Applications to Causal Gene Identification," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 14(3), pages 432-451, December.
    10. Kangning Wang & Lu Lin, 2017. "Robust and efficient direction identification for groupwise additive multiple-index models and its applications," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(1), pages 22-45, March.
    11. Umberto Amato & Anestis Antoniadis & Italia De Feis & Irene Gijbels, 2021. "Penalised robust estimators for sparse and high-dimensional linear models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(1), pages 1-48, March.
    12. Kai Yang & Xue Ding & Xiaohui Yuan, 2022. "Bayesian empirical likelihood inference and order shrinkage for autoregressive models," Statistical Papers, Springer, vol. 63(1), pages 97-121, February.
    13. Toshio Honda, 2021. "The de-biased group Lasso estimation for varying coefficient models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(1), pages 3-29, February.
    14. Peter Bühlmann & Jacopo Mandozzi, 2014. "High-dimensional variable screening and bias in subsequent inference, with an empirical comparison," Computational Statistics, Springer, vol. 29(3), pages 407-430, June.
    15. Jingxuan Luo & Lili Yue & Gaorong Li, 2023. "Overview of High-Dimensional Measurement Error Regression Models," Mathematics, MDPI, vol. 11(14), pages 1-22, July.
    16. Panxu Yuan & Xiao Guo, 2022. "High-dimensional inference for linear model with correlated errors," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(1), pages 21-52, January.
    17. Agboola, Oluwagbenga David & Yu, Han, 2023. "Neighborhood-based cross fitting approach to treatment effects with high-dimensional data," Computational Statistics & Data Analysis, Elsevier, vol. 186(C).
    18. Chaohua Dong & Jiti Gao & Dag Tjostheim, 2014. "Estimation for Single-index and Partially Linear Single-index Nonstationary Time Series Models," Monash Econometrics and Business Statistics Working Papers 7/14, Monash University, Department of Econometrics and Business Statistics.
    19. Huang, Zhensheng & Pang, Zhen, 2012. "Corrected empirical likelihood inference for right-censored partially linear single-index model," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 276-284.
    20. Xu, Mengshan & Otsu, Taisuke, 2020. "Score estimation of monotone partially linear index model," LSE Research Online Documents on Economics 106698, London School of Economics and Political Science, LSE Library.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:149:y:2016:i:c:p:13-29. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.