IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v100y2009i5p862-875.html
   My bibliography  Save this article

Nonconcave penalized inverse regression in single-index models with high dimensional predictors

Author

Listed:
  • Zhu, Li-Ping
  • Zhu, Li-Xing

Abstract

In this paper we aim to estimate the direction in general single-index models and to select important variables simultaneously when a diverging number of predictors are involved in regressions. Towards this end, we propose the nonconcave penalized inverse regression method. Specifically, the resulting estimation with the SCAD penalty enjoys an oracle property in semi-parametric models even when the dimension, pn, of predictors goes to infinity. Under regularity conditions we also achieve the asymptotic normality when the dimension of predictor vector goes to infinity at the rate of pn=o(n1/3) where n is sample size, which enables us to construct confidence interval/region for the estimated index. The asymptotic results are augmented by simulations, and illustrated by analysis of an air pollution dataset.

Suggested Citation

  • Zhu, Li-Ping & Zhu, Li-Xing, 2009. "Nonconcave penalized inverse regression in single-index models with high dimensional predictors," Journal of Multivariate Analysis, Elsevier, vol. 100(5), pages 862-875, May.
    • Handle: RePEc:eee:jmvana:v:100:y:2009:i:5:p:862-875
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(08)00191-7
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lexin Li, 2007. "Sparse sufficient dimension reduction," Biometrika, Biometrika Trust, vol. 94(3), pages 603-613.
    2. Leeb, Hannes & Potscher, Benedikt M., 2008. "Sparse estimators and the oracle property, or the return of Hodges' estimator," Journal of Econometrics, Elsevier, vol. 142(1), pages 201-211, January.
    3. Liqiang Ni & R. Dennis Cook & Chih-Ling Tsai, 2005. "A note on shrinkage sliced inverse regression," Biometrika, Biometrika Trust, vol. 92(1), pages 242-247, March.
    4. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    5. Li, Bing & Wang, Shaoli, 2007. "On Directional Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 997-1008, September.
    6. Cook, R. Dennis & Ni, Liqiang, 2005. "Sufficient Dimension Reduction via Inverse Regression: A Minimum Discrepancy Approach," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 410-428, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zou, Changliang & Chen, Xin, 2012. "On the consistency of coordinate-independent sparse estimation with BIC," Journal of Multivariate Analysis, Elsevier, vol. 112(C), pages 248-255.
    2. Rong Jiang & Wei-Min Qian & Zhan-Gong Zhou, 2016. "Single-index composite quantile regression with heteroscedasticity and general error distributions," Statistical Papers, Springer, vol. 57(1), pages 185-203, March.
    3. Li-Ping Zhu & Lin-Yi Qian & Jin-Guan Lin, 2011. "Variable selection in a class of single-index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(6), pages 1277-1293, December.
    4. Radchenko, Peter, 2015. "High dimensional single index models," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 266-282.
    5. Pircalabelu, Eugen & Artemiou, Andreas, 2021. "Graph informed sliced inverse regression," Computational Statistics & Data Analysis, Elsevier, vol. 164(C).
    6. Hu, Yuao & Lian, Heng, 2013. "Variable selection in a partially linear proportional hazards model with a diverging dimensionality," Statistics & Probability Letters, Elsevier, vol. 83(1), pages 61-69.
    7. Yongjin Li & Qingzhao Zhang & Qihua Wang, 2017. "Penalized estimation equation for an extended single-index model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(1), pages 169-187, February.
    8. Li, Gao-Rong & Zhu, Li-Ping & Zhu, Li-Xing, 2010. "Adaptive confidence region for the direction in semiparametric regressions," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1364-1377, July.
    9. Lian, Heng & Li, Jianbo & Tang, Xingyu, 2014. "SCAD-penalized regression in additive partially linear proportional hazards models with an ultra-high-dimensional linear part," Journal of Multivariate Analysis, Elsevier, vol. 125(C), pages 50-64.
    10. Jiang, Rong & Qian, Wei-Min & Zhou, Zhan-Gong, 2016. "Weighted composite quantile regression for single-index models," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 34-48.
    11. Heng Lian & Peng Lai & Hua Liang, 2013. "Partially Linear Structure Selection in Cox Models with Varying Coefficients," Biometrics, The International Biometric Society, vol. 69(2), pages 348-357, June.
    12. Gabriela Ciuperca, 2018. "Test by adaptive LASSO quantile method for real-time detection of a change-point," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 81(6), pages 689-720, August.
    13. Gaorong Li & Liugen Xue & Heng Lian, 2012. "SCAD-penalised generalised additive models with non-polynomial dimensionality," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(3), pages 681-697.
    14. Kangning Wang & Lu Lin, 2017. "Robust and efficient direction identification for groupwise additive multiple-index models and its applications," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(1), pages 22-45, March.
    15. Lai, Peng & Wang, Qihua & Zhou, Xiao-Hua, 2014. "Variable selection and semiparametric efficient estimation for the heteroscedastic partially linear single-index model," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 241-256.
    16. He, Yong & Zhang, Xinsheng & Zhang, Liwen, 2018. "Variable selection for high dimensional Gaussian copula regression model: An adaptive hypothesis testing procedure," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 132-150.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weng, Jiaying, 2022. "Fourier transform sparse inverse regression estimators for sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    2. Fang, Fang & Yu, Zhou, 2020. "Model averaging assisted sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    3. Hilafu, Haileab & Yin, Xiangrong, 2013. "Sufficient dimension reduction in multivariate regressions with categorical predictors," Computational Statistics & Data Analysis, Elsevier, vol. 63(C), pages 139-147.
    4. Li-Ping Zhu & Lin-Yi Qian & Jin-Guan Lin, 2011. "Variable selection in a class of single-index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(6), pages 1277-1293, December.
    5. Zhou Yu & Yuexiao Dong & Li-Xing Zhu, 2016. "Trace Pursuit: A General Framework for Model-Free Variable Selection," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 813-821, April.
    6. Wang, Tao & Xu, Pei-Rong & Zhu, Li-Xing, 2012. "Non-convex penalized estimation in high-dimensional models with single-index structure," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 221-235.
    7. Shin, Seung Jun & Artemiou, Andreas, 2017. "Penalized principal logistic regression for sparse sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 111(C), pages 48-58.
    8. Zou, Changliang & Chen, Xin, 2012. "On the consistency of coordinate-independent sparse estimation with BIC," Journal of Multivariate Analysis, Elsevier, vol. 112(C), pages 248-255.
    9. Alothman, Ahmad & Dong, Yuexiao & Artemiou, Andreas, 2018. "On dual model-free variable selection with two groups of variables," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 366-377.
    10. Wang, Tao & Zhu, Lixing, 2013. "Sparse sufficient dimension reduction using optimal scoring," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 223-232.
    11. Yao, Weixin & Wang, Qin, 2013. "Robust variable selection through MAVE," Computational Statistics & Data Analysis, Elsevier, vol. 63(C), pages 42-49.
    12. Zhang, Hong-Fan, 2021. "Minimum Average Variance Estimation with group Lasso for the multivariate response Central Mean Subspace," Journal of Multivariate Analysis, Elsevier, vol. 184(C).
    13. Heng-Hui Lue & Bing-Ran You, 2013. "High-dimensional regression analysis with treatment comparisons," Computational Statistics, Springer, vol. 28(3), pages 1299-1317, June.
    14. Yu, Zhou & Zhu, Lixing & Wen, Xuerong Meggie, 2012. "On model-free conditional coordinate tests for regressions," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 61-72.
    15. Zhu, Li-Ping & Yu, Zhou & Zhu, Li-Xing, 2010. "A sparse eigen-decomposition estimation in semiparametric regression," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 976-986, April.
    16. Wu, Runxiong & Chen, Xin, 2021. "MM algorithms for distance covariance based sufficient dimension reduction and sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    17. Yuan, Qingcong & Chen, Xianyan & Ke, Chenlu & Yin, Xiangrong, 2022. "Independence index sufficient variable screening for categorical responses," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    18. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Changrong Yan & Dixin Zhang, 2013. "Sparse dimension reduction for survival data," Computational Statistics, Springer, vol. 28(4), pages 1835-1852, August.
    20. Kangning Wang & Lu Lin, 2017. "Robust and efficient direction identification for groupwise additive multiple-index models and its applications," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(1), pages 22-45, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:100:y:2009:i:5:p:862-875. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.