IDEAS home Printed from https://ideas.repec.org/a/oup/biomet/v94y2007i1p217-229.html
   My bibliography  Save this article

Variable selection for the single‐index model

Author

Listed:
  • Efang Kong
  • Yingcun Xia

Abstract

We consider variable selection in the single-index model. We prove that the popular leave-m-out crossvalidation method has different behaviour in the single-index model from that in linear regression models or nonparametric regression models. A new consistent variable selection method, called separated crossvalidation, is proposed. Further analysis suggests that the method has better finite-sample performance and is computationally easier than leave-m-out crossvalidation. Separated crossvalidation, applied to the Swiss banknotes data and the ozone concentration data, leads to single-index models with selected variables that have better prediction capability than models based on all the covariates. Copyright 2007, Oxford University Press.

Suggested Citation

  • Efang Kong & Yingcun Xia, 2007. "Variable selection for the single‐index model," Biometrika, Biometrika Trust, vol. 94(1), pages 217-229.
    • Handle: RePEc:oup:biomet:v:94:y:2007:i:1:p:217-229
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/biomet/asm008
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhong, Wei & Liu, Xi & Ma, Shuangge, 2018. "Variable selection and direction estimation for single-index models via DC-TGDR method," IRTG 1792 Discussion Papers 2018-050, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    2. Langer, Sophie, 2021. "Analysis of the rate of convergence of fully connected deep neural network regression estimates with smooth activation function," Journal of Multivariate Analysis, Elsevier, vol. 182(C).
    3. Yazhao Lv & Riquan Zhang & Weihua Zhao & Jicai Liu, 2014. "Quantile regression and variable selection for the single-index model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(7), pages 1565-1577, July.
    4. Lai, Peng & Wang, Qihua & Zhou, Xiao-Hua, 2014. "Variable selection and semiparametric efficient estimation for the heteroscedastic partially linear single-index model," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 241-256.
    5. Lai, Peng & Wang, Qihua & Lian, Heng, 2012. "Bias-corrected GEE estimation and smooth-threshold GEE variable selection for single-index models with clustered data," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 422-432.
    6. The Tien Mai, 2023. "On a Low-Rank Matrix Single-Index Model," Mathematics, MDPI, vol. 11(9), pages 1-16, April.
    7. Yi, Grace Y. & He, Wenqing & Liang, Hua, 2009. "Analysis of correlated binary data under partially linear single-index logistic models," Journal of Multivariate Analysis, Elsevier, vol. 100(2), pages 278-290, February.
    8. Li, Weiyu & Patilea, Valentin, 2017. "A new minimum contrast approach for inference in single-index models," Journal of Multivariate Analysis, Elsevier, vol. 158(C), pages 47-59.
    9. Wai-Yin Poon & Hai-Bin Wang, 2014. "Multivariate partially linear single-index models: Bayesian analysis," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(4), pages 755-768, December.
    10. Melanie Birke & Sebastien Van Bellegem & Ingrid Van Keilegom, 2017. "Semi-parametric Estimation in a Single-index Model with Endogenous Variables," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(1), pages 168-191, March.
    11. Wang, Tao & Xu, Pei-Rong & Zhu, Li-Xing, 2012. "Non-convex penalized estimation in high-dimensional models with single-index structure," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 221-235.
    12. Jianbo Li & Yuan Li & Riquan Zhang, 2017. "B spline variable selection for the single index models," Statistical Papers, Springer, vol. 58(3), pages 691-706, September.
    13. Yongjin Li & Qingzhao Zhang & Qihua Wang, 2017. "Penalized estimation equation for an extended single-index model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(1), pages 169-187, February.
    14. Cai, Zongwu & Juhl, Ted & Yang, Bingduo, 2015. "Functional index coefficient models with variable selection," Journal of Econometrics, Elsevier, vol. 189(2), pages 272-284.
    15. Joel L. Horowitz, 2015. "Variable selection and estimation in high-dimensional models," CeMMAP working papers 35/15, Institute for Fiscal Studies.
    16. Joel L. Horowitz, 2015. "Variable selection and estimation in high-dimensional models," Canadian Journal of Economics, Canadian Economics Association, vol. 48(2), pages 389-407, May.
    17. Zongwu Cai & Ying Fang & Ming Lin & Zixuan Wu, 2023. "A Quasi Synthetic Control Method for Nonlinear Models With High-Dimensional Covariates," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202305, University of Kansas, Department of Economics, revised Aug 2023.
    18. Huang, Zhensheng & Pang, Zhen & Lin, Bingqing & Shao, Quanxi, 2014. "Model structure selection in single-index-coefficient regression models," Journal of Multivariate Analysis, Elsevier, vol. 125(C), pages 159-175.
    19. Joel L. Horowitz, 2015. "Variable selection and estimation in high‐dimensional models," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 48(2), pages 389-407, May.
    20. Joel L. Horowitz, 2015. "Variable selection and estimation in high-dimensional models," CeMMAP working papers CWP35/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    21. Zeng, Peng, 2011. "A link-free method for testing the significance of predictors," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 550-562, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:biomet:v:94:y:2007:i:1:p:217-229. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/biomet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.