IDEAS home Printed from https://ideas.repec.org/a/spr/metrik/v78y2015i1p85-118.html
   My bibliography  Save this article

Robust spline-based variable selection in varying coefficient model

Author

Listed:
  • Long Feng
  • Changliang Zou
  • Zhaojun Wang
  • Xianwu Wei
  • Bin Chen

Abstract

The varying coefficient model is widely used as an extension of the linear regression model. Many procedures have been developed for the model estimation, and recently efficient variable selection procedures for the varying coefficient model have been proposed as well. However, those variable selection approaches are mainly built on the least-squares (LS) type method. Although the LS method is a successful and standard choice in the varying coefficient model fitting and variable selection, it may suffer when the errors follow a heavy-tailed distribution or in the presence of outliers. To overcome this issue, we start by developing a novel robust estimator, termed rank-based spline estimator, which combines the ideas of rank inference and polynomial spline. Furthermore, we propose a robust variable selection method, incorporating the smoothly clipped absolute deviation penalty into the rank-based spline loss function. Under mild conditions, we theoretically show that the proposed rank-based spline estimator is highly efficient across a wide spectrum of distributions. Its asymptotic relative efficiency with respect to the LS-based method is closely related to that of the signed-rank Wilcoxon test with respect to the t test. Moreover, the proposed variable selection method can identify the true model consistently, and the resulting estimator can be as efficient as the oracle estimator. Simulation studies show that our procedure has better performance than the LS-based method when the errors deviate from normality. Copyright Springer-Verlag Berlin Heidelberg 2015

Suggested Citation

  • Long Feng & Changliang Zou & Zhaojun Wang & Xianwu Wei & Bin Chen, 2015. "Robust spline-based variable selection in varying coefficient model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(1), pages 85-118, January.
  • Handle: RePEc:spr:metrik:v:78:y:2015:i:1:p:85-118
    DOI: 10.1007/s00184-014-0491-y
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00184-014-0491-y
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s00184-014-0491-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Lifeng & Li, Hongzhe & Huang, Jianhua Z., 2008. "Variable Selection in Nonparametric Varying-Coefficient Models for Analysis of Repeated Measurements," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1556-1569.
    2. Zhao, Peixin & Xue, Liugen, 2009. "Variable selection for semiparametric varying coefficient partially linear models," Statistics & Probability Letters, Elsevier, vol. 79(20), pages 2148-2157, October.
    3. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    4. Wang, Hansheng & Xia, Yingcun, 2009. "Shrinkage Estimation of the Varying Coefficient Model," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 747-757.
    5. Wang, Hansheng & Li, Guodong & Jiang, Guohua, 2007. "Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 347-355, July.
    6. Terpstra, Jeff T. & McKean, Joseph W., 2005. "Rank-Based Analysis of Linear Models Using R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 14(i07).
    7. Wang, Lan & Kai, Bo & Li, Runze, 2009. "Local Rank Inference for Varying Coefficient Models," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1631-1645.
    8. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    9. Lan Wang & Runze Li, 2009. "Weighted Wilcoxon-Type Smoothly Clipped Absolute Deviation Method," Biometrics, The International Biometric Society, vol. 65(2), pages 564-571, June.
    10. Chiang C-T. & Rice J. A & Wu C. O, 2001. "Smoothing Spline Estimation for Varying Coefficient Models With Repeatedly Measured Dependent Variables," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 605-619, June.
    11. Jianhua Z. Huang & Haipeng Shen, 2004. "Functional Coefficient Regression Models for Non‐linear Time Series: A Polynomial Spline Approach," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 31(4), pages 515-534, December.
    12. Lan Wang, 2009. "Wilcoxon-type generalized Bayesian information criterion," Biometrika, Biometrika Trust, vol. 96(1), pages 163-173.
    13. Jianhua Z. Huang, 2002. "Varying-coefficient models and basis function approximations for the analysis of repeated measurements," Biometrika, Biometrika Trust, vol. 89(1), pages 111-128, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jing Yang & Hu Yang & Fang Lu, 2019. "Rank-based shrinkage estimation for identification in semiparametric additive models," Statistical Papers, Springer, vol. 60(4), pages 1255-1281, August.
    2. Jiaming Luan & Hongwei Wang & Kangning Wang & Benle Zhang, 2022. "Robust distributed estimation and variable selection for massive datasets via rank regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(3), pages 435-450, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kong, Dehan & Bondell, Howard D. & Wu, Yichao, 2015. "Domain selection for the varying coefficient model via local polynomial regression," Computational Statistics & Data Analysis, Elsevier, vol. 83(C), pages 236-250.
    2. Lian, Heng, 2015. "Quantile regression for dynamic partially linear varying coefficient time series models," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 49-66.
    3. Byeong U. Park & Enno Mammen & Young K. Lee & Eun Ryung Lee, 2015. "Varying Coefficient Regression Models: A Review and New Developments," International Statistical Review, International Statistical Institute, vol. 83(1), pages 36-64, April.
    4. Peixin Zhao & Liugen Xue, 2011. "Variable selection for varying coefficient models with measurement errors," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 74(2), pages 231-245, September.
    5. Zhaoping Hong & Yuao Hu & Heng Lian, 2013. "Variable selection for high-dimensional varying coefficient partially linear models via nonconcave penalty," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 76(7), pages 887-908, October.
    6. Zhao, Peixin & Xue, Liugen, 2010. "Variable selection for semiparametric varying coefficient partially linear errors-in-variables models," Journal of Multivariate Analysis, Elsevier, vol. 101(8), pages 1872-1883, September.
    7. Tian, Ruiqin & Xue, Liugen & Liu, Chunling, 2014. "Penalized quadratic inference functions for semiparametric varying coefficient partially linear models with longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 94-110.
    8. Tang, Yanlin & Wang, Huixia Judy & Zhu, Zhongyi, 2013. "Variable selection in quantile varying coefficient models with longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 435-449.
    9. Jun Jin & Tiefeng Ma & Jiajia Dai, 2021. "New efficient spline estimation for varying-coefficient models with two-step knot number selection," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(5), pages 693-712, July.
    10. Weihua Zhao & Weiping Zhang & Heng Lian, 2020. "Marginal quantile regression for varying coefficient models with longitudinal data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(1), pages 213-234, February.
    11. Zhao, Weihua & Lian, Heng, 2017. "Quantile index coefficient model with variable selection," Journal of Multivariate Analysis, Elsevier, vol. 154(C), pages 40-58.
    12. Qiu, Jia & Li, Degao & You, Jinhong, 2015. "SCAD-penalized regression for varying-coefficient models with autoregressive errors," Journal of Multivariate Analysis, Elsevier, vol. 137(C), pages 100-118.
    13. Zhao, Weihua & Zhang, Riquan & Liu, Jicai & Hu, Hongchang, 2015. "Robust adaptive estimation for semivarying coefficient models," Statistics & Probability Letters, Elsevier, vol. 97(C), pages 132-141.
    14. Feng, Sanying & He, Wenqi & Li, Feng, 2020. "Model detection and estimation for varying coefficient panel data models with fixed effects," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    15. Zhang, Ting, 2015. "Semiparametric model building for regression models with time-varying parameters," Journal of Econometrics, Elsevier, vol. 187(1), pages 189-200.
    16. Qu, Lianqiang & Song, Xinyuan & Sun, Liuquan, 2018. "Identification of local sparsity and variable selection for varying coefficient additive hazards models," Computational Statistics & Data Analysis, Elsevier, vol. 125(C), pages 119-135.
    17. Yunquan Song & Hang Su & Minmin Zhan, 2024. "Local Walsh-average-based Estimation and Variable Selection for Spatial Single-index Autoregressive Models," Networks and Spatial Economics, Springer, vol. 24(2), pages 313-339, June.
    18. Xuejun Ma & Yue Du & Jingli Wang, 2022. "Model detection and variable selection for mode varying coefficient model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 321-341, June.
    19. Weihua Zhao & Riquan Zhang & Jicai Liu & Yazhao Lv, 2014. "Robust and efficient variable selection for semiparametric partially linear varying coefficient model based on modal regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 165-191, February.
    20. Zhao, Weihua & Jiang, Xuejun & Lian, Heng, 2018. "A principal varying-coefficient model for quantile regression: Joint variable selection and dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 269-280.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:metrik:v:78:y:2015:i:1:p:85-118. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.