IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2013-30.html

Sparse High-dimensional Varying Coefficient Model : Non-asymptotic Minimax Study

Author

Listed:
  • Olga Klopp

    (CREST and University Paris- Nanterre)

  • Marianna Pensky

    (University of Central Florida)

Abstract

The objective of the present paper is to develop a minimax theory for the varying coefficient model in a non-asymptotic setting. We consider a high- dimensional sparse varying coefficient model where only few of the covariates are present and only some of those covariates are time dependent. Our analysis allows the time dependent covariates to have different degrees of smoothness and to be spatially inhomogeneous. We develop the minimax lower bounds for the quadratic risk and construct an adaptive estimator which attains those lower bounds within a constant (if all time-dependent covariates are spatially homogeneous) or logarithmic factor of the number of observations.

Suggested Citation

  • Olga Klopp & Marianna Pensky, 2013. "Sparse High-dimensional Varying Coefficient Model : Non-asymptotic Minimax Study," Working Papers 2013-30, Center for Research in Economics and Statistics.
    • Handle: RePEc:crs:wpaper:2013-30
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2013-30.pdf
    File Function: Crest working paper version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lukas Meier & Sara Van De Geer & Peter Bühlmann, 2008. "The group lasso for logistic regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(1), pages 53-71, February.
    2. Arnak Dalalyan & Yuri Ingster & Alexandre B. Tsybakov, 2012. "Statistical Inference in Compound Functional Models," Working Papers 2012-20, Center for Research in Economics and Statistics.
    3. Wang, Lan & Kai, Bo & Li, Runze, 2009. "Local Rank Inference for Varying Coefficient Models," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1631-1645.
    4. Şentürk, Damla & Müller, Hans-Georg, 2010. "Functional Varying Coefficient Models for Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1256-1264.
    5. Karim Lounici & Massimiliano Pontil & Alexandre B. Tsybakov & Sara Van De Geer, 2010. "Oracle Inequalities and Optimal Inference under Group Sparsity," Working Papers 2010-35, Center for Research in Economics and Statistics.
    6. Chiang C-T. & Rice J. A & Wu C. O, 2001. "Smoothing Spline Estimation for Varying Coefficient Models With Repeatedly Measured Dependent Variables," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 605-619, June.
    7. Jianhua Z. Huang & Haipeng Shen, 2004. "Functional Coefficient Regression Models for Non‐linear Time Series: A Polynomial Spline Approach," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 31(4), pages 515-534, December.
    8. Jianhua Z. Huang, 2002. "Varying-coefficient models and basis function approximations for the analysis of repeated measurements," Biometrika, Biometrika Trust, vol. 89(1), pages 111-128, March.
    9. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    10. Li, Gaorong & Xue, Liugen & Lian, Heng, 2011. "Semi-varying coefficient models with a diverging number of components," Journal of Multivariate Analysis, Elsevier, vol. 102(7), pages 1166-1174, August.
    11. Yang, Lijian & Park, Byeong U. & Xue, Lan & Hardle, Wolfgang, 2006. "Estimation and Testing for Varying Coefficients in Additive Models With Marginal Integration," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1212-1227, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Byeong U. Park & Enno Mammen & Young K. Lee & Eun Ryung Lee, 2015. "Varying Coefficient Regression Models: A Review and New Developments," International Statistical Review, International Statistical Institute, vol. 83(1), pages 36-64, April.
    2. Long Feng & Changliang Zou & Zhaojun Wang & Xianwu Wei & Bin Chen, 2015. "Robust spline-based variable selection in varying coefficient model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(1), pages 85-118, January.
    3. Kong, Dehan & Bondell, Howard D. & Wu, Yichao, 2015. "Domain selection for the varying coefficient model via local polynomial regression," Computational Statistics & Data Analysis, Elsevier, vol. 83(C), pages 236-250.
    4. Chen, Yixin & Wang, Qin & Yao, Weixin, 2015. "Adaptive estimation for varying coefficient models," Journal of Multivariate Analysis, Elsevier, vol. 137(C), pages 17-31.
    5. A. Antoniadis & I. Gijbels & S. Lambert-Lacroix, 2014. "Penalized estimation in additive varying coefficient models using grouped regularization," Statistical Papers, Springer, vol. 55(3), pages 727-750, August.
    6. Qiu, Jia & Li, Degao & You, Jinhong, 2015. "SCAD-penalized regression for varying-coefficient models with autoregressive errors," Journal of Multivariate Analysis, Elsevier, vol. 137(C), pages 100-118.
    7. Lian, Heng, 2015. "Quantile regression for dynamic partially linear varying coefficient time series models," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 49-66.
    8. Rahul Ghosal & Arnab Maity & Timothy Clark & Stefano B. Longo, 2020. "Variable selection in functional linear concurrent regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(3), pages 565-587, June.
    9. Weihua Zhao & Weiping Zhang & Heng Lian, 2020. "Marginal quantile regression for varying coefficient models with longitudinal data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(1), pages 213-234, February.
    10. Tang, Yanlin & Wang, Huixia Judy & Zhu, Zhongyi, 2013. "Variable selection in quantile varying coefficient models with longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 435-449.
    11. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    12. Ye, Ya-Fen & Shao, Yuan-Hai & Deng, Nai-Yang & Li, Chun-Na & Hua, Xiang-Yu, 2017. "Robust Lp-norm least squares support vector regression with feature selection," Applied Mathematics and Computation, Elsevier, vol. 305(C), pages 32-52.
    13. Şentürk, Damla & Ghosh, Samiran & Nguyen, Danh V., 2014. "Exploratory time varying lagged regression: Modeling association of cognitive and functional trajectories with expected clinic visits in older adults," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 1-15.
    14. Diego Vidaurre & Concha Bielza & Pedro Larrañaga, 2013. "A Survey of L1 Regression," International Statistical Review, International Statistical Institute, vol. 81(3), pages 361-387, December.
    15. Li, XiaoLi & You, JinHong, 2012. "Error covariance matrix correction based approach to functional coefficient regression models with generated covariates," Journal of Multivariate Analysis, Elsevier, vol. 107(C), pages 263-281.
    16. Mohit Agrawal & Joseph G. Altonji & Richard K. Mansfield, 2019. "Quantifying Family, School, and Location Effects in the Presence of Complementarities and Sorting," Journal of Labor Economics, University of Chicago Press, vol. 37(S1), pages 11-83.
    17. Lee, Wonyul & Liu, Yufeng, 2012. "Simultaneous multiple response regression and inverse covariance matrix estimation via penalized Gaussian maximum likelihood," Journal of Multivariate Analysis, Elsevier, vol. 111(C), pages 241-255.
    18. Mohamed Ouhourane & Yi Yang & Andréa L. Benedet & Karim Oualkacha, 2022. "Group penalized quantile regression," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(3), pages 495-529, September.
    19. Ye, Mao & Lu, Zhao-Hua & Li, Yimei & Song, Xinyuan, 2019. "Finite mixture of varying coefficient model: Estimation and component selection," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 452-474.
    20. Choi, Sungwoo & Park, Junyong, 2014. "Nonparametric additive model with grouped lasso and maximizing area under the ROC curve," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 313-325.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2013-30. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.