IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v146y2016icp63-71.html
   My bibliography  Save this article

Consistent variable selection for functional regression models

Author

Listed:
  • Collazos, Julian A.A.
  • Dias, Ronaldo
  • Zambom, Adriano Z.

Abstract

The dual problem of testing the predictive significance of a particular covariate, and identification of the set of relevant covariates is common in applied research and methodological investigations. To study this problem in the context of functional linear regression models with predictor variables observed over a grid and a scalar response, we consider basis expansions of the functional covariates and apply the likelihood ratio test. Based on p-values from testing each predictor, we propose a new variable selection method, which is consistent in selecting the relevant predictors from set of available predictors that is allowed to grow with the sample size n. Numerical simulations suggest that the proposed variable selection procedure outperforms existing methods found in the literature. A real dataset from weather stations in Japan is analyzed.

Suggested Citation

  • Collazos, Julian A.A. & Dias, Ronaldo & Zambom, Adriano Z., 2016. "Consistent variable selection for functional regression models," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 63-71.
    • Handle: RePEc:eee:jmvana:v:146:y:2016:i:c:p:63-71
    DOI: 10.1016/j.jmva.2015.06.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X15001529
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2015.06.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jianqing Fan & Runze Li, 2004. "New Estimation and Model Selection Procedures for Semiparametric Modeling in Longitudinal Data Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 710-723, January.
    2. Aneiros, Germán & Vieu, Philippe, 2014. "Variable selection in infinite-dimensional problems," Statistics & Probability Letters, Elsevier, vol. 94(C), pages 12-20.
    3. Meinshausen, Nicolai & Meier, Lukas & Bühlmann, Peter, 2009. "p-Values for High-Dimensional Regression," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1671-1681.
    4. Ferraty, Frédéric & Vieu, Philippe, 2009. "Additive prediction and boosting for functional data," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 1400-1413, February.
    5. Germán Aneiros & Philippe Vieu, 2015. "Partial linear modelling with multi-functional covariates," Computational Statistics, Springer, vol. 30(3), pages 647-671, September.
    6. Gareth M. James, 2002. "Generalized linear models with functional predictors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 411-432, August.
    7. Mingotti, Nicola & Lillo Rodríguez, Rosa Elvira & Romo, Juan, 2013. "Lasso variable selection in functional regression," DES - Working Papers. Statistics and Econometrics. WS ws131413, Universidad Carlos III de Madrid. Departamento de Estadística.
    8. Matsui, Hidetoshi & Konishi, Sadanori, 2011. "Variable selection for functional regression models via the L1 regularization," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3304-3310, December.
    9. Germán Aneiros-Pérez & Philippe Vieu, 2013. "Testing linearity in semi-parametric functional data analysis," Computational Statistics, Springer, vol. 28(2), pages 413-434, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mirosław Krzyśko & Łukasz Smaga, 2017. "An Application Of Functional Multivariate Regression Model To Multiclass Classification," Statistics in Transition New Series, Polish Statistical Association, vol. 18(3), pages 433-442, September.
    2. Římalová, Veronika & Fišerová, Eva & Menafoglio, Alessandra & Pini, Alessia, 2022. "Inference for spatial regression models with functional response using a permutational approach," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    3. Aneiros, Germán & Novo, Silvia & Vieu, Philippe, 2022. "Variable selection in functional regression models: A review," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    4. Wang, Yun & Wang, Haibo & Srinivasan, Dipti & Hu, Qinghua, 2019. "Robust functional regression for wind speed forecasting based on Sparse Bayesian learning," Renewable Energy, Elsevier, vol. 132(C), pages 43-60.
    5. Keyao Wang & Huiwen Wang & Shanshan Wang & Lihong Wang, 2024. "Variable selection for multivariate functional data via conditional correlation learning," Computational Statistics, Springer, vol. 39(4), pages 2375-2412, June.
    6. Vieu, Philippe, 2018. "On dimension reduction models for functional data," Statistics & Probability Letters, Elsevier, vol. 136(C), pages 134-138.
    7. Łukasz Smaga & Hidetoshi Matsui, 2018. "A note on variable selection in functional regression via random subspace method," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(3), pages 455-477, August.
    8. Yu, Dengdeng & Zhang, Li & Mizera, Ivan & Jiang, Bei & Kong, Linglong, 2019. "Sparse wavelet estimation in quantile regression with multiple functional predictors," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 12-29.
    9. Łukasz Smaga, 2020. "A note on repeated measures analysis for functional data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(1), pages 117-139, March.
    10. Shuzhi Zhu & Peixin Zhao, 2019. "Tests for the linear hypothesis in semi-functional partial linear regression models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 82(2), pages 125-148, March.
    11. Krzyśko Mirosław & Smaga Łukasz, 2017. "An Application of Functional Multivariate Regression Model to Multiclass Classification," Statistics in Transition New Series, Statistics Poland, vol. 18(3), pages 433-442, September.
    12. Sanying Feng & Menghan Zhang & Tiejun Tong, 2022. "Variable selection for functional linear models with strong heredity constraint," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(2), pages 321-339, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aneiros, Germán & Novo, Silvia & Vieu, Philippe, 2022. "Variable selection in functional regression models: A review," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    2. Ahmedou, Aziza & Marion, Jean-Marie & Pumo, Besnik, 2016. "Generalized linear model with functional predictors and their derivatives," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 313-324.
    3. Shuyu Meng & Zhensheng Huang, 2024. "Variable Selection in Semi-Functional Partially Linear Regression Models with Time Series Data," Mathematics, MDPI, vol. 12(17), pages 1-23, September.
    4. Łukasz Smaga & Hidetoshi Matsui, 2018. "A note on variable selection in functional regression via random subspace method," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(3), pages 455-477, August.
    5. Vieu, Philippe, 2018. "On dimension reduction models for functional data," Statistics & Probability Letters, Elsevier, vol. 136(C), pages 134-138.
    6. Matsui, Hidetoshi, 2014. "Variable and boundary selection for functional data via multiclass logistic regression modeling," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 176-185.
    7. Usset, Joseph & Staicu, Ana-Maria & Maity, Arnab, 2016. "Interaction models for functional regression," Computational Statistics & Data Analysis, Elsevier, vol. 94(C), pages 317-329.
    8. Chiou, Jeng-Min & Yang, Ya-Fang & Chen, Yu-Ting, 2016. "Multivariate functional linear regression and prediction," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 301-312.
    9. Zhu, Hanbing & Zhang, Riquan & Yu, Zhou & Lian, Heng & Liu, Yanghui, 2019. "Estimation and testing for partially functional linear errors-in-variables models," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 296-314.
    10. Shuzhi Zhu & Peixin Zhao, 2019. "Tests for the linear hypothesis in semi-functional partial linear regression models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 82(2), pages 125-148, March.
    11. Manuel Febrero-Bande & Wenceslao González-Manteiga, 2013. "Generalized additive models for functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(2), pages 278-292, June.
    12. Bodnar, Taras & Okhrin, Ostap & Parolya, Nestor, 2019. "Optimal shrinkage estimator for high-dimensional mean vector," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 63-79.
    13. Ping Yu & Zhongyi Zhu & Zhongzhan Zhang, 2019. "Robust exponential squared loss-based estimation in semi-functional linear regression models," Computational Statistics, Springer, vol. 34(2), pages 503-525, June.
    14. Belli, Edoardo, 2022. "Smoothly adaptively centered ridge estimator," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    15. Tomasz Górecki & Mirosław Krzyśko & Waldemar Wołyński, 2015. "Classification Problems Based On Regression Models For Multi-Dimensional Functional Data," Statistics in Transition New Series, Polish Statistical Association, vol. 16(1), pages 97-110, March.
    16. Lydia Kara-Zaitri & Ali Laksaci & Mustapha Rachdi & Philippe Vieu, 2017. "Uniform in bandwidth consistency for various kernel estimators involving functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 29(1), pages 85-107, January.
    17. Boumahdi, Mounir & Ouassou, Idir & Rachdi, Mustapha, 2023. "Estimation in nonparametric functional-on-functional models with surrogate responses," Journal of Multivariate Analysis, Elsevier, vol. 198(C).
    18. Germán Aneiros & Philippe Vieu, 2015. "Partial linear modelling with multi-functional covariates," Computational Statistics, Springer, vol. 30(3), pages 647-671, September.
    19. Germán Aneiros & Philippe Vieu, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 27-32, March.
    20. Crawford, F. & Watling, D.P. & Connors, R.D., 2017. "A statistical method for estimating predictable differences between daily traffic flow profiles," Transportation Research Part B: Methodological, Elsevier, vol. 95(C), pages 196-213.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:146:y:2016:i:c:p:63-71. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.