IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v158y2021ics0167947321000268.html
   My bibliography  Save this article

Clusterwise functional linear regression models

Author

Listed:
  • Li, Ting
  • Song, Xinyuan
  • Zhang, Yingying
  • Zhu, Hongtu
  • Zhu, Zhongyi

Abstract

Classical clusterwise linear regression is a useful method for investigating the relationship between scalar predictors and scalar responses with heterogeneous variation of regression patterns for different subgroups of subjects. This paper extends the classical clusterwise linear regression to incorporate multiple functional predictors by representing the functional coefficients in terms of a functional principal component basis. We estimate the functional principal component coefficients based on M-estimation and K-means clustering algorithm, which can classify the data into clusters and estimate clusterwise coefficients simultaneously. One advantage of the proposed method is that it is robust and flexible by adopting a general loss function, which can be broadly applied to mean regression, median regression, quantile regression and robust mean regression. A Bayesian information criterion is proposed to select the unknown number of groups and shown to be consistent in model selection. We also obtain the convergence rate of the set of estimators to the set of true coefficients for all clusters. Simulation studies and real data analysis show that the proposed method is easily implemented, and it consequently improves previous works and also requires much less computing burden than existing methods.

Suggested Citation

  • Li, Ting & Song, Xinyuan & Zhang, Yingying & Zhu, Hongtu & Zhu, Zhongyi, 2021. "Clusterwise functional linear regression models," Computational Statistics & Data Analysis, Elsevier, vol. 158(C).
  • Handle: RePEc:eee:csdana:v:158:y:2021:i:c:s0167947321000268
    DOI: 10.1016/j.csda.2021.107192
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947321000268
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2021.107192?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ping Yu & Zhongzhan Zhang & Jiang Du, 2016. "A test of linearity in partial functional linear regression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 79(8), pages 953-969, November.
    2. Guochang Wang & Xinyuan Song, 2018. "Functional Sufficient Dimension Reduction for Functional Data Classification," Journal of Classification, Springer;The Classification Society, vol. 35(2), pages 250-272, July.
    3. Preda, C. & Saporta, G., 2005. "Clusterwise PLS regression on a stochastic process," Computational Statistics & Data Analysis, Elsevier, vol. 49(1), pages 99-108, April.
    4. Ma, Haiqiang & Li, Ting & Zhu, Hongtu & Zhu, Zhongyi, 2019. "Quantile regression for functional partially linear model in ultra-high dimensions," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 135-147.
    5. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    6. Ciarleglio, Adam & Todd Ogden, R., 2016. "Wavelet-based scalar-on-function finite mixture regression models," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 86-96.
    7. Dehan Kong & Ana-Maria Staicu & Arnab Maity, 2016. "Classical testing in functional linear models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(4), pages 813-838, October.
    8. C. Abraham & P. A. Cornillon & E. Matzner‐Løber & N. Molinari, 2003. "Unsupervised Curve Clustering using B‐Splines," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 30(3), pages 581-595, September.
    9. Lawrence Hubert & Phipps Arabie, 1985. "Comparing partitions," Journal of Classification, Springer;The Classification Society, vol. 2(1), pages 193-218, December.
    10. Wayne DeSarbo & William Cron, 1988. "A maximum likelihood methodology for clusterwise linear regression," Journal of Classification, Springer;The Classification Society, vol. 5(2), pages 249-282, September.
    11. He, Xuming & Shi, Peide, 1996. "Bivariate Tensor-Product B-Splines in a Partly Linear Model," Journal of Multivariate Analysis, Elsevier, vol. 58(2), pages 162-181, August.
    12. Aurore Delaigle & Peter Hall & Tung Pham, 2019. "Clustering functional data into groups by using projections," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 271-304, April.
    13. Müller, Christine H. & Garlipp, Tim, 2005. "Simple consistent cluster methods based on redescending M-estimators with an application to edge identification in images," Journal of Multivariate Analysis, Elsevier, vol. 92(2), pages 359-385, February.
    14. Peter Hall & Mohammad Hosseini‐Nasab, 2006. "On properties of functional principal components analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 109-126, February.
    15. Dehan Kong & Kaijie Xue & Fang Yao & Hao H. Zhang, 2016. "Partially functional linear regression in high dimensions," Biometrika, Biometrika Trust, vol. 103(1), pages 147-159.
    16. Cristian Preda & Gilbert Saporta & Caroline Lévéder, 2007. "PLS classification of functional data," Computational Statistics, Springer, vol. 22(2), pages 223-235, July.
    17. Huang, Lele & Wang, Huiwen & Zheng, Andi, 2014. "The M-estimator for functional linear regression model," Statistics & Probability Letters, Elsevier, vol. 88(C), pages 165-173.
    18. Shujie Ma & Jian Huang, 2017. "A Concave Pairwise Fusion Approach to Subgroup Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 410-423, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bin Yang & Min Chen & Tong Su & Jianjun Zhou, 2023. "Robust Estimation for Semi-Functional Linear Model with Autoregressive Errors," Mathematics, MDPI, vol. 11(2), pages 1-14, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu Wang & Ying Sun & Huixia Judy Wang, 2023. "Latent group detection in functional partially linear regression models," Biometrics, The International Biometric Society, vol. 79(1), pages 280-291, March.
    2. Zhang, Xiaochen & Zhang, Qingzhao & Ma, Shuangge & Fang, Kuangnan, 2022. "Subgroup analysis for high-dimensional functional regression," Journal of Multivariate Analysis, Elsevier, vol. 192(C).
    3. Yao, Fang & Sue-Chee, Shivon & Wang, Fan, 2017. "Regularized partially functional quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 156(C), pages 39-56.
    4. Qingzhi Zhong & Huazhen Lin & Yi Li, 2021. "Cluster non‐Gaussian functional data," Biometrics, The International Biometric Society, vol. 77(3), pages 852-865, September.
    5. Liu, Yanghui & Li, Yehua & Carroll, Raymond J. & Wang, Naisyin, 2022. "Predictive functional linear models with diverging number of semiparametric single-index interactions," Journal of Econometrics, Elsevier, vol. 230(2), pages 221-239.
    6. Jiang, Jiakun & Lin, Huazhen & Zhong, Qingzhi & Li, Yi, 2022. "Analysis of multivariate non-gaussian functional data: A semiparametric latent process approach," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    7. Yang, Seong J. & Shin, Hyejin & Lee, Sang Han & Lee, Seokho, 2020. "Functional linear regression model with randomly censored data: Predicting conversion time to Alzheimer ’s disease," Computational Statistics & Data Analysis, Elsevier, vol. 150(C).
    8. Li, Pai-Ling & Chiou, Jeng-Min, 2011. "Identifying cluster number for subspace projected functional data clustering," Computational Statistics & Data Analysis, Elsevier, vol. 55(6), pages 2090-2103, June.
    9. Xiongtao Dai & Zhenhua Lin & Hans‐Georg Müller, 2021. "Modeling sparse longitudinal data on Riemannian manifolds," Biometrics, The International Biometric Society, vol. 77(4), pages 1328-1341, December.
    10. Golovkine, Steven & Klutchnikoff, Nicolas & Patilea, Valentin, 2022. "Clustering multivariate functional data using unsupervised binary trees," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    11. Dehan Kong & Joseph G. Ibrahim & Eunjee Lee & Hongtu Zhu, 2018. "FLCRM: Functional linear cox regression model," Biometrics, The International Biometric Society, vol. 74(1), pages 109-117, March.
    12. Liang, Weijuan & Zhang, Qingzhao & Ma, Shuangge, 2023. "Locally sparse quantile estimation for a partially functional interaction model," Computational Statistics & Data Analysis, Elsevier, vol. 186(C).
    13. Tang, Qingguo & Tu, Wei & Kong, Linglong, 2023. "Estimation for partial functional partially linear additive model," Computational Statistics & Data Analysis, Elsevier, vol. 177(C).
    14. Ma, Haiqiang & Li, Ting & Zhu, Hongtu & Zhu, Zhongyi, 2019. "Quantile regression for functional partially linear model in ultra-high dimensions," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 135-147.
    15. Aneiros, Germán & Novo, Silvia & Vieu, Philippe, 2022. "Variable selection in functional regression models: A review," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    16. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.
    17. Stéphanie Bougeard & Hervé Abdi & Gilbert Saporta & Ndèye Niang, 2018. "Clusterwise analysis for multiblock component methods," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 12(2), pages 285-313, June.
    18. Cui, Xia & Lin, Hongmei & Lian, Heng, 2020. "Partially functional linear regression in reproducing kernel Hilbert spaces," Computational Statistics & Data Analysis, Elsevier, vol. 150(C).
    19. Ufuk Beyaztas & Han Lin Shang & Aylin Alin, 2022. "Function-on-Function Partial Quantile Regression," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(1), pages 149-174, March.
    20. Philip T. Reiss & Jeff Goldsmith & Han Lin Shang & R. Todd Ogden, 2017. "Methods for Scalar-on-Function Regression," International Statistical Review, International Statistical Institute, vol. 85(2), pages 228-249, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:158:y:2021:i:c:s0167947321000268. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.