IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v81y2019i2p271-304.html
   My bibliography  Save this article

Clustering functional data into groups by using projections

Author

Listed:
  • Aurore Delaigle
  • Peter Hall
  • Tung Pham

Abstract

We show that, in the functional data context, by appropriately exploiting the functional nature of the data, it is possible to cluster the observations asymptotically perfectly. We demonstrate that this level of performance can sometimes be achieved by the k‐means algorithm as long as the data are projected on a carefully chosen finite dimensional space. In general, the notion of an ideal cluster is not clearly defined. We derive our results in the setting where the data come from two populations whose distributions differ at least in terms of means, and where an ideal cluster corresponds to one of these two populations. We propose an iterative algorithm to choose the projection functions in a way that optimizes clustering performance, where, to avoid peculiar solutions, we use a weighted least squares criterion. We apply our iterative clustering procedure on simulated and real data, where we show that it works well.

Suggested Citation

  • Aurore Delaigle & Peter Hall & Tung Pham, 2019. "Clustering functional data into groups by using projections," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 271-304, April.
  • Handle: RePEc:bla:jorssb:v:81:y:2019:i:2:p:271-304
    DOI: 10.1111/rssb.12310
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssb.12310
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssb.12310?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jeng‐Min Chiou & Pai‐Ling Li, 2007. "Functional clustering and identifying substructures of longitudinal data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 679-699, September.
    2. Fryzlewicz, Piotr, 2007. "Unbalanced Haar technique for nonparametric function estimation," LSE Research Online Documents on Economics 25216, London School of Economics and Political Science, LSE Library.
    3. Fryzlewicz, Piotr, 2007. "Unbalanced Haar Technique for Nonparametric Function Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1318-1327, December.
    4. A. Delaigle & P. Hall & N. Bathia, 2012. "Componentwise classification and clustering of functional data," Biometrika, Biometrika Trust, vol. 99(2), pages 299-313.
    5. C. Abraham & P. A. Cornillon & E. Matzner‐Løber & N. Molinari, 2003. "Unsupervised Curve Clustering using B‐Splines," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 30(3), pages 581-595, September.
    6. Michael Brusco & Douglas Steinley, 2007. "A Comparison of Heuristic Procedures for Minimum Within-Cluster Sums of Squares Partitioning," Psychometrika, Springer;The Psychometric Society, vol. 72(4), pages 583-600, December.
    7. Aurore Delaigle & Peter Hall, 2012. "Achieving near perfect classification for functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(2), pages 267-286, March.
    8. Serban, Nicoleta & Wasserman, Larry, 2005. "CATS: Clustering After Transformation and Smoothing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 990-999, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chenlei Leng & Degui Li & Hanlin Shang & Yingcun Xia, 2024. "Covariance Function Estimation for High-Dimensional Functional Time Series with Dual Factor Structures," Papers 2401.05784, arXiv.org, revised Jan 2024.
    2. Qingzhi Zhong & Huazhen Lin & Yi Li, 2021. "Cluster non‐Gaussian functional data," Biometrics, The International Biometric Society, vol. 77(3), pages 852-865, September.
    3. Aneiros, Germán & Horová, Ivana & Hušková, Marie & Vieu, Philippe, 2022. "On functional data analysis and related topics," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    4. Golovkine, Steven & Klutchnikoff, Nicolas & Patilea, Valentin, 2022. "Clustering multivariate functional data using unsupervised binary trees," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    5. Li, Ting & Song, Xinyuan & Zhang, Yingying & Zhu, Hongtu & Zhu, Zhongyi, 2021. "Clusterwise functional linear regression models," Computational Statistics & Data Analysis, Elsevier, vol. 158(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Pai-Ling & Chiou, Jeng-Min, 2011. "Identifying cluster number for subspace projected functional data clustering," Computational Statistics & Data Analysis, Elsevier, vol. 55(6), pages 2090-2103, June.
    2. Carlos Barrera-Causil & Juan Carlos Correa & Andrew Zamecnik & Francisco Torres-Avilés & Fernando Marmolejo-Ramos, 2021. "An FDA-Based Approach for Clustering Elicited Expert Knowledge," Stats, MDPI, vol. 4(1), pages 1-21, March.
    3. Maria Ruiz-Medina & Rosa Espejo & Elvira Romano, 2014. "Spatial functional normal mixed effect approach for curve classification," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 8(3), pages 257-285, September.
    4. Schroeder, Anna Louise & Fryzlewicz, Piotr, 2013. "Adaptive trend estimation in financial time series via multiscale change-point-induced basis recovery," LSE Research Online Documents on Economics 54934, London School of Economics and Political Science, LSE Library.
    5. Timmermans, Catherine & Delsol, Laurent & von Sachs, Rainer, 2013. "Using Bagidis in nonparametric functional data analysis: Predicting from curves with sharp local features," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 421-444.
    6. McGinnity, K. & Varbanov, R. & Chicken, E., 2017. "Cross-validated wavelet block thresholding for non-Gaussian errors," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 127-137.
    7. Michael Vogt & Oliver Linton, 2015. "Classification of nonparametric regression functions in heterogeneous panels," CeMMAP working papers CWP06/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Chau, Joris & von Sachs, Rainer, 2022. "Time-varying spectral matrix estimation via intrinsic wavelet regression for surfaces of Hermitian positive definite matrices," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    9. Fryzlewicz, Piotr, 2014. "Wild binary segmentation for multiple change-point detection," LSE Research Online Documents on Economics 57146, London School of Economics and Political Science, LSE Library.
    10. Michael Vogt & Oliver Linton, 2017. "Classification of non-parametric regression functions in longitudinal data models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 5-27, January.
    11. Michael Vogt & Oliver Linton, 2015. "Classification of nonparametric regression functions in heterogeneous panels," CeMMAP working papers 06/15, Institute for Fiscal Studies.
    12. Philip Preuss & Ruprecht Puchstein & Holger Dette, 2015. "Detection of Multiple Structural Breaks in Multivariate Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 654-668, June.
    13. Fang, Kuangnan & Chen, Yuanxing & Ma, Shuangge & Zhang, Qingzhao, 2022. "Biclustering analysis of functionals via penalized fusion," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    14. Fryzlewicz, Piotr & Ombao, Hernando, 2009. "Consistent classification of non-stationary time series using stochastic wavelet representations," LSE Research Online Documents on Economics 25162, London School of Economics and Political Science, LSE Library.
    15. Homesh Sayal & John A. D. Aston & Duncan Elliott & Hernando Ombao, 2017. "An introduction to applications of wavelet benchmarking with seasonal adjustment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(3), pages 863-889, June.
    16. Christoph Hellmayr & Alan E. Gelfand, 2021. "A Partition Dirichlet Process Model for Functional Data Analysis," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(1), pages 30-65, May.
    17. Karl Mosler & Pavlo Mozharovskyi, 2017. "Fast DD-classification of functional data," Statistical Papers, Springer, vol. 58(4), pages 1055-1089, December.
    18. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.
    19. Cho, Haeran & Goude, Yannig & Brossat, Xavier & Yao, Qiwei, 2013. "Modeling and forecasting daily electricity load curves: a hybrid approach," LSE Research Online Documents on Economics 49634, London School of Economics and Political Science, LSE Library.
    20. Kim, Joonpyo & Oh, Hee-Seok, 2020. "Pseudo-quantile functional data clustering," Journal of Multivariate Analysis, Elsevier, vol. 178(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:81:y:2019:i:2:p:271-304. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.