IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2009-13.html
   My bibliography  Save this paper

Description Length and Dimensionality Reduction in Functional Data Analysis

Author

Listed:
  • D. S. Poskitt
  • Arivalzahan Sengarapillai

Abstract

In this paper we investigate the use of description length principles to select an appropriate number of basis functions for functional data. We provide a flexible definition of the dimension of a random function that is constructed directly from the Karhunen-Loève expansion of the observed process. Our results show that although the classical, principle component variance decomposition technique will behave in a coherent manner, in general, the dimension chosen by this technique will not be consistent. We describe two description length criteria, and prove that they are consistent and that in low noise settings they will identify the true finite dimension of a signal that is embedded in noise. Two examples, one from mass-spectroscopy and the one from climatology, are used to illustrate our ideas. We also explore the application of different forms of the bootstrap for functional data and use these to demonstrate the workings of our theoretical results.

Suggested Citation

  • D. S. Poskitt & Arivalzahan Sengarapillai, 2009. "Description Length and Dimensionality Reduction in Functional Data Analysis," Monash Econometrics and Business Statistics Working Papers 13/09, Monash University, Department of Econometrics and Business Statistics.
    • Handle: RePEc:msh:ebswps:2009-13
    as

    Download full text from publisher

    File URL: http://www.buseco.monash.edu.au/ebs/pubs/wpapers/2009/wp13-09.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen M. H & Yu B., 2001. "Model Selection and the Principle of Minimum Description Length," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 746-774, June.
    2. Jeng‐Min Chiou & Pai‐Ling Li, 2007. "Functional clustering and identifying substructures of longitudinal data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 679-699, September.
    3. Ferraty, Frédéric & Vieu, Philippe, 2009. "Additive prediction and boosting for functional data," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 1400-1413, February.
    4. Philippe C. Besse & Herve Cardot & David B. Stephenson, 2000. "Autoregressive Forecasting of Some Functional Climatic Variations," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 27(4), pages 673-687, December.
    5. Peter Hall & Céline Vial, 2006. "Assessing the finite dimensionality of functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(4), pages 689-705, September.
    6. Li, Baibing & Martin, Elaine B. & Morris, A. Julian, 2002. "On principal component analysis in L1," Computational Statistics & Data Analysis, Elsevier, vol. 40(3), pages 471-474, September.
    7. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    8. Ramsay, James O. & Ramsey, James B., 2002. "Functional data analysis of the dynamics of the monthly index of nondurable goods production," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 327-344, March.
    9. Li, Bin & Yu, Qingzhao, 2008. "Classification of functional data: A segmentation approach," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4790-4800, June.
    10. Ferraty, F. & Vieu, P., 2003. "Curves discrimination: a nonparametric functional approach," Computational Statistics & Data Analysis, Elsevier, vol. 44(1-2), pages 161-173, October.
    11. Boente, Graciela & Fraiman, Ricardo, 2000. "Kernel-based functional principal components," Statistics & Probability Letters, Elsevier, vol. 48(4), pages 335-345, July.
    12. Peter Hall & Mohammad Hosseini‐Nasab, 2006. "On properties of functional principal components analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 109-126, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wong, Raymond K.W. & Zhang, Xiaoke, 2019. "Nonparametric operator-regularized covariance function estimation for functional data," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 131-144.
    2. Tengteng Xu & Riquan Zhang & Xiuzhen Zhang, 2023. "Estimation of spatial-functional based-line logit model for multivariate longitudinal data," Computational Statistics, Springer, vol. 38(1), pages 79-99, March.
    3. Sizhe Chen & Han Lin Shang & Yang Yang, 2025. "Is the age pension in Australia sustainable and fair? Evidence from forecasting the old-age dependency ratio using the Hamilton-Perry model," Journal of Population Research, Springer, vol. 42(1), pages 1-27, March.
    4. Jacques, Julien & Preda, Cristian, 2014. "Model-based clustering for multivariate functional data," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 92-106.
    5. Md Atikur Rahman Khan & D.S. Poskitt, 2010. "Description Length Based Signal Detection in singular Spectrum Analysis," Monash Econometrics and Business Statistics Working Papers 13/10, Monash University, Department of Econometrics and Business Statistics.
    6. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alonso, Andrés M. & Casado, David & Romo, Juan, 2012. "Supervised classification for functional data: A weighted distance approach," Computational Statistics & Data Analysis, Elsevier, vol. 56(7), pages 2334-2346.
    2. Zhu, Hanbing & Li, Rui & Zhang, Riquan & Lian, Heng, 2020. "Nonlinear functional canonical correlation analysis via distance covariance," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    3. Maria Ruiz-Medina & Rosa Espejo & Elvira Romano, 2014. "Spatial functional normal mixed effect approach for curve classification," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 8(3), pages 257-285, September.
    4. Delsol, Laurent & Ferraty, Frédéric & Vieu, Philippe, 2011. "Structural test in regression on functional variables," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 422-447, March.
    5. Beran, Jan & Liu, Haiyan, 2016. "Estimation of eigenvalues, eigenvectors and scores in FDA models with dependent errors," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 218-233.
    6. Han Lin Shang & Yang Yang, 2021. "Forecasting Australian subnational age-specific mortality rates," Journal of Population Research, Springer, vol. 38(1), pages 1-24, March.
    7. Han Lin Shang & Jiguo Cao & Peijun Sang, 2022. "Stopping time detection of wood panel compression: A functional time‐series approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1205-1224, November.
    8. Kokoszka, Piotr & Reimherr, Matthew, 2013. "Asymptotic normality of the principal components of functional time series," Stochastic Processes and their Applications, Elsevier, vol. 123(5), pages 1546-1562.
    9. Kyunghee Han & Pantelis Z Hadjipantelis & Jane-Ling Wang & Michael S Kramer & Seungmi Yang & Richard M Martin & Hans-Georg Müller, 2018. "Functional principal component analysis for identifying multivariate patterns and archetypes of growth, and their association with long-term cognitive development," PLOS ONE, Public Library of Science, vol. 13(11), pages 1-18, November.
    10. repec:cte:wsrepe:ws131312 is not listed on IDEAS
    11. Saart, Patrick W. & Xia, Yingcun, 2022. "Functional time series approach to analyzing asset returns co-movements," Journal of Econometrics, Elsevier, vol. 229(1), pages 127-151.
    12. Fang Yao & Yichao Wu & Jialin Zou, 2016. "Probability-enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 1-22, March.
    13. Qingzhi Zhong & Huazhen Lin & Yi Li, 2021. "Cluster non‐Gaussian functional data," Biometrics, The International Biometric Society, vol. 77(3), pages 852-865, September.
    14. Chen, Lu-Hung & Jiang, Ci-Ren, 2018. "Sensible functional linear discriminant analysis," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 39-52.
    15. Fraiman, Ricardo & Pateiro-López, Beatriz, 2012. "Quantiles for finite and infinite dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 108(C), pages 1-14.
    16. Han Lin Shang & Rob J Hyndman, 2016. "Grouped functional time series forecasting: An application to age-specific mortality rates," Monash Econometrics and Business Statistics Working Papers 4/16, Monash University, Department of Econometrics and Business Statistics.
    17. Gao, Yuan & Shang, Han Lin & Yang, Yanrong, 2019. "High-dimensional functional time series forecasting: An application to age-specific mortality rates," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 232-243.
    18. Epifanio, Irene & Ventura-Campos, Noelia, 2011. "Functional data analysis in shape analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2758-2773, September.
    19. Han Lin Shang & Yang Yang & Fearghal Kearney, 2019. "Intraday forecasts of a volatility index: functional time series methods with dynamic updating," Annals of Operations Research, Springer, vol. 282(1), pages 331-354, November.
    20. Fang Yao & Yichao Wu & Jialin Zou, 2016. "Probability-enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 1-22, March.
    21. Shang, Han Lin, 2017. "Functional time series forecasting with dynamic updating: An application to intraday particulate matter concentration," Econometrics and Statistics, Elsevier, vol. 1(C), pages 184-200.

    More about this item

    Keywords

    Bootstrap; consistency; dimension determination; Karhunen-Loève expansion; signal-to-noise ratio; variance decomposition;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2009-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.