IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2011-6.html
   My bibliography  Save this paper

A survey of functional principal component analysis

Author

Listed:
  • Han Lin Shang

Abstract

Advances in data collection and storage have tremendously increased the presence of functional data, whose graphical representations are curves, images or shapes. As a new area of Statistics, functional data analysis extends existing methodologies and theories from the fields of functional analysis, generalized linear models, multivariate data analysis, nonparametric statistics and many others. This paper provides a review into functional data analysis with main emphasis on functional principal component analysis, functional principal component regression, and bootstrap in functional principal component regression. Recent trends as well as open problems in the area are discussed.

Suggested Citation

  • Han Lin Shang, 2011. "A survey of functional principal component analysis," Monash Econometrics and Business Statistics Working Papers 6/11, Monash University, Department of Econometrics and Business Statistics.
    • Handle: RePEc:msh:ebswps:2011-6
    as

    Download full text from publisher

    File URL: http://business.monash.edu/econometrics-and-business-statistics/research/publications/ebs/wp6-11.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Müller, Hans-Georg & Yao, Fang, 2008. "Functional Additive Models," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1534-1544.
    2. Crainiceanu, Ciprian M. & Staicu, Ana-Maria & Di, Chong-Zhi, 2009. "Generalized Multilevel Functional Regression," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1550-1561.
    3. André Mas & Besnik Pumo, 2009. "Functional linear regression with derivatives," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(1), pages 19-40.
    4. Shang, Han Lin & Hyndman, Rob.J., 2011. "Nonparametric time series forecasting with dynamic updating," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 81(7), pages 1310-1324.
    5. Matthias Fengler & Wolfgang Härdle & Christophe Villa, 2003. "The Dynamics of Implied Volatilities: A Common Principal Components Approach," Review of Derivatives Research, Springer, vol. 6(3), pages 179-202, October.
    6. Harezlak, Jaroslaw & Coull, Brent A. & Laird, Nan M. & Magari, Shannon R. & Christiani, David C., 2007. "Penalized solutions to functional regression problems," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4911-4925, June.
    7. Cardot, Hervé & Ferraty, Frédéric & Sarda, Pascal, 1999. "Functional linear model," Statistics & Probability Letters, Elsevier, vol. 45(1), pages 11-22, October.
    8. Preda, C. & Saporta, G., 2005. "Clusterwise PLS regression on a stochastic process," Computational Statistics & Data Analysis, Elsevier, vol. 49(1), pages 99-108, April.
    9. Daniel Gervini, 2008. "Robust functional estimation using the median and spherical principal components," Biometrika, Biometrika Trust, vol. 95(3), pages 587-600.
    10. Pavel Cizek & Wolfgang Karl Härdle & Rafal Weron, 2005. "Statistical Tools for Finance and Insurance," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0501.
    11. Hervé Cardot & Frédéric Ferraty & André Mas & Pascal Sarda, 2003. "Testing Hypotheses in the Functional Linear Model," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 30(1), pages 241-255, March.
    12. Peter Hall & Céline Vial, 2006. "Assessing the finite dimensionality of functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(4), pages 689-705, September.
    13. A. Delaigle & P. Hall & N. Bathia, 2012. "Componentwise classification and clustering of functional data," Biometrika, Biometrika Trust, vol. 99(2), pages 299-313.
    14. López-Pintado, Sara & Romo, Juan, 2009. "On the Concept of Depth for Functional Data," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 718-734.
    15. Herve Cardot & Robert Faivre & Michel Goulard, 2003. "Functional approaches for predicting land use with the temporal evolution of coarse resolution remote sensing data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 30(10), pages 1185-1199.
    16. Boente, Graciela & Rodriguez, Daniela & Sued, Mariela, 2010. "Inference under functional proportional and common principal component models," Journal of Multivariate Analysis, Elsevier, vol. 101(2), pages 464-475, February.
    17. Besse, Philippe, 1992. "PCA stability and choice of dimensionality," Statistics & Probability Letters, Elsevier, vol. 13(5), pages 405-410, April.
    18. Lopez-Pintado, Sara & Romo, Juan, 2007. "Depth-based inference for functional data," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4957-4968, June.
    19. Poskitt, D.S. & Sengarapillai, Arivalzahan, 2013. "Description length and dimensionality reduction in functional data analysis," Computational Statistics & Data Analysis, Elsevier, vol. 58(C), pages 98-113.
    20. Natasha Zhang Foutz & Wolfgang Jank, 2010. "Research Note—Prerelease Demand Forecasting for Motion Pictures Using Functional Shape Analysis of Virtual Stock Markets," Marketing Science, INFORMS, vol. 29(3), pages 568-579, 05-06.
    21. Mas, André, 2002. "Weak convergence for the covariance operators of a Hilbertian linear process," Stochastic Processes and their Applications, Elsevier, vol. 99(1), pages 117-135, May.
    22. Antonio Cuevas & Manuel Febrero & Ricardo Fraiman, 2007. "Robust estimation and classification for functional data via projection-based depth notions," Computational Statistics, Springer, vol. 22(3), pages 481-496, September.
    23. James, Gareth M. & Silverman, Bernard W., 2005. "Functional Adaptive Model Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 565-576, June.
    24. Gareth M. James, 2002. "Generalized linear models with functional predictors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 411-432, August.
    25. Ricardo Fraiman & Graciela Muniz, 2001. "Trimmed means for functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 10(2), pages 419-440, December.
    26. Dauxois, J. & Pousse, A. & Romain, Y., 1982. "Asymptotic theory for the principal component analysis of a vector random function: Some applications to statistical inference," Journal of Multivariate Analysis, Elsevier, vol. 12(1), pages 136-154, March.
    27. Ledyard Tucker, 1958. "Determination of parameters of a functional relation by factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 23(1), pages 19-23, March.
    28. John A. D. Aston & Jeng‐Min Chiou & Jonathan P. Evans, 2010. "Linguistic pitch analysis using functional principal component mixed effect models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 59(2), pages 297-317, March.
    29. Hans-Georg Müller & Fang Yao, 2010. "Additive modelling of functional gradients," Biometrika, Biometrika Trust, vol. 97(4), pages 791-805.
    30. Aurore Delaigle & Peter Hall, 2012. "Achieving near perfect classification for functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(2), pages 267-286, March.
    31. Manteiga, Wenceslao Gonzalez & Vieu, Philippe, 2007. "Statistics for Functional Data," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4788-4792, June.
    32. John A. Rice & Colin O. Wu, 2001. "Nonparametric Mixed Effects Models for Unequally Sampled Noisy Curves," Biometrics, The International Biometric Society, vol. 57(1), pages 253-259, March.
    33. Mariano Valderrama, 2007. "An overview to modelling functional data," Computational Statistics, Springer, vol. 22(3), pages 331-334, September.
    34. Tarpey, Thaddeus, 2007. "Linear Transformations and the k-Means Clustering Algorithm: Applications to Clustering Curves," The American Statistician, American Statistical Association, vol. 61, pages 34-40, February.
    35. Ashish Sood & Gareth M. James & Gerard J. Tellis, 2009. "Functional Regression: A New Model for Predicting Market Penetration of New Products," Marketing Science, INFORMS, vol. 28(1), pages 36-51, 01-02.
    36. Lan Zhou & Jianhua Z. Huang & Raymond J. Carroll, 2008. "Joint modelling of paired sparse functional data using principal components," Biometrika, Biometrika Trust, vol. 95(3), pages 601-619.
    37. Charles Bouveyron & Julien Jacques, 2011. "Model-based clustering of time series in group-specific functional subspaces," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 5(4), pages 281-300, December.
    38. Mitsunori Kayano & Koji Dozono & Sadanori Konishi, 2010. "Functional Cluster Analysis via Orthonormalized Gaussian Basis Expansions and Its Application," Journal of Classification, Springer;The Classification Society, vol. 27(2), pages 211-230, September.
    39. Cuevas, Antonio & Fraiman, Ricardo, 2009. "On depth measures and dual statistics. A methodology for dealing with general data," Journal of Multivariate Analysis, Elsevier, vol. 100(4), pages 753-766, April.
    40. Aneiros-Pérez, Germán & Vieu, Philippe, 2008. "Nonparametric time series prediction: A semi-functional partial linear modeling," Journal of Multivariate Analysis, Elsevier, vol. 99(5), pages 834-857, May.
    41. Yuko Araki & Sadanori Konishi & Shuichi Kawano & Hidetoshi Matsui, 2009. "Functional regression modeling via regularized Gaussian basis expansions," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(4), pages 811-833, December.
    42. Reiss, Philip T. & Ogden, R. Todd, 2007. "Functional Principal Component Regression and Functional Partial Least Squares," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 984-996, September.
    43. Peter Hall & Mohammad Hosseini‐Nasab, 2006. "On properties of functional principal components analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 109-126, February.
    44. Chiou, Jeng-Min & Müller, Hans-Georg, 2009. "Modeling Hazard Rates as Functional Data for the Analysis of Cohort Lifetables and Mortality Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 572-585.
    45. Preda, C. & Saporta, G., 2005. "PLS regression on a stochastic process," Computational Statistics & Data Analysis, Elsevier, vol. 48(1), pages 149-158, January.
    46. Hyndman, Rob J. & Shahid Ullah, Md., 2007. "Robust forecasting of mortality and fertility rates: A functional data approach," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4942-4956, June.
    47. Hlubinka, Daniel & Prchal, Lubos, 2007. "Changes in atmospheric radiation from the statistical point of view," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4926-4941, June.
    48. Cristian Preda & Gilbert Saporta & Caroline Lévéder, 2007. "PLS classification of functional data," Computational Statistics, Springer, vol. 22(2), pages 223-235, July.
    49. Gareth M. James & Trevor J. Hastie, 2001. "Functional linear discriminant analysis for irregularly sampled curves," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 533-550.
    50. Rob J. Hyndman & Han Lin Shang, 2008. "Rainbow plots, Bagplots and Boxplots for Functional Data," Monash Econometrics and Business Statistics Working Papers 9/08, Monash University, Department of Econometrics and Business Statistics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shang, Han Lin & Hyndman, Rob.J., 2011. "Nonparametric time series forecasting with dynamic updating," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 81(7), pages 1310-1324.
    2. Philip T. Reiss & Jeff Goldsmith & Han Lin Shang & R. Todd Ogden, 2017. "Methods for Scalar-on-Function Regression," International Statistical Review, International Statistical Institute, vol. 85(2), pages 228-249, August.
    3. Shang, Han Lin, 2013. "Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 185-198.
    4. Fraiman, Ricardo & Pateiro-López, Beatriz, 2012. "Quantiles for finite and infinite dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 108(C), pages 1-14.
    5. Mousavi, Seyed Nourollah & Sørensen, Helle, 2017. "Multinomial functional regression with wavelets and LASSO penalization," Econometrics and Statistics, Elsevier, vol. 1(C), pages 150-166.
    6. Jiménez Recaredo, Raúl José & Elías Fernández, Antonio, 2017. "Prediction Bands for Functional Data Based on Depth Measures," DES - Working Papers. Statistics and Econometrics. WS 24606, Universidad Carlos III de Madrid. Departamento de Estadística.
    7. Tingting Huang & Gilbert Saporta & Huiwen Wang & Shanshan Wang, 2021. "A robust spatial autoregressive scalar-on-function regression with t-distribution," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(1), pages 57-81, March.
    8. Manuel Febrero-Bande & Pedro Galeano & Wenceslao González-Manteiga, 2017. "Functional Principal Component Regression and Functional Partial Least-squares Regression: An Overview and a Comparative Study," International Statistical Review, International Statistical Institute, vol. 85(1), pages 61-83, April.
    9. Hans-Georg Müller & Wenjing Yang, 2010. "Dynamic relations for sparsely sampled Gaussian processes," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 19(1), pages 1-29, May.
    10. Laurent Delsol, 2013. "No effect tests in regression on functional variable and some applications to spectrometric studies," Computational Statistics, Springer, vol. 28(4), pages 1775-1811, August.
    11. Fang Yao & Yichao Wu & Jialin Zou, 2016. "Probability-enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 1-22, March.
    12. Manuel Febrero-Bande, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 35-40, March.
    13. Daniel Hlubinka & Irène Gijbels & Marek Omelka & Stanislav Nagy, 2015. "Integrated data depth for smooth functions and its application in supervised classification," Computational Statistics, Springer, vol. 30(4), pages 1011-1031, December.
    14. Elías, Antonio & Jiménez, Raúl & Shang, Han Lin, 2022. "On projection methods for functional time series forecasting," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    15. Aguilera, Ana M. & Escabias, Manuel & Valderrama, Mariano J., 2008. "Forecasting binary longitudinal data by a functional PC-ARIMA model," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 3187-3197, February.
    16. Manuel Febrero-Bande, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 35-40, March.
    17. Fang Yao & Yichao Wu & Jialin Zou, 2016. "Probability-enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 1-22, March.
    18. Ufuk Beyaztas & Han Lin Shang, 2021. "A partial least squares approach for function-on-function interaction regression," Computational Statistics, Springer, vol. 36(2), pages 911-939, June.
    19. Carlo Sguera & Pedro Galeano & Rosa Lillo, 2014. "Spatial depth-based classification for functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(4), pages 725-750, December.
    20. Nieto-Reyes, Alicia & Battey, Heather, 2021. "A topologically valid construction of depth for functional data," Journal of Multivariate Analysis, Elsevier, vol. 184(C).

    More about this item

    Keywords

    Bootstrap; functional principal component regression; functional time series; Stiefel manifold; Von Mise-Fisher distribution.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2011-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.