IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v173y2019icp583-603.html
   My bibliography  Save this article

Inferential procedures for partially observed functional data

Author

Listed:
  • Kraus, David

Abstract

In functional data analysis it is usually assumed that all functions are completely, densely or sparsely observed on the same domain. Recent applications have brought attention to situations where each functional variable may be observed only on a subset of the domain while no information about the function is available on the complement. Various advanced methods for such partially observed functional data have already been developed but, interestingly, some essential methods, such as K-sample tests of equal means or covariances and confidence intervals for eigenvalues and eigenfunctions, are lacking. Without requiring any complete curves in the data, we derive asymptotic distributions of estimators of the mean function, covariance operator and eigenelements and construct hypothesis tests and confidence intervals. To overcome practical difficulties with storing large objects in computer memory, which arise due to partial observation, we use the nonparametric bootstrap approach. The proposed methods are investigated theoretically, in simulations and on a fragmentary functional data set from medical research.

Suggested Citation

  • Kraus, David, 2019. "Inferential procedures for partially observed functional data," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 583-603.
  • Handle: RePEc:eee:jmvana:v:173:y:2019:i:c:p:583-603
    DOI: 10.1016/j.jmva.2019.05.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X18304950
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2019.05.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jonathan E. Gellar & Elizabeth Colantuoni & Dale M. Needham & Ciprian M. Crainiceanu, 2014. "Variable-Domain Functional Regression for Modeling ICU Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1425-1439, December.
    2. Bugni, Federico A., 2012. "Specification Test For Missing Functional Data," Econometric Theory, Cambridge University Press, vol. 28(5), pages 959-1002, October.
    3. Jin-Ting Zhang & Xuehua Liang, 2014. "One-Way anova for Functional Data via Globalizing the Pointwise F-test," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(1), pages 51-71, March.
    4. Lajos Horváth & Piotr Kokoszka & Ron Reeder, 2013. "Estimation of the mean of functional time series and a two-sample problem," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(1), pages 103-122, January.
    5. Guo, Jia & Zhou, Bu & Zhang, Jin-Ting, 2018. "Testing the equality of several covariance functions for functional data: A supremum-norm based test," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 15-26.
    6. Kokoszka, Piotr & Reimherr, Matthew, 2013. "Asymptotic normality of the principal components of functional time series," Stochastic Processes and their Applications, Elsevier, vol. 123(5), pages 1546-1562.
    7. Davide Pigoli & John A. D. Aston & Ian L. Dryden & Piercesare Secchi, 2014. "Distances and inference for covariance operators," Biometrika, Biometrika Trust, vol. 101(2), pages 409-422.
    8. D. S. Gilliam & T. Hohage & X. Ji & F. Ruymgaart, 2009. "The Fréchet Derivative of an Analytic Function of a Bounded Operator with Some Applications," International Journal of Mathematics and Mathematical Sciences, Hindawi, vol. 2009, pages 1-17, April.
    9. Mojirsheibani, Majid & Shaw, Crystal, 2018. "Classification with incomplete functional covariates," Statistics & Probability Letters, Elsevier, vol. 139(C), pages 40-46.
    10. André Mas, 2007. "Testing for the Mean of Random Curves: A Penalization Approach," Statistical Inference for Stochastic Processes, Springer, vol. 10(2), pages 147-163, July.
    11. Stefan Fremdt & Josef G. Steinebach & Lajos Horváth & Piotr Kokoszka, 2013. "Testing the Equality of Covariance Operators in Functional Samples," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(1), pages 138-152, March.
    12. David Kraus & Victor M. Panaretos, 2012. "Dispersion operators and resistant second-order functional data analysis," Biometrika, Biometrika Trust, vol. 99(4), pages 813-832.
    13. Liebl, Dominik & Rameseder, Stefan, 2019. "Partially observed functional data: The case of systematically missing parts," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 104-115.
    14. Alessia Pini & Simone Vantini, 2016. "The interval testing procedure: A general framework for inference in functional data analysis," Biometrics, The International Biometric Society, vol. 72(3), pages 835-845, September.
    15. Dauxois, J. & Pousse, A. & Romain, Y., 1982. "Asymptotic theory for the principal component analysis of a vector random function: Some applications to statistical inference," Journal of Multivariate Analysis, Elsevier, vol. 12(1), pages 136-154, March.
    16. Aue, Alexander & Gabrys, Robertas & Horváth, Lajos & Kokoszka, Piotr, 2009. "Estimation of a change-point in the mean function of functional data," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2254-2269, November.
    17. Panaretos, Victor M. & Kraus, David & Maddocks, John H., 2010. "Second-Order Comparison of Gaussian Random Functions and the Geometry of DNA Minicircles," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 670-682.
    18. Pini, Alessia & Spreafico, Lorenzo & Vantini, Simone & Vietti, Alessandro, 2019. "Multi-aspect local inference for functional data: Analysis of ultrasound tongue profiles," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 162-185.
    19. Marco Stefanucci & Laura M. Sangalli & Pierpaolo Brutti, 2018. "PCA‐based discrimination of partially observed functional data, with an application to AneuRisk65 data set," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(3), pages 246-264, August.
    20. Horváth, Lajos & Husková, Marie & Kokoszka, Piotr, 2010. "Testing the stability of the functional autoregressive process," Journal of Multivariate Analysis, Elsevier, vol. 101(2), pages 352-367, February.
    21. Cuevas, Antonio & Febrero, Manuel & Fraiman, Ricardo, 2004. "An anova test for functional data," Computational Statistics & Data Analysis, Elsevier, vol. 47(1), pages 111-122, August.
    22. Liebl, Dominik, 2013. "Modeling and Forecasting Electricity Spot Prices: A Functional Data Perspective," MPRA Paper 50881, University Library of Munich, Germany.
    23. Pini, Alessia & Stamm, Aymeric & Vantini, Simone, 2018. "Hotelling’s T2 in separable Hilbert spaces," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 284-305.
    24. David Kraus, 2015. "Components and completion of partially observed functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(4), pages 777-801, September.
    25. M-H Descary & V M Panaretos, 2019. "Recovering covariance from functional fragments," Biometrika, Biometrika Trust, vol. 106(1), pages 145-160.
    26. Fremdt, Stefan & Horváth, Lajos & Kokoszka, Piotr & Steinebach, Josef G., 2014. "Functional data analysis with increasing number of projections," Journal of Multivariate Analysis, Elsevier, vol. 124(C), pages 313-332.
    27. Aurore Delaigle & Peter Hall, 2013. "Classification Using Censored Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1269-1283, December.
    28. E. Paparoditis & T. Sapatinas, 2016. "Bootstrap-based testing of equality of mean functions or equality of covariance operators for functional data," Biometrika, Biometrika Trust, vol. 103(3), pages 727-733.
    29. A. Delaigle & P. Hall, 2016. "Approximating fragmented functional data by segments of Markov chains," Biometrika, Biometrika Trust, vol. 103(4), pages 779-799.
    30. David Kraus & Marco Stefanucci, 2019. "Classification of functional fragments by regularized linear classifiers with domain selection," Biometrika, Biometrika Trust, vol. 106(1), pages 161-180.
    31. Guanqun Cao & Lijian Yang & David Todem, 2012. "Simultaneous inference for the mean function based on dense functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(2), pages 359-377.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kraus, David & Stefanucci, Marco, 2020. "Ridge reconstruction of partially observed functional data is asymptotically optimal," Statistics & Probability Letters, Elsevier, vol. 165(C).
    2. Huang, Wei-Hsueh & Huang, Li-Shan & Yang, Cheng-Tao, 2022. "Invariant tests for functional data with application to an earthquake impact study," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    3. Nengxiang Ling & Lilei Cheng & Philippe Vieu & Hui Ding, 2022. "Missing responses at random in functional single index model for time series data," Statistical Papers, Springer, vol. 63(2), pages 665-692, April.
    4. Jianing Fan & Hans‐Georg Müller, 2022. "Conditional distribution regression for functional responses," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(2), pages 502-524, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kraus, David & Stefanucci, Marco, 2020. "Ridge reconstruction of partially observed functional data is asymptotically optimal," Statistics & Probability Letters, Elsevier, vol. 165(C).
    2. Holger Dette & Kevin Kokot & Stanislav Volgushev, 2020. "Testing relevant hypotheses in functional time series via self‐normalization," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 629-660, July.
    3. Dimitrios Pilavakis & Efstathios Paparoditis & Theofanis Sapatinas, 2020. "Testing equality of autocovariance operators for functional time series," Journal of Time Series Analysis, Wiley Blackwell, vol. 41(4), pages 571-589, July.
    4. Holger Dette & Kevin Kokot, 2022. "Detecting relevant differences in the covariance operators of functional time series: a sup-norm approach," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(2), pages 195-231, April.
    5. Boente, Graciela & Rodriguez, Daniela & Sued, Mariela, 2019. "The spatial sign covariance operator: Asymptotic results and applications," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 115-128.
    6. Jiang, Qing & Hušková, Marie & Meintanis, Simos G. & Zhu, Lixing, 2019. "Asymptotics, finite-sample comparisons and applications for two-sample tests with functional data," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 202-220.
    7. Jia Guo & Bu Zhou & Jianwei Chen & Jin-Ting Zhang, 2019. "An $${{\varvec{L}}}^{2}$$L2-norm-based test for equality of several covariance functions: a further study," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(4), pages 1092-1112, December.
    8. Qiu, Zhiping & Chen, Jianwei & Zhang, Jin-Ting, 2021. "Two-sample tests for multivariate functional data with applications," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    9. Valentina Masarotto & Victor M. Panaretos & Yoav Zemel, 2019. "Procrustes Metrics on Covariance Operators and Optimal Transportation of Gaussian Processes," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 81(1), pages 172-213, February.
    10. Hlávka, Zdeněk & Hlubinka, Daniel & Koňasová, Kateřina, 2022. "Functional ANOVA based on empirical characteristic functionals," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    11. Liebl, Dominik & Rameseder, Stefan, 2019. "Partially observed functional data: The case of systematically missing parts," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 104-115.
    12. Chen, Yichao & Pun, Chi Seng, 2019. "A bootstrap-based KPSS test for functional time series," Journal of Multivariate Analysis, Elsevier, vol. 174(C).
    13. Ghiglietti, Andrea & Paganoni, Anna Maria, 2017. "Exact tests for the means of Gaussian stochastic processes," Statistics & Probability Letters, Elsevier, vol. 131(C), pages 102-107.
    14. Balogoun, Armando Sosthène Kali & Nkiet, Guy Martial & Ogouyandjou, Carlos, 2021. "Asymptotic normality of a generalized maximum mean discrepancy estimator," Statistics & Probability Letters, Elsevier, vol. 169(C).
    15. Jianing Fan & Hans‐Georg Müller, 2022. "Conditional distribution regression for functional responses," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(2), pages 502-524, June.
    16. Antonio Elías & Raúl Jiménez & Han Lin Shang, 2023. "Depth-based reconstruction method for incomplete functional data," Computational Statistics, Springer, vol. 38(3), pages 1507-1535, September.
    17. Marco Stefanucci & Laura M. Sangalli & Pierpaolo Brutti, 2018. "PCA‐based discrimination of partially observed functional data, with an application to AneuRisk65 data set," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(3), pages 246-264, August.
    18. Tao Zhang & Zhiwen Wang & Yanling Wan, 2021. "Functional test for high-dimensional covariance matrix, with application to mitochondrial calcium concentration," Statistical Papers, Springer, vol. 62(3), pages 1213-1230, June.
    19. Pini, Alessia & Stamm, Aymeric & Vantini, Simone, 2018. "Hotelling’s T2 in separable Hilbert spaces," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 284-305.
    20. R. Bárcenas & J. Ortega & A. J. Quiroz, 2017. "Quadratic forms of the empirical processes for the two-sample problem for functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(3), pages 503-526, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:173:y:2019:i:c:p:583-603. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.