IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v110y2015i510p824-836.html
   My bibliography  Save this article

Index Models for Sparsely Sampled Functional Data

Author

Listed:
  • Peter Radchenko
  • Xinghao Qiao
  • Gareth M. James

Abstract

The regression problem involving functional predictors has many important applications and a number of functional regression methods have been developed. However, a common complication in functional data analysis is one of sparsely observed curves, that is predictors that are observed, with error, on a small subset of the possible time points. Such sparsely observed data induce an errors-in-variables model, where one must account for measurement error in the functional predictors. Faced with sparsely observed data, most current functional regression methods simply estimate the unobserved predictors and treat them as fully observed; thus failing to account for the extra uncertainty from the measurement error. We propose a new functional errors-in-variables approach, sparse index model functional estimation (SIMFE), which uses a functional index model formulation to deal with sparsely observed predictors. SIMFE has several advantages over more traditional methods. First, the index model implements a nonlinear regression and uses an accurate supervised method to estimate the lower dimensional space into which the predictors should be projected. Second, SIMFE can be applied to both scalar and functional responses and multiple predictors. Finally, SIMFE uses a mixed effects model to effectively deal with very sparsely observed functional predictors and to correctly model the measurement error. Supplementary materials for this article are available online.

Suggested Citation

  • Peter Radchenko & Xinghao Qiao & Gareth M. James, 2015. "Index Models for Sparsely Sampled Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 824-836, June.
  • Handle: RePEc:taf:jnlasa:v:110:y:2015:i:510:p:824-836
    DOI: 10.1080/01621459.2014.931859
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2014.931859
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/01621459.2014.931859?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xia, Yingcun, 2008. "A Multiple-Index Model and Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1631-1640.
    2. Li, Lexin & Li, Bing & Zhu, Li-Xing, 2010. "Groupwise Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1188-1201.
    3. James, Gareth M. & Silverman, Bernard W., 2005. "Functional Adaptive Model Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 565-576, June.
    4. Li, Pai-Ling & Chiou, Jeng-Min, 2011. "Identifying cluster number for subspace projected functional data clustering," Computational Statistics & Data Analysis, Elsevier, vol. 55(6), pages 2090-2103, June.
    5. Wang, Shanshan & Jank, Wolfgang & Shmueli, Galit, 2008. "Explaining and Forecasting Online Auction Prices and Their Dynamics Using Functional Data Analysis," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 144-160, April.
    6. Florian Reithinger & Wolfgang Jank & Gerhard Tutz & Galit Shmueli, 2008. "Modelling price paths in on‐line auctions: smoothing sparse and unevenly sampled curves by using semiparametric mixed models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 57(2), pages 127-148, April.
    7. Gareth M. James, 2002. "Generalized linear models with functional predictors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 411-432, August.
    8. Li, Lexin, 2009. "Exploiting predictor domain information in sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 53(7), pages 2665-2672, May.
    9. Ferraty, F. & Vieu, P., 2003. "Curves discrimination: a nonparametric functional approach," Computational Statistics & Data Analysis, Elsevier, vol. 44(1-2), pages 161-173, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Łukasz Smaga & Hidetoshi Matsui, 2018. "A note on variable selection in functional regression via random subspace method," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(3), pages 455-477, August.
    2. Chiou, Jeng-Min & Yang, Ya-Fang & Chen, Yu-Ting, 2016. "Multivariate functional linear regression and prediction," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 301-312.
    3. Ferraty, Frédéric & Zullo, Anthony & Fauvel, Mathieu, 2019. "Nonparametric regression on contaminated functional predictor with application to hyperspectral data," Econometrics and Statistics, Elsevier, vol. 9(C), pages 95-107.
    4. Nagy, Stanislav & Ferraty, Frédéric, 2019. "Data depth for measurable noisy random functions," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 95-114.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zifang Guo & Lexin Li & Wenbin Lu & Bing Li, 2015. "Groupwise Dimension Reduction via Envelope Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1515-1527, December.
    2. Ahmedou, Aziza & Marion, Jean-Marie & Pumo, Besnik, 2016. "Generalized linear model with functional predictors and their derivatives," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 313-324.
    3. Epifanio, Irene & Ventura-Campos, Noelia, 2011. "Functional data analysis in shape analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2758-2773, September.
    4. Hongxiao Zhu & Philip J. Brown & Jeffrey S. Morris, 2012. "Robust Classification of Functional and Quantitative Image Data Using Functional Mixed Models," Biometrics, The International Biometric Society, vol. 68(4), pages 1260-1268, December.
    5. Li, Pai-Ling & Chiou, Jeng-Min & Shyr, Yu, 2017. "Functional data classification using covariate-adjusted subspace projection," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 21-34.
    6. Berrendero, J.R. & Justel, A. & Svarc, M., 2011. "Principal components for multivariate functional data," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2619-2634, September.
    7. Ciarleglio, Adam & Todd Ogden, R., 2016. "Wavelet-based scalar-on-function finite mixture regression models," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 86-96.
    8. Sudaraka Tholkage & Qi Zheng & Karunarathna B. Kulasekera, 2022. "Conditional Kaplan–Meier Estimator with Functional Covariates for Time-to-Event Data," Stats, MDPI, vol. 5(4), pages 1-17, November.
    9. Tingting Huang & Gilbert Saporta & Huiwen Wang & Shanshan Wang, 2021. "A robust spatial autoregressive scalar-on-function regression with t-distribution," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(1), pages 57-81, March.
    10. Park, Yeonjoo & Simpson, Douglas G., 2019. "Robust probabilistic classification applicable to irregularly sampled functional data," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 37-49.
    11. Manuel Febrero-Bande & Wenceslao González-Manteiga, 2013. "Generalized additive models for functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(2), pages 278-292, June.
    12. Junmin Liu & Deli Zhu & Luoyao Yu & Xuehu Zhu, 2023. "Specification testing of partially linear single-index models: a groupwise dimension reduction-based adaptive-to-model approach," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(1), pages 232-262, March.
    13. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.
    14. Philip T. Reiss & Jeff Goldsmith & Han Lin Shang & R. Todd Ogden, 2017. "Methods for Scalar-on-Function Regression," International Statistical Review, International Statistical Institute, vol. 85(2), pages 228-249, August.
    15. Fang Yao & Yichao Wu & Jialin Zou, 2016. "Probability-enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 1-22, March.
    16. Tomasz Górecki & Mirosław Krzyśko & Waldemar Wołyński, 2015. "Classification Problems Based On Regression Models For Multi-Dimensional Functional Data," Statistics in Transition New Series, Polish Statistical Association, vol. 16(1), pages 97-110, March.
    17. Tengteng Xu & Riquan Zhang & Xiuzhen Zhang, 2023. "Estimation of spatial-functional based-line logit model for multivariate longitudinal data," Computational Statistics, Springer, vol. 38(1), pages 79-99, March.
    18. Manuel Febrero-Bande, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 35-40, March.
    19. M. Aguilera-Morillo & Ana Aguilera & Manuel Escabias & Mariano Valderrama, 2013. "Penalized spline approaches for functional logit regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(2), pages 251-277, June.
    20. Lee, Eun Ryung & Park, Byeong U., 2012. "Sparse estimation in functional linear regression," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 1-17.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:110:y:2015:i:510:p:824-836. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.