IDEAS home Printed from https://ideas.repec.org/a/inm/orijds/v2y2023i1p81-98.html
   My bibliography  Save this article

Covariate Dependent Sparse Functional Data Analysis

Author

Listed:
  • Minhee Kim

    (Department of Industrial and Systems Engineering, University of Florida, Gainesville, Florida 32611)

  • Todd Allen

    (Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, Michigan 48109)

  • Kaibo Liu

    (Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, Wisconsin 53706)

Abstract

This study proposes a method to incorporate covariate information into sparse functional data analysis. The method aims at cases where each subject has a limited number of longitudinal measurements and is associated with static covariates. This research is motivated by several use cases in practice. One representative example is void swelling, a nuclear-specific material degradation mechanism. Void swelling is affected by many covariates, including alloy composition and irradiation type. How to accurately model the complicated joint effects of such covariates on the swelling process is the key to mitigating the effect of swelling and ensuring safe operation. Unlike most of the existing methods, the proposed method can handle high-dimensional covariates with the informative covariate identification procedure and sparse and irregularly spaced measurements, that is, does not require complete or dense observations. The main innovation of the proposed method is that we model the variation coming from covariates and the variation left conditioned on covariates, such that the functional principal component analysis and Gaussian process can be conducted in a unified manner. We also propose a systematic approach to identify important covariates in the hypothesis testing context. The methodology is demonstrated on applications in nuclear engineering and healthcare and simulation studies.

Suggested Citation

  • Minhee Kim & Todd Allen & Kaibo Liu, 2023. "Covariate Dependent Sparse Functional Data Analysis," INFORMS Joural on Data Science, INFORMS, vol. 2(1), pages 81-98, April.
  • Handle: RePEc:inm:orijds:v:2:y:2023:i:1:p:81-98
    DOI: 10.1287/ijds.2023.0025
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/ijds.2023.0025
    Download Restriction: no

    File URL: https://libkey.io/10.1287/ijds.2023.0025?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Peng, Weiwen & Li, Yan-Feng & Mi, Jinhua & Yu, Le & Huang, Hong-Zhong, 2016. "Reliability of complex systems under dynamic conditions: A Bayesian multivariate degradation perspective," Reliability Engineering and System Safety, Elsevier, vol. 153(C), pages 75-87.
    2. Jialiang Li & Chao Huang & Zhub Hongtu, 2017. "A Functional Varying-Coefficient Single-Index Model for Functional Response Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1169-1181, July.
    3. Wu, Yujun & Boos, Dennis D. & Stefanski, Leonard A., 2007. "Controlling Variable Selection by the Addition of Pseudovariables," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 235-243, March.
    4. Zhang, Hao, 2004. "Inconsistent Estimation and Asymptotically Equal Interpolations in Model-Based Geostatistics," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 250-261, January.
    5. Einmahl, J. H.J. & Dekkers, A. L.M. & de Haan, L., 1989. "A moment estimator for the index of an extreme-value distribution," Other publications TiSEM 81970cb3-5b7a-4cad-9bf6-2, Tilburg University, School of Economics and Management.
    6. Wensheng Guo, 2002. "Functional Mixed Effects Models," Biometrics, The International Biometric Society, vol. 58(1), pages 121-128, March.
    7. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    8. Hervé Cardot, 2007. "Conditional Functional Principal Components Analysis," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(2), pages 317-335, June.
    9. Minhee Kim & Kaibo Liu, 2020. "A Bayesian deep learning framework for interval estimation of remaining useful life in complex systems by incorporating general degradation characteristics," IISE Transactions, Taylor & Francis Journals, vol. 53(3), pages 326-340, December.
    10. Xiaolei Fang & Hao Yan & Nagi Gebraeel & Kamran Paynabar, 2021. "Multi-sensor prognostics modeling for applications with highly incomplete signals," IISE Transactions, Taylor & Francis Journals, vol. 53(5), pages 597-613, February.
    11. Zhibing Xu & Yili Hong & Ran Jin, 2016. "Nonlinear general path models for degradation data with dynamic covariates," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 32(2), pages 153-167, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ana-Maria Staicu & Yingxing Li & Ciprian M. Crainiceanu & David Ruppert, 2014. "Likelihood Ratio Tests for Dependent Data with Applications to Longitudinal and Functional Data Analysis," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(4), pages 932-949, December.
    2. Li, Pai-Ling & Chiou, Jeng-Min & Shyr, Yu, 2017. "Functional data classification using covariate-adjusted subspace projection," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 21-34.
    3. Mingfei Dong & Donatello Telesca & Catherine Sugar & Frederick Shic & Adam Naples & Scott P. Johnson & Beibin Li & Adham Atyabi & Minhang Xie & Sara J. Webb & Shafali Jeste & Susan Faja & April R. Lev, 2023. "A Functional Model for Studying Common Trends Across Trial Time in Eye Tracking Experiments," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(1), pages 261-287, April.
    4. Reiss Philip T. & Huang Lei & Mennes Maarten, 2010. "Fast Function-on-Scalar Regression with Penalized Basis Expansions," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-30, August.
    5. Huaihou Chen & Yuanjia Wang, 2011. "A Penalized Spline Approach to Functional Mixed Effects Model Analysis," Biometrics, The International Biometric Society, vol. 67(3), pages 861-870, September.
    6. Chen, Ziqi & Hu, Jianhua & Zhu, Hongtu, 2020. "Surface functional models," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    7. Fallahdizcheh, Amirhossein & Wang, Chao, 2022. "Transfer learning of degradation modeling and prognosis based on multivariate functional analysis with heterogeneous sampling rates," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    8. Rahul Ghosal & Arnab Maity & Timothy Clark & Stefano B. Longo, 2020. "Variable selection in functional linear concurrent regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(3), pages 565-587, June.
    9. Ruiyan Luo & Xin Qi, 2023. "Nonlinear function‐on‐scalar regression via functional universal approximation," Biometrics, The International Biometric Society, vol. 79(4), pages 3319-3331, December.
    10. Jeff Goldsmith & Vadim Zipunnikov & Jennifer Schrack, 2015. "Generalized multilevel function-on-scalar regression and principal component analysis," Biometrics, The International Biometric Society, vol. 71(2), pages 344-353, June.
    11. Qian Huang & Jinhong You & Liwen Zhang, 2022. "Efficient inference of longitudinal/functional data models with time‐varying additive structure," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(2), pages 744-771, June.
    12. Xu, Huyang & Fard, Nasser & Fang, Yuanchen, 2020. "Time series chain graph for modeling reliability covariates in degradation process," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    13. Yuan Wang & Jianhua Hu & Kim-Anh Do & Brian P. Hobbs, 2019. "An Efficient Nonparametric Estimate for Spatially Correlated Functional Data," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 11(1), pages 162-183, April.
    14. Panaretos, Victor M. & Tavakoli, Shahin, 2013. "Cramér–Karhunen–Loève representation and harmonic principal component analysis of functional time series," Stochastic Processes and their Applications, Elsevier, vol. 123(7), pages 2779-2807.
    15. Davide Pigoli & Pantelis Z. Hadjipantelis & John S. Coleman & John A. D. Aston, 2018. "The statistical analysis of acoustic phonetic data: exploring differences between spoken Romance languages," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 67(5), pages 1103-1145, November.
    16. Liebl, Dominik, 2019. "Inference for sparse and dense functional data with covariate adjustments," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 315-335.
    17. Caleb Weaver & Luo Xiao & Wenbin Lu, 2023. "Functional data analysis for longitudinal data with informative observation times," Biometrics, The International Biometric Society, vol. 79(2), pages 722-733, June.
    18. Ghosal, Rahul & Maity, Arnab, 2022. "A Score Based Test for Functional Linear Concurrent Regression," Econometrics and Statistics, Elsevier, vol. 21(C), pages 114-130.
    19. Zhang, Xiaoke & Zhong, Qixian & Wang, Jane-Ling, 2020. "A new approach to varying-coefficient additive models with longitudinal covariates," Computational Statistics & Data Analysis, Elsevier, vol. 145(C).
    20. Haochang Shou & Vadim Zipunnikov & Ciprian M. Crainiceanu & Sonja Greven, 2015. "Structured functional principal component analysis," Biometrics, The International Biometric Society, vol. 71(1), pages 247-257, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijds:v:2:y:2023:i:1:p:81-98. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.