IDEAS home Printed from https://ideas.repec.org/a/bpj/ijbist/v6y2010i1n28.html
   My bibliography  Save this article

Fast Function-on-Scalar Regression with Penalized Basis Expansions

Author

Listed:
  • Reiss Philip T.

    (New York University and Nathan S. Kline Institute for Psychiatric Research)

  • Huang Lei

    (New York University)

  • Mennes Maarten

    (New York University)

Abstract

Regression models for functional responses and scalar predictors are often fitted by means of basis functions, with quadratic roughness penalties applied to avoid overfitting. The fitting approach described by Ramsay and Silverman in the 1990s amounts to a penalized ordinary least squares (P-OLS) estimator of the coefficient functions. We recast this estimator as a generalized ridge regression estimator, and present a penalized generalized least squares (P-GLS) alternative. We describe algorithms by which both estimators can be implemented, with automatic selection of optimal smoothing parameters, in a more computationally efficient manner than has heretofore been available. We discuss pointwise confidence intervals for the coefficient functions, simultaneous inference by permutation tests, and model selection, including a novel notion of pointwise model selection. P-OLS and P-GLS are compared in a simulation study. Our methods are illustrated with an analysis of age effects in a functional magnetic resonance imaging data set, as well as a reanalysis of a now-classic Canadian weather data set. An R package implementing the methods is publicly available.

Suggested Citation

  • Reiss Philip T. & Huang Lei & Mennes Maarten, 2010. "Fast Function-on-Scalar Regression with Penalized Basis Expansions," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-30, August.
    • Handle: RePEc:bpj:ijbist:v:6:y:2010:i:1:n:28
    DOI: 10.2202/1557-4679.1246
    as

    Download full text from publisher

    File URL: https://doi.org/10.2202/1557-4679.1246
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    File URL: https://libkey.io/10.2202/1557-4679.1246?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Antoniadis, Anestis & Sapatinas, Theofanis, 2007. "Estimation and inference in functional mixed-effects models," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4793-4813, June.
    2. R. L. Eubank & Chunfeng Huang & Y. Muñoz Maldonado & Naisyin Wang & Suojin Wang & R. J. Buchanan, 2004. "Smoothing spline estimation in varying‐coefficient models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 653-667, August.
    3. Philip T. Reiss & R. Todd Ogden, 2009. "Smoothing parameter selection for a class of semiparametric linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 505-523, April.
    4. J. Fan & J.‐T. Zhang, 2000. "Two‐step estimation of functional linear models with applications to longitudinal data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(2), pages 303-322.
    5. Xihong Lin, 2004. "Equivalent kernels of smoothing splines in nonparametric regression for clustered/longitudinal data," Biometrika, Biometrika Trust, vol. 91(1), pages 177-193, March.
    6. Jeffrey S. Morris & Raymond J. Carroll, 2006. "Wavelet‐based functional mixed models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(2), pages 179-199, April.
    7. Krivobokova, Tatyana & Kauermann, Goran, 2007. "A Note on Penalized Spline Smoothing With Correlated Errors," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1328-1337, December.
    8. Maria Durbán & Iain D. Currie, 2003. "A note on P-spline additive models with correlated errors," Computational Statistics, Springer, vol. 18(2), pages 251-262, July.
    9. Wensheng Guo, 2002. "Functional Mixed Effects Models," Biometrics, The International Biometric Society, vol. 58(1), pages 121-128, March.
    10. Schäfer Juliane & Strimmer Korbinian, 2005. "A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 4(1), pages 1-32, November.
    11. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    12. Robert T. Krafty & Phyllis A. Gimotty & David Holtz & George Coukos & Wensheng Guo, 2008. "Varying Coefficient Model with Unknown Within-Subject Covariance for Analysis of Tumor Growth Curves," Biometrics, The International Biometric Society, vol. 64(4), pages 1023-1031, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ana-Maria Staicu & Yingxing Li & Ciprian M. Crainiceanu & David Ruppert, 2014. "Likelihood Ratio Tests for Dependent Data with Applications to Longitudinal and Functional Data Analysis," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(4), pages 932-949, December.
    2. Zhang, Xiaoke & Zhong, Qixian & Wang, Jane-Ling, 2020. "A new approach to varying-coefficient additive models with longitudinal covariates," Computational Statistics & Data Analysis, Elsevier, vol. 145(C).
    3. Chen, Ziqi & Hu, Jianhua & Zhu, Hongtu, 2020. "Surface functional models," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    4. Matthew Reimherr & Dan Nicolae, 2016. "Estimating Variance Components in Functional Linear Models With Applications to Genetic Heritability," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 407-422, March.
    5. Jeff Goldsmith & Vadim Zipunnikov & Jennifer Schrack, 2015. "Generalized multilevel function-on-scalar regression and principal component analysis," Biometrics, The International Biometric Society, vol. 71(2), pages 344-353, June.
    6. Yuan Wang & Jianhua Hu & Kim-Anh Do & Brian P. Hobbs, 2019. "An Efficient Nonparametric Estimate for Spatially Correlated Functional Data," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 11(1), pages 162-183, April.
    7. R. L. Eubank & Chunfeng Huang & Y. Muñoz Maldonado & Naisyin Wang & Suojin Wang & R. J. Buchanan, 2004. "Smoothing spline estimation in varying‐coefficient models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 653-667, August.
    8. Philip T. Reiss & Lei Huang & Pei‐Shien Wu & Huaihou Chen & Stan Colcombe, 2017. "Pointwise influence matrices for functional‐response regression," Biometrics, The International Biometric Society, vol. 73(4), pages 1092-1101, December.
    9. Haochang Shou & Vadim Zipunnikov & Ciprian M. Crainiceanu & Sonja Greven, 2015. "Structured functional principal component analysis," Biometrics, The International Biometric Society, vol. 71(1), pages 247-257, March.
    10. Huaihou Chen & Yuanjia Wang, 2011. "A Penalized Spline Approach to Functional Mixed Effects Model Analysis," Biometrics, The International Biometric Society, vol. 67(3), pages 861-870, September.
    11. Cederbaum, Jona & Scheipl, Fabian & Greven, Sonja, 2018. "Fast symmetric additive covariance smoothing," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 25-41.
    12. Mengfei Ran & Yihe Yang, 2022. "Optimal Estimation of Large Functional and Longitudinal Data by Using Functional Linear Mixed Model," Mathematics, MDPI, vol. 10(22), pages 1-28, November.
    13. Chau, Van Vinh & von Sachs, Rainer, 2016. "Functional mixed effects wavelet estimation for spectra of replicated time series," LIDAM Discussion Papers ISBA 2016013, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    14. Wang, Shaoli & Huang, Mian & Wu, Xing & Yao, Weixin, 2016. "Mixture of functional linear models and its application to CO2-GDP functional data," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 1-15.
    15. John A. D. Aston & Jeng‐Min Chiou & Jonathan P. Evans, 2010. "Linguistic pitch analysis using functional principal component mixed effect models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 59(2), pages 297-317, March.
    16. Tang Qingguo & Cheng Longsheng, 2008. "M-estimation and B-spline approximation for varying coefficient models with longitudinal data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 20(7), pages 611-625.
    17. Li, Kan & Luo, Sheng, 2019. "Bayesian functional joint models for multivariate longitudinal and time-to-event data," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 14-29.
    18. Yiqiang Lu & Riquan Zhang, 2009. "Smoothing spline estimation of generalised varying-coefficient mixed model," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(7), pages 815-825.
    19. Andrada Ivanescu & Ana-Maria Staicu & Fabian Scheipl & Sonja Greven, 2015. "Penalized function-on-function regression," Computational Statistics, Springer, vol. 30(2), pages 539-568, June.
    20. Ruiyan Luo & Xin Qi, 2023. "Nonlinear function‐on‐scalar regression via functional universal approximation," Biometrics, The International Biometric Society, vol. 79(4), pages 3319-3331, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:ijbist:v:6:y:2010:i:1:n:28. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.