IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v13y2025i5p853-d1605316.html
   My bibliography  Save this article

Partially Functional Linear Regression Based on Gaussian Process Prior and Ensemble Learning

Author

Listed:
  • Weice Sun

    (Sydney Smart Technology College, Northeastern University, Shenyang 110004, China)

  • Jiaqi Xu

    (Sydney Smart Technology College, Northeastern University, Shenyang 110004, China)

  • Tao Liu

    (School of Mathematics and Statistics, Northeastern University at Qinhuangdao, Qinhuangdao 066004, China)

Abstract

A novel partially functional linear regression model with random effects is proposed to address the case of Euclidean covariates and functional covariates. Specifically, the model assumes that the random effects follow a Gaussian process prior to establish the linkage structure between Euclidean covariates and scalar responses. For functional covariates, a linear relationship with scalar responses is assumed, and the functional covariates are approximated using the Karhunen–Loève expansion. To enhance the robustness of the predictive model, a cross-validation-based ensemble strategy is employed to optimize the proposed method. Results from both simulation studies and real-world data analyses demonstrate the superior performance and competitiveness of the proposed approach in terms of prediction accuracy and model stability.

Suggested Citation

  • Weice Sun & Jiaqi Xu & Tao Liu, 2025. "Partially Functional Linear Regression Based on Gaussian Process Prior and Ensemble Learning," Mathematics, MDPI, vol. 13(5), pages 1-25, March.
  • Handle: RePEc:gam:jmathe:v:13:y:2025:i:5:p:853-:d:1605316
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/13/5/853/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/13/5/853/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jiang Du & Hui Zhao & Zhongzhan Zhang, 2019. "Dynamic partially functional linear regression model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(4), pages 679-693, December.
    2. Hojin Yang & Veerabhadran Baladandayuthapani & Arvind U.K. Rao & Jeffrey S. Morris, 2020. "Quantile Function on Scalar Regression Analysis for Distributional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 90-106, January.
    3. Boente, Graciela & Salibian-Barrera, Matías & Vena, Pablo, 2020. "Robust estimation for semi-functional linear regression models," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    4. Benatia, David & Carrasco, Marine & Florens, Jean-Pierre, 2017. "Functional linear regression with functional response," Journal of Econometrics, Elsevier, vol. 201(2), pages 269-291.
    5. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.
    6. Kyunghee Han & Hans-Georg Müller & Byeong U. Park, 2020. "Additive Functional Regression for Densities as Responses," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 997-1010, April.
    7. Xuening Zhu & Zhanrui Cai & Yanyuan Ma, 2022. "Network Functional Varying Coefficient Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(540), pages 2074-2085, October.
    8. Jianbin Tan & Decai Liang & Yongtao Guan & Hui Huang, 2024. "Graphical Principal Component Analysis of Multivariate Functional Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(548), pages 3073-3085, October.
    9. Peijun Sang & Liangliang Wang & Jiguo Cao, 2017. "Parametric functional principal component analysis," Biometrics, The International Biometric Society, vol. 73(3), pages 802-810, September.
    10. Dehan Kong & Kaijie Xue & Fang Yao & Hao H. Zhang, 2016. "Partially functional linear regression in high dimensions," Biometrika, Biometrika Trust, vol. 103(1), pages 147-159.
    11. Patrick Toman & Nalini Ravishanker & Nathan Lally & Sanguthevar Rajasekaran, 2023. "Latent Autoregressive Student- t Prior Process Models to Assess Impact of Interventions in Time Series," Future Internet, MDPI, vol. 16(1), pages 1-17, December.
    12. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    13. Fei Jiang & Qing Cheng & Guosheng Yin & Haipeng Shen, 2020. "Functional Censored Quantile Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 931-944, April.
    14. Lee, Dong Jin & Kim, Tae-Hwan & Mizen, Paul, 2021. "Impulse response analysis in conditional quantile models with an application to monetary policy," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    15. Ping Yu & Zhongzhan Zhang & Jiang Du, 2016. "A test of linearity in partial functional linear regression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 79(8), pages 953-969, November.
    16. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    17. Maronna, Ricardo A. & Yohai, Victor J., 2013. "Robust functional linear regression based on splines," Computational Statistics & Data Analysis, Elsevier, vol. 65(C), pages 46-55.
    18. Kehui Chen & Jing Lei, 2015. "Localized Functional Principal Component Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1266-1275, September.
    19. Manuel Febrero-Bande & Wenceslao González-Manteiga & Manuel Oviedo de la Fuente, 2019. "Variable selection in functional additive regression models," Computational Statistics, Springer, vol. 34(2), pages 469-487, June.
    20. Ahmedou, Aziza & Marion, Jean-Marie & Pumo, Besnik, 2016. "Generalized linear model with functional predictors and their derivatives," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 313-324.
    21. Peter Hall & Mohammad Hosseini‐Nasab, 2006. "On properties of functional principal components analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 109-126, February.
    22. Piaoxuan Xiao & Guochang Wang, 2022. "Partial functional linear regression with autoregressive errors," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 51(13), pages 4515-4536, June.
    23. Chiou, Jeng-Min & Yang, Ya-Fang & Chen, Yu-Ting, 2016. "Multivariate functional linear regression and prediction," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 301-312.
    24. Clara Happ & Sonja Greven, 2018. "Multivariate Functional Principal Component Analysis for Data Observed on Different (Dimensional) Domains," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 649-659, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Yanghui & Li, Yehua & Carroll, Raymond J. & Wang, Naisyin, 2022. "Predictive functional linear models with diverging number of semiparametric single-index interactions," Journal of Econometrics, Elsevier, vol. 230(2), pages 221-239.
    2. Jiang, Jiakun & Lin, Huazhen & Zhong, Qingzhi & Li, Yi, 2022. "Analysis of multivariate non-gaussian functional data: A semiparametric latent process approach," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    3. Xiongtao Dai & Zhenhua Lin & Hans‐Georg Müller, 2021. "Modeling sparse longitudinal data on Riemannian manifolds," Biometrics, The International Biometric Society, vol. 77(4), pages 1328-1341, December.
    4. Zhang, Xiaochen & Zhang, Qingzhao & Ma, Shuangge & Fang, Kuangnan, 2022. "Subgroup analysis for high-dimensional functional regression," Journal of Multivariate Analysis, Elsevier, vol. 192(C).
    5. Yao, Fang & Sue-Chee, Shivon & Wang, Fan, 2017. "Regularized partially functional quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 156(C), pages 39-56.
    6. Cai Li & Luo Xiao & Sheng Luo, 2022. "Joint model for survival and multivariate sparse functional data with application to a study of Alzheimer's Disease," Biometrics, The International Biometric Society, vol. 78(2), pages 435-447, June.
    7. Li, Ting & Song, Xinyuan & Zhang, Yingying & Zhu, Hongtu & Zhu, Zhongyi, 2021. "Clusterwise functional linear regression models," Computational Statistics & Data Analysis, Elsevier, vol. 158(C).
    8. Wu Wang & Ying Sun & Huixia Judy Wang, 2023. "Latent group detection in functional partially linear regression models," Biometrics, The International Biometric Society, vol. 79(1), pages 280-291, March.
    9. Haixu Wang & Jiguo Cao, 2023. "Nonlinear prediction of functional time series," Environmetrics, John Wiley & Sons, Ltd., vol. 34(5), August.
    10. Nie, Yunlong & Cao, Jiguo, 2020. "Sparse functional principal component analysis in a new regression framework," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    11. Zhou, Zhiyang, 2021. "Fast implementation of partial least squares for function-on-function regression," Journal of Multivariate Analysis, Elsevier, vol. 185(C).
    12. Tang, Qingguo & Tu, Wei & Kong, Linglong, 2023. "Estimation for partial functional partially linear additive model," Computational Statistics & Data Analysis, Elsevier, vol. 177(C).
    13. Tadao Hoshino, 2024. "Functional Spatial Autoregressive Models," Papers 2402.14763, arXiv.org, revised Oct 2024.
    14. Ma, Haiqiang & Li, Ting & Zhu, Hongtu & Zhu, Zhongyi, 2019. "Quantile regression for functional partially linear model in ultra-high dimensions," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 135-147.
    15. Cody Carroll & Hans‐Georg Müller, 2023. "Latent deformation models for multivariate functional data and time‐warping separability," Biometrics, The International Biometric Society, vol. 79(4), pages 3345-3358, December.
    16. Aneiros, Germán & Novo, Silvia & Vieu, Philippe, 2022. "Variable selection in functional regression models: A review," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    17. Kyunghee Han & Pantelis Z Hadjipantelis & Jane-Ling Wang & Michael S Kramer & Seungmi Yang & Richard M Martin & Hans-Georg Müller, 2018. "Functional principal component analysis for identifying multivariate patterns and archetypes of growth, and their association with long-term cognitive development," PLOS ONE, Public Library of Science, vol. 13(11), pages 1-18, November.
    18. Chang, Jinyuan & Chen, Cheng & Qiao, Xinghao & Yao, Qiwei, 2023. "An autocovariance-based learning framework for high-dimensional functional time series," LSE Research Online Documents on Economics 117910, London School of Economics and Political Science, LSE Library.
    19. Ali Mahzarnia & Jun Song, 2022. "Multivariate functional group sparse regression: Functional predictor selection," PLOS ONE, Public Library of Science, vol. 17(4), pages 1-22, April.
    20. Qi, Xin & Luo, Ruiyan, 2018. "Function-on-function regression with thousands of predictive curves," Journal of Multivariate Analysis, Elsevier, vol. 163(C), pages 51-66.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:5:p:853-:d:1605316. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.