IDEAS home Printed from https://ideas.repec.org/a/bla/jorssc/v70y2021i5p1187-1209.html
   My bibliography  Save this article

Semiparametric model averaging prediction for lifetime data via hazards regression

Author

Listed:
  • Jialiang Li
  • Tonghui Yu
  • Jing Lv
  • Mei‐Ling Ting Lee

Abstract

Forecasting survival risks for time‐to‐event data is an essential task in clinical research. Practitioners often rely on well‐structured statistical models to make predictions for patient survival outcomes. The nonparametric proportional hazards model, as an extension of the Cox proportional hazards model, involves an additive nonlinear combination of covariate effects for hazards regression and may be more flexible. When there are a large number of predictors, nonparametric smoothing for different variables cannot be simultaneously optimal using the conventional fitting program. To address such a limitation and still maintain the nonparametric flavour, we present a novel model averaging method to produce model‐based prediction for survival outcome and our method automatically offers optimal smoothing for individual nonparametric functional estimation. The proposed semiparametric model averaging prediction (SMAP) method basically approximates the underlying unstructured nonparametric regression function by a weighted sum of low‐dimensional nonparametric submodels. The weights are obtained from maximizing the partial likelihood constructed for the aggregated model. Theoretical properties are discussed for the estimated model weights. Simulation studies are conducted to examine the performance of SMAP under various evaluation criteria. Two real examples from genetic research studies motivated our work and are analysed by the proposed SMAP to produce new scientific findings.

Suggested Citation

  • Jialiang Li & Tonghui Yu & Jing Lv & Mei‐Ling Ting Lee, 2021. "Semiparametric model averaging prediction for lifetime data via hazards regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(5), pages 1187-1209, November.
  • Handle: RePEc:bla:jorssc:v:70:y:2021:i:5:p:1187-1209
    DOI: 10.1111/rssc.12502
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssc.12502
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssc.12502?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Wenbin Lu, 2008. "Maximum likelihood estimation in the proportional hazards cure model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 60(3), pages 545-574, September.
    3. Chen, Kani & Guo, Shaojun & Sun, Liuquan & Wang, Jane-Ling, 2010. "Global Partial Likelihood for Nonparametric Proportional Hazards Models," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 750-760.
    4. Li, Degui & Linton, Oliver & Lu, Zudi, 2015. "A flexible semiparametric forecasting model for time series," Journal of Econometrics, Elsevier, vol. 187(1), pages 345-357.
    5. Wen, Chi-Chung & Chen, Yi-Hau, 2011. "Nonparametric maximum likelihood analysis of clustered current status data with the gamma-frailty Cox model," Computational Statistics & Data Analysis, Elsevier, vol. 55(2), pages 1053-1060, February.
    6. Takeshi Emura & Yi-Hau Chen & Hsuan-Yu Chen, 2012. "Survival Prediction Based on Compound Covariate under Cox Proportional Hazard Models," PLOS ONE, Public Library of Science, vol. 7(10), pages 1-12, October.
    7. Yang Y., 2001. "Adaptive Regression by Mixing," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 574-588, June.
    8. Zhao, Sihai Dave & Li, Yi, 2012. "Principled sure independence screening for Cox models with ultra-high-dimensional covariates," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 397-411.
    9. Wan, Alan T.K. & Zhang, Xinyu & Zou, Guohua, 2010. "Least squares model averaging by Mallows criterion," Journal of Econometrics, Elsevier, vol. 156(2), pages 277-283, June.
    10. Tao Huang & Jialiang Li, 2018. "Semiparametric model average prediction in panel data analysis," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 30(1), pages 125-144, January.
    11. Jialiang Li & Xiaochao Xia & Weng Kee Wong & David Nott, 2018. "Varying‐coefficient semiparametric model averaging prediction," Biometrics, The International Biometric Society, vol. 74(4), pages 1417-1426, December.
    12. Ao Yuan & Yuan Guo & Nawar M. Shara & Barbara V. Howard & Ming T. Tan, 2018. "An additive Cox model for coronary heart disease study," Journal of Applied Statistics, Taylor & Francis Journals, vol. 45(7), pages 1325-1346, May.
    13. Michael Schemper & Robin Henderson, 2000. "Predictive Accuracy and Explained Variation in Cox Regression," Biometrics, The International Biometric Society, vol. 56(1), pages 249-255, March.
    14. Hyokyoung G. Hong & Xuerong Chen & David C. Christiani & Yi Li, 2018. "Integrated powered density: Screening ultrahigh dimensional covariates with survival outcomes," Biometrics, The International Biometric Society, vol. 74(2), pages 421-429, June.
    15. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    16. Emura, Takeshi & Chen, Yi-Hau & Chen, Hsuan-Yu, 2012. "Survival prediction based on compound covariate under cox proportional hazard models," MPRA Paper 41149, University Library of Munich, Germany.
    17. Yongxiu Cao & Jian Huang & Yanyan Liu & Xingqiu Zhao, 2016. "Sieve estimation of Cox models with latent structures," Biometrics, The International Biometric Society, vol. 72(4), pages 1086-1097, December.
    18. Lu Wang & Pang Du & Hua Liang, 2012. "Two-Component Mixture Cure Rate Model with Spline Estimated Nonparametric Components," Biometrics, The International Biometric Society, vol. 68(3), pages 726-735, September.
    19. Xinyu Zhang & Dalei Yu & Guohua Zou & Hua Liang, 2016. "Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1775-1790, October.
    20. Bair, Eric & Hastie, Trevor & Paul, Debashis & Tibshirani, Robert, 2006. "Prediction by Supervised Principal Components," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 119-137, March.
    21. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang Li & Hao Liu & Xiaoshen Wang & Wanzhu Tu, 2022. "Semi‐parametric time‐to‐event modelling of lengths of hospital stays," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1623-1647, November.
    2. Dong, Qingkai & Liu, Binxia & Zhao, Hui, 2023. "Weighted least squares model averaging for accelerated failure time models," Computational Statistics & Data Analysis, Elsevier, vol. 184(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fang, Fang & Li, Jialiang & Xia, Xiaochao, 2022. "Semiparametric model averaging prediction for dichotomous response," Journal of Econometrics, Elsevier, vol. 229(2), pages 219-245.
    2. Jingwen Tu & Hu Yang & Chaohui Guo & Jing Lv, 2021. "Model averaging marginal regression for high dimensional conditional quantile prediction," Statistical Papers, Springer, vol. 62(6), pages 2661-2689, December.
    3. Fang, Fang & Yu, Zhou, 2020. "Model averaging assisted sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    4. Yuan, Chaoxia & Fang, Fang & Ni, Lyu, 2022. "Mallows model averaging with effective model size in fragmentary data prediction," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    5. Haili Zhang & Guohua Zou, 2020. "Cross-Validation Model Averaging for Generalized Functional Linear Model," Econometrics, MDPI, vol. 8(1), pages 1-35, February.
    6. Yuting Wei & Qihua Wang & Wei Liu, 2021. "Model averaging for linear models with responses missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 535-553, June.
    7. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics, revised Jan 2023.
    8. Peng, Jingfu & Yang, Yuhong, 2022. "On improvability of model selection by model averaging," Journal of Econometrics, Elsevier, vol. 229(2), pages 246-262.
    9. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    10. Liao, Jun & Wan, Alan T.K. & He, Shuyuan & Zou, Guohua, 2022. "Optimal model averaging for multivariate regression models," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    11. Wei, Yuting & Wang, Qihua, 2021. "Cross-validation-based model averaging in linear models with response missing at random," Statistics & Probability Letters, Elsevier, vol. 171(C).
    12. Yan, Xiaodong & Wang, Hongni & Wang, Wei & Xie, Jinhan & Ren, Yanyan & Wang, Xinjun, 2021. "Optimal model averaging forecasting in high-dimensional survival analysis," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1147-1155.
    13. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    14. Guo, Chaohui & Lv, Jing & Wu, Jibo, 2021. "Composite quantile regression for ultra-high dimensional semiparametric model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    15. Xiaochao Xia, 2021. "Model averaging prediction for nonparametric varying-coefficient models with B-spline smoothing," Statistical Papers, Springer, vol. 62(6), pages 2885-2905, December.
    16. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    17. Christopher F. Parmeter & Alan T. K. Wan & Xinyu Zhang, 2019. "Model averaging estimators for the stochastic frontier model," Journal of Productivity Analysis, Springer, vol. 51(2), pages 91-103, June.
    18. Yan Gao & Xinyu Zhang & Shouyang Wang & Terence Tai-leung Chong & Guohua Zou, 2019. "Frequentist model averaging for threshold models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 275-306, April.
    19. Rongjie Jiang & Liming Wang & Yang Bai, 2021. "Optimal model averaging estimator for semi-functional partially linear models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(2), pages 167-194, February.
    20. Chu-An Liu & Biing-Shen Kuo & Wen-Jen Tsay, 2017. "Autoregressive Spectral Averaging Estimator," IEAS Working Paper : academic research 17-A013, Institute of Economics, Academia Sinica, Taipei, Taiwan.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssc:v:70:y:2021:i:5:p:1187-1209. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.