IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v165y2022ics0167947321001572.html
   My bibliography  Save this article

Deep learning for quantile regression under right censoring: DeepQuantreg

Author

Listed:
  • Jia, Yichen
  • Jeong, Jong-Hyeon

Abstract

The computational prediction algorithm of neural network, or deep learning, has drawn much attention recently in statistics as well as in image recognition and natural language processing. Particularly in statistical application for censored survival data, the loss function used for optimization has been mainly based on the partial likelihood from Cox's model and its variations to utilize existing neural network library such as Keras, which was built upon the open source library of TensorFlow. As a novel contribution to the literature, an extension of the neural network to the quantile regression is proposed for survival data with right censoring, which is adjusted by the inverse of the estimated censoring distribution in the check function. The main purpose is to show that the deep learning method could be flexible enough to predict nonlinear patterns more accurately compared to existing quantile regression methods such as traditional linear quantile regression and nonparametric quantile regression with total variation regularization, emphasizing practicality of the method for censored survival data. Simulation studies were performed to generate nonlinear censored survival data and compare the deep learning method with existing quantile regression methods in terms of prediction accuracy. The proposed method is illustrated with two publicly available breast cancer data sets with gene signatures. The method has been built into a package and is freely available at https://github.com/yicjia/DeepQuantreg.

Suggested Citation

  • Jia, Yichen & Jeong, Jong-Hyeon, 2022. "Deep learning for quantile regression under right censoring: DeepQuantreg," Computational Statistics & Data Analysis, Elsevier, vol. 165(C).
  • Handle: RePEc:eee:csdana:v:165:y:2022:i:c:s0167947321001572
    DOI: 10.1016/j.csda.2021.107323
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947321001572
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2021.107323?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Christina Curtis & Sohrab P. Shah & Suet-Feung Chin & Gulisa Turashvili & Oscar M. Rueda & Mark J. Dunning & Doug Speed & Andy G. Lynch & Shamith Samarajiwa & Yinyin Yuan & Stefan Gräf & Gavin Ha & Gh, 2012. "The genomic and transcriptomic architecture of 2,000 breast tumours reveals novel subgroups," Nature, Nature, vol. 486(7403), pages 346-352, June.
    2. Powell, James L., 1984. "Least absolute deviations estimation for the censored regression model," Journal of Econometrics, Elsevier, vol. 25(3), pages 303-325, July.
    3. Peng, Limin & Huang, Yijian, 2008. "Survival Analysis With Quantile Regression Models," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 637-649, June.
    4. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    5. Patrick J. Heagerty & Yingye Zheng, 2005. "Survival Model Predictive Accuracy and ROC Curves," Biometrics, The International Biometric Society, vol. 61(1), pages 92-105, March.
    6. Ruosha Li & Limin Peng, 2017. "Assessing quantile prediction with censored quantile regression models," Biometrics, The International Biometric Society, vol. 73(2), pages 517-528, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ly, Sel & Xie, Jiahang & Wolter, Franz-Erich & Nguyen, Hung D. & Weng, Yu, 2023. "T-shape data and probabilistic remaining useful life prediction for Li-ion batteries using multiple non-crossing quantile long short-term memory," Applied Energy, Elsevier, vol. 349(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. De Backer, Mickael & El Ghouch, Anouar & Van Keilegom, Ingrid, 2017. "An Adapted Loss Function for Censored Quantile Regression," LIDAM Discussion Papers ISBA 2017003, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    2. Marcelo Cajias & Philipp Freudenreich & Anna Heller & Wolfgang Schaefers, 2018. "Censored Quantile Regressions and the Determinants of Real Estate Liquidity," ERES eres2018_203, European Real Estate Society (ERES).
    3. Jiang, Rong & Qian, Weimin & Zhou, Zhangong, 2012. "Variable selection and coefficient estimation via composite quantile regression with randomly censored data," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 308-317.
    4. Xiaoyan Sun & Limin Peng & Yijian Huang & HuiChuan J. Lai, 2016. "Generalizing Quantile Regression for Counting Processes With Applications to Recurrent Events," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 145-156, March.
    5. Marcelo Cajias & Philipp Freudenreich & Anna Freudenreich, 2020. "Exploring the determinants of real estate liquidity from an alternative perspective: censored quantile regression in real estate research," Journal of Business Economics, Springer, vol. 90(7), pages 1057-1086, August.
    6. Chen, Songnian, 2019. "Quantile regression for duration models with time-varying regressors," Journal of Econometrics, Elsevier, vol. 209(1), pages 1-17.
    7. Xiaofeng Lv & Gupeng Zhang & Xinkuo Xu & Qinghai Li, 2019. "Weighted quantile regression for censored data with application to export duration data," Statistical Papers, Springer, vol. 60(4), pages 1161-1192, August.
    8. Yuanshan Wu & Yanyuan Ma & Guosheng Yin, 2015. "Smoothed and Corrected Score Approach to Censored Quantile Regression With Measurement Errors," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1670-1683, December.
    9. Zheng, Ming & Zhao, Ziqiang & Yu, Wen, 2013. "Quantile regression analysis of case-cohort data," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 20-34.
    10. Pang, Lei & Lu, Wenbin & Wang, Huixia Judy, 2012. "Variance estimation in censored quantile regression via induced smoothing," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 785-796.
    11. Chen, Songnian, 2023. "Two-step estimation of censored quantile regression for duration models with time-varying regressors," Journal of Econometrics, Elsevier, vol. 235(2), pages 1310-1336.
    12. Xianghua Luo & Chiung-Yu Huang & Lan Wang, 2013. "Quantile Regression for Recurrent Gap Time Data," Biometrics, The International Biometric Society, vol. 69(2), pages 375-385, June.
    13. Jung-Yu Cheng & Shinn-Jia Tzeng, 2014. "Quantile regression of right-censored length-biased data using the Buckley–James-type method," Computational Statistics, Springer, vol. 29(6), pages 1571-1592, December.
    14. Shuang Ji & Limin Peng & Yu Cheng & HuiChuan Lai, 2012. "Quantile Regression for Doubly Censored Data," Biometrics, The International Biometric Society, vol. 68(1), pages 101-112, March.
    15. Fan, Yanqin & Liu, Ruixuan, 2018. "Partial identification and inference in censored quantile regression," Journal of Econometrics, Elsevier, vol. 206(1), pages 1-38.
    16. Zexi Cai & Tony Sit, 2023. "On interquantile smoothness of censored quantile regression with induced smoothing," Biometrics, The International Biometric Society, vol. 79(4), pages 3549-3563, December.
    17. Peng, Limin, 2012. "Self-consistent estimation of censored quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 368-379.
    18. Chen, Songnian, 2018. "Sequential estimation of censored quantile regression models," Journal of Econometrics, Elsevier, vol. 207(1), pages 30-52.
    19. Rima Rajab & Milan Dražić & Nenad Mladenović & Pavle Mladenović & Keming Yu, 2015. "Fitting censored quantile regression by variable neighborhood search," Journal of Global Optimization, Springer, vol. 63(3), pages 481-500, November.
    20. Peracchi, Franco, 2002. "On estimating conditional quantiles and distribution functions," Computational Statistics & Data Analysis, Elsevier, vol. 38(4), pages 433-447, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:165:y:2022:i:c:s0167947321001572. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.