IDEAS home Printed from https://ideas.repec.org/a/spr/lifeda/v26y2020i4d10.1007_s10985-020-09503-3.html
   My bibliography  Save this article

Measuring the temporal prognostic utility of a baseline risk score

Author

Listed:
  • Sean M. Devlin

    (Memorial Sloan Kettering Cancer Center)

  • Mithat Gönen

    (Memorial Sloan Kettering Cancer Center)

  • Glenn Heller

    (Memorial Sloan Kettering Cancer Center)

Abstract

In the time-to-event setting, the concordance probability assesses the relative level of agreement between a model-based risk score and the survival time of a patient. While it provides a measure of discrimination over the entire follow-up period of a study, the probability does not provide information on the longitudinal durability of a baseline risk score. It is possible that a baseline risk model is able to segregate short-term from long-term survivors but unable to maintain its discriminatory strength later in the follow-up period. As a consequence, this would motivate clinicians to re-evaluate the risk score longitudinally. This longitudinal re-evaluation may not, however, be feasible in many scenarios since a single baseline evaluation may be the only data collectible due to treatment or other clinical or ethical reasons. In these scenarios, an attenuation of the discriminatory power of the patient risk score over time would indicate decreased clinical utility and call into question whether this score should remain a prognostic tool at later time points. Working within the concordance probability paradigm, we propose a method to address this clinical scenario and evaluate the discriminatory power of a baseline derived risk score over time. The methodology is illustrated with two examples: a baseline risk score in colorectal cancer defined at the time of tumor resection, and for circulating tumor cells in metastatic prostate cancer.

Suggested Citation

  • Sean M. Devlin & Mithat Gönen & Glenn Heller, 2020. "Measuring the temporal prognostic utility of a baseline risk score," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 26(4), pages 856-871, October.
  • Handle: RePEc:spr:lifeda:v:26:y:2020:i:4:d:10.1007_s10985-020-09503-3
    DOI: 10.1007/s10985-020-09503-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10985-020-09503-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10985-020-09503-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ronghui Xu & John O'Quigley, 2000. "Proportional hazards estimate of the conditional survival function," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(4), pages 667-680.
    2. Mithat Gonen & Glenn Heller, 2005. "Concordance probability and discriminatory power in proportional hazards regression," Biometrika, Biometrika Trust, vol. 92(4), pages 965-970, December.
    3. Glenn Heller & Qianxing Mo, 2016. "Estimating the concordance probability in a survival analysis with a discrete number of risk groups," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 22(2), pages 263-279, April.
    4. Patrick J. Heagerty & Yingye Zheng, 2005. "Survival Model Predictive Accuracy and ROC Curves," Biometrics, The International Biometric Society, vol. 61(1), pages 92-105, March.
    5. Hans C. Van Houwelingen, 2007. "Dynamic Prediction by Landmarking in Event History Analysis," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(1), pages 70-85, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. van Geloven, N. & He, Y. & Zwinderman, A.H. & Putter, H., 2021. "Estimation of incident dynamic AUC in practice," Computational Statistics & Data Analysis, Elsevier, vol. 154(C).
    2. Ruosha Li & Jing Ning & Ziding Feng, 2022. "Estimation and inference of predictive discrimination for survival outcome risk prediction models," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 28(2), pages 219-240, April.
    3. Wolf, Petra & Schmidt, Georg & Ulm, Kurt, 2011. "The use of ROC for defining the validity of the prognostic index in censored data," Statistics & Probability Letters, Elsevier, vol. 81(7), pages 783-791, July.
    4. P. Saha & P. J. Heagerty, 2010. "Time-Dependent Predictive Accuracy in the Presence of Competing Risks," Biometrics, The International Biometric Society, vol. 66(4), pages 999-1011, December.
    5. Jing Zhang & Jing Ning & Ruosha Li, 2023. "Evaluating Dynamic Discrimination Performance of Risk Prediction Models for Survival Outcomes," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(2), pages 353-371, July.
    6. Liang Li & Sheng Luo & Bo Hu & Tom Greene, 2017. "Dynamic Prediction of Renal Failure Using Longitudinal Biomarkers in a Cohort Study of Chronic Kidney Disease," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 9(2), pages 357-378, December.
    7. Daniel Commenges & Benoit Liquet & Cécile Proust-Lima, 2012. "Choice of Prognostic Estimators in Joint Models by Estimating Differences of Expected Conditional Kullback–Leibler Risks," Biometrics, The International Biometric Society, vol. 68(2), pages 380-387, June.
    8. Schmid, Matthias & Tutz, Gerhard & Welchowski, Thomas, 2018. "Discrimination measures for discrete time-to-event predictions," Econometrics and Statistics, Elsevier, vol. 7(C), pages 153-164.
    9. Xin Wang & Douglas E. Schaubel, 2018. "Modeling restricted mean survival time under general censoring mechanisms," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 24(1), pages 176-199, January.
    10. Patrick Ten Eyck & Joseph E. Cavanaugh, 2018. "Model selection criteria based on cross-validatory concordance statistics," Computational Statistics, Springer, vol. 33(2), pages 595-621, June.
    11. Yu Zheng & Tianxi Cai, 2017. "Augmented estimation for t‐year survival with censored regression models," Biometrics, The International Biometric Society, vol. 73(4), pages 1169-1178, December.
    12. Lin Lu & Laurent Dercle & Binsheng Zhao & Lawrence H. Schwartz, 2021. "Deep learning for the prediction of early on-treatment response in metastatic colorectal cancer from serial medical imaging," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    13. Nuriye Sancar & Deniz Inan, 2018. "A novel method as a diagnostic tool for the detection of influential observations in the Cox proportional hazards model," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(2), pages 1253-1266, December.
    14. Bin Qiu & Wei Guo & Fan Zhang & Fang Lv & Ying Ji & Yue Peng & Xiaoxi Chen & Hua Bao & Yang Xu & Yang Shao & Fengwei Tan & Qi Xue & Shugeng Gao & Jie He, 2021. "Dynamic recurrence risk and adjuvant chemotherapy benefit prediction by ctDNA in resected NSCLC," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    15. Robin Van Oirbeek & Emmanuel Lesaffre, 2018. "An Investigation of the Discriminatory Ability of the Clustering Effect of the Frailty Survival Model," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 6(3), pages 87-98, April.
    16. Yuanjia Wang & Huaihou Chen & Runze Li & Naihua Duan & Roberto Lewis-Fernández, 2011. "Prediction-Based Structured Variable Selection through the Receiver Operating Characteristic Curves," Biometrics, The International Biometric Society, vol. 67(3), pages 896-905, September.
    17. Chrianna I Bharat & Kevin Murray & Edward Cripps & Melinda R Hodkiewicz, 2018. "Methods for displaying and calibration of Cox proportional hazards models," Journal of Risk and Reliability, , vol. 232(1), pages 105-115, February.
    18. Kevin He & Yue Wang & Xiang Zhou & Han Xu & Can Huang, 2019. "An improved variable selection procedure for adaptive Lasso in high-dimensional survival analysis," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 25(3), pages 569-585, July.
    19. Raul Aguirre-Gamboa & Hugo Gomez-Rueda & Emmanuel Martínez-Ledesma & Antonio Martínez-Torteya & Rafael Chacolla-Huaringa & Alberto Rodriguez-Barrientos & José G Tamez-Peña & Victor Treviño, 2013. "SurvExpress: An Online Biomarker Validation Tool and Database for Cancer Gene Expression Data Using Survival Analysis," PLOS ONE, Public Library of Science, vol. 8(9), pages 1-9, September.
    20. Weining Shen & Jing Ning & Ying Yuan, 2015. "A direct method to evaluate the time-dependent predictive accuracy for biomarkers," Biometrics, The International Biometric Society, vol. 71(2), pages 439-449, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:lifeda:v:26:y:2020:i:4:d:10.1007_s10985-020-09503-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.