IDEAS home Printed from https://ideas.repec.org/a/tsj/stataj/v15y2015i1p275-291.html
   My bibliography  Save this article

Tools for checking calibration of a Cox model in external validation: Prediction of population-averaged survival curves based on risk groups

Author

Listed:
  • Patrick Royston

    (MRC Clinical Trials Unit at University College London)

Abstract

Royston (2014, Stata Journal 14: 738–755) explained how a popular application of the Cox proportional hazards model "is to develop a multivariable prediction model, often a prognostic model to predict the future clinical outcome of patients with a particular disorder from 'baseline' factors measured at some initial time point. For such a model to be useful in practice, it must be ‘validated’; that is, it must perform satisfactorily in an external sample of patients independent of the one on which the model was originally developed. One key aspect of performance is calibration, which is the accuracy of prediction, particularly of survival (or equivalently, failure or event) probabilities at any time after the time origin". In this article, I suggest an approach to assess calibration by comparing observed (Kaplan–Meier) and predicted survival probabilities in several prognostic groups derived by placing cutpoints on the prognostic index. I distinguish between full validation, where all relevant quantities are estimated on the derivation dataset and predicted on the validation dataset, and partial validation, where the prognostic index and prognostic groups are derived from published information and the baseline distribution function is estimated in the validation dataset. Partial validation is more feasible in practice because it is uncommon to have access to individual patient values in both datasets. I exemplify the method by detailed analysis of two datasets in the disease primary biliary cirrhosis; the datasets comprise a derivation and a validation dataset. I describe a new ado-file, stcoxgrp, that performs the necessary calculations. Results for stcoxgrp are displayed graphically, which makes it easier for users to picture calibration (or lack thereof ) according to follow-up time. Copyright 2015 by StataCorp LP.

Suggested Citation

  • Patrick Royston, 2015. "Tools for checking calibration of a Cox model in external validation: Prediction of population-averaged survival curves based on risk groups," Stata Journal, StataCorp LP, vol. 15(1), pages 275-291, March.
  • Handle: RePEc:tsj:stataj:v:15:y:2015:i:1:p:275-291
    Note: to access software from within Stata, net describe http://www.stata-journal.com/software/sj15-1/st0380/
    as

    Download full text from publisher

    File URL: http://www.stata-journal.com/article.html?article=st0380
    File Function: link to article purchase
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Thijssens, O.W.M. & Verhagen, Wim J.C., 2020. "Application of Extended Cox Regression Model to Time-On-Wing Data of Aircraft Repairables," Reliability Engineering and System Safety, Elsevier, vol. 204(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tsj:stataj:v:15:y:2015:i:1:p:275-291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum or Lisa Gilmore (email available below). General contact details of provider: http://www.stata-journal.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.