Comparing the predictive powers of survival models using Harrell’s C or Somers’ D
Medical researchers frequently make statements that one model pre- dicts survival better than another, and they are frequently challenged to provide rigorous statistical justification for those statements. Stata provides the estat concordance command to calculate the rank parameters Harrell’s C and Somers’ D as measures of the ordinal predictive power of a model. However, no confidence limits or p-values are provided to compare the predictive power of distinct models. The somersd package, downloadable from Statistical Software Components, can provide such confidence intervals, but they should not be taken seriously if they are calculated in the dataset in which the model was fit. Methods are demonstrated for fitting alternative models to a training set of data, and then measuring and comparing their predictive powers by using out-of-sample prediction and somersd in a test set to produce statistically sensible confidence intervals and p-values for the differences between the predictive powers of different models. Copyright 2010 by StataCorp LP.
Volume (Year): 10 (2010)
Issue (Month): 3 (September)
|Note:||to access software from within Stata, net describe http://www.stata-journal.com/software/sj10-3/st0198/|
|Contact details of provider:|| Web page: http://www.stata-journal.com/|
|Order Information:||Web: http://www.stata-journal.com/subscription.html|
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Roger Newson, 2002. "Parameters behind "nonparametric" statistics: Kendall's tau,Somers' D and median differences," Stata Journal, StataCorp LP, vol. 2(1), pages 45-64, February.
When requesting a correction, please mention this item's handle: RePEc:tsj:stataj:v:10:y:2010:i:3:p:339-358. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F. Baum)or (Lisa Gilmore)
If references are entirely missing, you can add them using this form.