IDEAS home Printed from https://ideas.repec.org/a/eee/ecosta/v7y2018icp153-164.html
   My bibliography  Save this article

Discrimination measures for discrete time-to-event predictions

Author

Listed:
  • Schmid, Matthias
  • Tutz, Gerhard
  • Welchowski, Thomas

Abstract

Discrete time-to-event models have become a popular tool for the statistical analysis of longitudinal data. These models are useful when either time is intrinsically discrete or when continuous time-to-event outcomes are collected at pre-specified follow-up times, yielding interval-censored data. While there exists a variety of methods for discrete-time model building and estimation, measures for the evaluation of discrete time-to-event predictions are scarce. To address this issue, a set of measures that quantify the discriminatory power of prediction rules for discrete event times is proposed. More specifically, sensitivity rates, specificity rates, AUC, and also a time-independent summary index (“concordance index”) for discrete time-to-event outcomes are developed. Using inverse-probability-of-censoring weighting, it is shown how to consistently estimate the proposed measures from a set of censored data. To illustrate the proposed methodology, the duration of unemployment of US citizens is analyzed, and it is demonstrated how discrimination measures can be used for model comparison.

Suggested Citation

  • Schmid, Matthias & Tutz, Gerhard & Welchowski, Thomas, 2018. "Discrimination measures for discrete time-to-event predictions," Econometrics and Statistics, Elsevier, vol. 7(C), pages 153-164.
    • Handle: RePEc:eee:ecosta:v:7:y:2018:i:c:p:153-164
    DOI: 10.1016/j.ecosta.2017.03.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2452306217300321
    Download Restriction: Full text for ScienceDirect subscribers only. Contains open access articles
    File URL: https://libkey.io/10.1016/j.ecosta.2017.03.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. McCall, Brian P, 1996. "Unemployment Insurance Rules, Joblessness, and Part-Time Work," Econometrica, Econometric Society, vol. 64(3), pages 647-682, May.
    2. Mithat Gonen & Glenn Heller, 2005. "Concordance probability and discriminatory power in proportional hazards regression," Biometrika, Biometrika Trust, vol. 92(4), pages 965-970, December.
    3. Matthias Schmid & Thomas Hielscher & Thomas Augustin & Olaf Gefeller, 2011. "A Robust Alternative to the Schemper–Henderson Estimator of Prediction Error," Biometrics, The International Biometric Society, vol. 67(2), pages 524-535, June.
    4. Uno, Hajime & Cai, Tianxi & Tian, Lu & Wei, L.J., 2007. "Evaluating Prediction Rules for t-Year Survivors With Censored Regression Models," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 527-537, June.
    5. Van den Berg, Gerard J., 2001. "Duration models: specification, identification and multiple durations," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 55, pages 3381-3460, Elsevier.
    6. Patrick J. Heagerty & Yingye Zheng, 2005. "Survival Model Predictive Accuracy and ROC Curves," Biometrics, The International Biometric Society, vol. 61(1), pages 92-105, March.
    7. Giuseppe Casalicchio & Bernd Bischl & Anne-Laure Boulesteix & Matthias Schmid, 2016. "The residual-based predictiveness curve: A visual tool to assess the performance of prediction models," Biometrics, The International Biometric Society, vol. 72(2), pages 392-401, June.
    8. Patrick J. Heagerty & Thomas Lumley & Margaret S. Pepe, 2000. "Time-Dependent ROC Curves for Censored Survival Data and a Diagnostic Marker," Biometrics, The International Biometric Society, vol. 56(2), pages 337-344, June.
    9. Ming Wang & Qi Long, 2016. "Addressing issues associated with evaluating prediction models for survival endpoints based on the concordance statistic," Biometrics, The International Biometric Society, vol. 72(3), pages 897-906, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Moritz Berger & Thomas Welchowski & Steffen Schmitz-Valckenberg & Matthias Schmid, 2019. "A classification tree approach for the modeling of competing risks in discrete time," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(4), pages 965-990, December.
    2. Burgard, Jan Pablo & Krause, Joscha & Schmaus, Simon, 2021. "Estimation of regional transition probabilities for spatial dynamic microsimulations from survey data lacking in regional detail," Computational Statistics & Data Analysis, Elsevier, vol. 154(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruosha Li & Jing Ning & Ziding Feng, 2022. "Estimation and inference of predictive discrimination for survival outcome risk prediction models," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 28(2), pages 219-240, April.
    2. Matthias Schmid & Thomas Hielscher & Thomas Augustin & Olaf Gefeller, 2011. "A Robust Alternative to the Schemper–Henderson Estimator of Prediction Error," Biometrics, The International Biometric Society, vol. 67(2), pages 524-535, June.
    3. Susana Díaz-Coto & Pablo Martínez-Camblor & Sonia Pérez-Fernández, 2020. "smoothROCtime: an R package for time-dependent ROC curve estimation," Computational Statistics, Springer, vol. 35(3), pages 1231-1251, September.
    4. Wolf, Petra & Schmidt, Georg & Ulm, Kurt, 2011. "The use of ROC for defining the validity of the prognostic index in censored data," Statistics & Probability Letters, Elsevier, vol. 81(7), pages 783-791, July.
    5. Sehee Kim & Douglas E. Schaubel & Keith P. McCullough, 2018. "A C†index for recurrent event data: Application to hospitalizations among dialysis patients," Biometrics, The International Biometric Society, vol. 74(2), pages 734-743, June.
    6. Cockx, Bart & Robin, Stéphane R. & Goebel, Christian, 2006. "Income Support Policies for Part-Time Workers: A Stepping-Stone to Regular Jobs? An Application to Young Long-Term Unemployed Women in Belgium," IZA Discussion Papers 2432, Institute of Labor Economics (IZA).
    7. Liu Xinhua & Jin Zhezhen, 2009. "A Non-Parametric Approach to Scale Reduction for Uni-Dimensional Screening Scales," The International Journal of Biostatistics, De Gruyter, vol. 5(1), pages 1-22, January.
    8. Weining Shen & Jing Ning & Ying Yuan, 2015. "A direct method to evaluate the time-dependent predictive accuracy for biomarkers," Biometrics, The International Biometric Society, vol. 71(2), pages 439-449, June.
    9. Anna Godøy & Knut Røed, 2016. "Unemployment Insurance and Underemployment," LABOUR, CEIS, vol. 30(2), pages 158-179, June.
    10. P. Saha & P. J. Heagerty, 2010. "Time-Dependent Predictive Accuracy in the Presence of Competing Risks," Biometrics, The International Biometric Society, vol. 66(4), pages 999-1011, December.
    11. Janez Stare & Maja Pohar Perme & Robin Henderson, 2011. "A Measure of Explained Variation for Event History Data," Biometrics, The International Biometric Society, vol. 67(3), pages 750-759, September.
    12. Yingye Zheng & Tianxi Cai & Ziding Feng, 2006. "Application of the Time-Dependent ROC Curves for Prognostic Accuracy with Multiple Biomarkers," Biometrics, The International Biometric Society, vol. 62(1), pages 279-287, March.
    13. C. Jason Liang & Patrick J. Heagerty, 2017. "Rejoinder to discussions on: A risk-based measure of time-varying prognostic discrimination for survival models," Biometrics, The International Biometric Society, vol. 73(3), pages 745-748, September.
    14. C. Jason Liang & Patrick J. Heagerty, 2017. "A risk-based measure of time-varying prognostic discrimination for survival models," Biometrics, The International Biometric Society, vol. 73(3), pages 725-734, September.
    15. Yingye Zheng & Patrick J. Heagerty, 2007. "Prospective Accuracy for Longitudinal Markers," Biometrics, The International Biometric Society, vol. 63(2), pages 332-341, June.
    16. Hajime Uno & Tianxi Cai & Lu Tian & L. J. Wei, 2011. "Graphical Procedures for Evaluating Overall and Subject-Specific Incremental Values from New Predictors with Censored Event Time Data," Biometrics, The International Biometric Society, vol. 67(4), pages 1389-1396, December.
    17. Liang Li & Sheng Luo & Bo Hu & Tom Greene, 2017. "Dynamic Prediction of Renal Failure Using Longitudinal Biomarkers in a Cohort Study of Chronic Kidney Disease," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 9(2), pages 357-378, December.
    18. Bidisha Chakrabarty & Zhaohui Han & Konstantin Tyurin & Xiaoyong Zheng, 2006. "A Competing Risk Analysis of Executions and Cancellations in a Limit Order Market," CAEPR Working Papers 2006-015, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    19. Tianxi Cai & Thomas A Gerds & Yingye Zheng & Jinbo Chen, 2011. "Robust Prediction of t-Year Survival with Data from Multiple Studies," Biometrics, The International Biometric Society, vol. 67(2), pages 436-444, June.
    20. Yingye Zheng & Tianxi Cai & Yuying Jin & Ziding Feng, 2012. "Evaluating Prognostic Accuracy of Biomarkers under Competing Risk," Biometrics, The International Biometric Society, vol. 68(2), pages 388-396, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecosta:v:7:y:2018:i:c:p:153-164. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/econometrics-and-statistics .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.