IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v36y2021i1d10.1007_s00180-020-01000-3.html
   My bibliography  Save this article

Clustering method for censored and collinear survival data

Author

Listed:
  • Silvia Liverani

    (Queen Mary University of London
    The British Library)

  • Lucy Leigh

    (Hunter Medical Research Institute
    University of Newcastle)

  • Irene L. Hudson

    (Royal Melbourne Institute of Technology (RMIT))

  • Julie E. Byles

    (University of Newcastle)

Abstract

In this paper we propose a Dirichlet process mixture model for censored survival data with covariates. This model is suitable in two scenarios. First, this method can be used to identify clusters determined by both the censored survival data and the predictors. Second, this method is suitable for highly correlated predictors, in cases when the usual survival models cannot be implemented because they would be unstable due to multicollinearity. The Dirichlet process mixture model links a response vector to covariate data through cluster membership and in this paper this model is extended for mixtures of Weibull distributions, which can be used to model survival times and also allow for censoring. We propose two variants of this model, one with a shape parameter common to all clusters (referred to as a global parameter) for the Weibull distributions and one with a cluster-specific shape parameter. The first satisfies the proportional hazard assumption, while the latter is very flexible, as it has the advantage of allowing estimation of the survival curve whether or not the proportional hazards assumption is satisfied. We present a simulation study and, to demonstrate the applicability of the method in practice, a real application to sleep surveys in older women from The Australian Longitudinal Study on Women’s Health. The method developed in the paper is available in the R package PReMiuM.

Suggested Citation

  • Silvia Liverani & Lucy Leigh & Irene L. Hudson & Julie E. Byles, 2021. "Clustering method for censored and collinear survival data," Computational Statistics, Springer, vol. 36(1), pages 35-60, March.
    • Handle: RePEc:spr:compst:v:36:y:2021:i:1:d:10.1007_s00180-020-01000-3
    DOI: 10.1007/s00180-020-01000-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-020-01000-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00180-020-01000-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chung, Yeonseung & Dunson, David B., 2009. "Nonparametric Bayes Conditional Distribution Modeling With Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1646-1660.
    2. Dunson, David B. & Herring, Amy H. & Siega-Riz, Anna Maria, 2008. "Bayesian Inference on Changes in Response Densities Over Predictor Clusters," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1508-1517.
    3. Liverani, Silvia & Hastie, David I. & Azizi, Lamiae & Papathomas, Michail & Richardson, Sylvia, 2015. "PReMiuM: An R Package for Profile Regression Mixture Models Using Dirichlet Processes," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 64(i07).
    4. W. R. Gilks & P. Wild, 1992. "Adaptive Rejection Sampling for Gibbs Sampling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 41(2), pages 337-348, June.
    5. Bigelow, Jamie L. & Dunson, David B., 2009. "Bayesian Semiparametric Joint Models for Functional Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 26-36.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rifai Afin & Keresztély Tibor & Cserháti Ilona, 2025. "Firm performance and markets: survival analysis of medium and large manufacturing enterprises in Indonesia," Economia e Politica Industriale: Journal of Industrial and Business Economics, Springer;Associazione Amici di Economia e Politica Industriale, vol. 52(1), pages 107-151, March.
    2. Lavigne, Aurore & Liverani, Silvia, 2024. "Quantifying the uncertainty of partitions for infinite mixture models," Statistics & Probability Letters, Elsevier, vol. 204(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eric Coker & Robert Gunier & Asa Bradman & Kim Harley & Katherine Kogut & John Molitor & Brenda Eskenazi, 2017. "Association between Pesticide Profiles Used on Agricultural Fields near Maternal Residences during Pregnancy and IQ at Age 7 Years," IJERPH, MDPI, vol. 14(5), pages 1-20, May.
    2. Liverani, Silvia & Hastie, David I. & Azizi, Lamiae & Papathomas, Michail & Richardson, Sylvia, 2015. "PReMiuM: An R Package for Profile Regression Mixture Models Using Dirichlet Processes," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 64(i07).
    3. Bruno Scarpa & David B. Dunson, 2014. "Enriched Stick-Breaking Processes for Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 647-660, June.
    4. Daniele Durante & Sally Paganin & Bruno Scarpa & David B. Dunson, 2017. "Bayesian modelling of networks in complex business intelligence problems," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(3), pages 555-580, April.
    5. Lauren Hoskovec & Wande Benka-Coker & Rachel Severson & Sheryl Magzamen & Ander Wilson, 2021. "Model choice for estimating the association between exposure to chemical mixtures and health outcomes: A simulation study," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-21, March.
    6. Jaeeun Yu & Jinsu Park & Taeryon Choi & Masahiro Hashizume & Yoonhee Kim & Yasushi Honda & Yeonseung Chung, 2021. "Nonparametric Bayesian Functional Meta-Regression: Applications in Environmental Epidemiology," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 26(1), pages 45-70, March.
    7. Pang, W. K. & Yang, Z. H. & Hou, S. H. & Leung, P. K., 2002. "Non-uniform random variate generation by the vertical strip method," European Journal of Operational Research, Elsevier, vol. 142(3), pages 595-609, November.
    8. Z. Rezaei Ghahroodi & M. Ganjali, 2013. "A Bayesian approach for analysing longitudinal nominal outcomes using random coefficients transitional generalized logit model: an application to the labour force survey data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(7), pages 1425-1445, July.
    9. Anis Fradi & Chafik Samir & Ines Adouani, 2024. "A New Bayesian Approach to Global Optimization on Parametrized Surfaces in $$\mathbb {R}^{3}$$ R 3," Journal of Optimization Theory and Applications, Springer, vol. 202(3), pages 1077-1100, September.
    10. Antonello Loddo & Shawn Ni & Dongchu Sun, 2011. "Selection of Multivariate Stochastic Volatility Models via Bayesian Stochastic Search," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 342-355, July.
    11. Ryo Kato & Takahiro Hoshino, 2020. "Semiparametric Bayesian multiple imputation for regression models with missing mixed continuous–discrete covariates," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 803-825, June.
    12. Nandram, Balgobin & Zelterman, Daniel, 2007. "Computational Bayesian inference for estimating the size of a finite population," Computational Statistics & Data Analysis, Elsevier, vol. 51(6), pages 2934-2945, March.
    13. Fuentes-García, Ruth & Mena, Ramsés H. & Walker, Stephen G., 2009. "A nonparametric dependent process for Bayesian regression," Statistics & Probability Letters, Elsevier, vol. 79(8), pages 1112-1119, April.
    14. Daniel W Kennedy & Jessica Cameron & Paul P -Y Wu & Kerrie Mengersen, 2021. "Peer groups for organisational learning: Clustering with practical constraints," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-20, June.
    15. Laura Liu, 2017. "Density Forecasts in Panel Models: A semiparametric Bayesian Perspective," PIER Working Paper Archive 17-006, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 28 Apr 2017.
    16. Deschamps, Philippe J., 2012. "Bayesian estimation of generalized hyperbolic skewed student GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3035-3054.
    17. Hattam, Caroline & Holloway, Garth J., 2007. "Bayes Estimates of Time to Organic Certification," 81st Annual Conference, April 2-4, 2007, Reading University, UK 7979, Agricultural Economics Society.
    18. Peter F. Thall & Lurdes Y. T. Inoue & Thomas G. Martin, 2002. "Adaptive Decision Making in a Lymphocyte Infusion Trial," Biometrics, The International Biometric Society, vol. 58(3), pages 560-568, September.
    19. M. Ghosh & B. Carlin & M. Srivastava, 1995. "Probability matching priors for linear calibration," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 4(2), pages 333-357, December.
    20. Pang, Wan Kai & Yu, Bosco Wing-Tong & Troutt, Marvin D. & Hou, Shui Hung, 2008. "A simulation-based approach to the study of coefficient of variation of dividend yields," European Journal of Operational Research, Elsevier, vol. 189(2), pages 559-569, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:36:y:2021:i:1:d:10.1007_s00180-020-01000-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.