IDEAS home Printed from https://ideas.repec.org/p/ulp/sbbeta/2006-10.html

Partial Likelihood Estimation of a Cox Model with Random Effects: an EM Algorithm based on Penalized Likelihood

Author

Listed:
  • Guillaume Horny

Abstract

The aim of this paper is to present a general EM algorithm to estimate Mixed Proportional Hazard models including more than one random effect, through partial likelihood. We assume only that the mixing distributions admit Laplace transforms. We show how to transform inference in a single complicated model in the estimation of MPH models involving only a single frailty, which are easily manageable. We then face on gamma unobserved heterogeneity. This choice is a weak assumption as the heterogeneity distribution among survivors converges to a gamma distribution, often quickly, for many types of unobserved heterogeneity distributions. The proposed approach can thus be used to estimate a wide class of models. We describe how to use the penalized partial likelihood within the EM algorithm, to improve speed and stability. The behaviour of the estimator on different clusterings and sample sizes is assessed through a Monte Carlo study. We also provide an application on the ratiffcation of ILO conventions by developing countries over the period 1975-1995. Both the simulations and the empirical results indicate an important decrease in computing time. Furthermore, our procedure converges in settings where a standard EM algorithm does not.

Suggested Citation

  • Guillaume Horny, 2006. "Partial Likelihood Estimation of a Cox Model with Random Effects: an EM Algorithm based on Penalized Likelihood," Working Papers of BETA 2006-10, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    • Handle: RePEc:ulp:sbbeta:2006-10
    as

    Download full text from publisher

    File URL: http://beta.u-strasbg.fr/WP/2006/2006-10.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. J.J. Heckman & E.E. Leamer (ed.), 2001. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 5, number 5.
    2. Van den Berg, Gerard J., 2001. "Duration models: specification, identification and multiple durations," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 55, pages 3381-3460, Elsevier.
    3. Vu, Hien T. V. & Knuiman, Matthew W., 2002. "A hybrid ML-EM algorithm for calculation of maximum likelihood estimates in semiparametric shared frailty models," Computational Statistics & Data Analysis, Elsevier, vol. 40(1), pages 173-187, July.
    4. Heckman, James J. & Singer, Burton, 1984. "Econometric duration analysis," Journal of Econometrics, Elsevier, vol. 24(1-2), pages 63-132.
    5. Kelvin K. W. Yau, 2001. "Multilevel Models for Survival Analysis with Random Effects," Biometrics, The International Biometric Society, vol. 57(1), pages 96-102, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andreas Groll & Gerhard Tutz, 2017. "Variable selection in discrete survival models including heterogeneity," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 23(2), pages 305-338, April.
    2. Hess, Wolfgang & Persson, Maria, 2010. "The Duration of Trade Revisited. Continuous-Time vs. Discrete-Time Hazards," Working Papers 2010:1, Lund University, Department of Economics.
    3. Arkadiusz Szydlowski, 2015. "Endogenous Censoring in the Mixed Proportional Hazard Model with an Application to Optimal Unemployment Insurance," Discussion Papers in Economics 15/06, Division of Economics, School of Business, University of Leicester.
    4. Yolanda Rebollo Sanz, 2009. "Landing a Permanent Contract: Do Job Interruptions and Employer Diversification Matter?," Working Papers 09.07, Universidad Pablo de Olavide, Department of Economics.
    5. Jaap H. Abbring & Gerard J. Van Den Berg, 2007. "The unobserved heterogeneity distribution in duration analysis," Biometrika, Biometrika Trust, vol. 94(1), pages 87-99.
    6. Lau, John W., 2006. "Bayesian semi-parametric modeling for mixed proportional hazard models with right censoring," Statistics & Probability Letters, Elsevier, vol. 76(7), pages 719-728, April.
    7. Hess, Wolfgang & Persson, Maria, 2009. "Survival and Death in International Trade - Discrete-Time Durations of EU Imports," Working Papers 2009:12, Lund University, Department of Economics.
    8. Botosaru, Irene, 2020. "Nonparametric analysis of a duration model with stochastic unobserved heterogeneity," Journal of Econometrics, Elsevier, vol. 217(1), pages 112-139.
    9. Falavigna Falavigna & Elena Ragazzi & Lisa Sella, "undated". "Vocational training and labour market: inclusion or segregation paths? An integrated approach on immigrant trainees in Piedmont," CERIS Working Paper 201425, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    10. Kyyrä, Tomi, 2007. "Studies on Wage Differentials and Labour Market Transitions," Research Reports 133, VATT Institute for Economic Research.
    11. Jaap Abbring & James Heckman, 2008. "Dynamic policy analysis," CeMMAP working papers CWP05/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    12. Jean-Pierre Florens & Denis Fougère & Julien Pouget & Michel Mouchart, 2007. "Duration Models and Point Processes," Working Papers 2007-37, Center for Research in Economics and Statistics.
    13. Guillaume Horny, 2009. "Inference in mixed proportional hazard models with K random effects," Statistical Papers, Springer, vol. 50(3), pages 481-499, June.
    14. van den Berg, Gerard J. & Back Kjaersgaard, Lene & Rosholm, Michael, 2014. "To meet or not to meet, that is the question - short-run effects of high-frequency meetings with case workers," Working Paper Series 2014:6, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    15. Joshua S. Gans & David H. Hsu & Scott Stern, 2008. "The Impact of Uncertain Intellectual Property Rights on the Market for Ideas: Evidence from Patent Grant Delays," Management Science, INFORMS, vol. 54(5), pages 982-997, May.
    16. Wienke, Andreas & Kuss, Oliver, 2009. "Random effects Weibull regression model for occupational lifetime," European Journal of Operational Research, Elsevier, vol. 196(3), pages 1249-1250, August.
    17. Nicoletti, Cheti & Rondinelli, Concetta, 2010. "The (mis)specification of discrete duration models with unobserved heterogeneity: A Monte Carlo study," Journal of Econometrics, Elsevier, vol. 159(1), pages 1-13, November.
    18. Brinch, Christian N., 2007. "Nonparametric Identification Of The Mixed Hazards Model With Time-Varying Covariates," Econometric Theory, Cambridge University Press, vol. 23(2), pages 349-354, April.
    19. Nicoletti, Cheti & Rondinelli, Concetta, 2006. "The (mis)specification of discrete time duration models with unobserved heterogenity: a Monte Carlo study," ISER Working Paper Series 2006-53, Institute for Social and Economic Research.
    20. Hausman, Jerry A. & Woutersen, Tiemen, 2014. "Estimating a semi-parametric duration model without specifying heterogeneity," Journal of Econometrics, Elsevier, vol. 178(P1), pages 114-131.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ulp:sbbeta:2006-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge The email address of this maintainer does not seem to be valid anymore. Please ask the person in charge to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/bestrfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.