Logistic Regression in Cases of Separation by Means of Penalized Maximum Likelihood Estimation
Users of –logit- or –logistic- occasionally encounter instances in which one or more predictors perfectly predict one or both outcomes (a condition called separation), or in which some outcomes are completely determined (quasicomplete separation). Finite maximum likelihood estimates do not exist under conditions of separation. Exact logistic regression with –exlogistic- can serve as an alternative in these circumstances, but is sometimes not feasible. In the 1990s, David Firth proposed a type of penalization for reducing bias of maximum likelihood estimates in generalized linear models by means of modifying the score equations. Firth’s method has the interpretation of penalized maximum likelihood when the canonical link function is used, such as in logistic regression. In this decade, Georg Heinze and colleagues have explored this technique as a solution to the problem of separation in logistic regression. A Stata implementation, -firthlogit-, which maximizes the log penalized likelihood using –ml-, is described here. Model fitting and predictions, inference with penalized likelihood ratio tests, and construction of profile penalized likelihood confidence intervals is illustrated using examples where –logit- and –logistic- either balk or do not give finite maximum likelihood estimates, and where exact logistic regression is problematic because of memory requirements or degenerate conditional distributions.
|Date of creation:||29 Jul 2008|
|Date of revision:||24 Sep 2008|
|Contact details of provider:|| Web page: http://stata.com/meeting/snasug08/|
More information through EDIRC
When requesting a correction, please mention this item's handle: RePEc:boc:nsug08:10. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F Baum)
If references are entirely missing, you can add them using this form.