Constrained EM algorithm with projection method
This paper proposes a new step called the P-step to handle the linear or nonlinear equality constraint in addition to the conventional EM algorithm. This new step is easy to implement, first because only the first derivatives of the object function and the constraint function are necessary, and secondly, because the P-step is carried out after the conventional EM algorithm. The estimate sequence produced by our method enjoys a monotonic increase in the observed likelihood function. We apply the P-step in addition to the conventional EM algorithm to the two illustrative examples. The first example has a linear constraint function. The second has a nonlinear constraint function. We show finally that there exists a Kuhn–Tucker vector at the limit point produced by our method. Copyright Springer-Verlag 2012
Volume (Year): 27 (2012)
Issue (Month): 4 (December)
|Contact details of provider:|| Web page: http://www.springerlink.com/link.asp?id=120306|
|Order Information:||Web: http://link.springer.de/orders.htm|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Jamshidian, Mortaza, 2004. "On algorithms for restricted maximum likelihood estimation," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 137-157, March.
- Sik-Yum Lee & Sin-Yu Tsang, 1999. "Constrained maximum likelihood estimation of two-level covariance structure model via EM type algorithms," Psychometrika, Springer, vol. 64(4), pages 435-450, December.
- Celeux, Gilles & Govaert, Gerard, 1992. "A classification EM algorithm for clustering and two stochastic versions," Computational Statistics & Data Analysis, Elsevier, vol. 14(3), pages 315-332, October.
- Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer, vol. 47(1), pages 69-76, March.
When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:27:y:2012:i:4:p:701-714. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Guenther Eichhorn)or (Christopher F Baum)
If references are entirely missing, you can add them using this form.