Algorithms for Maximum Entropy Parameter Estimation
AbstractIn this paper, we consider a number of algorithms for estimating the parameters of ME models, including iterative scaling, gradient ascent, conjugate gradient, and variable metric methods. Surprisingly, the standardly used iterative scaling algorithms perform quite poorly in comparison to the others, and for all of the test problems, a limitedmemory variable metric algorithm outperformed the other choices. Maximum entropy (ME) models, variously known as log-linear, Gibbs, exponential, and multinomial logit models, provide a general purpose machine learning technique for classification and prediction which has been successfully applied to fields as diverse as computer vision and econometrics.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Ovidius University of Constantza, Faculty of Economic Sciences in its journal Ovidius University Annals, Economic Sciences Series.
Volume (Year): XI (2011)
Issue (Month): 2 (May)
Contact details of provider:
Web page: http://www.univ-ovidius.ro/facultatea-de-stiinte-economice
More information through EDIRC
GIS; entropy; ME models; probability; heuristic;
Find related papers by JEL classification:
- L63 - Industrial Organization - - Industry Studies: Manufacturing - - - Microelectronics; Computers; Communications Equipment
You can help add them by filling out this form.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jeflea Victor).
If references are entirely missing, you can add them using this form.