Bayes Estimate and Inference for Entropy and Information Index of Fit
This article defines a quantized entropy and develops Bayes estimates and inference for the entropy and a Kullback-Leibler information index of the model fit. We use a Dirichlet process prior for the unknown data-generating distribution with a maximum entropy candidate model as the expected distribution. This formulation produces prior and posterior distributions for the quantized entropy, the information index of fit, the moments, and the model parameters. The posterior mean of the quantized entropy provides a Bayes estimate of entropy under quadratic loss. The consistency of the Bayes estimates and the information index are shown. The implementation and the performances of the Bayes estimates are illustrated using data simulated from exponential, gamma, and lognormal distributions.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Volume (Year): 27 (2008)
Issue (Month): 4-6 ()
|Contact details of provider:|| Web page: http://www.tandfonline.com/LECR20|
|Order Information:||Web: http://www.tandfonline.com/pricing/journal/LECR20|
When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:27:y:2008:i:4-6:p:428-456. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ()
If references are entirely missing, you can add them using this form.