On the performance of the flexible maximum entropy distributions within partially adaptive estimation
AbstractThe partially adaptive estimation based on the assumed error distribution has emerged as a popular approach for estimating a regression model with non-normal errors. In this approach, if the assumed distribution is flexible enough to accommodate the shape of the true underlying error distribution, the efficiency of the partially adaptive estimator is expected to be close to the efficiency of the maximum likelihood estimator based on knowledge of the true error distribution. In this context, the maximum entropy distributions have attracted interest since such distributions have a very flexible functional form and nest most of the statistical distributions. Therefore, several flexible MaxEnt distributions under certain moment constraints are determined to use within the partially adaptive estimation procedure and their performances are evaluated relative to well-known estimators. The simulation results indicate that the determined partially adaptive estimators perform well for non-normal error distributions. In particular, some can be useful in dealing with small sample sizes. In addition, various linear regression applications with non-normal errors are provided.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal Computational Statistics & Data Analysis.
Volume (Year): 55 (2011)
Issue (Month): 6 (June)
Contact details of provider:
Web page: http://www.elsevier.com/locate/csda
Partially adaptive estimator Maximum entropy distribution Efficiency Non-normal error term;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- McDonald, James B., 1989. "Partially adaptive estimation of ARMA time series models," International Journal of Forecasting, Elsevier, vol. 5(2), pages 217-230.
- Hansen, James V. & McDonald, James B. & Turley, Robert S., 2006. "Partially adaptive robust estimation of regression models and applications," European Journal of Operational Research, Elsevier, vol. 170(1), pages 132-143, April.
- Sukant K. Misra & Jeannie Nelson, 2003. "Efficient Estimation of Agricultural Time Series Models with Nonnormal Dependent Variables," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(4), pages 1029-1040.
- Borra, Simone & Di Ciaccio, Agostino, 2010. "Measuring the prediction error. A comparison of cross-validation, bootstrap and covariance penalty methods," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 2976-2989, December.
- Butler, Richard J, et al, 1990. "Robust and Partially Adaptive Estimation of Regression Models," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 321-27, May.
- Wu, Ximing, 2003. "Calculation of maximum entropy densities with application to income distribution," Journal of Econometrics, Elsevier, vol. 115(2), pages 347-354, August.
- Brian Boyer & James McDonald & Whitney Newey, 2003. "A Comparison of Partially Adaptive and Reweighted Least Squares Estimation," Econometric Reviews, Taylor & Francis Journals, vol. 22(2), pages 115-134.
- Kim, Ji-Hyun, 2009. "Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 53(11), pages 3735-3745, September.
- Thanasis Stengos & Ximing Wu, 2005. "Partially Adaptive Estimation via Maximum Entropy Densities," University of Cyprus Working Papers in Economics 6-2005, University of Cyprus Department of Economics.
- D. Ormoneit & H. White, 1999. "An efficient algorithm to compute maximum entropy densities," Econometric Reviews, Taylor & Francis Journals, vol. 18(2), pages 127-140.
- McDonald, James B., 1991. "Parametric models for partially adaptive estimation with skewed and leptokurtic residuals," Economics Letters, Elsevier, vol. 37(3), pages 273-278, November.
- Lu Tian & Tianxi Cai & Els Goetghebeur & L. J. Wei, 2007. "Model evaluation based on the sampling distribution of estimated absolute prediction error," Biometrika, Biometrika Trust, vol. 94(2), pages 297-311.
- M. C. Jones & M. J. Faddy, 2003. "A skew extension of the "t"-distribution, with applications," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 159-174.
- Park, Sung Y. & Bera, Anil K., 2009. "Maximum entropy autoregressive conditional heteroskedasticity model," Journal of Econometrics, Elsevier, vol. 150(2), pages 219-230, June.
- Bartolucci, F. & Scaccia, L., 2005. "The use of mixtures for dealing with non-normal regression errors," Computational Statistics & Data Analysis, Elsevier, vol. 48(4), pages 821-834, April.
- Ximing Wu & Thanasis Stengos, 2005. "Partially adaptive estimation via the maximum entropy densities," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 352-366, December.
- Vicente Cancho & Víctor Lachos & Edwin Ortega, 2010. "A nonlinear regression model with skew-normal errors," Statistical Papers, Springer, vol. 51(3), pages 547-558, September.
- Shamilov, Aladdin, 2007. "Generalized entropy optimization problems and the existence of their solutions," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 382(2), pages 465-472.
- McDonald, James B. & Newey, Whitney K., 1988. "Partially Adaptive Estimation of Regression Models via the Generalized T Distribution," Econometric Theory, Cambridge University Press, vol. 4(03), pages 428-457, December.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.