Partially Adaptive Estimation via Maximum Entropy Densities
AbstractWe propose a partially adaptive estimator based on information theoretic maximum entropy estimates of the error distribution. The maximum entropy (maxent) densities have simple yet flexible functional forms to nest most of the mathematical distributions. Unlike the nonparametric fully adaptive estimators, our parametric estimators do not involve choosing a bandwidth or trimming, and only require estimating a small number of nuisance parameters, which is desirable when the sample size is small. Monte Carlo simulations suggest that the proposed estimators fare well with non-normal error distributions. When the errors are normal, the efficiency loss due to redundant nuisance parameters is negligible as the proposed error densities nest the normal. The proposed partially adaptive estimator compares favorably with existing methods, especially when the sample size is small. We apply the estimator to a bio-pharmaceutical example and a stochastic frontier model.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University of Cyprus Department of Economics in its series University of Cyprus Working Papers in Economics with number 6-2005.
Length: 25 pages
Date of creation: Oct 2005
Date of revision:
Contact details of provider:
Web page: http://www.econ.ucy.ac.cy
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Linton, Oliver, 1993.
"Adaptive Estimation in ARCH Models,"
Cambridge University Press, vol. 9(04), pages 539-569, August.
- Newey, Whitney K., 1988. "Adaptive estimation of regression models via moment restrictions," Journal of Econometrics, Elsevier, vol. 38(3), pages 301-339, July.
- McDonald, James B., 1989. "Partially adaptive estimation of ARMA time series models," International Journal of Forecasting, Elsevier, vol. 5(2), pages 217-230.
- Gallant, A. Ronald, 1981. "On the bias in flexible functional forms and an essentially unbiased form : The fourier flexible form," Journal of Econometrics, Elsevier, vol. 15(2), pages 211-245, February.
- Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
- McDonald, James B. & Newey, Whitney K., 1988. "Partially Adaptive Estimation of Regression Models via the Generalized T Distribution," Econometric Theory, Cambridge University Press, vol. 4(03), pages 428-457, December.
- Li, Qi & Stengos, Thanasis, 1994.
"Adaptive Estimation in the Panel Data Error Component Model with Heteroskedasticity of Unknown Form,"
International Economic Review,
Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(4), pages 981-1000, November.
- Stengos, T. & Li, Q., 1993. "Adaptive Estimation in the Panel Data Error Component Model with Heteroskedasticity of Unknown Form," Working Papers 1993-4, University of Guelph, Department of Economics and Finance.
- Phillips, Robert F., 1994. "Partially adaptive estimation via a normal mixture," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 123-144.
- Steigerwald, Douglas G., 1992. "On the finite sample behavior of adaptive estimators," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 371-400.
- Greene, William H., 1990. "A Gamma-distributed stochastic frontier model," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 141-163.
- Wu, Ximing & Perloff, Jeffrey M., 2007. "GMM estimation of a maximum entropy distribution with interval data," Journal of Econometrics, Elsevier, vol. 138(2), pages 532-546, June.
- Christensen, Laurits R & Greene, William H, 1976. "Economies of Scale in U.S. Electric Power Generation," Journal of Political Economy, University of Chicago Press, vol. 84(4), pages 655-76, August.
- Wu, Ximing, 2003. "Calculation of maximum entropy densities with application to income distribution," Journal of Econometrics, Elsevier, vol. 115(2), pages 347-354, August.
- Steven Caudill, 2012. "A partially adaptive estimator for the censored regression model based on a mixture of normal distributions," Statistical Methods and Applications, Springer, vol. 21(2), pages 121-137, June.
- Usta, Ilhan & Kantar, Yeliz Mert, 2011. "On the performance of the flexible maximum entropy distributions within partially adaptive estimation," Computational Statistics & Data Analysis, Elsevier, vol. 55(6), pages 2172-2182, June.
- Pendharkar, Parag C., 2008. "Maximum entropy and least square error minimizing procedures for estimating missing conditional probabilities in Bayesian networks," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3583-3602, March.
- Thanasis Stengos & Ximing Wu, 2010.
"Information-Theoretic Distribution Test with Application to Normality,"
Taylor & Francis Journals, vol. 29(3), pages 307-329.
- Thanasis Stengos & Ximing Wu, 2006. "Information-Theoretic Distribution Test with Application to Normality," University of Cyprus Working Papers in Economics 3-2006, University of Cyprus Department of Economics.
- Thanasis Stengos & Ximing Wu, 2006. "Information-Theoretic Distribution Test with Application to Normality," Working Papers 0604, University of Guelph, Department of Economics and Finance.
- Rompolis, Leonidas S., 2010. "Retrieving risk neutral densities from European option prices based on the principle of maximum entropy," Journal of Empirical Finance, Elsevier, vol. 17(5), pages 918-937, December.
- Thanasis Stengos & Ximing Wu†, 2007. "We derive general distribution tests based on the method of Maximum Entropy density," Working Paper Series 24-07, The Rimini Centre for Economic Analysis, revised Jul 2007.
- Steven Caudill & James Long, 2010. "Do former athletes make better managers? Evidence from a partially adaptive grouped-data regression model," Empirical Economics, Springer, vol. 39(1), pages 275-290, August.
- Wu, Ximing & Perloff, Jeffrey M., 2005. "GMM Estimation of a Maximum Distribution With Interval Data," Institute for Research on Labor and Employment, Working Paper Series qt7jf5w1ht, Institute of Industrial Relations, UC Berkeley.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.