Information-Theoretic Distribution Test with Application to Normality
We derive general distribution tests based on the method of maximum entropy (ME) density. The proposed tests are derived from maximizing the differential entropy subject to given moment constraints. By exploiting the equivalence between the ME and maximum likelihood (ML) estimates for the general exponential family, we can use the conventional likelihood ratio (LR), Wald, and Lagrange multiplier (LM) testing principles in the maximum entropy framework. In particular, we use the LM approach to derive tests for normality. Monte Carlo evidence suggests that the proposed tests are compatible with and sometimes outperform some commonly used normality tests. We show that the proposed tests can be extended to tests based on regression residuals and non-i.i.d. data in a straightforward manner. An empirical example on production function estimation is presented.
Volume (Year): 29 (2010)
Issue (Month): 3 ()
|Contact details of provider:|| Web page: http://www.tandfonline.com/LECR20|
|Order Information:||Web: http://www.tandfonline.com/pricing/journal/LECR20|
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Bera, Anil K. & Jarque, Carlos M., 1981. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals : Monte Carlo Evidence," Economics Letters, Elsevier, vol. 7(4), pages 313-318.
- Thanasis Stengos & Yiguo Sun, 2006.
"The absolute health income hypothesis revisited: A Semiparametric Quantile Regression Approach,"
0606, University of Guelph, Department of Economics and Finance.
- Thanasis Stengos & Yiguo Sun, 2005. "The Absolute Health Income Hypothesis Revisited : A Semiparametric Quantile Regression Approach," University of Cyprus Working Papers in Economics 7-2005, University of Cyprus Department of Economics.
- Yiguo Sun & Thanasis Stengos, 2007. "The absolute health income hypothesis revisited: A Semiparametric Quantile Regression Approach," Working Paper Series 23_07, The Rimini Centre for Economic Analysis.
- Ximing Wu & Thanasis Stengos, 2005. "Partially adaptive estimation via the maximum entropy densities," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 352-366, December.
- Wu, Ximing, 2003. "Calculation of maximum entropy densities with application to income distribution," Journal of Econometrics, Elsevier, vol. 115(2), pages 347-354, August.
- BONTEMPS, Christian & MEDDAHI, Nour, 2002.
"Testing Normality : A GMM Approach,"
Cahiers de recherche
2002-14, Universite de Montreal, Departement de sciences economiques.
- Christensen, Laurits R & Greene, William H, 1976. "Economies of Scale in U.S. Electric Power Generation," Journal of Political Economy, University of Chicago Press, vol. 84(4), pages 655-676, August.
- Guido W. Imbens & Phillip Johnson & Richard H. Spady, 1995.
"Information Theoretic Approaches to Inference in Moment Condition Models,"
NBER Technical Working Papers
0186, National Bureau of Economic Research, Inc.
- Guido W. Imbens & Richard H. Spady & Phillip Johnson, 1998. "Information Theoretic Approaches to Inference in Moment Condition Models," Econometrica, Econometric Society, vol. 66(2), pages 333-358, March.
- Guido W. Imbens & Phillip Johnson & Richard H. Spady, 1995. "Information Theoretic Approaches to Inference in Moment Condition Models," Harvard Institute of Economic Research Working Papers 1736, Harvard - Institute of Economic Research.
- Guido W Imbens, Phillip Johnson & Richard H Spady, "undated". "Information theoretic approaches to inference in moment condition model," Economics Papers W12., Economics Group, Nuffield College, University of Oxford.
- Imbens, G.W. & Johnson, P. & Spady, R.H., 1995. "Information Theoretic Approaches to Inference in Movement Condition Models," Economics Papers 99, Economics Group, Nuffield College, University of Oxford.
- Thanasis Stengos & Ximing Wu, 2005. "Partially Adaptive Estimation via Maximum Entropy Densities," University of Cyprus Working Papers in Economics 6-2005, University of Cyprus Department of Economics.
- Jushan Bai & Serena Ng, 2001.
"Tests for Skewness, Kurtosis, and Normality for Time Series Data,"
Boston College Working Papers in Economics
501, Boston College Department of Economics.
- Jushan Bai & Serena Ng, 2005. "Tests for Skewness, Kurtosis, and Normality for Time Series Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 49-60, January.
- Dalén, Jörgen, 1987. "Algebraic bounds on standardized sample moments," Statistics & Probability Letters, Elsevier, vol. 5(5), pages 329-331, August.
- White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
- D. Ormoneit & H. White, 1999. "An efficient algorithm to compute maximum entropy densities," Econometric Reviews, Taylor & Francis Journals, vol. 18(2), pages 127-140.
- Zellner, Arnold & Highfield, Richard A., 1988. "Calculation of maximum entropy distributions and approximation of marginalposterior distributions," Journal of Econometrics, Elsevier, vol. 37(2), pages 195-209, February.
- Gallant, A. Ronald, 1981. "On the bias in flexible functional forms and an essentially unbiased form : The fourier flexible form," Journal of Econometrics, Elsevier, vol. 15(2), pages 211-245, February.
When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:29:y:2010:i:3:p:307-329. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ()
If references are entirely missing, you can add them using this form.