Information-Theoretic Distribution Test with Application to Normality
We derive general distribution tests based on the method of maximum entropy (ME) density. The proposed tests are derived from maximizing the differential entropy subject to given moment constraints. By exploiting the equivalence between the ME and maximum likelihood (ML) estimates for the general exponential family, we can use the conventional likelihood ratio (LR), Wald, and Lagrange multiplier (LM) testing principles in the maximum entropy framework. In particular, we use the LM approach to derive tests for normality. Monte Carlo evidence suggests that the proposed tests are compatible with and sometimes outperform some commonly used normality tests. We show that the proposed tests can be extended to tests based on regression residuals and non-i.i.d. data in a straightforward manner. An empirical example on production function estimation is presented.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Volume (Year): 29 (2010)
Issue (Month): 3 ()
|Contact details of provider:|| Web page: http://www.tandfonline.com/LECR20|
|Order Information:||Web: http://www.tandfonline.com/pricing/journal/LECR20|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Bontemps, Christian & Meddahi, Nour, 2005.
"Testing normality: a GMM approach,"
Journal of Econometrics,
Elsevier, vol. 124(1), pages 149-186, January.
- Christian BONTEMPS & Nour MEDDAHI, 2002. "Testing Normality : A Gmm Approach," Cahiers de recherche 14-2002, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
- Christian Bontemps & Nour Meddahi, 2002. "Testing Normality: A GMM Approach," CIRANO Working Papers 2002s-63, CIRANO.
- BONTEMPS, Christian & MEDDAHI, Nour, 2002. "Testing Normality : A GMM Approach," Cahiers de recherche 2002-14, Universite de Montreal, Departement de sciences economiques.
- Zellner, Arnold & Highfield, Richard A., 1988. "Calculation of maximum entropy distributions and approximation of marginalposterior distributions," Journal of Econometrics, Elsevier, vol. 37(2), pages 195-209, February.
- Gallant, A. Ronald, 1981. "On the bias in flexible functional forms and an essentially unbiased form : The fourier flexible form," Journal of Econometrics, Elsevier, vol. 15(2), pages 211-245, February.
- Thanasis Stengos & Yiguo Sun, 2006.
"The absolute health income hypothesis revisited: A Semiparametric Quantile Regression Approach,"
0606, University of Guelph, Department of Economics and Finance.
- Yiguo Sun & Thanasis Stengos, 2008. "The absolute health income hypothesis revisited: a semiparametric quantile regression approach," Empirical Economics, Springer, vol. 35(2), pages 395-412, September.
- Thanasis Stengos & Yiguo Sun, 2005. "The Absolute Health Income Hypothesis Revisited : A Semiparametric Quantile Regression Approach," University of Cyprus Working Papers in Economics 7-2005, University of Cyprus Department of Economics.
- Yiguo Sun & Thanasis Stengos, 2007. "The absolute health income hypothesis revisited: A Semiparametric Quantile Regression Approach," Working Paper Series 23_07, The Rimini Centre for Economic Analysis.
- Jushan Bai & Serena Ng, 2005.
"Tests for Skewness, Kurtosis, and Normality for Time Series Data,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 23, pages 49-60, January.
- Jushan Bai & Serena Ng, 2001. "Tests for Skewness, Kurtosis, and Normality for Time Series Data," Boston College Working Papers in Economics 501, Boston College Department of Economics.
- Wu, Ximing, 2003. "Calculation of maximum entropy densities with application to income distribution," Journal of Econometrics, Elsevier, vol. 115(2), pages 347-354, August.
- Guido W. Imbens & Phillip Johnson & Richard H. Spady, 1995.
"Information Theoretic Approaches to Inference in Moment Condition Models,"
Harvard Institute of Economic Research Working Papers
1736, Harvard - Institute of Economic Research.
- Guido W. Imbens & Richard H. Spady & Phillip Johnson, 1998. "Information Theoretic Approaches to Inference in Moment Condition Models," Econometrica, Econometric Society, vol. 66(2), pages 333-358, March.
- Imbens, G.W. & Johnson, P. & Spady, R.H., 1995. "Information Theoretic Approaches to Inference in Movement Condition Models," Economics Papers 99, Economics Group, Nuffield College, University of Oxford.
- Guido W Imbens, Phillip Johnson & Richard H Spady, "undated". "Information theoretic approaches to inference in moment condition model," Economics Papers W12., Economics Group, Nuffield College, University of Oxford.
- Guido W. Imbens & Phillip Johnson & Richard H. Spady, 1995. "Information Theoretic Approaches to Inference in Moment Condition Models," NBER Technical Working Papers 0186, National Bureau of Economic Research, Inc.
- White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
- D. Ormoneit & H. White, 1999. "An efficient algorithm to compute maximum entropy densities," Econometric Reviews, Taylor & Francis Journals, vol. 18(2), pages 127-140.
- Thanasis Stengos & Ximing Wu, 2005. "Partially Adaptive Estimation via Maximum Entropy Densities," University of Cyprus Working Papers in Economics 6-2005, University of Cyprus Department of Economics.
- Ximing Wu & Thanasis Stengos, 2005. "Partially adaptive estimation via the maximum entropy densities," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 352-366, December.
- Dalén, Jörgen, 1987. "Algebraic bounds on standardized sample moments," Statistics & Probability Letters, Elsevier, vol. 5(5), pages 329-331, August.
- Christensen, Laurits R & Greene, William H, 1976. "Economies of Scale in U.S. Electric Power Generation," Journal of Political Economy, University of Chicago Press, vol. 84(4), pages 655-676, August.
- Bera, Anil K. & Jarque, Carlos M., 1981. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals : Monte Carlo Evidence," Economics Letters, Elsevier, vol. 7(4), pages 313-318.
When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:29:y:2010:i:3:p:307-329. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ()
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.