IDEAS home Printed from https://ideas.repec.org/a/gam/jecnmx/v10y2022i1p5-d724895.html
   My bibliography  Save this article

An Entropy-Based Approach for Nonparametrically Testing Simple Probability Distribution Hypotheses

Author

Listed:
  • Ron Mittelhammer

    (School of Economic Sciences, Washington State University, Pullman, WA 99164, USA)

  • George Judge

    (Graduate School, University of California, Berkeley, CA 92093, USA)

  • Miguel Henry

    (Greylock McKinnon Associates, Boston, MA 02116, USA)

Abstract

In this paper, we introduce a flexible and widely applicable nonparametric entropy-based testing procedure that can be used to assess the validity of simple hypotheses about a specific parametric population distribution. The testing methodology relies on the characteristic function of the population probability distribution being tested and is attractive in that, regardless of the null hypothesis being tested, it provides a unified framework for conducting such tests. The testing procedure is also computationally tractable and relatively straightforward to implement. In contrast to some alternative test statistics, the proposed entropy test is free from user-specified kernel and bandwidth choices, idiosyncratic and complex regularity conditions, and/or choices of evaluation grids. Several simulation exercises were performed to document the empirical performance of our proposed test, including a regression example that is illustrative of how, in some contexts, the approach can be applied to composite hypothesis-testing situations via data transformations. Overall, the testing procedure exhibits notable promise, exhibiting appreciable increasing power as sample size increases for a number of alternative distributions when contrasted with hypothesized null distributions. Possible general extensions of the approach to composite hypothesis-testing contexts, and directions for future work are also discussed.

Suggested Citation

  • Ron Mittelhammer & George Judge & Miguel Henry, 2022. "An Entropy-Based Approach for Nonparametrically Testing Simple Probability Distribution Hypotheses," Econometrics, MDPI, vol. 10(1), pages 1-19, January.
  • Handle: RePEc:gam:jecnmx:v:10:y:2022:i:1:p:5-:d:724895
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2225-1146/10/1/5/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2225-1146/10/1/5/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Amengual, Dante & Carrasco, Marine & Sentana, Enrique, 2020. "Testing distributional assumptions using a continuum of moments," Journal of Econometrics, Elsevier, vol. 218(2), pages 655-689.
    2. Bera, Anil K. & Galvao, Antonio F. & Wang, Liang & Xiao, Zhijie, 2016. "A New Characterization Of The Normal Distribution And Test For Normality," Econometric Theory, Cambridge University Press, vol. 32(5), pages 1216-1252, October.
    3. Bera, Anil K & Jarque, Carlos M & Lee, Lung-Fei, 1984. "Testing the Normality Assumption in Limited Dependent Variable Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 25(3), pages 563-578, October.
    4. Lee, Lung-Fei, 1984. "Tests for the Bivariate Normal Distribution in Econometric Models with Selectivity," Econometrica, Econometric Society, vol. 52(4), pages 843-863, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriel Montes-Rojas, 2011. "Robust Misspecification Tests for the Heckman's Two-Step Estimator," Econometric Reviews, Taylor & Francis Journals, vol. 30(2), pages 154-172.
    2. Michael Pfaffermayr, 2014. "A GMM-Based Test for Normal Disturbances of the Heckman Sample Selection Model," Econometrics, MDPI, vol. 2(4), pages 1-18, October.
    3. repec:cty:dpaper:10.1080/07474938.2011.534035 is not listed on IDEAS
    4. Lahiri, Kajal & Song, Jae G., 1999. "Testing for normality in a probit model with double selection," Economics Letters, Elsevier, vol. 65(1), pages 33-39, October.
    5. Cheti Nicoletti & Marco Francesconi, 2006. "Intergenerational mobility and sample selection in short panels," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(8), pages 1265-1293.
    6. Riccardo Lucchetti & Claudia Pigini, 2013. "A test for bivariate normality with applications in microeconometric models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 22(4), pages 535-572, November.
    7. repec:cty:dpaper:1479 is not listed on IDEAS
    8. Stefano Puddu & Andreas Waelchli, 2015. "TAF Effect on Liquidity Risk Exposure," IRENE Working Papers 15-07, IRENE Institute of Economic Research.
    9. Riccardo LUCCHETTI & Claudia PIGINI, 2011. "Conditional Moment Tests for Normality in Bivariate Limited Dependent Variable Models: a Monte Carlo Study," Working Papers 357, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    10. Catherine Sofer & Natalia Radtchenko & Ekaterina Kalugina, 2008. "Une analyse du partage intra familial du revenu à partir de données subjectives," Économie et Prévision, Programme National Persée, vol. 186(5), pages 101-116.
    11. Verbeek, M.J.C.M. & Nijman, T.E., 1993. "Testing for selectivity bias in panel data models," Other publications TiSEM 45c3a75b-eb19-456f-ba92-a, Tilburg University, School of Economics and Management.
    12. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    13. Ye, Xin & Garikapati, Venu M. & You, Daehyun & Pendyala, Ram M., 2017. "A practical method to test the validity of the standard Gumbel distribution in logit-based multinomial choice models of travel behavior," Transportation Research Part B: Methodological, Elsevier, vol. 106(C), pages 173-192.
    14. Humphery-Jenner, M., 2011. "Anti-takeover Provisions as a Source of Innovation and Value Creation," Discussion Paper 2011-045, Tilburg University, Center for Economic Research.
    15. Martin Browning & Anne Moller Dano & Eskil Heinesen, 2006. "Job displacement and stress‐related health outcomes," Health Economics, John Wiley & Sons, Ltd., vol. 15(10), pages 1061-1075, October.
    16. Jose Miguel Benavente, 2006. "The role of research and innovation in promoting productivity in chile," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 15(4-5), pages 301-315.
    17. Murphy, Anthony, 2007. "Score tests of normality in bivariate probit models," Economics Letters, Elsevier, vol. 95(3), pages 374-379, June.
    18. Per G. Fredriksson & Jim R. Wollscheid, 2018. "Legal origins and environmental policies: evidence from OECD and developing countries," Letters in Spatial and Resource Sciences, Springer, vol. 11(3), pages 369-375, October.
    19. Inés Hardoy & Pål Schøne, 2014. "Does the impact of plant closure on labour market attachment differ between immigrants and native workers across the business cycle?," Empirical Economics, Springer, vol. 46(1), pages 229-252, February.
    20. Lechner, Michael & Smith, Jeffrey, 2007. "What is the value added by caseworkers?," Labour Economics, Elsevier, vol. 14(2), pages 135-151, April.
    21. Gabriele Fiorentini & Enrique Sentana, 2021. "Specification tests for non‐Gaussian maximum likelihood estimators," Quantitative Economics, Econometric Society, vol. 12(3), pages 683-742, July.
    22. Melenberg, B. & Van Soest, A., 1993. "Semi-Parametric Estimation on the Sample Selection Model," Papers 9334, Tilburg - Center for Economic Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecnmx:v:10:y:2022:i:1:p:5-:d:724895. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.