IDEAS home Printed from https://ideas.repec.org/p/cir/cirwor/2026s-15.html

Regularized goodness-of-fit statistics and exact nonparametric confidence bands for distributions with application to household consumption

Author

Listed:
  • Jean-Marie Dufour
  • Mame Astou Diouf

Abstract

We study from a finite-sample viewpoint the problem of building tests and simultaneous confidence bands for cumulative distribution functions (CDFs), continuous or discrete. We emphasize procedures based on reweighted empirical distribution function (EDF) with shrinking bandwidths in the tails of the distribution. Since weighted statistics may have a problematic behavior when scaling factors are small (or zero), we propose to use regularized statistics. We consider a wide class set of modified EDF-type statistics, and give general characterizations of their distributions in the case of i.i.d. observations, so that the relevant distributions can be simulated in finite samples. We show that test criteria in the class studied can be implemented through the technique of Monte Carlo tests (MCT), so that the level is fully controlled in finite samples, irrespective of whether the tested distribution is continuous or discrete, without the need to establish an asymptotic distribution. Standard criteria such as the Kolmogorov-Smirnov (KS), Anderson-Darling (AD), Eicker (E), and Berk– Jones (BJ) statistics are covered as special cases. Confidence bands are built by inverting sup-type goodness-of-fit test statistics. We show that the bands based on regularized AD-type and E-type statistics have closed forms which are especially easy to compute, without nonlinear optimization. For continuous variables, the null distributions of the statistics do not depend on the CDF tested. For noncontinuous distributions, we show that the MCT approach transparently controls test levels irrespective of the distribution tested. We also establish monotonicity properties (based on nesting image sets) and a general dominance result, so continuous critical values are valid (conservative) critical points. We show in Monte Carlo simulations that the proposed regularized goodness-of-fit tests and confidence bands are numerically tractable, reliable and yield power and precision improvements over standard procedures. The proposed methods are applied to the distribution of households’ consumption in Kenya. Nous étudions, dans une perspective d'échantillons finis, le problème de la construction de tests et de bandes de confiance simultanées pour les fonctions de distribution cumulées (FDC), qu'elles soient continues ou discrètes. Nous mettons l'accent sur les procédures basées sur la fonction de distribution empirique (FDE) repondérée, avec des largeurs de bande décroissantes dans les queues de la distribution. Étant donné que les statistiques pondérées peuvent présenter un comportement problématique lorsque les facteurs d'échelle sont faibles (ou nuls), nous proposons d'utiliser des statistiques régularisées. Nous considérons une vaste classe de statistiques de type EDF modifiées et donnons des caractérisations générales de leurs distributions dans le cas d’observations i.i.d., de sorte que les distributions concernées puissent être simulées dans des échantillons finis. Nous montrons que les critères de test de la classe étudiée peuvent être mis en œuvre à l’aide de la technique des tests de Monte Carlo (MCT), de sorte que le niveau de confiance soit entièrement contrôlé dans des échantillons finis, que la distribution testée soit continue ou discrète, sans qu’il soit nécessaire d’établir une distribution asymptotique. Les critères standard tels que les statistiques de Kolmogorov-Smirnov (KS), d’Anderson-Darling (AD), d’Eicker (E) et de Berk–Jones (BJ) sont traités comme des cas particuliers. Les intervalles de confiance sont construits en inversant les statistiques de test d’adéquation de type sup. Nous montrons que les bandes basées sur les statistiques régularisées de type AD et de type E ont des formes fermées particulièrement faciles à calculer, sans optimisation non linéaire. Pour les variables continues, les distributions nulles des statistiques ne dépendent pas de la fonction de distribution cumulative (FDC) testée. Pour les distributions non continues, nous montrons que l’approche MCT permet de contrôler de manière transparente le niveau de signification, quelle que soit la distribution testée. Nous établissons également des propriétés de monotonie (basées sur des ensembles d’images imbriquées) et un résultat général de dominance, de sorte que les valeurs critiques continues constituent des points critiques valides (conservateurs). Nous montrons, à l’aide de simulations de Monte Carlo, que les tests de bon ajustement régularisés et les intervalles de confiance proposés sont numériquement gérables, fiables et permettent d’améliorer la puissance et la précision par rapport aux procédures standard. Les méthodes proposées sont appliquées à la distribution de la consommation des ménages au Kenya.

Suggested Citation

  • Jean-Marie Dufour & Mame Astou Diouf, 2026. "Regularized goodness-of-fit statistics and exact nonparametric confidence bands for distributions with application to household consumption," CIRANO Working Papers 2026s-15, CIRANO.
  • Handle: RePEc:cir:cirwor:2026s-15
    as

    Download full text from publisher

    File URL: https://cirano.qc.ca/files/publications/2026s-15.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Singh, S K & Maddala, G S, 1976. "A Function for Size Distribution of Incomes," Econometrica, Econometric Society, vol. 44(5), pages 963-970, September.
    2. Donald W. K. Andrews, 1997. "A Conditional Kolmogorov Test," Econometrica, Econometric Society, vol. 65(5), pages 1097-1128, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dickens, Richard & Machin, Stephen & Manning, Alan, 1998. "Estimating the effect of minimum wages on employment from the distribution of wages: A critical view," Labour Economics, Elsevier, vol. 5(2), pages 109-134, June.
    2. Jinhyun Lee, 2013. "A Consistent Nonparametric Bootstrap Test of Exogeneity," Discussion Paper Series, School of Economics and Finance 201316, School of Economics and Finance, University of St Andrews.
    3. Juan Mora & Antonia Febrer, 2005. "Wage Distribution In Spain, 1994-1999: An Application Of A Flexible Estimator Of Conditional Distributions," Working Papers. Serie EC 2005-04, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    4. Corradi, Valentina & Swanson, Norman R., 2004. "A test for the distributional comparison of simulated and historical data," Economics Letters, Elsevier, vol. 85(2), pages 185-193, November.
    5. Oliver Linton & Pedro Gozalo, 1996. "Conditional Independence Restrictions: Testing and Estimation," Cowles Foundation Discussion Papers 1140, Cowles Foundation for Research in Economics, Yale University.
    6. Sarabia, José María, 2008. "A general definition of the Leimkuhler curve," Journal of Informetrics, Elsevier, vol. 2(2), pages 156-163.
    7. Fabio Clementi & Mauro Gallegati & Giorgio Kaniadakis, 2010. "A model of personal income distribution with application to Italian data," Empirical Economics, Springer, vol. 39(2), pages 559-591, October.
    8. Dai, Shengtao & Song, Xiaojun, 2025. "Consistent tests for semiparametric conditional independence," Statistics & Probability Letters, Elsevier, vol. 216(C).
    9. Fabio Fiorillo & Agnese Sacchi, 2012. "The Political Economy of the Standard Level of Services: The Role of Income Distribution," CESifo Working Paper Series 3696, CESifo.
    10. Schluter, Christian & van Garderen, Kees Jan, 2009. "Edgeworth expansions and normalizing transforms for inequality measures," Journal of Econometrics, Elsevier, vol. 150(1), pages 16-29, May.
    11. van den Berg, Gerard J., 2007. "On the uniqueness of optimal prices set by monopolistic sellers," Journal of Econometrics, Elsevier, vol. 141(2), pages 482-491, December.
    12. Fisher, Mark & Jensen, Mark J., 2022. "Bayesian nonparametric learning of how skill is distributed across the mutual fund industry," Journal of Econometrics, Elsevier, vol. 230(1), pages 131-153.
    13. Vladimir Hlasny, 2021. "Parametric representation of the top of income distributions: Options, historical evidence, and model selection," Journal of Economic Surveys, Wiley Blackwell, vol. 35(4), pages 1217-1256, September.
    14. Pesendorfer, Martin & Takahashi, Yuya & Otsu, Taisuke, 2014. "Testing Equilibrium Multiplicity in Dynamic Games," CEPR Discussion Papers 10111, Centre for Economic Policy Research.
    15. Sherrick, Bruce J. & Forster, D. Lynn & Irwin, Scott H., "undated". "The Calibration Of Expected Soybean Price Distributions: An Option Based Approach," 1990 Annual meeting, August 5-8, Vancouver, Canada 270919, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    16. Michał Brzeziński, 2013. "Parametric Modelling of Income Distribution in Central and Eastern Europe," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 5(3), pages 207-230, September.
    17. Masato Okamoto, 2014. "Interpolating the Lorenz Curve: Methods to Preserve Shape and Remain Consistent with the Concentration Curves for Components," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 60(2), pages 349-384, June.
    18. Manuel A. Dominguez & Ignacio N. Lobato, 2001. "A Consistent Test for the Martingale Difference Hypothesis," Working Papers 0101, Centro de Investigacion Economica, ITAM.
    19. Corradi, Valentina & Swanson, Norman R., 2005. "Bootstrap specification tests for diffusion processes," Journal of Econometrics, Elsevier, vol. 124(1), pages 117-148, January.
    20. Andreou, E. & Werker, B.J.M., 2003. "A Simple Asymptotic Analysis of Residual-Based Statistics," Other publications TiSEM 9fe68e51-a026-4660-b6e7-8, Tilburg University, School of Economics and Management.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C3 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • G1 - Financial Economics - - General Financial Markets
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2026s-15. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Webmaster (email available below). General contact details of provider: https://edirc.repec.org/data/ciranca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.