IDEAS home Printed from https://ideas.repec.org/p/upf/upfgen/281.html
   My bibliography  Save this paper

Inequalities for a new data-based method for selecting nonparametric density estimates

Author

Abstract

We continue the development of a method for the selection of a bandwidth or a number of design parameters in density estimation. We provide explicit non-asymptotic density-free inequalities that relate the $L_1$ error of the selected estimate with that of the best possible estimate, and study in particular the connection between the richness of the class of density estimates and the performance bound. For example, our method allows one to pick the bandwidth and kernel order in the kernel estimate simultaneously and still assure that for {\it all densities}, the $L_1$ error of the corresponding kernel estimate is not larger than about three times the error of the estimate with the optimal smoothing factor and kernel plus a constant times $\sqrt{\log n/n}$, where $n$ is the sample size, and the constant only depends on the complexity of the family of kernels used in the estimate. Further applications include multivariate kernel estimates, transformed kernel estimates, and variable kernel estimates.

Suggested Citation

  • Luc Devroye & Gábor Lugosi & Frederic Udina, 1998. "Inequalities for a new data-based method for selecting nonparametric density estimates," Economics Working Papers 281, Department of Economics and Business, Universitat Pompeu Fabra.
  • Handle: RePEc:upf:upfgen:281
    as

    Download full text from publisher

    File URL: https://econ-papers.upf.edu/papers/281.pdf
    File Function: Whole Paper
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Devroye, Luc, 1982. "Bounds for the uniform deviation of empirical measures," Journal of Multivariate Analysis, Elsevier, vol. 12(1), pages 72-79, March.
    2. Duc Devroye & J. Beirlant & R. Cao & R. Fraiman & P. Hall & M. Jones & Gábor Lugosi & E. Mammen & J. Marron & C. Sánchez-Sellero & J. Uña & F. Udina & L. Devroye, 1997. "Universal smoothing factor selection in density estimation: theory and practice," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 6(2), pages 223-320, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cristina Butucea, 2001. "Numerical results concerning a sharp adaptive density estimator," Computational Statistics, Springer, vol. 16(2), pages 271-298, July.
    2. Luc Devroye & Gábor Lugosi, 1998. "Variable Kernel estimates: On the impossibility of tuning the parameters," Economics Working Papers 325, Department of Economics and Business, Universitat Pompeu Fabra.
    3. Luc Devroye & Gábor Lugosi, 1999. "Almost sure testability of classes of densities," Economics Working Papers 375, Department of Economics and Business, Universitat Pompeu Fabra.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. Liao & Yujun Wu & Yong Lin, 2010. "Improving Sheather and Jones’ bandwidth selector for difficult densities in kernel density estimation," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(1), pages 105-114.
    2. Langrené, Nicolas & Warin, Xavier, 2021. "Fast multivariate empirical cumulative distribution function with connection to kernel density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 162(C).
    3. Pal, Soumik, 2007. "Computing strategies for achieving acceptability: A Monte Carlo approach," Stochastic Processes and their Applications, Elsevier, vol. 117(11), pages 1587-1605, November.
    4. Horová Ivana & Vieu Philippe & Zelinka Jiří, 2002. "Optimal Choice Of Nonparametric Estimates Of A Density And Of Its Derivatives," Statistics & Risk Modeling, De Gruyter, vol. 20(1-4), pages 355-378, April.
    5. Lugosi, Gábor, 1995. "Improved upper bounds for probabilities of uniform deviations," Statistics & Probability Letters, Elsevier, vol. 25(1), pages 71-77, October.
    6. Ann-Kathrin Bott & Michael Kohler, 2016. "Adaptive Estimation of a Conditional Density," International Statistical Review, International Statistical Institute, vol. 84(2), pages 291-316, August.
    7. Ryan Cumings-Menon, 2022. "Differentially Private Estimation via Statistical Depth," Papers 2207.12602, arXiv.org.
    8. Bartlett, Peter & Lugosi, Gábor, 1999. "An inequality for uniform deviations of sample averages from their means," Statistics & Probability Letters, Elsevier, vol. 44(1), pages 55-62, August.
    9. Biau, Gérard & Devroye, Luc, 2005. "Density estimation by the penalized combinatorial method," Journal of Multivariate Analysis, Elsevier, vol. 94(1), pages 196-208, May.
    10. Pablo Martínez-Camblor & Jacobo Uña-Álvarez, 2013. "Studying the bandwidth in $$k$$ -sample smooth tests," Computational Statistics, Springer, vol. 28(2), pages 875-892, April.
    11. Martínez-Camblor, Pablo & de Uña-Álvarez, Jacobo, 2009. "Non-parametric k-sample tests: Density functions vs distribution functions," Computational Statistics & Data Analysis, Elsevier, vol. 53(9), pages 3344-3357, July.
    12. Nils-Bastian Heidenreich & Anja Schindler & Stefan Sperlich, 2013. "Bandwidth selection for kernel density estimation: a review of fully automatic selectors," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 97(4), pages 403-433, October.
    13. Miguel Reyes & Mario Francisco-Fernández & Ricardo Cao, 2017. "Bandwidth selection in kernel density estimation for interval-grouped data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(3), pages 527-545, September.
    14. Levon Demirdjian & Majid Mojirsheibani, 2019. "Kernel classification with missing data and the choice of smoothing parameters," Statistical Papers, Springer, vol. 60(5), pages 1487-1513, October.
    15. Luc Devroye & Gábor Lugosi, 1998. "Variable Kernel estimates: On the impossibility of tuning the parameters," Economics Working Papers 325, Department of Economics and Business, Universitat Pompeu Fabra.
    16. Xu, Jianjun & Tan, Xianming & Zhang, Runchu, 2010. "A note on Phillips (1991): "A constrained maximum likelihood approach to estimating switching regressions"," Journal of Econometrics, Elsevier, vol. 154(1), pages 35-41, January.
    17. Cuevas, Antonio & Febrero, Manuel & Fraiman, Ricardo, 2001. "Cluster analysis: a further approach based on density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 36(4), pages 441-459, June.

    More about this item

    Keywords

    Density estimation; Kernel estimate; convergence; smoothing factor; minimum distance estimate; asymptotic optimality;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:upf:upfgen:281. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.upf.edu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.