IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v94y2005i1p196-208.html
   My bibliography  Save this article

Density estimation by the penalized combinatorial method

Author

Listed:
  • Biau, Gérard
  • Devroye, Luc

Abstract

Let f be an unknown multivariate density belonging to a prespecified parametric class of densities, , where k is unknown, but for all k and each has finite Vapnik-Chervonenkis dimension. Given an i.i.d. sample of size n drawn from f, we show that it is possible to select automatically, and without extra restrictions on f, an estimate with the property that . Our method is inspired by the combinatorial tools developed in Devroye and Lugosi (Combinatorial Methods in Density Estimation, Springer, New York, 2001) and it includes a wide range of density models, such as mixture models or exponential families.

Suggested Citation

  • Biau, Gérard & Devroye, Luc, 2005. "Density estimation by the penalized combinatorial method," Journal of Multivariate Analysis, Elsevier, vol. 94(1), pages 196-208, May.
    • Handle: RePEc:eee:jmvana:v:94:y:2005:i:1:p:196-208
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(04)00085-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marta Horvath & Gábor Lugosi, 1996. "A data-dependent skeleton estimate and a scale-sensitive dimension for classification," Economics Working Papers 199, Department of Economics and Business, Universitat Pompeu Fabra.
    2. Duc Devroye & J. Beirlant & R. Cao & R. Fraiman & P. Hall & M. Jones & Gábor Lugosi & E. Mammen & J. Marron & C. Sánchez-Sellero & J. Uña & F. Udina & L. Devroye, 1997. "Universal smoothing factor selection in density estimation: theory and practice," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 6(2), pages 223-320, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Broniatowski, Michel & Keziou, Amor, 2009. "Parametric estimation and tests through divergences and the duality technique," Journal of Multivariate Analysis, Elsevier, vol. 100(1), pages 16-36, January.
    2. Biau, Gérard & Wegkamp, Marten, 2005. "A note on minimum distance estimation of copula densities," Statistics & Probability Letters, Elsevier, vol. 73(2), pages 105-114, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fischer, Aurélie, 2010. "Quantization and clustering with Bregman divergences," Journal of Multivariate Analysis, Elsevier, vol. 101(9), pages 2207-2221, October.
    2. Mojirsheibani, Majid, 2001. "An iterated classification rule based on auxiliary pseudo-predictors," Computational Statistics & Data Analysis, Elsevier, vol. 38(2), pages 125-138, December.
    3. J. Liao & Yujun Wu & Yong Lin, 2010. "Improving Sheather and Jones’ bandwidth selector for difficult densities in kernel density estimation," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(1), pages 105-114.
    4. Kohler, Michael & Máthé, Kinga & Pintér, Márta, 2002. "Prediction from Randomly Right Censored Data," Journal of Multivariate Analysis, Elsevier, vol. 80(1), pages 73-100, January.
    5. Langrené, Nicolas & Warin, Xavier, 2021. "Fast multivariate empirical cumulative distribution function with connection to kernel density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 162(C).
    6. Camerlenghi, F. & Capasso, V. & Villa, E., 2014. "On the estimation of the mean density of random closed sets," Journal of Multivariate Analysis, Elsevier, vol. 125(C), pages 65-88.
    7. Luc Devroye & Gábor Lugosi & Frederic Udina, 1998. "Inequalities for a new data-based method for selecting nonparametric density estimates," Economics Working Papers 281, Department of Economics and Business, Universitat Pompeu Fabra.
    8. Boumaza, Rachid, 2004. "Discriminant analysis with independently repeated multivariate measurements: an L2 approach," Computational Statistics & Data Analysis, Elsevier, vol. 47(4), pages 823-843, November.
    9. Horová Ivana & Vieu Philippe & Zelinka Jiří, 2002. "Optimal Choice Of Nonparametric Estimates Of A Density And Of Its Derivatives," Statistics & Risk Modeling, De Gruyter, vol. 20(1-4), pages 355-378, April.
    10. Ann-Kathrin Bott & Michael Kohler, 2016. "Adaptive Estimation of a Conditional Density," International Statistical Review, International Statistical Institute, vol. 84(2), pages 291-316, August.
    11. Pablo Martínez-Camblor & Jacobo Uña-Álvarez, 2013. "Studying the bandwidth in $$k$$ -sample smooth tests," Computational Statistics, Springer, vol. 28(2), pages 875-892, April.
    12. Martínez-Camblor, Pablo & de Uña-Álvarez, Jacobo, 2009. "Non-parametric k-sample tests: Density functions vs distribution functions," Computational Statistics & Data Analysis, Elsevier, vol. 53(9), pages 3344-3357, July.
    13. Devroye, Luc & Györfi, Laszlo & Krzyzak, Adam, 1998. "The Hilbert Kernel Regression Estimate," Journal of Multivariate Analysis, Elsevier, vol. 65(2), pages 209-227, May.
    14. Mojirsheibani, Majid, 2002. "An Almost Surely Optimal Combined Classification Rule," Journal of Multivariate Analysis, Elsevier, vol. 81(1), pages 28-46, April.
    15. Nils-Bastian Heidenreich & Anja Schindler & Stefan Sperlich, 2013. "Bandwidth selection for kernel density estimation: a review of fully automatic selectors," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 97(4), pages 403-433, October.
    16. Kohler, Michael, 1999. "Universally Consistent Regression Function Estimation Using Hierarchial B-Splines," Journal of Multivariate Analysis, Elsevier, vol. 68(1), pages 138-164, January.
    17. Miguel Reyes & Mario Francisco-Fernández & Ricardo Cao, 2017. "Bandwidth selection in kernel density estimation for interval-grouped data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(3), pages 527-545, September.
    18. Luc Devroye & Gábor Lugosi, 1998. "Variable Kernel estimates: On the impossibility of tuning the parameters," Economics Working Papers 325, Department of Economics and Business, Universitat Pompeu Fabra.
    19. Cuevas, Antonio & Febrero, Manuel & Fraiman, Ricardo, 2001. "Cluster analysis: a further approach based on density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 36(4), pages 441-459, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:94:y:2005:i:1:p:196-208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.