IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2013-19.html
   My bibliography  Save this paper

Bayesian Optimal Adaptive Estimation Using a Sieve prior

Author

Listed:
  • Julyan Arbel

    (CREST)

  • Ghislaine Gayraud

    (CREST)

  • Judith Rousseau

    (CREST)

Abstract

We derive rates of contraction of posterior distributions on nonparametric models resulting from sieve priors. The aim of the paper is to provide general conditions to get posterior rates when the parameter space has a general structure, and rate adaptation when the parameter space is, e.g., a Sobolev class. The conditions employed, although standard in the literature, are combined in a different way. The results are applied to density, regression, nonlinear autoregression and Gaussian white noise models. In the latter we have also considered a loss function which is different from the usual l2 norm, namely the pointwise loss. In this case it is possible to prove that the adaptive Bayesian approach for the l2 loss is strongly suboptimal and we provide a lower bound on the rate.

Suggested Citation

  • Julyan Arbel & Ghislaine Gayraud & Judith Rousseau, 2013. "Bayesian Optimal Adaptive Estimation Using a Sieve prior," Working Papers 2013-19, Center for Research in Economics and Statistics.
  • Handle: RePEc:crs:wpaper:2013-19
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2013-19.pdf
    File Function: Crest working paper version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Felix Abramovich & Claudia Angelini & Daniela Canditiis, 2007. "Pointwise optimality of Bayesian wavelet estimators," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 59(3), pages 425-434, September.
    2. repec:dau:papers:123456789/3984 is not listed on IDEAS
    3. Babenko, Alexandra & Belitser, Eduard, 2009. "On the posterior pointwise convergence rate of a Gaussian signal under a conjugate prior," Statistics & Probability Letters, Elsevier, vol. 79(5), pages 670-675, March.
    4. Felix Abramovich & Vadim Grinshtein & Athanasia Petsa & Theofanis Sapatinas, 2010. "On Bayesian testimation and its application to wavelet thresholding," Biometrika, Biometrika Trust, vol. 97(1), pages 181-198.
    5. repec:dau:papers:123456789/1908 is not listed on IDEAS
    6. repec:dau:papers:123456789/7335 is not listed on IDEAS
    7. F. Abramovich & T. Sapatinas & B. W. Silverman, 1998. "Wavelet thresholding via a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(4), pages 725-749.
    8. Felix Abramovich & Umberto Amato & Claudia Angelini, 2004. "On Optimality of Bayesian Wavelet Estimators," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 31(2), pages 217-234, June.
    9. Judith Rousseau & Nicolas Chopin & Brunero Liseo, 2010. "Bayesian Nonparametric Estimation of the Spectral Density of a Long or Intermediate Memory Gaussian Process," Working Papers 2010-38, Center for Research in Economics and Statistics.
    10. repec:dau:papers:123456789/4659 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jan Johannes & Anna Simoni & Rudolf Schenk, 2020. "Adaptive Bayesian Estimation in Indirect Gaussian Sequence Space Models," Annals of Economics and Statistics, GENES, issue 137, pages 83-116.
    2. Zhe Wang & Ryan Martin, 2021. "Gibbs posterior inference on a Levy density under discrete sampling," Papers 2109.06567, arXiv.org.
    3. I. Votsi & G. Gayraud & V. S. Barbu & N. Limnios, 2021. "Hypotheses testing and posterior concentration rates for semi-Markov processes," Statistical Inference for Stochastic Processes, Springer, vol. 24(3), pages 707-732, October.
    4. Yi, Taihe & Wang, Zhengming, 2017. "Bayesian sieve method for piece-wise smooth regression," Statistics & Probability Letters, Elsevier, vol. 130(C), pages 5-11.
    5. van Waaij, Jan & van Zanten, Harry, 2017. "Full adaptation to smoothness using randomly truncated series priors with Gaussian coefficients and inverse gamma scaling," Statistics & Probability Letters, Elsevier, vol. 123(C), pages 93-99.
    6. Weining Shen & Subhashis Ghosal, 2015. "Adaptive Bayesian Procedures Using Random Series Priors," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(4), pages 1194-1213, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Julyan Arbel & Ghislaine Gayraud & Judith Rousseau, 2013. "Bayesian Optimal Adaptive Estimation Using a Sieve Prior," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(3), pages 549-570, September.
    2. ter Braak, Cajo J.F., 2006. "Bayesian sigmoid shrinkage with improper variance priors and an application to wavelet denoising," Computational Statistics & Data Analysis, Elsevier, vol. 51(2), pages 1232-1242, November.
    3. Marco Di Zio & Arnoldo Frigessi, 1999. "Smoothness in Bayesian Non-parametric Regression with Wavelets," Methodology and Computing in Applied Probability, Springer, vol. 1(4), pages 391-405, December.
    4. Babenko, Alexandra & Belitser, Eduard, 2011. "Lower bound for the oracle projection posterior convergence rate," Statistics & Probability Letters, Elsevier, vol. 81(2), pages 175-180, February.
    5. A. Antoniadis, 1997. "Rejoinder," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 6(2), pages 143-144, August.
    6. Matthieu Garcin & Dominique Guegan, 2015. "Optimal wavelet shrinkage of a noisy dynamical system with non-linear noise impact," Documents de travail du Centre d'Economie de la Sorbonne 15085, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    7. Yu Yue & Paul Speckman & Dongchu Sun, 2012. "Priors for Bayesian adaptive spline smoothing," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(3), pages 577-613, June.
    8. Beran, Jan & Heiler, Mark A., 2008. "A nonparametric regression cross spectrum for multivariate time series," Journal of Multivariate Analysis, Elsevier, vol. 99(4), pages 684-714, April.
    9. Nilotpal Sanyal & Marco A. R. Ferreira, 2017. "Bayesian Wavelet Analysis Using Nonlocal Priors with an Application to fMRI Analysis," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 79(2), pages 361-388, November.
    10. Mak Kaboudan, 2006. "Computational Forecasting of Wavelet-converted Monthly Sunspot Numbers," Journal of Applied Statistics, Taylor & Francis Journals, vol. 33(9), pages 925-941.
    11. Hee-Seok Oh & Donghoh Kim & Youngjo Lee, 2009. "Cross-validated wavelet shrinkage," Computational Statistics, Springer, vol. 24(3), pages 497-512, August.
    12. Capobianco Enrico & Marras Elisabetta & Travaglione Antonella, 2011. "Multiscale Characterization of Signaling Network Dynamics through Features," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 10(1), pages 1-32, November.
    13. Iolanda Lo Cascio, 2007. "Wavelet Analysis and Denoising: New Tools for Economists," Working Papers 600, Queen Mary University of London, School of Economics and Finance.
    14. Michael R. Wierzbicki & Li-Bing Guo & Qing-Tao Du & Wensheng Guo, 2014. "Sparse Semiparametric Nonlinear Model With Application to Chromatographic Fingerprints," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1339-1349, December.
    15. Matthieu Garcin & Dominique Guegan, 2015. "Optimal wavelet shrinkage of a noisy dynamical system with non-linear noise impact," Post-Print halshs-01244239, HAL.
    16. Alex Rodrigo dos S. Sousa & Nancy L. Garcia & Brani Vidakovic, 2021. "Bayesian wavelet shrinkage with beta priors," Computational Statistics, Springer, vol. 36(2), pages 1341-1363, June.
    17. Christophe Chesneau & Fabien Navarro, 2017. "On the pointwise mean squared error of a multidimensional term-by-term thresholding wavelet estimator," Working Papers 2017-68, Center for Research in Economics and Statistics.
    18. A. Antoniadis, 1997. "Wavelets in statistics: A review," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 6(2), pages 97-130, August.
    19. Felix Abramovich & Claudia Angelini & Daniela Canditiis, 2007. "Pointwise optimality of Bayesian wavelet estimators," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 59(3), pages 425-434, September.
    20. Jan Johannes & Anna Simoni & Rudolf Schenk, 2020. "Adaptive Bayesian Estimation in Indirect Gaussian Sequence Space Models," Annals of Economics and Statistics, GENES, issue 137, pages 83-116.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2013-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.