IDEAS home Printed from https://ideas.repec.org/a/bla/jorssc/v70y2021i4p858-885.html
   My bibliography  Save this article

Accelerating Bayesian estimation for network Poisson models using frequentist variational estimates

Author

Listed:
  • Sophie Donnet
  • Stéphane Robin

Abstract

This work is motivated by the analysis of ecological interaction networks. Poisson stochastic block models are widely used in this field to decipher the structure that underlies a weighted network, while accounting for covariate effects. Efficient algorithms based on variational approximations exist for frequentist inference, but without statistical guaranties as for the resulting estimates. In the absence of variational Bayes estimates, we show that a good proxy of the posterior distribution can be straightforwardly derived from the frequentist variational estimation procedure, using a Laplace approximation. We use this proxy to sample from the true posterior distribution via a sequential Monte Carlo algorithm. As shown in the simulation study, the efficiency of the posterior sampling is greatly improved by the accuracy of the approximate posterior distribution. The proposed procedure can be easily extended to other latent variable models. We use this methodology to assess the influence of available covariates on the organization of several ecological networks, as well as the existence of a residual interaction structure.

Suggested Citation

  • Sophie Donnet & Stéphane Robin, 2021. "Accelerating Bayesian estimation for network Poisson models using frequentist variational estimates," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(4), pages 858-885, August.
  • Handle: RePEc:bla:jorssc:v:70:y:2021:i:4:p:858-885
    DOI: 10.1111/rssc.12489
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssc.12489
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssc.12489?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. David M. Blei & Alp Kucukelbir & Jon D. McAuliffe, 2017. "Variational Inference: A Review for Statisticians," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 859-877, April.
    3. Ajay Jasra & David A. Stephens & Arnaud Doucet & Theodoros Tsagaris, 2011. "Inference for Lévy‐Driven Stochastic Volatility Models via Adaptive Sequential Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 38(1), pages 1-22, March.
    4. repec:dau:papers:123456789/5671 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arnaud Dufays, 2016. "Evolutionary Sequential Monte Carlo Samplers for Change-Point Models," Econometrics, MDPI, vol. 4(1), pages 1-33, March.
    2. Ho, Paul, 2023. "Global robust Bayesian analysis in large models," Journal of Econometrics, Elsevier, vol. 235(2), pages 608-642.
    3. Arnaud Dufays, 2014. "On the conjugacy of off-line and on-line Sequential Monte Carlo Samplers," Working Paper Research 263, National Bank of Belgium.
    4. Ramis Khabibullin & Sergei Seleznev, 2022. "Fast Estimation of Bayesian State Space Models Using Amortized Simulation-Based Inference," Bank of Russia Working Paper Series wps104, Bank of Russia.
    5. Golchi, Shirin & Campbell, David A., 2016. "Sequentially Constrained Monte Carlo," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 98-113.
    6. Dufays, A. & Rombouts, V., 2015. "Sparse Change-Point Time Series Models," LIDAM Discussion Papers CORE 2015032, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    7. Herbst, Edward & Schorfheide, Frank, 2019. "Tempered particle filtering," Journal of Econometrics, Elsevier, vol. 210(1), pages 26-44.
    8. Moffa, Giusi & Kuipers, Jack, 2014. "Sequential Monte Carlo EM for multivariate probit models," Computational Statistics & Data Analysis, Elsevier, vol. 72(C), pages 252-272.
    9. Speich, Matthias & Dormann, Carsten F. & Hartig, Florian, 2021. "Sequential Monte-Carlo algorithms for Bayesian model calibration – A review and method comparison✰," Ecological Modelling, Elsevier, vol. 455(C).
    10. Gunawan, David & Dang, Khue-Dung & Quiroz, Matias & Kohn, Robert & Tran, Minh-Ngoc, 2019. "Subsampling Sequential Monte Carlo for Static Bayesian Models," Working Paper Series 371, Sveriges Riksbank (Central Bank of Sweden).
    11. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    12. Ajay Jasra & Kody Law & Carina Suciu, 2020. "Advanced Multilevel Monte Carlo Methods," International Statistical Review, International Statistical Institute, vol. 88(3), pages 548-579, December.
    13. Duffield, Samuel & Singh, Sumeetpal S., 2022. "Ensemble Kalman inversion for general likelihoods," Statistics & Probability Letters, Elsevier, vol. 187(C).
    14. Allassonnière, Stéphanie & Chevallier, Juliette, 2021. "A new class of stochastic EM algorithms. Escaping local maxima and handling intractable sampling," Computational Statistics & Data Analysis, Elsevier, vol. 159(C).
    15. Riccardo Rastelli & Michael Fop, 2020. "A stochastic block model for interaction lengths," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 14(2), pages 485-512, June.
    16. Derennes, Pierre & Morio, Jérôme & Simatos, Florian, 2021. "Simultaneous estimation of complementary moment independent and reliability-oriented sensitivity measures," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 182(C), pages 721-737.
    17. Deborah Gefang & Gary Koop & Aubrey Poon, 2019. "Variational Bayesian Inference in Large Vector Autoregressions with Hierarchical Shrinkage," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2019-07, Economic Statistics Centre of Excellence (ESCoE).
    18. McKinley Trevelyan & Cook Alex R & Deardon Robert, 2009. "Inference in Epidemic Models without Likelihoods," The International Journal of Biostatistics, De Gruyter, vol. 5(1), pages 1-40, July.
    19. Korobilis, Dimitris & Koop, Gary, 2018. "Variational Bayes inference in high-dimensional time-varying parameter models," Essex Finance Centre Working Papers 22665, University of Essex, Essex Business School.
    20. Dayuan Wu & Ping Yan & You Guo & Han Zhou & Jian Chen, 2022. "A gear machining error prediction method based on adaptive Gaussian mixture regression considering stochastic disturbance," Journal of Intelligent Manufacturing, Springer, vol. 33(8), pages 2321-2339, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssc:v:70:y:2021:i:4:p:858-885. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.