IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v128y2018icp221-241.html
   My bibliography  Save this article

Model comparison for Gibbs random fields using noisy reversible jump Markov chain Monte Carlo

Author

Listed:
  • Bouranis, Lampros
  • Friel, Nial
  • Maire, Florian

Abstract

The reversible jump Markov chain Monte Carlo (RJMCMC) method offers an across-model simulation approach for Bayesian estimation and model comparison, by exploring the sampling space that consists of several models of possibly varying dimensions. A naive implementation of RJMCMC to models like Gibbs random fields suffers from computational difficulties: the posterior distribution for each model is termed doubly-intractable since computation of the likelihood function is rarely available. Consequently, it is simply impossible to simulate a transition of the Markov chain in the presence of likelihood intractability. A variant of RJMCMC is presented, called noisy RJMCMC, where the underlying transition kernel is replaced with an approximation based on unbiased estimators. Based on previous theoretical developments, convergence guarantees for the noisy RJMCMC algorithm are provided. The experiments show that the noisy RJMCMC algorithm can be much more efficient than other exact methods, provided that an estimator with controlled Monte Carlo variance is used, a fact which is in agreement with the theoretical analysis.

Suggested Citation

  • Bouranis, Lampros & Friel, Nial & Maire, Florian, 2018. "Model comparison for Gibbs random fields using noisy reversible jump Markov chain Monte Carlo," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 221-241.
    • Handle: RePEc:eee:csdana:v:128:y:2018:i:c:p:221-241
    DOI: 10.1016/j.csda.2018.07.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947318301713
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2018.07.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. S. P. Brooks & P. Giudici & G. O. Roberts, 2003. "Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 3-39, January.
    2. Hunter, David R. & Handcock, Mark S. & Butts, Carter T. & Goodreau, Steven M. & Morris, Martina, 2008. "ergm: A Package to Fit, Simulate and Diagnose Exponential-Family Models for Networks," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 24(i03).
    3. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    4. Caimo, Alberto & Friel, Nial, 2014. "Bergm: Bayesian Exponential Random Graphs in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 61(i02).
    5. Martin, Andrew D. & Quinn, Kevin M. & Park, Jong Hee, 2011. "MCMCpack: Markov Chain Monte Carlo in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i09).
    6. Nial Friel & Jason Wyse, 2012. "Estimating the evidence – a review," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 66(3), pages 288-308, August.
    7. Stanley Wasserman & Philippa Pattison, 1996. "Logit models and logistic regressions for social networks: I. An introduction to Markov graphs andp," Psychometrika, Springer;The Psychometric Society, vol. 61(3), pages 401-425, September.
    8. Ricardo S. Ehlers & Stephen P. Brooks, 2008. "Adaptive Proposal Construction for Reversible Jump MCMC," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 35(4), pages 677-690, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    2. David I. Hastie & Peter J. Green, 2012. "Model choice using reversible jump Markov chain Monte Carlo," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 66(3), pages 309-338, August.
    3. Krivitsky, Pavel N., 2017. "Using contrastive divergence to seed Monte Carlo MLE for exponential-family random graph models," Computational Statistics & Data Analysis, Elsevier, vol. 107(C), pages 149-161.
    4. Cody J. Dey & James S. Quinn, 2014. "Individual attributes and self-organizational processes affect dominance network structure in pukeko," Behavioral Ecology, International Society for Behavioral Ecology, vol. 25(6), pages 1402-1408.
    5. Joshua C. C. Chan & Liana Jacobi & Dan Zhu, 2022. "An automated prior robustness analysis in Bayesian model comparison," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 583-602, April.
    6. Goodreau, Steven M. & Handcock, Mark S. & Hunter, David R. & Butts, Carter T. & Morris, Martina, 2008. "A statnet Tutorial," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 24(i09).
    7. Alexander Meyer-Gohde & Daniel Neuhoff, 2015. "Generalized Exogenous Processes in DSGE: A Bayesian Approach," SFB 649 Discussion Papers SFB649DP2015-014, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    8. Angel Ortiz-Pelaez & Getaneh Ashenafi & Francois Roger & Agnes Waret-Szkuta, 2012. "Can Geographical Factors Determine the Choices of Farmers in the Ethiopian Highlands to Trade in Livestock Markets?," PLOS ONE, Public Library of Science, vol. 7(2), pages 1-11, February.
    9. Pandolfi, Silvia & Bartolucci, Francesco & Friel, Nial, 2014. "A generalized multiple-try version of the Reversible Jump algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 72(C), pages 298-314.
    10. Lee, Jihui & Li, Gen & Wilson, James D., 2020. "Varying-coefficient models for dynamic networks," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    11. Pavel N. Krivitsky & Laura M. Koehly & Christopher Steven Marcum, 2020. "Exponential-Family Random Graph Models for Multi-Layer Networks," Psychometrika, Springer;The Psychometric Society, vol. 85(3), pages 630-659, September.
    12. Alzahrani, Naif & Neal, Peter & Spencer, Simon E.F. & McKinley, Trevelyan J. & Touloupou, Panayiota, 2018. "Model selection for time series of count data," Computational Statistics & Data Analysis, Elsevier, vol. 122(C), pages 33-44.
    13. Kobayashi, Genya, 2014. "A transdimensional approximate Bayesian computation using the pseudo-marginal approach for model choice," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 167-183.
    14. N. Friel & A. N. Pettitt, 2008. "Marginal likelihood estimation via power posteriors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(3), pages 589-607, July.
    15. Yaveroğlu, Ömer Nebil & Fitzhugh, Sean M. & Kurant, Maciej & Markopoulou, Athina & Butts, Carter T. & Pržulj, Nataša, 2015. "ergm.graphlets: A Package for ERG Modeling Based on Graphlet Statistics," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 65(i12).
    16. Jeffrey A. Smith & Jessica Burow, 2020. "Using Ego Network Data to Inform Agent-based Models of Diffusion," Sociological Methods & Research, , vol. 49(4), pages 1018-1063, November.
    17. Kei, Yik Lun & Chen, Yanzhen & Madrid Padilla, Oscar Hernan, 2023. "A partially separable model for dynamic valued networks," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    18. Ivan Cucco, 2014. "Network-based policies and innovation networks in two Italian regions: a comparison through a social selection model," STUDI ECONOMICI, FrancoAngeli Editore, vol. 2014(114), pages 78-96.
    19. Joshua Daniel Loyal & Yuguo Chen, 2020. "Statistical Network Analysis: A Review with Applications to the Coronavirus Disease 2019 Pandemic," International Statistical Review, International Statistical Institute, vol. 88(2), pages 419-440, August.
    20. Johannes Pol, 2019. "Introduction to Network Modeling Using Exponential Random Graph Models (ERGM): Theory and an Application Using R-Project," Computational Economics, Springer;Society for Computational Economics, vol. 54(3), pages 845-875, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:128:y:2018:i:c:p:221-241. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.