IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v38y2023i2d10.1007_s00180-022-01256-x.html
   My bibliography  Save this article

A synthetic likelihood approach for intractable markov random fields

Author

Listed:
  • Wanchuang Zhu

    (The University of Sydney
    The University of Sydney)

  • Yanan Fan

    (University of New South Wales
    University of New South Wales)

Abstract

We propose a new scalable method to approximate the intractable likelihood of the Potts model. The method decomposes the original likelihood into products of many low-dimensional conditional terms, and a Monte Carlo method is then proposed to approximate each of the small terms using their corresponding (exact) Multinomial distribution. The resulting tractable synthetic likelihood then serves as an approximation to the true likelihood. The method is scalable with respect to lattice size and can also be used for problems with irregular lattices. We provide theoretical justifications for our approach, and carry out extensive simulation studies, which show that our method performs at least as well as existing methods, whilst providing significant computational savings, up to ten times faster than the current fastest method. Finally, we include three real data applications for illustration.

Suggested Citation

  • Wanchuang Zhu & Yanan Fan, 2023. "A synthetic likelihood approach for intractable markov random fields," Computational Statistics, Springer, vol. 38(2), pages 749-777, June.
    • Handle: RePEc:spr:compst:v:38:y:2023:i:2:d:10.1007_s00180-022-01256-x
    DOI: 10.1007/s00180-022-01256-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-022-01256-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00180-022-01256-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cressie, Noel & Davidson, Jennifer L., 1998. "Image analysis with partially ordered markov models," Computational Statistics & Data Analysis, Elsevier, vol. 29(1), pages 1-26, November.
    2. Simon N. Wood, 2010. "Statistical inference for noisy nonlinear ecological dynamic systems," Nature, Nature, vol. 466(7310), pages 1102-1104, August.
    3. Faming Liang & Ick Hoon Jin & Qifan Song & Jun S. Liu, 2016. "An Adaptive Exchange Algorithm for Sampling From Distributions With Intractable Normalizing Constants," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 377-393, March.
    4. R. Reeves, 2004. "Efficient recursions for general factorisable models," Biometrika, Biometrika Trust, vol. 91(3), pages 751-757, September.
    5. Ming Gao Gu & Hong‐Tu Zhu, 2001. "Maximum likelihood estimation for spatial models by Markov chain Monte Carlo stochastic approximation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 339-355.
    6. J. Møller & A. N. Pettitt & R. Reeves & K. K. Berthelsen, 2006. "An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants," Biometrika, Biometrika Trust, vol. 93(2), pages 451-458, June.
    7. Francesco Bartolucci, 2002. "A recursive algorithm for Markov random fields," Biometrika, Biometrika Trust, vol. 89(3), pages 724-730, August.
    8. Green P.J. & Richardson S., 2002. "Hidden Markov Models and Disease Mapping," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1055-1070, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. R. Reeves, 2004. "Efficient recursions for general factorisable models," Biometrika, Biometrika Trust, vol. 91(3), pages 751-757, September.
    2. Cécile Hardouin & Xavier Guyon, 2014. "Recursions on the marginals and exact computation of the normalizing constant for Gibbs processes," Computational Statistics, Springer, vol. 29(6), pages 1637-1650, December.
    3. Nial Friel & Håvard Rue, 2007. "Recursive computing and simulation-free inference for general factorizable models," Biometrika, Biometrika Trust, vol. 94(3), pages 661-672.
    4. Luigi Spezia, 2019. "Modelling covariance matrices by the trigonometric separation strategy with application to hidden Markov models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(2), pages 399-422, June.
    5. Solaiman Afroughi & Soghrat Faghihzadeh & Majid Jafari Khaledi & Mehdi Ghandehari Motlagh & Ebrahim Hajizadeh, 2011. "Analysis of clustered spatially correlated binary data using autologistic model and Bayesian method with an application to dental caries of 3--5-year-old children," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(12), pages 2763-2774, February.
    6. Magnussen, Steen & Reeves, Rob, 2008. "A method for bias-reduction of sample-based MLE of the autologistic model," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 103-111, September.
    7. Tetyana Kosyakova & Thomas Otter & Sanjog Misra & Christian Neuerburg, 2020. "Exact MCMC for Choices from Menus—Measuring Substitution and Complementarity Among Menu Items," Marketing Science, INFORMS, vol. 39(2), pages 427-447, March.
    8. Jonathan U Harrison & Ruth E Baker, 2020. "An automatic adaptive method to combine summary statistics in approximate Bayesian computation," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-21, August.
    9. Park, Jaewoo & Jin, Ick Hoon & Schweinberger, Michael, 2022. "Bayesian model selection for high-dimensional Ising models, with applications to educational data," Computational Statistics & Data Analysis, Elsevier, vol. 165(C).
    10. N. Friel & A. N. Pettitt, 2008. "Marginal likelihood estimation via power posteriors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(3), pages 589-607, July.
    11. Lim, Johan & Wang, Xinlei & Sherman, Michael, 2007. "An adjustment for edge effects using an augmented neighborhood model in the spatial auto-logistic model," Computational Statistics & Data Analysis, Elsevier, vol. 51(8), pages 3679-3688, May.
    12. Jin, Ick Hoon & Liang, Faming, 2014. "Use of SAMC for Bayesian analysis of statistical models with intractable normalizing constants," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 402-416.
    13. Faming Liang & Ick Hoon Jin & Qifan Song & Jun S. Liu, 2016. "An Adaptive Exchange Algorithm for Sampling From Distributions With Intractable Normalizing Constants," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 377-393, March.
    14. Rajala, T. & Penttinen, A., 2014. "Bayesian analysis of a Gibbs hard-core point pattern model with varying repulsion range," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 530-541.
    15. Noel Cressie & Jun Zhu & Adrian J. Baddeley & M. Gopalan Nair, 2000. "Directed Markov Point Processes as Limits of Partially Ordered Markov Models," Methodology and Computing in Applied Probability, Springer, vol. 2(1), pages 5-21, April.
    16. Laleh Tafakori & Armin Pourkhanali & Riccardo Rastelli, 2022. "Measuring systemic risk and contagion in the European financial network," Empirical Economics, Springer, vol. 63(1), pages 345-389, July.
    17. Grazzini, Jakob & Richiardi, Matteo G. & Tsionas, Mike, 2017. "Bayesian estimation of agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 26-47.
    18. Del Negro, Marco & Schorfheide, Frank, 2008. "Forming priors for DSGE models (and how it affects the assessment of nominal rigidities)," Journal of Monetary Economics, Elsevier, vol. 55(7), pages 1191-1208, October.
    19. Rulloni, Valeria, 2014. "Uniqueness condition for an auto-logistic model," Statistics & Probability Letters, Elsevier, vol. 87(C), pages 1-6.
    20. Noel Cressie & Andrew Zammit-Mangion, 2016. "Multivariate spatial covariance models: a conditional approach," Biometrika, Biometrika Trust, vol. 103(4), pages 915-935.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:38:y:2023:i:2:d:10.1007_s00180-022-01256-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.