IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v72y2010i3p269-342.html
   My bibliography  Save this article

Particle Markov chain Monte Carlo methods

Author

Listed:
  • Christophe Andrieu
  • Arnaud Doucet
  • Roman Holenstein

Abstract

Markov chain Monte Carlo and sequential Monte Carlo methods have emerged as the two main tools to sample from high dimensional probability distributions. Although asymptotic convergence of Markov chain Monte Carlo algorithms is ensured under weak assumptions, the performance of these algorithms is unreliable when the proposal distributions that are used to explore the space are poorly chosen and/or if highly correlated variables are updated independently. We show here how it is possible to build efficient high dimensional proposal distributions by using sequential Monte Carlo methods. This allows us not only to improve over standard Markov chain Monte Carlo schemes but also to make Bayesian inference feasible for a large class of statistical models where this was not previously so. We demonstrate these algorithms on a non-linear state space model and a Lévy-driven stochastic volatility model. Copyright (c) 2010 Royal Statistical Society.

Suggested Citation

  • Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342.
  • Handle: RePEc:bla:jorssb:v:72:y:2010:i:3:p:269-342
    as

    Download full text from publisher

    File URL: http://www.blackwell-synergy.com/doi/abs/10.1111/j.1467-9868.2009.00736.x
    File Function: link to full text
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436.
    2. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," Review of Economic Studies, Oxford University Press, vol. 74(4), pages 1059-1087.
    3. repec:eee:ecomod:v:200:y:2007:i:3:p:521-528 is not listed on IDEAS
    4. Godsill, Simon J. & Doucet, Arnaud & West, Mike, 2004. "Monte Carlo Smoothing for Nonlinear Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 156-168, January.
    5. Golightly, A. & Wilkinson, D.J., 2008. "Bayesian inference for nonlinear multivariate diffusion models observed with error," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1674-1693, January.
    6. Juan F. Rubio-Ramirez & Jesus Fernández-Villaverde, 2005. "Estimating dynamic equilibrium economies: linear versus nonlinear likelihood," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 891-910.
    7. Gareth O. Roberts & Omiros Papaspiliopoulos & Petros Dellaportas, 2004. "Bayesian inference for non-Gaussian Ornstein-Uhlenbeck stochastic volatility processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 369-393.
    8. Johansen, Adam M., 2009. "SMCTC: Sequential Monte Carlo in C++," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 30(i06).
    9. Ole E. Barndorff-Nielsen & Neil Shephard, 2001. "Normal modified stable processes," Economics Papers 2001-W6, Economics Group, Nuffield College, University of Oxford.
    10. Paul Fearnhead & Peter Clifford, 2003. "On-line inference for hidden Markov models via particle filters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(4), pages 887-899.
    11. Nicolas Chopin, 2007. "Inference and model choice for sequentially ordered hidden Markov models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 269-284.
    12. Creal, Drew D., 2008. "Analysis of filtering and smoothing algorithms for Lévy-driven stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2863-2876, February.
    13. Lin, Ming & Chen, Rong & Mykland, Per, 2010. "On Generating Monte Carlo Samples of Continuous Diffusion Bridges," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 820-838.
    14. Pitt, Michael K, 2002. "Smooth Particle Filters for Likelihood Evaluation and Maximisation," The Warwick Economics Research Paper Series (TWERPS) 651, University of Warwick, Department of Economics.
    15. Paul Fearnhead & Zhen Liu, 2007. "On-line inference for multiple changepoint problems," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 589-605.
    16. LeGland, François & Oudjane, Nadia, 2003. "A robustification approach to stability and to uniform particle approximation of nonlinear filters: the example of pseudo-mixing signals," Stochastic Processes and their Applications, Elsevier, vol. 106(2), pages 279-316, August.
    17. Nicolas Chopin, 2002. "A sequential particle filter method for static models," Biometrika, Biometrika Trust, vol. 89(3), pages 539-552, August.
    18. Ole E. Barndorff-Nielsen & Neil Shephard, 2001. "Non-Gaussian Ornstein-Uhlenbeck-based models and some of their uses in financial economics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 167-241.
    19. Yuguo Chen & Junyi Xie & Jun S. Liu, 2005. "Stopping-time resampling for sequential Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 199-217.
    20. Mark A. Beaumont & Jean-Marie Cornuet & Jean-Michel Marin & Christian P. Robert, 2009. "Adaptive approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 96(4), pages 983-990.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:72:y:2010:i:3:p:269-342. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://edirc.repec.org/data/rssssea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.