IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v72y2010i3p269-342.html
   My bibliography  Save this article

Particle Markov chain Monte Carlo methods

Author

Listed:
  • Christophe Andrieu
  • Arnaud Doucet
  • Roman Holenstein

Abstract

Summary. Markov chain Monte Carlo and sequential Monte Carlo methods have emerged as the two main tools to sample from high dimensional probability distributions. Although asymptotic convergence of Markov chain Monte Carlo algorithms is ensured under weak assumptions, the performance of these algorithms is unreliable when the proposal distributions that are used to explore the space are poorly chosen and/or if highly correlated variables are updated independently. We show here how it is possible to build efficient high dimensional proposal distributions by using sequential Monte Carlo methods. This allows us not only to improve over standard Markov chain Monte Carlo schemes but also to make Bayesian inference feasible for a large class of statistical models where this was not previously so. We demonstrate these algorithms on a non‐linear state space model and a Lévy‐driven stochastic volatility model.

Suggested Citation

  • Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
  • Handle: RePEc:bla:jorssb:v:72:y:2010:i:3:p:269-342
    DOI: 10.1111/j.1467-9868.2009.00736.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9868.2009.00736.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1467-9868.2009.00736.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," Review of Economic Studies, Oxford University Press, vol. 74(4), pages 1059-1087.
    3. Wang, Guiming, 2007. "On the latent state estimation of nonlinear population dynamics using Bayesian and non-Bayesian state-space models," Ecological Modelling, Elsevier, vol. 200(3), pages 521-528.
    4. Godsill, Simon J. & Doucet, Arnaud & West, Mike, 2004. "Monte Carlo Smoothing for Nonlinear Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 156-168, January.
    5. Neil Shephard & Ole E. Barndorff-Nielsen & University of Aarhus, 2001. "Normal Modified Stable Processes," Economics Series Working Papers 72, University of Oxford, Department of Economics.
    6. Juan F. Rubio-Ramirez & Jesus Fernández-Villaverde, 2005. "Estimating dynamic equilibrium economies: linear versus nonlinear likelihood," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 891-910.
    7. Paul Fearnhead & Peter Clifford, 2003. "On‐line inference for hidden Markov models via particle filters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(4), pages 887-899, November.
    8. Creal, Drew D., 2008. "Analysis of filtering and smoothing algorithms for Lévy-driven stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2863-2876, February.
    9. Lin, Ming & Chen, Rong & Mykland, Per, 2010. "On Generating Monte Carlo Samples of Continuous Diffusion Bridges," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 820-838.
    10. Nicolas Chopin & Christian P. Robert, 2010. "Properties of nested sampling," Biometrika, Biometrika Trust, vol. 97(3), pages 741-755.
    11. Paul Fearnhead & Zhen Liu, 2007. "On‐line inference for multiple changepoint problems," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 589-605, September.
    12. Nicolas Chopin, 2002. "A sequential particle filter method for static models," Biometrika, Biometrika Trust, vol. 89(3), pages 539-552, August.
    13. Golightly, A. & Wilkinson, D.J., 2008. "Bayesian inference for nonlinear multivariate diffusion models observed with error," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1674-1693, January.
    14. Gareth O. Roberts & Omiros Papaspiliopoulos & Petros Dellaportas, 2004. "Bayesian inference for non‐Gaussian Ornstein–Uhlenbeck stochastic volatility processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 369-393, May.
    15. Johansen, Adam M., 2009. "SMCTC: Sequential Monte Carlo in C++," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 30(i06).
    16. Nicolas Chopin, 2007. "Inference and model choice for sequentially ordered hidden Markov models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 269-284, April.
    17. Pitt, Michael K., 2002. "Smooth particle filters for likelihood evaluation and maximisation," Economic Research Papers 269464, University of Warwick - Department of Economics.
    18. Pitt, Michael K, 2002. "Smooth Particle Filters for Likelihood Evaluation and Maximisation," The Warwick Economics Research Paper Series (TWERPS) 651, University of Warwick, Department of Economics.
    19. LeGland, François & Oudjane, Nadia, 2003. "A robustification approach to stability and to uniform particle approximation of nonlinear filters: the example of pseudo-mixing signals," Stochastic Processes and their Applications, Elsevier, vol. 106(2), pages 279-316, August.
    20. Ole E. Barndorff‐Nielsen & Neil Shephard, 2001. "Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 167-241.
    21. Yuguo Chen & Junyi Xie & Jun S. Liu, 2005. "Stopping‐time resampling for sequential Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 199-217, April.
    22. Mark A. Beaumont & Jean-Marie Cornuet & Jean-Michel Marin & Christian P. Robert, 2009. "Adaptive approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 96(4), pages 983-990.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    2. N. Chopin & P. E. Jacob & O. Papaspiliopoulos, 2013. "SMC-super-2: an efficient algorithm for sequential analysis of state space models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 397-426, June.
    3. Roman Liesenfeld & Guilherme V. Moura & Jean-François Richard & Hariharan Dharmarajan, 2013. "Efficient Likelihood Evaluation of State-Space Representations," Review of Economic Studies, Oxford University Press, vol. 80(2), pages 538-567.
    4. repec:wyi:journl:002173 is not listed on IDEAS
    5. James Martin & Ajay Jasra & Emma McCoy, 2013. "Inference for a class of partially observed point process models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(3), pages 413-437, June.
    6. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2008. "How Structural Are Structural Parameters?," NBER Chapters, in: NBER Macroeconomics Annual 2007, Volume 22, pages 83-137, National Bureau of Economic Research, Inc.
    7. Ole Barndorff-Nielsen & Elisa Nicolato & Neil Shephard, 2002. "Some recent developments in stochastic volatility modelling," Quantitative Finance, Taylor & Francis Journals, vol. 2(1), pages 11-23.
    8. Calvet, Laurent-Emmanuel & Czellar , Veronika, 2011. "state-observation sampling and the econometrics of learning models," HEC Research Papers Series 947, HEC Paris.
    9. Creal, Drew D., 2008. "Analysis of filtering and smoothing algorithms for Lévy-driven stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2863-2876, February.
    10. Karamé, Frédéric, 2018. "A new particle filtering approach to estimate stochastic volatility models with Markov-switching," Econometrics and Statistics, Elsevier, vol. 8(C), pages 204-230.
    11. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    12. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    13. Giuliano De Rossi, 2010. "Maximum Likelihood Estimation of the Cox–Ingersoll–Ross Model Using Particle Filters," Computational Economics, Springer;Society for Computational Economics, vol. 36(1), pages 1-16, June.
    14. Maciej Augustyniak & Mathieu Boudreault & Manuel Morales, 2018. "Maximum Likelihood Estimation of the Markov-Switching GARCH Model Based on a General Collapsing Procedure," Methodology and Computing in Applied Probability, Springer, vol. 20(1), pages 165-188, March.
    15. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    16. Elena Ehrlich & Ajay Jasra & Nikolas Kantas, 2015. "Gradient Free Parameter Estimation for Hidden Markov Models with Intractable Likelihoods," Methodology and Computing in Applied Probability, Springer, vol. 17(2), pages 315-349, June.
    17. C. C. Drovandi & A. N. Pettitt, 2011. "Estimation of Parameters for Macroparasite Population Evolution Using Approximate Bayesian Computation," Biometrics, The International Biometric Society, vol. 67(1), pages 225-233, March.
    18. Griffin, J.E. & Steel, M.F.J., 2010. "Bayesian inference with stochastic volatility models using continuous superpositions of non-Gaussian Ornstein-Uhlenbeck processes," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2594-2608, November.
    19. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    20. Martin M. Andreasen, 2010. "Non-linear DSGE Models and The Optimized Particle Filter," CREATES Research Papers 2010-05, Department of Economics and Business Economics, Aarhus University.
    21. Golchi, Shirin & Campbell, David A., 2016. "Sequentially Constrained Monte Carlo," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 98-113.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:72:y:2010:i:3:p:269-342. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.