IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v72y2010i3p269-342.html

Particle Markov chain Monte Carlo methods

Author

Listed:
  • Christophe Andrieu
  • Arnaud Doucet
  • Roman Holenstein

Abstract

Summary. Markov chain Monte Carlo and sequential Monte Carlo methods have emerged as the two main tools to sample from high dimensional probability distributions. Although asymptotic convergence of Markov chain Monte Carlo algorithms is ensured under weak assumptions, the performance of these algorithms is unreliable when the proposal distributions that are used to explore the space are poorly chosen and/or if highly correlated variables are updated independently. We show here how it is possible to build efficient high dimensional proposal distributions by using sequential Monte Carlo methods. This allows us not only to improve over standard Markov chain Monte Carlo schemes but also to make Bayesian inference feasible for a large class of statistical models where this was not previously so. We demonstrate these algorithms on a non‐linear state space model and a Lévy‐driven stochastic volatility model.

Suggested Citation

  • Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
  • Handle: RePEc:bla:jorssb:v:72:y:2010:i:3:p:269-342
    DOI: 10.1111/j.1467-9868.2009.00736.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9868.2009.00736.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1467-9868.2009.00736.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. Nicolas Chopin, 2007. "Inference and model choice for sequentially ordered hidden Markov models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 269-284, April.
    3. Pitt, Michael K., "undated". "Smooth particle filters for likelihood evaluation and maximisation," Economic Research Papers 269464, University of Warwick - Department of Economics.
    4. Wang, Guiming, 2007. "On the latent state estimation of nonlinear population dynamics using Bayesian and non-Bayesian state-space models," Ecological Modelling, Elsevier, vol. 200(3), pages 521-528.
    5. Creal, Drew D., 2008. "Analysis of filtering and smoothing algorithms for Lévy-driven stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2863-2876, February.
    6. Lin, Ming & Chen, Rong & Mykland, Per, 2010. "On Generating Monte Carlo Samples of Continuous Diffusion Bridges," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 820-838.
    7. Godsill, Simon J. & Doucet, Arnaud & West, Mike, 2004. "Monte Carlo Smoothing for Nonlinear Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 156-168, January.
    8. Pitt, Michael K, 2002. "Smooth Particle Filters for Likelihood Evaluation and Maximisation," The Warwick Economics Research Paper Series (TWERPS) 651, University of Warwick, Department of Economics.
    9. Nicolas Chopin & Christian P. Robert, 2010. "Properties of nested sampling," Biometrika, Biometrika Trust, vol. 97(3), pages 741-755.
    10. Golightly, A. & Wilkinson, D.J., 2008. "Bayesian inference for nonlinear multivariate diffusion models observed with error," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1674-1693, January.
    11. Juan F. Rubio-Ramirez & Jesus Fernández-Villaverde, 2005. "Estimating dynamic equilibrium economies: linear versus nonlinear likelihood," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 891-910.
    12. Gareth O. Roberts & Omiros Papaspiliopoulos & Petros Dellaportas, 2004. "Bayesian inference for non‐Gaussian Ornstein–Uhlenbeck stochastic volatility processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 369-393, May.
    13. Paul Fearnhead & Zhen Liu, 2007. "On‐line inference for multiple changepoint problems," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 589-605, September.
    14. LeGland, François & Oudjane, Nadia, 2003. "A robustification approach to stability and to uniform particle approximation of nonlinear filters: the example of pseudo-mixing signals," Stochastic Processes and their Applications, Elsevier, vol. 106(2), pages 279-316, August.
    15. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    16. Nicolas Chopin, 2002. "A sequential particle filter method for static models," Biometrika, Biometrika Trust, vol. 89(3), pages 539-552, August.
    17. Ole E. Barndorff‐Nielsen & Neil Shephard, 2001. "Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 167-241.
    18. Johansen, Adam M., 2009. "SMCTC: Sequential Monte Carlo in C++," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 30(i06).
    19. Yuguo Chen & Junyi Xie & Jun S. Liu, 2005. "Stopping‐time resampling for sequential Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 199-217, April.
    20. Neil Shephard & Ole E. Barndorff-Nielsen & University of Aarhus, 2001. "Normal Modified Stable Processes," Economics Series Working Papers 72, University of Oxford, Department of Economics.
    21. Paul Fearnhead & Peter Clifford, 2003. "On‐line inference for hidden Markov models via particle filters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(4), pages 887-899, November.
    22. Mark A. Beaumont & Jean-Marie Cornuet & Jean-Michel Marin & Christian P. Robert, 2009. "Adaptive approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 96(4), pages 983-990.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    2. N. Chopin & P. E. Jacob & O. Papaspiliopoulos, 2013. "SMC-super-2: an efficient algorithm for sequential analysis of state space models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 397-426, June.
    3. Roman Liesenfeld & Guilherme V. Moura & Jean-François Richard & Hariharan Dharmarajan, 2013. "Efficient Likelihood Evaluation of State-Space Representations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(2), pages 538-567.
    4. repec:wyi:journl:002173 is not listed on IDEAS
    5. James Martin & Ajay Jasra & Emma McCoy, 2013. "Inference for a class of partially observed point process models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(3), pages 413-437, June.
    6. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2008. "How Structural Are Structural Parameters?," NBER Chapters, in: NBER Macroeconomics Annual 2007, Volume 22, pages 83-137, National Bureau of Economic Research, Inc.
    7. Creal, Drew D., 2008. "Analysis of filtering and smoothing algorithms for Lévy-driven stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2863-2876, February.
    8. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    9. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    10. Giuliano De Rossi, 2010. "Maximum Likelihood Estimation of the Cox–Ingersoll–Ross Model Using Particle Filters," Computational Economics, Springer;Society for Computational Economics, vol. 36(1), pages 1-16, June.
    11. Maciej Augustyniak & Mathieu Boudreault & Manuel Morales, 2018. "Maximum Likelihood Estimation of the Markov-Switching GARCH Model Based on a General Collapsing Procedure," Methodology and Computing in Applied Probability, Springer, vol. 20(1), pages 165-188, March.
    12. Elena Ehrlich & Ajay Jasra & Nikolas Kantas, 2015. "Gradient Free Parameter Estimation for Hidden Markov Models with Intractable Likelihoods," Methodology and Computing in Applied Probability, Springer, vol. 17(2), pages 315-349, June.
    13. C. C. Drovandi & A. N. Pettitt, 2011. "Estimation of Parameters for Macroparasite Population Evolution Using Approximate Bayesian Computation," Biometrics, The International Biometric Society, vol. 67(1), pages 225-233, March.
    14. Yan Qu & Angelos Dassios & Hongbiao Zhao, 2023. "Shot-noise cojumps: Exact simulation and option pricing," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 74(3), pages 647-665, March.
    15. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    16. Martin M. Andreasen, 2010. "Non-linear DSGE Models and The Optimized Particle Filter," CREATES Research Papers 2010-05, Department of Economics and Business Economics, Aarhus University.
    17. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    18. Golchi, Shirin & Campbell, David A., 2016. "Sequentially Constrained Monte Carlo," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 98-113.
    19. Karamé, Frédéric, 2018. "A new particle filtering approach to estimate stochastic volatility models with Markov-switching," Econometrics and Statistics, Elsevier, vol. 8(C), pages 204-230.
    20. Laurent-Emmanuel Calvet & Veronika Czellar, 2011. "State-Observation Sampling and the Econometrics of Learning Models," Working Papers hal-00625500, HAL.
    21. Drovandi, Christopher C. & Pettitt, Anthony N., 2011. "Likelihood-free Bayesian estimation of multivariate quantile distributions," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2541-2556, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:72:y:2010:i:3:p:269-342. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.