IDEAS home Printed from https://ideas.repec.org/a/eee/ecosta/v33y2025icp35-55.html
   My bibliography  Save this article

Flexible and Robust Particle Tempering for State Space Models

Author

Listed:
  • Gunawan, David
  • Kohn, Robert
  • Tran, Minh Ngoc

Abstract

Density tempering (also called density annealing) is a sequential Monte Carlo approach to Bayesian inference for general state models which is an alternative to Markov chain Monte Carlo. When applied to state space models, it moves a collection of parameters and latent states (which are called particles) through a number of stages, with each stage having its own target distribution. The particles are initially generated from a distribution that is easy to sample from, e.g. the prior; the target at the final stage is the posterior distribution. Tempering is usually carried out either in batch mode, involving all the data at each stage, or sequentially with observations added at each stage, which is called data tempering. Efficient Markov moves for generating the parameters and states for each stage of particle based density tempering are proposed. This allows the proposed SMC methods to increase (scale up) the number of parameters and states that can be handled. Most current methods use a pseudo-marginal Markov move step with the states “integrated out”, and the parameters generated by a random walk proposal; although this strategy is general, it can be very inefficient when the states or parameters are high dimensional. By adding batch tempering at each stage, previous methods are extended to make data tempering more robust to outliers and structural changes for models with intractable likelihoods. The performance of the proposed methods is evaluated using univariate stochastic volatility models with outliers and structural breaks, and high dimensional factor stochastic volatility models having many parameters and many latent states.11This article has an online supplement that contains additional technical details and empirical results.

Suggested Citation

  • Gunawan, David & Kohn, Robert & Tran, Minh Ngoc, 2025. "Flexible and Robust Particle Tempering for State Space Models," Econometrics and Statistics, Elsevier, vol. 33(C), pages 35-55.
  • Handle: RePEc:eee:ecosta:v:33:y:2025:i:c:p:35-55
    DOI: 10.1016/j.ecosta.2022.09.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2452306222000843
    Download Restriction: Full text for ScienceDirect subscribers only. Contains open access articles

    File URL: https://libkey.io/10.1016/j.ecosta.2022.09.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. Fulop, Andras & Li, Junye, 2013. "Efficient learning via simulation: A marginalized resample-move approach," Journal of Econometrics, Elsevier, vol. 176(2), pages 146-161.
    3. Zhou, Xiaocong & Nakajima, Jouchi & West, Mike, 2014. "Bayesian forecasting and portfolio decisions using dynamic dependent sparse factor models," International Journal of Forecasting, Elsevier, vol. 30(4), pages 963-980.
    4. Bodnar, Taras & Mazur, Stepan & Okhrin, Yarema, 2017. "Bayesian estimation of the global minimum variance portfolio," European Journal of Operational Research, Elsevier, vol. 256(1), pages 292-307.
    5. Stein, Elias M & Stein, Jeremy C, 1991. "Stock Price Distributions with Stochastic Volatility: An Analytic Approach," The Review of Financial Studies, Society for Financial Studies, vol. 4(4), pages 727-752.
    6. Jensen, Mark J. & Maheu, John M., 2010. "Bayesian semiparametric stochastic volatility modeling," Journal of Econometrics, Elsevier, vol. 157(2), pages 306-316, August.
    7. Richard Gerlach & Chris Carter & Robert Kohn, 1999. "Diagnostics for Time Series Analysis," Journal of Time Series Analysis, Wiley Blackwell, vol. 20(3), pages 309-330, May.
    8. Chib, Siddhartha & Nardari, Federico & Shephard, Neil, 2006. "Analysis of high dimensional multivariate stochastic volatility models," Journal of Econometrics, Elsevier, vol. 134(2), pages 341-371, October.
    9. Aguilar, Omar & West, Mike, 2000. "Bayesian Dynamic Factor Models and Portfolio Allocation," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(3), pages 338-357, July.
    10. Nardari, Federico & Scruggs, John T., 2007. "Bayesian Analysis of Linear Factor Models with Latent Factors, Multivariate Stochastic Volatility, and APT Pricing Restrictions," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 42(4), pages 857-891, December.
    11. Jin-Chuan Duan & Andras Fulop, 2015. "Density-Tempered Marginalized Sequential Monte Carlo Samplers," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 192-202, April.
    12. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    13. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    14. Arnaud Dufays, 2016. "Evolutionary Sequential Monte Carlo Samplers for Change-Point Models," Econometrics, MDPI, vol. 4(1), pages 1-33, March.
    15. N. Chopin & P. E. Jacob & O. Papaspiliopoulos, 2013. "SMC-super-2: an efficient algorithm for sequential analysis of state space models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 397-426, June.
    16. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    17. Gregor Kastner & Sylvia Fruhwirth-Schnatter & Hedibert Freitas Lopes, 2016. "Efficient Bayesian Inference for Multivariate Factor Stochastic Volatility Models," Papers 1602.08154, arXiv.org, revised Jul 2017.
    18. Katja Ignatieva & Paulo Rodrigues & Norman Seeger, 2015. "Empirical Analysis of Affine Versus Nonaffine Variance Specifications in Jump-Diffusion Models for Equity Indices," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 68-75, January.
    19. Christopher Nemeth & Chris Sherlock & Paul Fearnhead, 2016. "Particle Metropolis-adjusted Langevin algorithms," Biometrika, Biometrika Trust, vol. 103(3), pages 701-717.
    20. repec:dau:papers:123456789/7305 is not listed on IDEAS
    21. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    22. Mark Girolami & Ben Calderhead, 2011. "Riemann manifold Langevin and Hamiltonian Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(2), pages 123-214, March.
    23. George Deligiannidis & Arnaud Doucet & Michael K. Pitt, 2018. "The correlated pseudomarginal method," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(5), pages 839-870, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    2. Martin, Gael M. & Frazier, David T. & Maneesoonthorn, Worapree & Loaiza-Maya, Rubén & Huber, Florian & Koop, Gary & Maheu, John & Nibbering, Didier & Panagiotelis, Anastasios, 2024. "Bayesian forecasting in economics and finance: A modern review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 811-839.
    3. Gregor Kastner & Sylvia Fruhwirth-Schnatter & Hedibert Freitas Lopes, 2016. "Efficient Bayesian Inference for Multivariate Factor Stochastic Volatility Models," Papers 1602.08154, arXiv.org, revised Jul 2017.
    4. Mike K. P. So & C. Y. Choi, 2009. "A threshold factor multivariate stochastic volatility model," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(8), pages 712-735.
    5. Baştürk, N. & Borowska, A. & Grassi, S. & Hoogerheide, L. & van Dijk, H.K., 2019. "Forecast density combinations of dynamic models and data driven portfolio strategies," Journal of Econometrics, Elsevier, vol. 210(1), pages 170-186.
    6. Brignone, Riccardo & Gonzato, Luca & Lütkebohmert, Eva, 2023. "Efficient Quasi-Bayesian Estimation of Affine Option Pricing Models Using Risk-Neutral Cumulants," Journal of Banking & Finance, Elsevier, vol. 148(C).
    7. Virbickaitė, Audronė & Frey, Christoph & Macedo, Demian N., 2020. "Bayesian sequential stock return prediction through copulas," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    8. Rezitis, Anthony N. & Kastner, Gregor, 2021. "On the joint volatility dynamics in international dairy commodity markets," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 60(2), January.
    9. Andras Fulop & Jeremy Heng & Junye Li, 2022. "Efficient Likelihood-based Estimation via Annealing for Dynamic Structural Macrofinance Models," Papers 2201.01094, arXiv.org.
    10. Gunawan, David & Kohn, Robert & Nott, David, 2021. "Variational Bayes approximation of factor stochastic volatility models," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1355-1375.
    11. Lopes, Hedibert F. & McCulloch, Robert E. & Tsay, Ruey S., 2022. "Parsimony inducing priors for large scale state–space models," Journal of Econometrics, Elsevier, vol. 230(1), pages 39-61.
    12. Gareth W. Peters & Rodrigo S. Targino & Mario V. Wüthrich, 2017. "Bayesian Modelling, Monte Carlo Sampling and Capital Allocation of Insurance Risks," Risks, MDPI, vol. 5(4), pages 1-51, September.
    13. Duan, Jin-Chuan & Fulop, Andras & Hsieh, Yu-Wei, 2020. "Data-cloning SMC2: A global optimizer for maximum likelihood estimation of latent variable models," Computational Statistics & Data Analysis, Elsevier, vol. 143(C).
    14. Anthony N. Rezitis & Gregor Kastner, 2021. "On the joint volatility dynamics in dairy markets," Papers 2104.12707, arXiv.org.
    15. Arnaud Dufays, 2014. "On the conjugacy of off-line and on-line Sequential Monte Carlo Samplers," Working Paper Research 263, National Bank of Belgium.
    16. Darjus Hosszejni & Gregor Kastner, 2019. "Modeling Univariate and Multivariate Stochastic Volatility in R with stochvol and factorstochvol," Papers 1906.12123, arXiv.org, revised Feb 2021.
    17. Kastner, Gregor, 2019. "Sparse Bayesian time-varying covariance estimation in many dimensions," Journal of Econometrics, Elsevier, vol. 210(1), pages 98-115.
    18. Arnaud Dufays, 2016. "Evolutionary Sequential Monte Carlo Samplers for Change-Point Models," Econometrics, MDPI, vol. 4(1), pages 1-33, March.
    19. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    20. Joshua C. C. Chan, 2024. "BVARs and stochastic volatility," Chapters, in: Michael P. Clements & Ana Beatriz Galvão (ed.), Handbook of Research Methods and Applications in Macroeconomic Forecasting, chapter 3, pages 43-67, Edward Elgar Publishing.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecosta:v:33:y:2025:i:c:p:35-55. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/econometrics-and-statistics .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.