Bayesian Adaptively Updated Hamiltonian Monte Carlo with an Application to High-Dimensional BEKK GARCH Models
AbstractHamiltonian Monte Carlo (HMC) is a recent statistical procedure to sample from complex distributions. Distant proposal draws are taken in a sequence of steps following the Hamiltonian dynamics of the underlying parameter space, often yielding superior mixing properties of the resulting Markov chain. However, its performance can deteriorate sharply with the degree of irregularity of the underlying likelihood due to its lack of local adaptability in the parameter space. Riemann Manifold HMC (RMHMC), a locally adaptive version of HMC, alleviates this problem, but at a substantially increased computational cost that can become prohibitive in high-dimensional scenarios. In this paper we propose the Adaptively Updated HMC (AUHMC), an alternative inferential method based on HMC that is both fast and locally adaptive, combining the advantages of both HMC and RMHMC. The benefits become more pronounced with higher dimensionality of the parameter space and with the degree of irregularity of the underlying likelihood surface. We show that AUHMC satisfies detailed balance for a valid MCMC scheme and provide a comparison with RMHMC in terms of effective sample size, highlighting substantial efficiency gains of AUHMC. Simulation examples and an application of the BEKK GARCH model show the practical usefulness of the new posterior sampler.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by The Rimini Centre for Economic Analysis in its series Working Paper Series with number 46_12.
Date of creation: Jun 2012
Date of revision:
High-dimensional joint sampling; Markov chain Monte Carlo;
Other versions of this item:
- Burda Martin & Maheu John M., 2013. "Bayesian adaptively updated Hamiltonian Monte Carlo with an application to high-dimensional BEKK GARCH models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 17(4), pages 345-372, September.
- C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
- C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
- C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
- C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models
This paper has been announced in the following NEP Reports:
- NEP-ALL-2012-07-08 (All new papers)
- NEP-ECM-2012-07-08 (Econometrics)
- NEP-ETS-2012-07-08 (Econometric Time Series)
- NEP-ORE-2012-07-08 (Operations Research)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Engle, Robert F. & Kroner, Kenneth F., 1995. "Multivariate Simultaneous Generalized ARCH," Econometric Theory, Cambridge University Press, vol. 11(01), pages 122-150, February.
- BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," CORE Discussion Papers 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007.
"On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks,"
Journal of Econometrics,
Elsevier, vol. 139(1), pages 154-180, July.
- HOOGERHEIDE, Lennart F. & KAASHOEK, Johan F. & VAN DIJK, Herman K., 2005. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," CORE Discussion Papers 2005029, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Bauwens, L. & Bos, C.S. & Dijk, H.K. van & Oest, R.D. van, 2003.
"Adaptive radial-based direction sampling; Some flexible and robust Monte Carlo integration methods,"
Econometric Institute Report
EI 2003-22, Erasmus University Rotterdam, Econometric Institute.
- Bauwens, Luc & Bos, Charles S. & van Dijk, Herman K. & van Oest, Rutger D., 2004. "Adaptive radial-based direction sampling: some flexible and robust Monte Carlo integration methods," Journal of Econometrics, Elsevier, vol. 123(2), pages 201-225, December.
- BAUWENS, Luc & BOS, Charles S. & VAN DIJK, Herman K. & VAN OEST, Rutger D., . "Adaptive radial-based direction sampling: some flexible and robust Monte Carlo integration methods," CORE Discussion Papers RP -1731, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Chib, Siddhartha & Ramamurthy, Srikanth, 2010. "Tailored randomized block MCMC methods with application to DSGE models," Journal of Econometrics, Elsevier, vol. 155(1), pages 19-38, March.
- Osiewalski, Jacek & Pipien, Mateusz, 2004. "Bayesian comparison of bivariate ARCH-type models for the main exchange rates in Poland," Journal of Econometrics, Elsevier, vol. 123(2), pages 371-391, December.
- P. Dellaportas & I. D. Vrontos, 2007. "Modelling volatility asymmetries: a Bayesian analysis of a class of tree structured multivariate GARCH models," Econometrics Journal, Royal Economic Society, vol. 10(3), pages 503-520, November.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Roberto Patuelli).
If references are entirely missing, you can add them using this form.