Improving MCMC Using Efficient Importance Sampling
Abstract
This paper develops a systematic Markov Chain Monte Carlo (MCMC) framework based upon Efficient Importance Sampling (EIS) which can be used for the analysis of a wide range of econometric models involving integrals without an analytical solution. EIS is a simple, generic and yet accurate Monte-Carlo integration procedure based on sampling densities which are chosen to be global approximations to the integrand. By embedding EIS within MCMC procedures based on Metropolis-Hastings (MH) one can significantly improve their numerical properties, essentially by providing a fully automated selection of critical MCMC components such as auxiliary sampling densities, normalizing constants and starting values. The potential of this integrated MCMC- EIS approach is illustrated with simple univariate integration problems and with the Bayesian posterior analysis of stochastic volatility models and stationary autoregressive processes. --Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Christian-Albrechts-University of Kiel, Department of Economics in its series Economics Working Papers with number 2006,05.Length:
Date of creation: 2006
Date of revision:
Handle: RePEc:zbw:cauewp:4349
Contact details of provider:
Postal: D-24098 Kiel,Wilhelm-Seelig-Platz 1
Phone: 0431-880 3282
Fax: 0431-880 3150
Web page: http://www.wiso.uni-kiel.de/econ/
More information through EDIRC
Related research
Keywords: Autoregressive models; Bayesian posterior analysis; Dynamic latent variables; Gibbs sampling; Metropolis Hastings; Stochastic volatility;Other versions of this item:
- Liesenfeld, Roman & Richard, Jean-François, 2008. "Improving MCMC, using efficient importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 272-288, December.
- NEP-ALL-2006-08-05 (All new papers)
- NEP-ECM-2006-08-05 (Econometrics)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-39, November.
- Chib, Siddhartha & Greenberg, Edward, 1994. "Bayes inference in regression models with ARMA (p, q) errors," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 183-206.
- Roman Liesenfeld & Jean-Francois Richard, 2006.
"Classical and Bayesian Analysis of Univariate and Multivariate Stochastic Volatility Models,"
Econometric Reviews,
Taylor and Francis Journals, vol. 25(2-3), pages 335-360.
- Liesenfeld, Roman & Richard, Jean-François, 2004. "Classical and Bayesian Analysis of Univariate and Multivariate Stochastic Volatility Models," Economics Working Papers 2004,12, Christian-Albrechts-University of Kiel, Department of Economics.
- Jean-Francois Richard & Roman Liesenfeld, 2007. "Classical and Bayesian Analysis of Univariate and Multivariate Stochastic Volatility Models," Working Papers 322, University of Pittsburgh, Department of Economics, revised Jan 2004.
- BAUWENS, Luc & HAUTSCH, Nikolaus, 2003. "Dynamic latent factor models for intensity processes," CORE Discussion Papers 2003103, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Neil Shephard, 2005. "Stochastic Volatility," Economics Papers 2005-W17, Economics Group, Nuffield College, University of Oxford.
- Sangjoon Kim & Neil Shephard, 1994.
"Stochastic volatility: likelihood inference and comparison with ARCH models,"
Economics Papers
3., Economics Group, Nuffield College, University of Oxford.
- Kim, Sangjoon & Shephard, Neil & Chib, Siddhartha, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Wiley Blackwell, vol. 65(3), pages 361-93, July.
- Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1996. "Stochastic Volatility: Likelihood Inference And Comparison With Arch Models," Econometrics 9610002, EconWPA.
- Sangjoon Kim, Neil Shephard & Siddhartha Chib, . "Stochastic volatility: likelihood inference and comparison with ARCH models," Economics Papers W26, revised version of W, Economics Group, Nuffield College, University of Oxford.
- Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
- Ghysels, E. & Harvey, A. & Renault, E., 1996.
"Stochastic Volatility,"
Cahiers de recherche
9613, Universite de Montreal, Departement de sciences economiques.
- GHYSELS, Eric & HARVEY, Andrew & RENAULT, Eric, 1995. "Stochastic Volatility," CORE Discussion Papers 1995069, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Ghysels, E. & Harvey, A. & Renault, E., 1995. "Stochastic Volatility," Papers 95.400, Toulouse - GREMAQ.
- Ghysels, E. & Harvey, A. & Renault, E., 1996. "Stochastic Volatility," Cahiers de recherche 9613, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
- Eric Ghysels & Andrew Harvey & Éric Renault, 1995. "Stochastic Volatility," CIRANO Working Papers 95s-49, CIRANO.
- Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 2002.
"Bayesian Analysis of Stochastic Volatility Models,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 20(1), pages 69-87, January.
- Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 1994. "Bayesian Analysis of Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(4), pages 371-89, October.
- Luc Bauwens & Nikolaus Hautsch, 2006. "Stochastic Conditional Intensity Processes," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(3), pages 450-493.
- Liesenfeld, Roman & Richard, Jean-Francois, 2003. "Estimation of Dynamic Bivariate Mixture Models: Comments on Watanabe (2000)," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(4), pages 570-76, October.
- John Geweke, 1998.
"Using simulation methods for Bayesian econometric models: inference, development, and communication,"
Staff Report
249, Federal Reserve Bank of Minneapolis.
- John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor and Francis Journals, vol. 18(1), pages 1-73.
- Richard, Jean-Francois & Zhang, Wei, 2007.
"Efficient high-dimensional importance sampling,"
Journal of Econometrics,
Elsevier, vol. 141(2), pages 1385-1411, December.
- Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Papers 321, University of Pittsburgh, Department of Economics, revised Jan 2007.
- Liesenfeld, Roman & Richard, Jean-Francois, 2003. "Univariate and multivariate stochastic volatility models: estimation and diagnostics," Journal of Empirical Finance, Elsevier, vol. 10(4), pages 505-531, September.
- Chib, Siddhartha & Nardari, Federico & Shephard, Neil, 2002. "Markov chain Monte Carlo methods for stochastic volatility models," Journal of Econometrics, Elsevier, vol. 108(2), pages 281-316, June.
- Siem Jan Koopman & Neil Shephard, 2002. "Testing the Assumptions Behind the Use of Importance Sampling," Economics Papers 2002-W17, Economics Group, Nuffield College, University of Oxford.
- Sandmann, Gleb & Koopman, Siem Jan, 1998. "Estimation of stochastic volatility models via Monte Carlo maximum likelihood," Journal of Econometrics, Elsevier, vol. 87(2), pages 271-301, September.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Naylor, J.C. & Tremayne, A.R. & Marriott, J.M., 2010. "Exploratory data analysis and model criticism with posterior plots," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2707-2720, November.
- Bauwens, L. & Galli, F., 2009.
"Efficient importance sampling for ML estimation of SCD models,"
Computational Statistics & Data Analysis,
Elsevier, vol. 53(6), pages 1974-1992, April.
- BAUWENS, Luc & GALLI, Fausto, 2007. "Efficient importance sampling for ML estimation of SCD models," CORE Discussion Papers 2007053, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Luc, BAUWENS & Fausto Galli, 2007. "Efficient importance sampling for ML estimation of SCD models," Discussion Papers (ECON - Département des Sciences Economiques) 2007032, Université catholique de Louvain, Département des Sciences Economiques.
- Pastorello, S. & Rossi, E., 2010. "Efficient importance sampling maximum likelihood estimation of stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2753-2762, November.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:zbw:cauewp:4349For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (ZBW - German National Library of Economics).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

