Advanced Search
MyIDEAS: Login to save this paper or follow this series

A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods

Contents:

Author Info

  • David Ardia

    (University of Fribourg, aeris CAPITAL AG, Switzerland)

  • Nalan Basturk

    (Erasmus University Rotterdam)

  • Lennart Hoogerheide

    (Erasmus University Rotterdam)

  • Herman K. van Dijk

    (Erasmus University Rotterdam)

Abstract

Strategic choices for efficient and accurate evaluation of marginal likelihoods by means of Monte Carlo simulation methods are studied for the case of highly non-elliptical posterior distributions. A comparative analysis is presented of possible advantages and limitations of different simulation techniques; of possible choices of candidate distributions and choices of target or warped target distributions; and finally of numerical standard errors. The importance of a robust and flexible estimation strategy is demonstrated where the complete posterior distribution is explored. Given an appropriately yet quickly tuned adaptive candidate, straightforward importance sampling provides a computationally efficient estimator of the marginal likelihood (and a reliable and easily computed corresponding numerical standard error) in the cases investigated in this paper, which include a non-linear regression model and a mixture GARCH model. Warping the posterior density can lead to a further gain in efficiency, but it is more important that the posterior kernel is appropriately wrapped by the candidate distribution than that is warped.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://papers.tinbergen.nl/10059.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Tinbergen Institute in its series Tinbergen Institute Discussion Papers with number 10-059/4.

as in new window
Length:
Date of creation: 21 Jun 2010
Date of revision:
Handle: RePEc:dgr:uvatin:20100059

Contact details of provider:
Web page: http://www.tinbergen.nl

Related research

Keywords: marginal likelihood; Bayes factor; importance sampling; bridge sampling; adaptive mixture of Student-t distributions;

Other versions of this item:

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2008. "Adaptive mixture of Student-t distributions as a flexible candidate distribution for efficient simulation: the R package AdMit," DQE Working Papers 9, Department of Quantitative Economics, University of Freiburg/Fribourg Switzerland, revised 07 Jan 2009.
  2. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2008. "AdMit: Adaptive Mixtures of Student-t Distributions," DQE Working Papers 10, Department of Quantitative Economics, University of Freiburg/Fribourg Switzerland, revised 07 Jan 2009.
  3. Hoogerheide, L.F. & Kaashoek, J.F. & van Dijk, H.K., 2005. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: an application of flexible sampling methods using neural networks," Econometric Institute Research Papers EI 2005-12, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  4. David Ardia & Nalan Basturk & Lennart Hoogerheide & Herman K. van Dijk, 2010. "A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods," Tinbergen Institute Discussion Papers 10-059/4, Tinbergen Institute.
  5. María Concepcion Ausin & Pedro Galeano, 2005. "Bayesian Estimation Of The Gaussian Mixture Garch Model," Statistics and Econometrics Working Papers ws053605, Universidad Carlos III, Departamento de Estadística y Econometría.
  6. repec:dgr:uvatin:2009017 is not listed on IDEAS
  7. van Dijk, H. K. & Kloek, T., 1980. "Further experience in Bayesian analysis using Monte Carlo integration," Journal of Econometrics, Elsevier, vol. 14(3), pages 307-328, December.
  8. Fruhwirth-Schnatter S., 2001. "Markov Chain Monte Carlo Estimation of Classical and Dynamic Switching and Mixture Models," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 194-209, March.
  9. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
  10. Bauwens, L. & Bos, C.S. & van Dijk, H.K. & van Oest, R.D., 2003. "Adaptive radial-based direction sampling; Some flexible and robust Monte Carlo integration methods," Econometric Institute Research Papers EI 2003-22, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  11. David Ardia & Lennart Hoogerheide & Herman K. van Dijk, 2009. "To Bridge, to Warp or to Wrap? A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods," Tinbergen Institute Discussion Papers 09-017/4, Tinbergen Institute.
  12. Eklund, Jana & Karlsson, Sune, 2005. "Forecast Combination and Model Averaging using Predictive Measures," Working Paper Series 191, Sveriges Riksbank (Central Bank of Sweden).
  13. David Ardia & Lennart F. Hoogerheide & Herman K. van Dijk, 2008. "Adaptive Mixture of Student-t distributions as a Flexible Candidate Distribution for Efficient Simulation," Tinbergen Institute Discussion Papers 08-062/4, Tinbergen Institute, revised 15 Dec 2008.
  14. Han C. & Carlin B. P., 2001. "Markov Chain Monte Carlo Methods for Computing Bayes Factors: A Comparative Review," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1122-1132, September.
  15. Frühwirth-Schnatter, Sylvia & Wagner, Helga, 2008. "Marginal likelihoods for non-Gaussian models using auxiliary mixture sampling," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4608-4624, June.
  16. H. K. Van Dijk, 1999. "Some remarks on the simulation revolution in bayesian econometric inference," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 105-112.
  17. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
  18. Tatiana Miazhynskaia & Georg Dorffner, 2006. "A comparison of Bayesian model selection based on MCMC with an application to GARCH-type models," Statistical Papers, Springer, vol. 47(4), pages 525-549, October.
  19. Hop, J Peter & Van Dijk, Herman K, 1992. "SISAM and MIXIN: Two Algorithms for the Computation of Posterior Moments and Densities Using Monte Carlo Integration," Computer Science in Economics & Management, Society for Computational Economics, vol. 5(3), pages 183-220, August.
  20. Whitney K. Newey & Kenneth D. West, 1986. "A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix," NBER Technical Working Papers 0055, National Bureau of Economic Research, Inc.
  21. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-39, November.
  22. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Luc Luc & Arnaud Dufays & Jeroen V.K. Rombouts, 2011. "Marginal Likelihood for Markov-switching and Change-point Garch Models," CREATES Research Papers 2011-41, School of Economics and Management, University of Aarhus.
  2. Ardia, David & Hoogerheide, Lennart F., 2010. "Efficient Bayesian estimation and combination of GARCH-type models," MPRA Paper 22919, University Library of Munich, Germany.
  3. Arnold Zellner & Tomohiro Ando & Nalan Basturk & Lennart Hoogerheide & Herman K. van Dijk, 2011. "Instrumental Variables, Errors in Variables, and Simultaneous Equations Models: Applicability and Limitations of Direct Monte Carlo," Tinbergen Institute Discussion Papers 11-137/4, Tinbergen Institute.
  4. David Ardia & Nalan Basturk & Lennart Hoogerheide & Herman K. van Dijk, 2010. "A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods," Tinbergen Institute Discussion Papers 10-059/4, Tinbergen Institute.
  5. Chan, Joshua & Eisenstat, Eric, 2012. "Marginal Likelihood Estimation with the Cross-Entropy Method," MPRA Paper 40051, University Library of Munich, Germany.
  6. repec:dgr:uvatin:2013047 is not listed on IDEAS
  7. repec:luc:wpaper:14-07 is not listed on IDEAS
  8. Lukasz Gatarek & Lennart Hoogerheide & Koen Hooning & Herman K. van Dijk, 2013. "Censored Posterior and Predictive Likelihood in Left-Tail Prediction for Accurate Value at Risk Estimation," Tinbergen Institute Discussion Papers 13-060/III, Tinbergen Institute, revised 06 Mar 2014.
  9. Loza-Reyes, E. & Hurn, M.A. & Robinson, A., 2014. "Classification of molecular sequence data using Bayesian phylogenetic mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 81-95.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:dgr:uvatin:20100059. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Antoine Maartens (+31 626 - 160 892)).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.