Marginal likelihood estimation via power posteriors
AbstractModel choice plays an increasingly important role in statistics. From a Bayesian perspective a crucial goal is to compute the marginal likelihood of the data for a given model. However, this is typically a difficult task since it amounts to integrating over all model parameters. The aim of the paper is to illustrate how this may be achieved by using ideas from thermodynamic integration or path sampling. We show how the marginal likelihood can be computed via Markov chain Monte Carlo methods on modified posterior distributions for each model. This then allows Bayes factors or posterior model probabilities to be calculated. We show that this approach requires very little tuning and is straightforward to implement. The new method is illustrated in a variety of challenging statistical settings. Copyright (c) 2008 Royal Statistical Society.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Royal Statistical Society in its journal Journal of the Royal Statistical Society: Series B (Statistical Methodology).
Volume (Year): 70 (2008)
Issue (Month): 3 ()
Contact details of provider:
Postal: 12 Errol Street, London EC1Y 8LX, United Kingdom
Web page: http://wileyonlinelibrary.com/journal/rssb
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Ian L. Dryden & Mark R. Scarr & Charles C. Taylor, 2003. "Bayesian texture segmentation of weed and crop images using reversible jump Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 52(1), pages 31-50.
- Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
- Sisson, Scott A., 2005. "Transdimensional Markov Chains: A Decade of Progress and Future Perspectives," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1077-1089, September.
- R. Reeves, 2004. "Efficient recursions for general factorisable models," Biometrika, Biometrika Trust, vol. 91(3), pages 751-757, September.
- Francesco Bartolucci & Luisa Scaccia & Antonietta Mira, 2006. "Efficient Bayes factor estimation from the reversible jump output," Biometrika, Biometrika Trust, vol. 93(1), pages 41-52, March.
- Jose M. Perez, 2002. "Expected-posterior prior distributions for model selection," Biometrika, Biometrika Trust, vol. 89(3), pages 491-512, August.
- S. P. Brooks & P. Giudici & G. O. Roberts, 2003. "Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 3-39.
- P. G. Ridall & A. N. Pettitt & N. Friel & P. A. McCombe & R. D. Henderson, 2007. "Motor unit number estimation using reversible jump Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 56(3), pages 235-269.
- Drovandi, Christopher C. & McGree, James M. & Pettitt, Anthony N., 2013. "Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 320-335.
- Heaps, Sarah E. & Boys, Richard J. & Farrow, Malcolm, 2014. "Computation of marginal likelihoods with data-dependent support for latent variables," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 392-401.
- Spezia, L. & Cooksley, S.L. & Brewer, M.J. & Donnelly, D. & Tree, A., 2014. "Modelling species abundance in a river by Negative Binomial hidden Markov models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 599-614.
- Calderhead, Ben & Girolami, Mark, 2009. "Estimating Bayes factors via thermodynamic integration and population MCMC," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4028-4045, October.
- Ryan, Elizabeth G. & Drovandi, Christopher C. & Thompson, M. Helen & Pettitt, Anthony N., 2014. "Towards Bayesian experimental design for nonlinear models that require a large number of sampling times," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 45-60.
- Chan, Joshua & Eisenstat, Eric, 2012.
"Marginal Likelihood Estimation with the Cross-Entropy Method,"
40051, University Library of Munich, Germany.
- Joshua C C Chan & Eric Eisenstat, 2012. "Marginal Likelihood Estimation with the Cross-Entropy Method," CAMA Working Papers 2012-18, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Lefebvre, Geneviève & Steele, Russell & Vandal, Alain C., 2010. "A path sampling identity for computing the Kullback-Leibler and J divergences," Computational Statistics & Data Analysis, Elsevier, vol. 54(7), pages 1719-1731, July.
- Jeong Eun Lee & Christian Robert, 2013. "Imortance Sampling Schemes for Evidence Approximation in Mixture Models," Working Papers 2013-42, Centre de Recherche en Economie et Statistique.
- Filippone, Maurizio & Sanguinetti, Guido, 2011. "Approximate inference of the bandwidth in multivariate kernel density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3104-3122, December.
- Joshua C.C. Chan & Angelia L. Grant, 2014. "Fast Computation of the Deviance Information Criterion for Latent Variable Models," CAMA Working Papers 2014-09, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.