Advanced Search
MyIDEAS: Login to save this article or follow this journal

Adaptive sampling for Bayesian variable selection

Contents:

Author Info

  • David J. Nott
  • Robert Kohn

Abstract

Our paper proposes adaptive Monte Carlo sampling schemes for Bayesian variable selection in linear regression that improve on standard Markov chain methods. We do so by considering Metropolis--Hastings proposals that make use of accumulated information about the posterior distribution obtained during sampling. Adaptation needs to be done carefully to ensure that sampling is from the correct ergodic distribution. We give conditions for the validity of an adaptive sampling scheme in this problem, and for simulating from a distribution on a finite state space in general, and suggest a class of adaptive proposal densities which uses best linear prediction to approximate the Gibbs sampler. Our sampling scheme is computationally much faster per iteration than the Gibbs sampler, and when this is taken into account the efficiency gains when using our sampling scheme compared to alternative approaches are substantial in terms of precision of estimation of posterior quantities of interest for a given amount of computation time. We compare our method with other sampling schemes for examples involving both real and simulated data. The methodology developed in the paper can be extended to variable selection in more general problems. Copyright 2005, Oxford University Press.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://hdl.handle.net/10.1093/biomet/92.4.747
Download Restriction: Access to full text is restricted to subscribers.

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Bibliographic Info

Article provided by Biometrika Trust in its journal Biometrika.

Volume (Year): 92 (2005)
Issue (Month): 4 (December)
Pages: 747-763

as in new window
Handle: RePEc:oup:biomet:v:92:y:2005:i:4:p:747-763

Contact details of provider:
Postal: Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK
Fax: 01865 267 985
Email:
Web page: http://biomet.oxfordjournals.org/

Order Information:
Web: http://www.oup.co.uk/journals

Related research

Keywords:

References

No references listed on IDEAS
You can help add them by filling out this form.

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Ley, Eduardo & Steel, Mark F.J., 2012. "Mixtures of g-priors for Bayesian model averaging with economic applications," Journal of Econometrics, Elsevier, vol. 171(2), pages 251-266.
  2. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2013. "A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density," Monash Econometrics and Business Statistics Working Papers 20/13, Monash University, Department of Econometrics and Business Statistics.
  3. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2007. "Nonparametric Regression Density Estimation Using Smoothly Varying Normal Mixtures," Working Paper Series 211, Sveriges Riksbank (Central Bank of Sweden).
  4. Fouskakis, D., 2012. "Bayesian variable selection in generalized linear models using a combination of stochastic optimization methods," European Journal of Operational Research, Elsevier, vol. 220(2), pages 414-422.
  5. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian identification, selection and estimation of semiparametric functions in high-dimensional additive models," Journal of Econometrics, Elsevier, vol. 143(2), pages 291-316, April.
  6. Giordani, Paolo & Kohn, Robert, 2006. "Efficient Bayesian Inference for Multiple Change-Point and Mixture Innovation Models," Working Paper Series 196, Sveriges Riksbank (Central Bank of Sweden).
  7. Ouysse, Rachida & Kohn, Robert, 2010. "Bayesian variable selection and model averaging in the arbitrage pricing theory model," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3249-3268, December.
  8. Eduardo Ley & Mark F.J. Steel, 2009. "On the effect of prior assumptions in Bayesian model averaging with applications to growth regression This article was published online on 30 March 2009. An error was subsequently identified. This not," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 651-674.
  9. Villani, Mattias & Kohn, Robert & Nott, David J., 2012. "Generalized smooth finite mixtures," Journal of Econometrics, Elsevier, vol. 171(2), pages 121-133.
  10. Paroli, Roberta & Spezia, Luigi, 2008. "Bayesian inference in non-homogeneous Markov mixtures of periodic autoregressions with state-dependent exogenous variables," Computational Statistics & Data Analysis, Elsevier, vol. 52(5), pages 2311-2330, January.
  11. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2009. "Regression density estimation using smooth adaptive Gaussian mixtures," Journal of Econometrics, Elsevier, vol. 153(2), pages 155-173, December.
  12. Ley, Eduardo & Steel, Mark F. J., 2007. "On the effect of prior assumptions in Bayesian model averaging with applications to growth regression," Policy Research Working Paper Series 4238, The World Bank.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:oup:biomet:v:92:y:2005:i:4:p:747-763. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Oxford University Press) or (Christopher F. Baum).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.