Computational Efficiency in Bayesian Model and Variable Selection
AbstractThis paper is concerned with the efficient implementation of Bayesian model averaging (BMA) and Bayesian variable selection, when the number of candidate variables and models is large, and estimation of posterior model probabilities must be based on a subset of the models. Efficient implementation is concerned with two issues, the efficiency of the MCMC algorithm itself and efficient computation of the quantities needed to obtain a draw from the MCMC algorithm. For the first aspect, it is desirable that the chain moves well and quickly through the model space and takes draws from regions with high probabilities. In this context there is a natural trade-off between local moves, which make use of the current parameter values to propose plausible values for model parameters, and more global transitions, which potentially allow exploration of the distribution of interest in fewer steps, but where each step is more computationally intensive. We assess the convergence properties of simple samplers based on local moves and some recently proposed algorithms intended to improve on the basic samplers. For the second aspect, efficient computation within the sampler, we focus on the important case of linear models where the computations essentially reduce to least squares calculations. When the chain makes local moves, adding or dropping a variable, substantial gains in efficiency can be made by updating the previous least squares solution.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Department of Economics, Central bank of Iceland in its series Economics with number wp35.
Date of creation: May 2007
Date of revision:
Other versions of this item:
- Eklund, Jana & Karlsson, Sune, 2007. "Computational Efficiency in Bayesian Model and Variable Selection," Working Papers 2007:4, Örebro University, School of Business.
- C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
- C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001.
"Benchmark priors for Bayesian model averaging,"
Journal of Econometrics,
Elsevier, vol. 100(2), pages 381-427, February.
- Carmen Fernandez & E Ley & Mark F J Steel, 2004. "Benchmark priors for Bayesian models averaging," ESE Discussion Papers 66, Edinburgh School of Economics, University of Edinburgh.
- Carmen Fernandez & Eduardo Ley & Mark F.J. Steel, 1998. "Benchmark Priors for Bayesian Model Averaging," Econometrics 9804001, EconWPA, revised 31 Jul 1999.
- Smith, Michael & Kohn, Robert, 1996.
"Nonparametric regression using Bayesian variable selection,"
Journal of Econometrics,
Elsevier, vol. 75(2), pages 317-343, December.
- Smith, M. & Kohn, R., . "Nonparametric Regression using Bayesian Variable Selection," Statistics Working Paper _009, Australian Graduate School of Management.
- Gary Koop & Simon Potter, 2004. "Forecasting in dynamic factor models using Bayesian model averaging," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 550-565, December.
- Sune Karlsson & Tor Jacobson, 2004.
"Finding good predictors for inflation: a Bayesian model averaging approach,"
Journal of Forecasting,
John Wiley & Sons, Ltd., vol. 23(7), pages 479-496.
- Jacobson, Tor & Karlsson, Sune, 2002. "Finding Good Predictors for Inflation: A Bayesian Model Averaging Approach," Working Paper Series 138, Sveriges Riksbank (Central Bank of Sweden).
- Jesús Crespo-Cuaresma & Gernot Doppelhofer & Martin Feldkircher, 2009.
"The Determinants of Economic Growth in European Regions,"
CESifo Working Paper Series
2519, CESifo Group Munich.
- Jesus Crespo Cuaresma & Gernot Doppelhofer & Martin Feldkircher, 2008. "The Determinants of Economic Growth in European Regions," Working Papers 2008-26, Faculty of Economics and Statistics, University of Innsbruck.
- Jesus Crespo-Cuaresma & Gernot Doppelhofer & Martin Feldkircher, 2009. "The Determinants of Economic Growth in European Regions," wiiw Working Papers 57, The Vienna Institute for International Economic Studies, wiiw.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Central Bank of Iceland).
If references are entirely missing, you can add them using this form.