IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v67y2015i5p963-997.html
   My bibliography  Save this article

On consistency and optimality of Bayesian variable selection based on $$g$$ g -prior in normal linear regression models

Author

Listed:
  • Minerva Mukhopadhyay
  • Tapas Samanta
  • Arijit Chakrabarti

Abstract

Consider Bayesian variable selection in normal linear regression models based on Zellner’s $$g$$ g -prior. We study theoretical properties of this method when the sample size $$n$$ n grows and consider the cases when the number of regressors, $$p$$ p is fixed and when it grows with $$n$$ n . We first consider the situation where the true model is not in the model space and prove under mild conditions that the method is consistent and “loss efficient” in appropriate sense. We then consider the case when the true model is in the model space and prove that the posterior probability of the true model goes to one as $$n$$ n goes to infinity. “Loss efficiency” is also proved in this situation. We give explicit conditions on the rate of growth of $$g$$ g , possibly depending on that of $$p$$ p as $$n$$ n grows, for our results to hold. This helps in making recommendations for the choice of $$g$$ g . Copyright The Institute of Statistical Mathematics, Tokyo 2015

Suggested Citation

  • Minerva Mukhopadhyay & Tapas Samanta & Arijit Chakrabarti, 2015. "On consistency and optimality of Bayesian variable selection based on $$g$$ g -prior in normal linear regression models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(5), pages 963-997, October.
  • Handle: RePEc:spr:aistmt:v:67:y:2015:i:5:p:963-997
    DOI: 10.1007/s10463-014-0483-8
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10463-014-0483-8
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10463-014-0483-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    2. Liang, Feng & Paulo, Rui & Molina, German & Clyde, Merlise A. & Berger, Jim O., 2008. "Mixtures of g Priors for Bayesian Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 410-423, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Minerva Mukhopadhyay & Tapas Samanta, 2017. "A mixture of g-priors for variable selection when the number of regressors grows with the sample size," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(2), pages 377-404, June.
    2. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    3. Minerva Mukhopadhyay & Sourabh Bhattacharya, 2022. "Bayes factor asymptotics for variable selection in the Gaussian process framework," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(3), pages 581-613, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anna Sokolova, 2023. "Marginal Propensity to Consume and Unemployment: a Meta-analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 813-846, December.
    2. Ley, Eduardo & Steel, Mark F.J., 2012. "Mixtures of g-priors for Bayesian model averaging with economic applications," Journal of Econometrics, Elsevier, vol. 171(2), pages 251-266.
    3. Jesus Crespo Cuaresma & Bettina Grün & Paul Hofmarcher & Stefan Humer & Mathias Moser, 2015. "A Comprehensive Approach to Posterior Jointness Analysis in Bayesian Model Averaging Applications," Department of Economics Working Papers wuwp193, Vienna University of Economics and Business, Department of Economics.
    4. Philipp Piribauer & Jesús Crespo Cuaresma, 2016. "Bayesian Variable Selection in Spatial Autoregressive Models," Spatial Economic Analysis, Taylor & Francis Journals, vol. 11(4), pages 457-479, October.
    5. Ley, Eduardo & Steel, Mark F. J., 2007. "On the effect of prior assumptions in Bayesian model averaging with applications to growth regression," Policy Research Working Paper Series 4238, The World Bank.
    6. Aart Kraay & Norikazu Tawara, 2013. "Can specific policy indicators identify reform priorities?," Journal of Economic Growth, Springer, vol. 18(3), pages 253-283, September.
    7. Crespo Cuaresma, Jesus & von Schweinitz, Gregor & Wendt, Katharina, 2019. "On the empirics of reserve requirements and economic growth," Journal of Macroeconomics, Elsevier, vol. 60(C), pages 253-274.
    8. Jesús Crespo Cuaresma & Martin Feldkircher, 2013. "Spatial Filtering, Model Uncertainty And The Speed Of Income Convergence In Europe," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(4), pages 720-741, June.
    9. Chen Ray-Bing & Lee Kuo-Jung & Chen Yi-Chi & Chu Chi-Hsiang, 2017. "On the determinants of the 2008 financial crisis: a Bayesian approach to the selection of groups and variables," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 21(5), pages 1-17, December.
    10. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    11. Bruns, Stephan B. & Ioannidis, John P.A., 2020. "Determinants of economic growth: Different time different answer?," Journal of Macroeconomics, Elsevier, vol. 63(C).
    12. Gilles Celeux & Mohammed El Anbari & Jean-Michel Marin & Christian P. Robert, 2010. "Regularization in Regression : Comparing Bayesian and Frequentist Methods in a Poorly Informative Situation," Working Papers 2010-43, Center for Research in Economics and Statistics.
    13. Theo S. Eicher & Chris Papageorgiou & Adrian E. Raftery, 2011. "Default priors and predictive performance in Bayesian model averaging, with application to growth determinants," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 30-55, January/F.
    14. Korobilis, Dimitris, 2013. "Hierarchical shrinkage priors for dynamic regressions with many predictors," International Journal of Forecasting, Elsevier, vol. 29(1), pages 43-59.
    15. Min Wang & Guangying Liu, 2016. "A Simple Two-Sample Bayesian t -Test for Hypothesis Testing," The American Statistician, Taylor & Francis Journals, vol. 70(2), pages 195-201, May.
    16. Njindan Iyke, Bernard, 2015. "Macro Determinants of the Real Exchange Rate in a Small Open Small Island Economy: Evidence from Mauritius via BMA," MPRA Paper 68968, University Library of Munich, Germany.
    17. João M. Sousa & Ricardo M. Sousa, 2019. "Asset Returns Under Model Uncertainty: Evidence from the Euro Area, the US and the UK," Computational Economics, Springer;Society for Computational Economics, vol. 54(1), pages 139-176, June.
    18. Rockey, James & Temple, Jonathan, 2016. "Growth econometrics for agnostics and true believers," European Economic Review, Elsevier, vol. 81(C), pages 86-102.
    19. Min Wang & Xiaoqian Sun & Tao Lu, 2015. "Bayesian structured variable selection in linear regression models," Computational Statistics, Springer, vol. 30(1), pages 205-229, March.
    20. Katrin Wölfel & Christoph S. Weber, 2017. "Searching for the Fed’s reaction function," Empirical Economics, Springer, vol. 52(1), pages 191-227, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:67:y:2015:i:5:p:963-997. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.