IDEAS home Printed from https://ideas.repec.org/a/oup/biomet/v105y2018i3p739-744..html
   My bibliography  Save this article

On Bayes factors for the linear model

Author

Listed:
  • T S Shively
  • S G Walker

Abstract

SummaryWe show that the Bayes factor for testing whether a subset of coefficients are zero in the normal linear regression model gives the uniformly most powerful test amongst the class of invariant tests discussed in Lehmann & Romano (2005) if the prior distributions for the regression coefficients are in a specific class of distributions. The priors in this class can have any elliptical distribution, with a specific scale matrix, for the subset of coefficients that are being tested. We also show under mild conditions that the Bayes factor gives the uniformly most powerful invariant test only if the prior for the coefficients being tested is an elliptical distribution with this scale matrix. The implications are discussed.

Suggested Citation

  • T S Shively & S G Walker, 2018. "On Bayes factors for the linear model," Biometrika, Biometrika Trust, vol. 105(3), pages 739-744.
    • Handle: RePEc:oup:biomet:v:105:y:2018:i:3:p:739-744.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/biomet/asy022
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrew J. Womack & Luis León-Novelo & George Casella, 2014. "Inference From Intrinsic Bayes' Procedures Under Model Selection and Uncertainty," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1040-1053, September.
    2. F. Javier Girón & M. Lina Martínez & Elías Moreno & Francisco Torres, 2006. "Objective Testing Procedures in Linear Models: Calibration of the p‐values," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(4), pages 765-784, December.
    3. Casella, George & Moreno, Elias, 2006. "Objective Bayesian Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 157-167, March.
    4. Liang, Feng & Paulo, Rui & Molina, German & Clyde, Merlise A. & Berger, Jim O., 2008. "Mixtures of g Priors for Bayesian Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 410-423, March.
    5. Valen E. Johnson & David Rossell, 2010. "On the use of non‐local prior densities in Bayesian hypothesis tests," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(2), pages 143-170, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido Consonni & Roberta Paroli, 2017. "Objective Bayesian Comparison of Constrained Analysis of Variance Models," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 589-609, September.
    2. Rui Wang & Xingzhong Xu, 2021. "A Bayesian-motivated test for high-dimensional linear regression models with fixed design matrix," Statistical Papers, Springer, vol. 62(4), pages 1821-1852, August.
    3. Arnab Kumar Maity & Sanjib Basu & Santu Ghosh, 2021. "Bayesian criterion‐based variable selection," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(4), pages 835-857, August.
    4. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    5. Gilles Celeux & Mohammed El Anbari & Jean-Michel Marin & Christian P. Robert, 2010. "Regularization in Regression : Comparing Bayesian and Frequentist Methods in a Poorly Informative Situation," Working Papers 2010-43, Center for Research in Economics and Statistics.
    6. Min Wang & Xiaoqian Sun & Tao Lu, 2015. "Bayesian structured variable selection in linear regression models," Computational Statistics, Springer, vol. 30(1), pages 205-229, March.
    7. Valen E. Johnson & David Rossell, 2010. "On the use of non‐local prior densities in Bayesian hypothesis tests," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(2), pages 143-170, March.
    8. Byron Botha & Rulof Burger & Kevin Kotzé & Neil Rankin & Daan Steenkamp, 2023. "Big data forecasting of South African inflation," Empirical Economics, Springer, vol. 65(1), pages 149-188, July.
    9. Christian P. Robert, 2013. "On the jeffreys-Lindley's Paradox," Working Papers 2013-46, Center for Research in Economics and Statistics.
    10. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    11. Scott D. Goddard & Valen E. Johnson, 2016. "Restricted most powerful Bayesian tests for linear models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(4), pages 1162-1177, December.
    12. Kwon, Deukwoo & Landi, Maria Teresa & Vannucci, Marina & Issaq, Haleem J. & Prieto, DaRue & Pfeiffer, Ruth M., 2011. "An efficient stochastic search for Bayesian variable selection with high-dimensional correlated predictors," Computational Statistics & Data Analysis, Elsevier, vol. 55(10), pages 2807-2818, October.
    13. Dimitris Fouskakis & Ioannis Ntzoufras, 2020. "Bayesian Model Averaging Using Power-Expected-Posterior Priors," Econometrics, MDPI, vol. 8(2), pages 1-15, May.
    14. Guido Consonni & Luca La Rocca, 2010. "Moment Priors for Bayesian Model Choice with Applications to Directed Acyclic Graphs," Quaderni di Dipartimento 115, University of Pavia, Department of Economics and Quantitative Methods.
    15. Dimitris Fouskakis & Ioannis Ntzoufras, 2017. "Information consistency of the Jeffreys power-expected-posterior prior in Gaussian linear models," METRON, Springer;Sapienza Università di Roma, vol. 75(3), pages 371-380, December.
    16. Sang Gil Kang & Woo Dong Lee & Yongku Kim, 2022. "Objective Bayesian group variable selection for linear model," Computational Statistics, Springer, vol. 37(3), pages 1287-1310, July.
    17. Andrew J. Womack & Luis León-Novelo & George Casella, 2014. "Inference From Intrinsic Bayes' Procedures Under Model Selection and Uncertainty," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1040-1053, September.
    18. Miguel A. Negrín & Francisco J. Vázquez-Polo & María Martel & Elías Moreno & Francisco J. Girón, 2010. "Bayesian Variable Selection in Cost-Effectiveness Analysis," IJERPH, MDPI, vol. 7(4), pages 1-20, April.
    19. Diego Salmeron & Juan Antonio Cano & Christian Robert, 2013. "Objective bayesian Hypothesis Testing in Binomial Regression Models with Integral Prior Distributions," Working Papers 2013-44, Center for Research in Economics and Statistics.
    20. Gelman Andrew & Robert Christian P. & Rousseau Judith, 2013. "Inherent difficulties of non-Bayesian likelihood-based inference, as revealed by an examination of a recent book by Aitkin," Statistics & Risk Modeling, De Gruyter, vol. 30(2), pages 105-120, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:biomet:v:105:y:2018:i:3:p:739-744.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/biomet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.