IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v65y2024i2d10.1007_s00362-023-01441-0.html
   My bibliography  Save this article

Consistent group selection using nonlocal priors in regression

Author

Listed:
  • Fang Yang

    (University of Cincinnati)

  • Liangliang Zhang

    (Case Western Reserve University)

  • Jingyi Zheng

    (Auburn University)

  • Xuan Cao

    (University of Cincinnati)

Abstract

In many applications, variables can be naturally partitioned into different groups. We consider a hierarchical model with nonlocal priors over group-structured covariates to perform group selection in high-dimensional linear regression. While several frequentist and Bayesian approaches have been proposed for group selection, theoretical properties of Bayesian approaches using nonlocal priors have not been studied. Under mild conditions, we establish strong group selection consistency of the induced posterior when the number of covariates grows at nearly exponential rate with sample size. An efficient shotgun stochastic search algorithm tailored for the group selection is adopted for implementing our proposed approach and simulation studies are conducted to demonstrate its superior empirical performance. We further apply the proposed method to an fMRI dataset for identifying brain regions with altered functional activities to predict disease progression.

Suggested Citation

  • Fang Yang & Liangliang Zhang & Jingyi Zheng & Xuan Cao, 2024. "Consistent group selection using nonlocal priors in regression," Statistical Papers, Springer, vol. 65(2), pages 989-1019, April.
    • Handle: RePEc:spr:stpapr:v:65:y:2024:i:2:d:10.1007_s00362-023-01441-0
    DOI: 10.1007/s00362-023-01441-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-023-01441-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00362-023-01441-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Patrick Breheny, 2015. "The group exponential lasso for bi‐level variable selection," Biometrics, The International Biometric Society, vol. 71(3), pages 731-740, September.
    2. Xiao-Wei Song & Zhang-Ye Dong & Xiang-Yu Long & Su-Fang Li & Xi-Nian Zuo & Chao-Zhe Zhu & Yong He & Chao-Gan Yan & Yu-Feng Zang, 2011. "REST: A Toolkit for Resting-State Functional Magnetic Resonance Imaging Data Processing," PLOS ONE, Public Library of Science, vol. 6(9), pages 1-12, September.
    3. Veronika Ročková & Edward I. George, 2018. "The Spike-and-Slab LASSO," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 431-444, January.
    4. David Rossell & Donatello Telesca, 2017. "Nonlocal Priors for High-Dimensional Estimation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 254-265, January.
    5. Valen E. Johnson & David Rossell, 2012. "Bayesian Model Selection in High-Dimensional Settings," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 649-660, June.
    6. Weibing Li & Thierry Chekouo, 2022. "Bayesian group selection with non-local priors," Computational Statistics, Springer, vol. 37(1), pages 287-302, March.
    7. Naveen N. Narisetty & Juan Shen & Xuming He, 2019. "Skinny Gibbs: A Consistent and Scalable Gibbs Sampler for Model Selection," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(527), pages 1205-1217, July.
    8. Shi, Guiling & Lim, Chae Young & Maiti, Tapabrata, 2019. "Bayesian model selection for generalized linear models using non-local priors," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 285-296.
    9. Kyoungjae Lee & Xuan Cao, 2021. "Bayesian group selection in logistic regression with application to MRI data analysis," Biometrics, The International Biometric Society, vol. 77(2), pages 391-400, June.
    10. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ouyang, Jiarong & Cao, Xuan, 2024. "Consistent skinny Gibbs in probit regression," Computational Statistics & Data Analysis, Elsevier, vol. 198(C).
    2. Weibing Li & Thierry Chekouo, 2022. "Bayesian group selection with non-local priors," Computational Statistics, Springer, vol. 37(1), pages 287-302, March.
    3. Gonzalo García-Donato & María Eugenia Castellanos & Alicia Quirós, 2021. "Bayesian Variable Selection with Applications in Health Sciences," Mathematics, MDPI, vol. 9(3), pages 1-16, January.
    4. Tanin Sirimongkolkasem & Reza Drikvandi, 2019. "On Regularisation Methods for Analysis of High Dimensional Data," Annals of Data Science, Springer, vol. 6(4), pages 737-763, December.
    5. Arfan Raheen Afzal & Jing Yang & Xuewen Lu, 2021. "Variable selection in partially linear additive hazards model with grouped covariates and a diverging number of parameters," Computational Statistics, Springer, vol. 36(2), pages 829-855, June.
    6. Mogliani, Matteo & Simoni, Anna, 2021. "Bayesian MIDAS penalized regressions: Estimation, selection, and prediction," Journal of Econometrics, Elsevier, vol. 222(1), pages 833-860.
    7. Kshitij Khare & Malay Ghosh, 2022. "MCMC Convergence for Global-Local Shrinkage Priors," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 20(1), pages 211-234, September.
    8. Byron Botha & Rulof Burger & Kevin Kotzé & Neil Rankin & Daan Steenkamp, 2023. "Big data forecasting of South African inflation," Empirical Economics, Springer, vol. 65(1), pages 149-188, July.
    9. Huang Hailin & Shangguan Jizi & Ruan Peifeng & Liang Hua, 2019. "Bi-level feature selection in high dimensional AFT models with applications to a genomic study," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 18(5), pages 1-11, October.
    10. Chengbin Wang & Kuangnan Fang & Chenlu Zheng & Hechao Xu & Zewei Li, 0. "Credit scoring of micro and small entrepreneurial firms in China," International Entrepreneurship and Management Journal, Springer, vol. 0, pages 1-15.
    11. Zhang, Xin & Zhao, Junlong, 2024. "Group variable selection via group sparse neural network," Computational Statistics & Data Analysis, Elsevier, vol. 192(C).
    12. Wang, Jia & Cai, Xizhen & Li, Runze, 2021. "Variable selection for partially linear models via Bayesian subset modeling with diffusing prior," Journal of Multivariate Analysis, Elsevier, vol. 183(C).
    13. Liu, Jicai & Si, Yuefeng & Niu, Yong & Zhang, Riquan, 2022. "Projection quantile correlation and its use in high-dimensional grouped variable screening," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    14. Chengbin Wang & Kuangnan Fang & Chenlu Zheng & Hechao Xu & Zewei Li, 2021. "Credit scoring of micro and small entrepreneurial firms in China," International Entrepreneurship and Management Journal, Springer, vol. 17(1), pages 29-43, March.
    15. Qiu, Debin & Ahn, Jeongyoun, 2020. "Grouped variable screening for ultra-high dimensional data for linear model," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    16. Mallick, Himel & Yi, Nengjun, 2017. "Bayesian group bridge for bi-level variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 110(C), pages 115-133.
    17. Shi, Guiling & Lim, Chae Young & Maiti, Tapabrata, 2019. "Model selection using mass-nonlocal prior," Statistics & Probability Letters, Elsevier, vol. 147(C), pages 36-44.
    18. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    19. Wenyan Zhong & Xuewen Lu & Jingjing Wu, 2021. "Bi-level variable selection in semiparametric transformation models with right-censored data," Computational Statistics, Springer, vol. 36(3), pages 1661-1692, September.
    20. Naveen Naidu Narisetty, 2020. "Discussion," International Statistical Review, International Statistical Institute, vol. 88(2), pages 330-334, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:65:y:2024:i:2:d:10.1007_s00362-023-01441-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.