IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v38y2023i4d10.1007_s00180-023-01354-4.html
   My bibliography  Save this article

Sparse Bayesian learning with automatic-weighting Laplace priors for sparse signal recovery

Author

Listed:
  • Zonglong Bai

    (North China Electric Power University
    North China Electric Power University)

  • Jinwei Sun

    (Harbin Institute of Technology)

Abstract

The least absolute shrinkage and selection operator (LASSO) and its variants are widely used for sparse signal recovery. However, the determination of the regularization factor requires cross-validation strategy, which may obtain a sub-optimal solution. Motivated by the self-regularization nature of sparse Bayesian learning (SBL) approach and the framework of generalized LASSO, we propose a new hierarchical Bayesian model using automatic-weighting Laplace priors in this paper. In the proposed hierarchical Bayesian model, the posterior distributions of all the parameters can be approximated using variational Bayesian inference, resulting in closed-form solutions for all parameters updating. Moreover, the space alternating variational estimation strategy is used to avoid matrix inversion, and a fast algorithm (SAVE-WLap-SBL) is proposed. Comparing to existed SBL methods, the proposed method encourages the sparsity of signals more efficiently. Numerical experiments on synthetic and real data illustrate the benefit of these advances.

Suggested Citation

  • Zonglong Bai & Jinwei Sun, 2023. "Sparse Bayesian learning with automatic-weighting Laplace priors for sparse signal recovery," Computational Statistics, Springer, vol. 38(4), pages 2053-2074, December.
  • Handle: RePEc:spr:compst:v:38:y:2023:i:4:d:10.1007_s00180-023-01354-4
    DOI: 10.1007/s00180-023-01354-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-023-01354-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00180-023-01354-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    2. Gozgor, Giray & Li, Jing & Saleem, Irfan & Shinwari, Riazullah, 2025. "The impact of women's political empowerment on renewable energy demand: Evidence from OECD countries," Energy Economics, Elsevier, vol. 141(C).
    3. Margherita Giuzio, 2017. "Genetic algorithm versus classical methods in sparse index tracking," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 40(1), pages 243-256, November.
    4. Xu, Yang & Zhao, Shishun & Hu, Tao & Sun, Jianguo, 2021. "Variable selection for generalized odds rate mixture cure models with interval-censored failure time data," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    5. Emmanouil Androulakis & Christos Koukouvinos & Kalliopi Mylona & Filia Vonta, 2010. "A real survival analysis application via variable selection methods for Cox's proportional hazards model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(8), pages 1399-1406.
    6. Li, Chunyu & Lou, Chenxin & Luo, Dan & Xing, Kai, 2021. "Chinese corporate distress prediction using LASSO: The role of earnings management," International Review of Financial Analysis, Elsevier, vol. 76(C).
    7. Ying Huang & Shibasish Dasgupta, 2019. "Likelihood-Based Methods for Assessing Principal Surrogate Endpoints in Vaccine Trials," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 11(3), pages 504-523, December.
    8. Linton, Oliver & Seo, Myung Hwan & Whang, Yoon-Jae, 2023. "Testing stochastic dominance with many conditioning variables," Journal of Econometrics, Elsevier, vol. 235(2), pages 507-527.
    9. Zhongnan Jin & Jie Min & Yili Hong & Pang Du & Qingyu Yang, 2024. "Multivariate Functional Clustering with Variable Selection and Application to Sensor Data from Engineering Systems," INFORMS Joural on Data Science, INFORMS, vol. 3(2), pages 203-218, October.
    10. Mert Demirer & Francis X. Diebold & Laura Liu & Kamil Yilmaz, 2018. "Estimating global bank network connectedness," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(1), pages 1-15, January.
    11. Mandys, F., 2021. "Electric vehicles and consumer choices," Renewable and Sustainable Energy Reviews, Elsevier, vol. 142(C).
    12. Sophie Brana & Dalila Chenaf-Nicet & Delphine Lahet, 2023. "Drivers of cross-border bank claims: The role of foreign-owned banks in emerging countries," Working Papers 2023.06, International Network for Economic Research - INFER.
    13. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    14. William C. Horrace & Hyunseok Jung & Yi Yang, 2023. "The conditional mode in parametric frontier models," Journal of Productivity Analysis, Springer, vol. 60(3), pages 333-343, December.
    15. Ni, Xiao & Zhang, Hao Helen & Zhang, Daowen, 2009. "Automatic model selection for partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2100-2111, October.
    16. David Kohns & Tibor Szendrei, 2021. "Decoupling Shrinkage and Selection for the Bayesian Quantile Regression," Papers 2107.08498, arXiv.org.
    17. Avagyan, Vahe & Alonso Fernández, Andrés Modesto & Nogales, Francisco J., 2015. "D-trace Precision Matrix Estimation Using Adaptive Lasso Penalties," DES - Working Papers. Statistics and Econometrics. WS 21775, Universidad Carlos III de Madrid. Departamento de Estadística.
    18. Diego Vidaurre & Concha Bielza & Pedro Larrañaga, 2013. "A Survey of L1 Regression," International Statistical Review, International Statistical Institute, vol. 81(3), pages 361-387, December.
    19. Xiong, Wei & Wang, Dehui & Deng, Dianliang & Wang, Xinyang & Zhang, Wanying, 2022. "Penalized multiply robust estimation in high-order autoregressive processes with missing explanatory variables," Journal of Multivariate Analysis, Elsevier, vol. 187(C).
    20. Juan Antonio Duro & Alejandro Perez‐Laborda & Markus Löw & Sarah Matej & Barbara Plank & Fridolin Krausmann & Dominik Wiedenhofer & Helmut Haberl, 2024. "Spatial patterns of built structures co‐determine nations’ level of resource demand," Journal of Industrial Ecology, Yale University, vol. 28(2), pages 289-302, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:38:y:2023:i:4:d:10.1007_s00180-023-01354-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.