IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v39y2024i4d10.1007_s00180-023-01438-1.html
   My bibliography  Save this article

Wavelet-based Bayesian approximate kernel method for high-dimensional data analysis

Author

Listed:
  • Wenxing Guo

    (University of Essex
    University of Alberta)

  • Xueying Zhang

    (University of Alberta)

  • Bei Jiang

    (University of Alberta)

  • Linglong Kong

    (University of Alberta)

  • Yaozhong Hu

    (University of Alberta)

Abstract

Kernel methods are often used for nonlinear regression and classification in statistics and machine learning because they are computationally cheap and accurate. The wavelet kernel functions based on wavelet analysis can efficiently approximate any nonlinear functions. In this article, we construct a novel wavelet kernel function in terms of random wavelet bases and define a linear vector space that captures nonlinear structures in reproducing kernel Hilbert spaces (RKHS). Based on the wavelet transform, the data are mapped into a low-dimensional randomized feature space and convert kernel function into operations of a linear machine. We then propose a new Bayesian approximate kernel model with the random wavelet expansion and use the Gibbs sampler to compute the model’s parameters. Finally, some simulation studies and two real datasets analyses are carried out to demonstrate that the proposed method displays good stability, prediction performance compared to some other existing methods.

Suggested Citation

  • Wenxing Guo & Xueying Zhang & Bei Jiang & Linglong Kong & Yaozhong Hu, 2024. "Wavelet-based Bayesian approximate kernel method for high-dimensional data analysis," Computational Statistics, Springer, vol. 39(4), pages 2323-2341, June.
  • Handle: RePEc:spr:compst:v:39:y:2024:i:4:d:10.1007_s00180-023-01438-1
    DOI: 10.1007/s00180-023-01438-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-023-01438-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00180-023-01438-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chakraborty, Sounak, 2009. "Bayesian binary kernel probit model for microarray based cancer classification and gene selection," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4198-4209, October.
    2. Bani K. Mallick & Debashis Ghosh & Malay Ghosh, 2005. "Bayesian classification of tumours by using gene expression data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 219-234, April.
    3. Chakraborty, Sounak & Ghosh, Malay & Mallick, Bani K., 2012. "Bayesian nonlinear regression for large p small n problems," Journal of Multivariate Analysis, Elsevier, vol. 108(C), pages 28-40.
    4. Wang, F. K. & Du, T. C. T., 2000. "Using principal component analysis in process performance for multivariate data," Omega, Elsevier, vol. 28(2), pages 185-194, April.
    5. Lorin Crawford & Kris C. Wood & Xiang Zhou & Sayan Mukherjee, 2018. "Bayesian Approximate Kernel Regression With Variable Selection," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1710-1721, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aßmann, Christian & Boysen-Hogrefe, Jens, 2011. "A Bayesian approach to model-based clustering for binary panel probit models," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 261-279, January.
    2. Todd E. Clark & Florian Huber & Gary Koop & Massimiliano Marcellino & Michael Pfarrhofer, 2023. "Tail Forecasting With Multivariate Bayesian Additive Regression Trees," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 979-1022, August.
    3. Chakraborty, Sounak, 2012. "Bayesian multiple response kernel regression model for high dimensional data and its practical applications in near infrared spectroscopy," Computational Statistics & Data Analysis, Elsevier, vol. 56(9), pages 2742-2755.
    4. Huber, Florian & Koop, Gary & Onorante, Luca & Pfarrhofer, Michael & Schreiner, Josef, 2023. "Nowcasting in a pandemic using non-parametric mixed frequency VARs," Journal of Econometrics, Elsevier, vol. 232(1), pages 52-69.
    5. Sounak Chakraborty & Peng Zhao & Yilun Huang & Tanujit Dey, 2022. "Semiparametric Survival Analysis of 30-Day Hospital Readmissions with Bayesian Additive Regression Kernel Model," Stats, MDPI, vol. 5(3), pages 1-14, July.
    6. Seebacher, Gottfried & Winkler, Herwig, 2015. "A capability approach to evaluate supply chain flexibility," International Journal of Production Economics, Elsevier, vol. 167(C), pages 177-186.
    7. Dixit, Anand & Roy, Vivekananda, 2021. "Posterior impropriety of some sparse Bayesian learning models," Statistics & Probability Letters, Elsevier, vol. 171(C).
    8. Richard D. Payne & Bani K. Mallick, 2018. "Two-Stage Metropolis-Hastings for Tall Data," Journal of Classification, Springer;The Classification Society, vol. 35(1), pages 29-51, April.
    9. Das Nandini & Dwivedi Prem Saurav, 2013. "Multivariate Process Capability Index: A Review and Some Results," Stochastics and Quality Control, De Gruyter, vol. 28(2), pages 151-166, December.
    10. Chakraborty, Sounak, 2009. "Simultaneous cancer classification and gene selection with Bayesian nearest neighbor method: An integrated approach," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 1462-1474, February.
    11. Noureddine Kouaissah & Sergio Ortobelli Lozza & Ikram Jebabli, 2022. "Portfolio Selection Using Multivariate Semiparametric Estimators and a Copula PCA-Based Approach," Computational Economics, Springer;Society for Computational Economics, vol. 60(3), pages 833-859, October.
    12. Luts, Jan & Ormerod, John T., 2014. "Mean field variational Bayesian inference for support vector machine classification," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 163-176.
    13. Song, Chaegeun & Li, Bing, 2025. "On exact Bayesian credible sets for discrete parameters," Statistics & Probability Letters, Elsevier, vol. 218(C).
    14. Hauzenberger, Niko & Huber, Florian & Klieber, Karin, 2023. "Real-time inflation forecasting using non-linear dimension reduction techniques," International Journal of Forecasting, Elsevier, vol. 39(2), pages 901-921.
    15. Xiaodong Qu & Yuxi Zhang & Zhenming Li, 2024. "Is China’s Rural Revitalization Good Enough? Evidence from Spatial Agglomeration and Cluster Analysis," Sustainability, MDPI, vol. 16(11), pages 1-31, May.
    16. Bo Xiong & Martin Skitmore & Bo Xia, 2015. "Exploring and validating the internal dimensions of occupational stress: evidence from construction cost estimators in China," Construction Management and Economics, Taylor & Francis Journals, vol. 33(5-6), pages 495-507, June.
    17. Daniela F. Dianda & Marta B. Quaglino & José A. Pagura, 2018. "Impact of measurement errors on the performance and distributional properties of the multivariate capability index $$\mathbf{NMC }_\mathbf{pm }$$ NMC pm," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(1), pages 117-143, January.
    18. Pearn, W.L. & Wu, Chien-Wei, 2006. "Production quality and yield assurance for processes with multiple independent characteristics," European Journal of Operational Research, Elsevier, vol. 173(2), pages 637-647, September.
    19. Aijun Yang & Xuejun Jiang & Lianjie Shu & Jinguan Lin, 2017. "Bayesian variable selection with sparse and correlation priors for high-dimensional data analysis," Computational Statistics, Springer, vol. 32(1), pages 127-143, March.
    20. Panagopoulos, Orestis P. & Pappu, Vijay & Xanthopoulos, Petros & Pardalos, Panos M., 2016. "Constrained subspace classifier for high dimensional datasets," Omega, Elsevier, vol. 59(PA), pages 40-46.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:39:y:2024:i:4:d:10.1007_s00180-023-01438-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.