IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v189y2024ics0167947323001494.html
   My bibliography  Save this article

Full uncertainty analysis for Bayesian nonparametric mixture models

Author

Listed:
  • Moya, Blake
  • Walker, Stephen G.

Abstract

A full posterior analysis for nonparametric mixture models using Gibbs-type prior distributions is presented. This includes the well known Dirichlet process mixture (DPM) model. The random mixing distribution is removed enabling a simple-to-implement Markov chain Monte Carlo (MCMC) algorithm. The removal procedure takes away some of the posterior uncertainty and how it is replaced forms a novel aspect to the work. The removal, MCMC algorithm and replacement of the uncertainty only require the probabilities of a new or an old value associated with the corresponding Gibbs-type exchangeable sequence. Consequently, no explicit representations of the prior or posterior are required and instead only knowledge of the exchangeable sequence is needed. This allows the implementation of mixture models with full posterior uncertainty, not previously possible, including one introduced by Gnedin. Numerous illustrations are presented, as is an R-package called CopRe which implements the methodology, and other supplemental material.

Suggested Citation

  • Moya, Blake & Walker, Stephen G., 2024. "Full uncertainty analysis for Bayesian nonparametric mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 189(C).
    • Handle: RePEc:eee:csdana:v:189:y:2024:i:c:s0167947323001494
    DOI: 10.1016/j.csda.2023.107838
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947323001494
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2023.107838?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Omiros Papaspiliopoulos & Gareth O. Roberts, 2008. "Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models," Biometrika, Biometrika Trust, vol. 95(1), pages 169-186.
    2. Peter J. Green & Sylvia Richardson, 2001. "Modelling Heterogeneity With and Without the Dirichlet Process," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 28(2), pages 355-375, June.
    3. Sylvia. Richardson & Peter J. Green, 1997. "On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 59(4), pages 731-792.
    4. Matthew Stephens, 2000. "Dealing with label switching in mixture models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(4), pages 795-809.
    5. Arbel, Julyan & Lijoi, Antonio & Nipoti, Bernardo, 2016. "Full Bayesian inference with hazard mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 359-372.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sylvia Frühwirth-Schnatter & Gertraud Malsiner-Walli, 2019. "From here to infinity: sparse finite versus Dirichlet process mixtures in model-based clustering," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(1), pages 33-64, March.
    2. Li, Mingyang & Meng, Hongdao & Zhang, Qingpeng, 2017. "A nonparametric Bayesian modeling approach for heterogeneous lifetime data with covariates," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 95-104.
    3. Ungolo, Francesco & Kleinow, Torsten & Macdonald, Angus S., 2020. "A hierarchical model for the joint mortality analysis of pension scheme data with missing covariates," Insurance: Mathematics and Economics, Elsevier, vol. 91(C), pages 68-84.
    4. Park, Byung-Jung & Zhang, Yunlong & Lord, Dominique, 2010. "Bayesian mixture modeling approach to account for heterogeneity in speed data," Transportation Research Part B: Methodological, Elsevier, vol. 44(5), pages 662-673, June.
    5. Kozumi, Hideo, 2004. "Posterior analysis of latent competing risk models by parallel tempering," Computational Statistics & Data Analysis, Elsevier, vol. 46(3), pages 441-458, June.
    6. Im, Yunju & Tan, Aixin, 2021. "Bayesian subgroup analysis in regression using mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 162(C).
    7. Billio, Monica & Casarin, Roberto & Rossini, Luca, 2019. "Bayesian nonparametric sparse VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 97-115.
    8. Yuan Fang & Dimitris Karlis & Sanjeena Subedi, 2022. "Infinite Mixtures of Multivariate Normal-Inverse Gaussian Distributions for Clustering of Skewed Data," Journal of Classification, Springer;The Classification Society, vol. 39(3), pages 510-552, November.
    9. Villani, Mattias & Kohn, Robert & Nott, David J., 2012. "Generalized smooth finite mixtures," Journal of Econometrics, Elsevier, vol. 171(2), pages 121-133.
    10. Jia-Chiun Pan & Chih-Min Liu & Hai-Gwo Hwu & Guan-Hua Huang, 2015. "Allocation Variable-Based Probabilistic Algorithm to Deal with Label Switching Problem in Bayesian Mixture Models," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-23, October.
    11. Weber, Anett & Steiner, Winfried J., 2021. "Modeling price response from retail sales: An empirical comparison of models with different representations of heterogeneity," European Journal of Operational Research, Elsevier, vol. 294(3), pages 843-859.
    12. Jonathan Jaeger & Philippe Lambert, 2014. "Bayesian penalized smoothing approaches in models specified using differential equations with unknown error distributions," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(12), pages 2709-2726, December.
    13. Panagiotis Papastamoulis & George Iliopoulos, 2013. "On the Convergence Rate of Random Permutation Sampler and ECR Algorithm in Missing Data Models," Methodology and Computing in Applied Probability, Springer, vol. 15(2), pages 293-304, June.
    14. Komárek, Arnost, 2009. "A new R package for Bayesian estimation of multivariate normal mixtures allowing for selection of the number of components and interval-censored data," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 3932-3947, October.
    15. José Dias & Jeroen Vermunt, 2008. "A bootstrap-based aggregate classifier for model-based clustering," Computational Statistics, Springer, vol. 23(4), pages 643-659, October.
    16. Roy Costilla & Ivy Liu & Richard Arnold & Daniel Fernández, 2019. "Bayesian model-based clustering for longitudinal ordinal data," Computational Statistics, Springer, vol. 34(3), pages 1015-1038, September.
    17. Paroli, Roberta & Spezia, Luigi, 2008. "Bayesian inference in non-homogeneous Markov mixtures of periodic autoregressions with state-dependent exogenous variables," Computational Statistics & Data Analysis, Elsevier, vol. 52(5), pages 2311-2330, January.
    18. Lee, Kuo-Jung & Feldkircher, Martin & Chen, Yi-Chi, 2021. "Variable selection in finite mixture of regression models with an unknown number of components," Computational Statistics & Data Analysis, Elsevier, vol. 158(C).
    19. De Blasi, Pierpaolo & Martínez, Asael Fabian & Mena, Ramsés H. & Prünster, Igor, 2020. "On the inferential implications of decreasing weight structures in mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 147(C).
    20. C. Yau & O. Papaspiliopoulos & G. O. Roberts & C. Holmes, 2011. "Bayesian non‐parametric hidden Markov models with applications in genomics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 37-57, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:189:y:2024:i:c:s0167947323001494. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.