IDEAS home Printed from https://ideas.repec.org/p/pav/demwpp/demwp0046.html
   My bibliography  Save this paper

Dependent mixture models: clustering and borrowing information

Author

Listed:
  • Antonio Lijoi

    (Department of Economics and Management, University of Pavia and Collegio Carlo Alberto)

  • Bernardo Nipoti

    (University of Turin and Collegio Carlo Alberto)

  • Igor Prünster

    (University of Turin and Collegio Carlo Alberto)

Abstract

Most of the Bayesian nonparametric models for non–exchangeable data that are used in applications are based on some extension to the multivariate setting of the Dirichlet process, the best known being MacEachern’s dependent Dirichlet process. A comparison of two recently introduced classes of vectors of dependent nonparametric priors, based on the Dirichlet and the normalized s–stable processes respectively, is provided. These priors are used to define dependent hierarchical mixture models whose distributional properties are investigated. Furthermore, their inferential performance is examined through an extensive simulation study. The models exhibit different features, especially in terms of the clustering behavior and the borrowing of information across studies. Compared to popular Dirichlet process based models, mixtures of dependent normalized s–stable processes turn out to be a valid choice being capable of more effectively detecting the clustering structure featured by the data.

Suggested Citation

  • Antonio Lijoi & Bernardo Nipoti & Igor Prünster, 2013. "Dependent mixture models: clustering and borrowing information," DEM Working Papers Series 046, University of Pavia, Department of Economics and Management.
    • Handle: RePEc:pav:demwpp:demwp0046
    as

    Download full text from publisher

    File URL: http://dem-web.unipv.it/web/docs/dipeco/quad/ps/RePEc/pav/demwpp/DEMWP0046.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Antonio Lijoi & Ramsés H. Mena & Igor Prünster, 2007. "Bayesian Nonparametric Estimation of the Probability of Discovering New Species," Biometrika, Biometrika Trust, vol. 94(4), pages 769-786.
    2. Lancelot F. James & Antonio Lijoi & Igor Prünster, 2009. "Posterior Analysis for Normalized Random Measures with Independent Increments," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(1), pages 76-97, March.
    3. Robert M. Dorazio & Bhramar Mukherjee & Li Zhang & Malay Ghosh & Howard L. Jelks & Frank Jordan, 2008. "Modeling Unobserved Sources of Heterogeneity in Animal Abundance Using a Dirichlet Process Prior," Biometrics, The International Biometric Society, vol. 64(2), pages 635-644, June.
    4. Lijoi, Antonio & Mena, Ramses H. & Prunster, Igor, 2005. "Hierarchical Mixture Modeling With Normalized Inverse-Gaussian Priors," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1278-1291, December.
    5. Hatjispyros, Spyridon J. & Nicoleris, Theodoros & Walker, Stephen G., 2011. "Dependent mixtures of Dirichlet processes," Computational Statistics & Data Analysis, Elsevier, vol. 55(6), pages 2011-2025, June.
    6. Antonio Lijoi & Ramsés H. Mena & Igor Prünster, 2007. "Controlling the reinforcement in Bayesian non‐parametric mixture models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 715-740, September.
    7. Lancelot F. James & Antonio Lijoi & Igor Prünster, 2006. "Conjugacy as a Distinctive Feature of the Dirichlet Process," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(1), pages 105-120, March.
    8. Griffiths, R. C. & Milne, R. K., 1978. "A class of bivariate Poisson processes," Journal of Multivariate Analysis, Elsevier, vol. 8(3), pages 380-395, September.
    9. Petrone, Sonia & Raftery, Adrian E., 1997. "A note on the Dirichlet process prior in Bayesian nonparametric inference with partial exchangeability," Statistics & Probability Letters, Elsevier, vol. 36(1), pages 69-83, November.
    10. Peter Müller & Fernando Quintana & Gary Rosner, 2004. "A method for combining inference across related nonparametric Bayesian models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 735-749, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lijoi, Antonio & Nipoti, Bernardo & Prünster, Igor, 2014. "Dependent mixture models: Clustering and borrowing information," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 417-433.
    2. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "On the stick–breaking representation of normalized inverse Gaussian priors," DEM Working Papers Series 008, University of Pavia, Department of Economics and Management.
    3. Antonio Lijoi & Igor Pruenster, 2009. "Distributional Properties of means of Random Probability Measures," ICER Working Papers - Applied Mathematics Series 22-2009, ICER - International Centre for Economic Research.
    4. Antonio Lijoi & Igor Prunster, 2009. "Models beyond the Dirichlet process," Quaderni di Dipartimento 103, University of Pavia, Department of Economics and Quantitative Methods.
    5. J. E. Griffin & M. Kolossiatis & M. F. J. Steel, 2013. "Comparing distributions by using dependent normalized random-measure mixtures," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 499-529, June.
    6. Pierpaolo De Blasi & Stefano Favaro & Antonio Lijoi & Ramsés H. Mena & Igor Prünster & Mattteo Ruggiero, 2013. "Are Gibbs-type priors the most natural generalization of the Dirichlet process?," DEM Working Papers Series 054, University of Pavia, Department of Economics and Management.
    7. Canale, Antonio & Lijoi, Antonio & Nipoti, Bernardo & Prünster, Igor, 2023. "Inner spike and slab Bayesian nonparametric models," Econometrics and Statistics, Elsevier, vol. 27(C), pages 120-135.
    8. Argiento, Raffaele & Guglielmi, Alessandra & Pievatolo, Antonio, 2010. "Bayesian density estimation and model selection using nonparametric hierarchical mixtures," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 816-832, April.
    9. Lancelot F. James & Antonio Lijoi & Igor Prünster, 2009. "Posterior Analysis for Normalized Random Measures with Independent Increments," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(1), pages 76-97, March.
    10. Kolossiatis, M. & Griffin, J.E. & Steel, M.F.J., 2011. "Modeling overdispersion with the normalized tempered stable distribution," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2288-2301, July.
    11. Antonio Canale & Igor Prünster, 2017. "Robustifying Bayesian nonparametric mixtures for count data," Biometrics, The International Biometric Society, vol. 73(1), pages 174-184, March.
    12. Stefano Favaro & Antonio Lijoi & Igor Prunster, 2011. "Asymptotics for a Bayesian nonparametric estimator of species richness," Quaderni di Dipartimento 144, University of Pavia, Department of Economics and Quantitative Methods.
    13. Corradin, Riccardo & Nieto-Barajas, Luis Enrique & Nipoti, Bernardo, 2022. "Optimal stratification of survival data via Bayesian nonparametric mixtures," Econometrics and Statistics, Elsevier, vol. 22(C), pages 17-38.
    14. Antonio Lijoi & Igor Pruenster, 2009. "Models beyond the Dirichlet process," ICER Working Papers - Applied Mathematics Series 23-2009, ICER - International Centre for Economic Research.
    15. Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2018. "Bayesian Nonparametric Calibration and Combination of Predictive Distributions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 675-685, April.
    16. Griffin, J.E. & Steel, M.F.J., 2011. "Stick-breaking autoregressive processes," Journal of Econometrics, Elsevier, vol. 162(2), pages 383-396, June.
    17. François Caron & Emily B. Fox, 2017. "Sparse graphs using exchangeable random measures," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1295-1366, November.
    18. Julyan Arbel & Stefano Favaro, 2021. "Approximating Predictive Probabilities of Gibbs-Type Priors," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(1), pages 496-519, February.
    19. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "A new estimator of the discovery probability," DEM Working Papers Series 007, University of Pavia, Department of Economics and Management.
    20. Bassetti, Federico & Casarin, Roberto & Leisen, Fabrizio, 2014. "Beta-product dependent Pitman–Yor processes for Bayesian inference," Journal of Econometrics, Elsevier, vol. 180(1), pages 49-72.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pav:demwpp:demwp0046. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alice Albonico (email available below). General contact details of provider: https://edirc.repec.org/data/dppavit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.