IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v36y2009i1p76-97.html
   My bibliography  Save this article

Posterior Analysis for Normalized Random Measures with Independent Increments

Author

Listed:
  • LANCELOT F. JAMES
  • ANTONIO LIJOI
  • IGOR PRÜNSTER

Abstract

. One of the main research areas in Bayesian Nonparametrics is the proposal and study of priors which generalize the Dirichlet process. In this paper, we provide a comprehensive Bayesian non‐parametric analysis of random probabilities which are obtained by normalizing random measures with independent increments (NRMI). Special cases of these priors have already shown to be useful for statistical applications such as mixture models and species sampling problems. However, in order to fully exploit these priors, the derivation of the posterior distribution of NRMIs is crucial: here we achieve this goal and, indeed, provide explicit and tractable expressions suitable for practical implementation. The posterior distribution of an NRMI turns out to be a mixture with respect to the distribution of a specific latent variable. The analysis is completed by the derivation of the corresponding predictive distributions and by a thorough investigation of the marginal structure. These results allow to derive a generalized Blackwell–MacQueen sampling scheme, which is then adapted to cover also mixture models driven by general NRMIs.

Suggested Citation

  • Lancelot F. James & Antonio Lijoi & Igor Prünster, 2009. "Posterior Analysis for Normalized Random Measures with Independent Increments," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(1), pages 76-97, March.
    • Handle: RePEc:bla:scjsta:v:36:y:2009:i:1:p:76-97
    DOI: 10.1111/j.1467-9469.2008.00609.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9469.2008.00609.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1467-9469.2008.00609.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Omiros Papaspiliopoulos & Gareth O. Roberts, 2008. "Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models," Biometrika, Biometrika Trust, vol. 95(1), pages 169-186.
    2. James, Lancelot F., 2003. "A simple proof of the almost sure discreteness of a class of random measures," Statistics & Probability Letters, Elsevier, vol. 65(4), pages 363-368, December.
    3. McGrory, C.A. & Titterington, D.M., 2007. "Variational approximations in Bayesian model selection for finite mixture distributions," Computational Statistics & Data Analysis, Elsevier, vol. 51(11), pages 5352-5367, July.
    4. Lijoi, Antonio & Mena, Ramses H. & Prunster, Igor, 2005. "Hierarchical Mixture Modeling With Normalized Inverse-Gaussian Priors," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1278-1291, December.
    5. Antonio Lijoi & Ramsés H. Mena & Igor Prünster, 2007. "Controlling the reinforcement in Bayesian non‐parametric mixture models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 715-740, September.
    6. Lancelot F. James & Antonio Lijoi & Igor Prünster, 2006. "Conjugacy as a Distinctive Feature of the Dirichlet Process," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(1), pages 105-120, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matthew D. Koslovsky, 2023. "A Bayesian zero‐inflated Dirichlet‐multinomial regression model for multivariate compositional count data," Biometrics, The International Biometric Society, vol. 79(4), pages 3239-3251, December.
    2. Antonio Lijoi & Igor Prünster, 2014. "Discussion of “On simulation and properties of the stable law” by L. Devroye and L. James," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(3), pages 371-377, August.
    3. Griffin, J.E. & Steel, M.F.J., 2011. "Stick-breaking autoregressive processes," Journal of Econometrics, Elsevier, vol. 162(2), pages 383-396, June.
    4. Lancelot F. James, 2022. "Single-Block Recursive Poisson–Dirichlet Fragmentations of Normalized Generalized Gamma Processes," Mathematics, MDPI, vol. 10(4), pages 1-10, February.
    5. Nieto-Barajas, Luis E., 2014. "Bayesian semiparametric analysis of short- and long-term hazard ratios with covariates," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 477-490.
    6. Antonio Lijoi & Igor Pruenster, 2009. "Models beyond the Dirichlet process," ICER Working Papers - Applied Mathematics Series 23-2009, ICER - International Centre for Economic Research.
    7. Argiento, Raffaele & Guglielmi, Alessandra & Pievatolo, Antonio, 2010. "Bayesian density estimation and model selection using nonparametric hierarchical mixtures," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 816-832, April.
    8. Jim E. Griffin & Fabrizio Leisen, 2017. "Compound random measures and their use in Bayesian non-parametrics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(2), pages 525-545, March.
    9. Riva Palacio, Alan & Leisen, Fabrizio, 2018. "Integrability conditions for compound random measures," Statistics & Probability Letters, Elsevier, vol. 135(C), pages 32-37.
    10. Pierpaolo De Blasi & Stefano Favaro & Antonio Lijoi & Ramsés H. Mena & Igor Prünster & Mattteo Ruggiero, 2013. "Are Gibbs-type priors the most natural generalization of the Dirichlet process?," DEM Working Papers Series 054, University of Pavia, Department of Economics and Management.
    11. J. E. Griffin & M. Kolossiatis & M. F. J. Steel, 2013. "Comparing distributions by using dependent normalized random-measure mixtures," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 499-529, June.
    12. Stefano Favaro & Antonio Lijoi & Igor Prunster, 2011. "Asymptotics for a Bayesian nonparametric estimator of species richness," Quaderni di Dipartimento 144, University of Pavia, Department of Economics and Quantitative Methods.
    13. Antonio Lijoi & Bernardo Nipoti & Igor Prünster, 2013. "Dependent mixture models: clustering and borrowing information," DEM Working Papers Series 046, University of Pavia, Department of Economics and Management.
    14. Lijoi, Antonio & Nipoti, Bernardo & Prünster, Igor, 2014. "Dependent mixture models: Clustering and borrowing information," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 417-433.
    15. Corradin, Riccardo & Nieto-Barajas, Luis Enrique & Nipoti, Bernardo, 2022. "Optimal stratification of survival data via Bayesian nonparametric mixtures," Econometrics and Statistics, Elsevier, vol. 22(C), pages 17-38.
    16. Antonio Lijoi & Igor Prunster, 2009. "Models beyond the Dirichlet process," Quaderni di Dipartimento 103, University of Pavia, Department of Economics and Quantitative Methods.
    17. Griffin, Jim, 2019. "Two part envelopes for rejection sampling of some completely random measures," Statistics & Probability Letters, Elsevier, vol. 151(C), pages 36-41.
    18. Luai Al Labadi & Ibrahim Abdelrazeq, 2017. "On functional central limit theorems of Bayesian nonparametric priors," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 26(2), pages 215-229, June.
    19. Antonio Lijoi & Igor Pruenster, 2009. "Distributional Properties of means of Random Probability Measures," ICER Working Papers - Applied Mathematics Series 22-2009, ICER - International Centre for Economic Research.
    20. Collet, Francesca & Leisen, Fabrizio, 2011. "Free completely random measures," DES - Working Papers. Statistics and Econometrics. WS ws112821, Universidad Carlos III de Madrid. Departamento de Estadística.
    21. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "On the stick–breaking representation of normalized inverse Gaussian priors," DEM Working Papers Series 008, University of Pavia, Department of Economics and Management.
    22. Federico Bassetti & Lucia Ladelli, 2021. "Mixture of Species Sampling Models," Mathematics, MDPI, vol. 9(23), pages 1-27, December.
    23. Peter Müeller & Fernando A. Quintana & Garritt Page, 2018. "Nonparametric Bayesian inference in applications," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(2), pages 175-206, June.
    24. François Caron & Emily B. Fox, 2017. "Sparse graphs using exchangeable random measures," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1295-1366, November.
    25. Canale, Antonio & Lijoi, Antonio & Nipoti, Bernardo & Prünster, Igor, 2023. "Inner spike and slab Bayesian nonparametric models," Econometrics and Statistics, Elsevier, vol. 27(C), pages 120-135.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kolossiatis, M. & Griffin, J.E. & Steel, M.F.J., 2011. "Modeling overdispersion with the normalized tempered stable distribution," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2288-2301, July.
    2. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "On the stick–breaking representation of normalized inverse Gaussian priors," DEM Working Papers Series 008, University of Pavia, Department of Economics and Management.
    3. Antonio Lijoi & Igor Pruenster, 2009. "Distributional Properties of means of Random Probability Measures," ICER Working Papers - Applied Mathematics Series 22-2009, ICER - International Centre for Economic Research.
    4. Antonio Lijoi & Igor Prunster, 2009. "Models beyond the Dirichlet process," Quaderni di Dipartimento 103, University of Pavia, Department of Economics and Quantitative Methods.
    5. J. E. Griffin & M. Kolossiatis & M. F. J. Steel, 2013. "Comparing distributions by using dependent normalized random-measure mixtures," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 499-529, June.
    6. Antonio Lijoi & Bernardo Nipoti & Igor Prünster, 2013. "Dependent mixture models: clustering and borrowing information," DEM Working Papers Series 046, University of Pavia, Department of Economics and Management.
    7. Lijoi, Antonio & Nipoti, Bernardo & Prünster, Igor, 2014. "Dependent mixture models: Clustering and borrowing information," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 417-433.
    8. Ruth Fuentes–García & Ramsés Mena & Stephen Walker, 2010. "A Probability for Classification Based on the Dirichlet Process Mixture Model," Journal of Classification, Springer;The Classification Society, vol. 27(3), pages 389-403, November.
    9. Antonio Lijoi & Igor Pruenster, 2009. "Models beyond the Dirichlet process," ICER Working Papers - Applied Mathematics Series 23-2009, ICER - International Centre for Economic Research.
    10. Antonio Canale & Igor Prünster, 2017. "Robustifying Bayesian nonparametric mixtures for count data," Biometrics, The International Biometric Society, vol. 73(1), pages 174-184, March.
    11. Canale, Antonio & Lijoi, Antonio & Nipoti, Bernardo & Prünster, Igor, 2023. "Inner spike and slab Bayesian nonparametric models," Econometrics and Statistics, Elsevier, vol. 27(C), pages 120-135.
    12. Matteo Ruggiero & Matteo Sordello, 2018. "Clustering dynamics in a class of normalised generalised gamma dependent priors," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(1), pages 83-98, February.
    13. Raffaele Argiento & Alessandra Guglielmi & Antonio Pievatolo, 2014. "Estimation, prediction and interpretation of NGG random effects models: an application to Kevlar fibre failure times," Statistical Papers, Springer, vol. 55(3), pages 805-826, August.
    14. Argiento, Raffaele & Guglielmi, Alessandra & Pievatolo, Antonio, 2010. "Bayesian density estimation and model selection using nonparametric hierarchical mixtures," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 816-832, April.
    15. Julyan Arbel & Stefano Favaro, 2021. "Approximating Predictive Probabilities of Gibbs-Type Priors," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(1), pages 496-519, February.
    16. Ali Karimnezhad & Mahmoud Zarepour, 2020. "A general guide in Bayesian and robust Bayesian estimation using Dirichlet processes," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 83(3), pages 321-346, April.
    17. Pierpaolo De Blasi & Stefano Favaro & Antonio Lijoi & Ramsés H. Mena & Igor Prünster & Mattteo Ruggiero, 2013. "Are Gibbs-type priors the most natural generalization of the Dirichlet process?," DEM Working Papers Series 054, University of Pavia, Department of Economics and Management.
    18. De Blasi, Pierpaolo & Martínez, Asael Fabian & Mena, Ramsés H. & Prünster, Igor, 2020. "On the inferential implications of decreasing weight structures in mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 147(C).
    19. Corradin, Riccardo & Nieto-Barajas, Luis Enrique & Nipoti, Bernardo, 2022. "Optimal stratification of survival data via Bayesian nonparametric mixtures," Econometrics and Statistics, Elsevier, vol. 22(C), pages 17-38.
    20. Hajargasht, Gholamreza & Rao, D.S. Prasada, 2019. "Multilateral index number systems for international price comparisons: Properties, existence and uniqueness," Journal of Mathematical Economics, Elsevier, vol. 83(C), pages 36-47.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:36:y:2009:i:1:p:76-97. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.