IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v36y2009i1p76-97.html
   My bibliography  Save this article

Posterior Analysis for Normalized Random Measures with Independent Increments

Author

Listed:
  • LANCELOT F. JAMES
  • ANTONIO LIJOI
  • IGOR PRÜNSTER

Abstract

. One of the main research areas in Bayesian Nonparametrics is the proposal and study of priors which generalize the Dirichlet process. In this paper, we provide a comprehensive Bayesian non‐parametric analysis of random probabilities which are obtained by normalizing random measures with independent increments (NRMI). Special cases of these priors have already shown to be useful for statistical applications such as mixture models and species sampling problems. However, in order to fully exploit these priors, the derivation of the posterior distribution of NRMIs is crucial: here we achieve this goal and, indeed, provide explicit and tractable expressions suitable for practical implementation. The posterior distribution of an NRMI turns out to be a mixture with respect to the distribution of a specific latent variable. The analysis is completed by the derivation of the corresponding predictive distributions and by a thorough investigation of the marginal structure. These results allow to derive a generalized Blackwell–MacQueen sampling scheme, which is then adapted to cover also mixture models driven by general NRMIs.

Suggested Citation

  • Lancelot F. James & Antonio Lijoi & Igor Prünster, 2009. "Posterior Analysis for Normalized Random Measures with Independent Increments," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(1), pages 76-97, March.
  • Handle: RePEc:bla:scjsta:v:36:y:2009:i:1:p:76-97
    DOI: 10.1111/j.1467-9469.2008.00609.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9469.2008.00609.x
    Download Restriction: no

    References listed on IDEAS

    as
    1. Omiros Papaspiliopoulos & Gareth O. Roberts, 2008. "Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models," Biometrika, Biometrika Trust, vol. 95(1), pages 169-186.
    2. James, Lancelot F., 2003. "A simple proof of the almost sure discreteness of a class of random measures," Statistics & Probability Letters, Elsevier, vol. 65(4), pages 363-368, December.
    3. McGrory, C.A. & Titterington, D.M., 2007. "Variational approximations in Bayesian model selection for finite mixture distributions," Computational Statistics & Data Analysis, Elsevier, vol. 51(11), pages 5352-5367, July.
    4. Lijoi, Antonio & Mena, Ramses H. & Prunster, Igor, 2005. "Hierarchical Mixture Modeling With Normalized Inverse-Gaussian Priors," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1278-1291, December.
    5. Antonio Lijoi & Ramsés H. Mena & Igor Prünster, 2007. "Controlling the reinforcement in Bayesian non‐parametric mixture models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 715-740, September.
    6. Lancelot F. James & Antonio Lijoi & Igor Prünster, 2006. "Conjugacy as a Distinctive Feature of the Dirichlet Process," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(1), pages 105-120, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lijoi, Antonio & Nipoti, Bernardo & Prünster, Igor, 2014. "Dependent mixture models: Clustering and borrowing information," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 417-433.
    2. Antonio Lijoi & Igor Prunster, 2009. "Models beyond the Dirichlet process," Quaderni di Dipartimento 103, University of Pavia, Department of Economics and Quantitative Methods.
    3. Griffin, Jim, 2019. "Two part envelopes for rejection sampling of some completely random measures," Statistics & Probability Letters, Elsevier, vol. 151(C), pages 36-41.
    4. Luai Al Labadi & Ibrahim Abdelrazeq, 2017. "On functional central limit theorems of Bayesian nonparametric priors," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 26(2), pages 215-229, June.
    5. Antonio Lijoi & Igor Pruenster, 2009. "Distributional Properties of means of Random Probability Measures," ICER Working Papers - Applied Mathematics Series 22-2009, ICER - International Centre for Economic Research.
    6. Antonio Lijoi & Igor Prünster, 2014. "Discussion of “On simulation and properties of the stable law” by L. Devroye and L. James," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(3), pages 371-377, August.
    7. Leisen, Fabrizio & Collet, Francesca, 2011. "Free completely random measures," DES - Working Papers. Statistics and Econometrics. WS ws112821, Universidad Carlos III de Madrid. Departamento de Estadística.
    8. Griffin, J.E. & Steel, M.F.J., 2011. "Stick-breaking autoregressive processes," Journal of Econometrics, Elsevier, vol. 162(2), pages 383-396, June.
    9. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "On the stick–breaking representation of normalized inverse Gaussian priors," DEM Working Papers Series 008, University of Pavia, Department of Economics and Management.
    10. Nieto-Barajas, Luis E., 2014. "Bayesian semiparametric analysis of short- and long-term hazard ratios with covariates," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 477-490.
    11. Antonio Lijoi & Igor Pruenster, 2009. "Models beyond the Dirichlet process," ICER Working Papers - Applied Mathematics Series 23-2009, ICER - International Centre for Economic Research.
    12. Argiento, Raffaele & Guglielmi, Alessandra & Pievatolo, Antonio, 2010. "Bayesian density estimation and model selection using nonparametric hierarchical mixtures," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 816-832, April.
    13. Peter Müeller & Fernando A. Quintana & Garritt Page, 2018. "Nonparametric Bayesian inference in applications," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(2), pages 175-206, June.
    14. Jim E. Griffin & Fabrizio Leisen, 2017. "Compound random measures and their use in Bayesian non-parametrics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(2), pages 525-545, March.
    15. François Caron & Emily B. Fox, 2017. "Sparse graphs using exchangeable random measures," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1295-1366, November.
    16. Riva Palacio, Alan & Leisen, Fabrizio, 2018. "Integrability conditions for compound random measures," Statistics & Probability Letters, Elsevier, vol. 135(C), pages 32-37.
    17. Pierpaolo De Blasi & Stefano Favaro & Antonio Lijoi & Ramsés H. Mena & Igor Prünster & Mattteo Ruggiero, 2013. "Are Gibbs-type priors the most natural generalization of the Dirichlet process?," DEM Working Papers Series 054, University of Pavia, Department of Economics and Management.
    18. J. E. Griffin & M. Kolossiatis & M. F. J. Steel, 2013. "Comparing distributions by using dependent normalized random-measure mixtures," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 499-529, June.
    19. Stefano Favaro & Antonio Lijoi & Igor Prunster, 2011. "Asymptotics for a Bayesian nonparametric estimator of species richness," Quaderni di Dipartimento 144, University of Pavia, Department of Economics and Quantitative Methods.
    20. Antonio Lijoi & Bernardo Nipoti & Igor Prünster, 2013. "Dependent mixture models: clustering and borrowing information," DEM Working Papers Series 046, University of Pavia, Department of Economics and Management.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. E. Griffin & M. Kolossiatis & M. F. J. Steel, 2013. "Comparing distributions by using dependent normalized random-measure mixtures," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 499-529, June.
    2. Kolossiatis, M. & Griffin, J.E. & Steel, M.F.J., 2011. "Modeling overdispersion with the normalized tempered stable distribution," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2288-2301, July.
    3. Antonio Lijoi & Bernardo Nipoti & Igor Prünster, 2013. "Dependent mixture models: clustering and borrowing information," DEM Working Papers Series 046, University of Pavia, Department of Economics and Management.
    4. Lijoi, Antonio & Nipoti, Bernardo & Prünster, Igor, 2014. "Dependent mixture models: Clustering and borrowing information," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 417-433.
    5. Ruth Fuentes–García & Ramsés Mena & Stephen Walker, 2010. "A Probability for Classification Based on the Dirichlet Process Mixture Model," Journal of Classification, Springer;The Classification Society, vol. 27(3), pages 389-403, November.
    6. Stefano Favaro & Antonio Lijoi & Igor Prünster, 2012. "On the stick–breaking representation of normalized inverse Gaussian priors," DEM Working Papers Series 008, University of Pavia, Department of Economics and Management.
    7. Ali Karimnezhad & Mahmoud Zarepour, 2020. "A general guide in Bayesian and robust Bayesian estimation using Dirichlet processes," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 83(3), pages 321-346, April.
    8. Antonio Canale & Igor Prünster, 2017. "Robustifying Bayesian nonparametric mixtures for count data," Biometrics, The International Biometric Society, vol. 73(1), pages 174-184, March.
    9. Antonio Lijoi & Igor Prunster, 2009. "Models beyond the Dirichlet process," Quaderni di Dipartimento 103, University of Pavia, Department of Economics and Quantitative Methods.
    10. Matteo Ruggiero & Matteo Sordello, 2018. "Clustering dynamics in a class of normalised generalised gamma dependent priors," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(1), pages 83-98, February.
    11. Pierpaolo De Blasi & Stefano Favaro & Antonio Lijoi & Ramsés H. Mena & Igor Prünster & Mattteo Ruggiero, 2013. "Are Gibbs-type priors the most natural generalization of the Dirichlet process?," DEM Working Papers Series 054, University of Pavia, Department of Economics and Management.
    12. Raffaele Argiento & Alessandra Guglielmi & Antonio Pievatolo, 2014. "Estimation, prediction and interpretation of NGG random effects models: an application to Kevlar fibre failure times," Statistical Papers, Springer, vol. 55(3), pages 805-826, August.
    13. De Blasi, Pierpaolo & Martínez, Asael Fabian & Mena, Ramsés H. & Prünster, Igor, 2020. "On the inferential implications of decreasing weight structures in mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 147(C).
    14. Argiento, Raffaele & Guglielmi, Alessandra & Pievatolo, Antonio, 2010. "Bayesian density estimation and model selection using nonparametric hierarchical mixtures," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 816-832, April.
    15. Hajargasht, Gholamreza & Rao, D.S. Prasada, 2019. "Multilateral index number systems for international price comparisons: Properties, existence and uniqueness," Journal of Mathematical Economics, Elsevier, vol. 83(C), pages 36-47.
    16. Fuentes-García, Ruth & Mena, Ramsés H. & Walker, Stephen G., 2019. "Modal posterior clustering motivated by Hopfield’s network," Computational Statistics & Data Analysis, Elsevier, vol. 137(C), pages 92-100.
    17. Ausín, M. Concepción & Galeano, Pedro & Ghosh, Pulak, 2014. "A semiparametric Bayesian approach to the analysis of financial time series with applications to value at risk estimation," European Journal of Operational Research, Elsevier, vol. 232(2), pages 350-358.
    18. Richard F. MacLehose & David B. Dunson, 2010. "Bayesian Semiparametric Multiple Shrinkage," Biometrics, The International Biometric Society, vol. 66(2), pages 455-462, June.
    19. Antonio Lijoi & Igor Pruenster & Stephen G. Walker, 2008. "Posterior analysis for some classes of nonparametric models," ICER Working Papers - Applied Mathematics Series 05-2008, ICER - International Centre for Economic Research.
    20. Melnykov, Volodymyr & Melnykov, Igor, 2012. "Initializing the EM algorithm in Gaussian mixture models with an unknown number of components," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1381-1395.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:36:y:2009:i:1:p:76-97. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley Content Delivery). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.