IDEAS home Printed from https://ideas.repec.org/p/tor/tecipa/tecipa-473.html
   My bibliography  Save this paper

Copula Based Factorization in Bayesian Multivariate Infinite Mixture Models

Author

Listed:
  • Martin Burda
  • Artem Prokhorov

Abstract

Bayesian nonparametric models based on infinite mixtures of density kernels have been recently gaining in popularity due to their flexibility and feasibility of implementation even in complicated modeling scenarios. In economics, they have been particularly useful in estimating nonparametric distributions of latent variables. However, these models have been rarely applied in more than one dimension. Indeed, the multivariate case suffers from the curse of dimensionality, with a rapidly increasing number of parameters needed to jointly characterize each mixing component. In this paper, we propose a factorization scheme for nonparametric mixture models whereby each marginal dimension in the mixing parameter space is modeled separately, linked by a nonparametric random copula function. Specifically, we consider nonparametric univariate Gaussian mixtures for the marginals and a multivariate random Bernstein polynomial copula for the link function, under Dirichlet process priors. We show that this scheme leads to an improvement in the precision of a density estimate in finite samples, providing a suitable tool for applications in higher dimensions. We derive weak posterior consistency of the copula-based mixing scheme for general kernel types under high-level conditions, and strong posterior consistency for the specific Bernstein-Gaussian mixture model.

Suggested Citation

  • Martin Burda & Artem Prokhorov, 2013. "Copula Based Factorization in Bayesian Multivariate Infinite Mixture Models," Working Papers tecipa-473, University of Toronto, Department of Economics.
  • Handle: RePEc:tor:tecipa:tecipa-473
    as

    Download full text from publisher

    File URL: https://www.economics.utoronto.ca/public/workingPapers/tecipa-473.pdf
    File Function: Main Text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Paolo Giordani & Xiuyan Mun & Robert Kohn, 2012. "Efficient Estimation of Covariance Matrices using Posterior Mode Multiple Shrinkage," Journal of Financial Econometrics, Oxford University Press, vol. 11(1), pages 154-192, December.
    2. Axel Tenbusch, 1994. "Two-dimensional Bernstein polynomial density estimators," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 41(1), pages 233-253, December.
    3. Jensen, Mark J. & Maheu, John M., 2010. "Bayesian semiparametric stochastic volatility modeling," Journal of Econometrics, Elsevier, vol. 157(2), pages 306-316, August.
    4. Chen, Xiaohong & Fan, Yanqin & Tsyrennikov, Viktor, 2006. "Efficient Estimation of Semiparametric Multivariate Copula Models," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1228-1240, September.
    5. Keisuke Hirano, 2002. "Semiparametric Bayesian Inference in Autoregressive Panel Data Models," Econometrica, Econometric Society, vol. 70(2), pages 781-799, March.
    6. Michael Pitt & David Chan & Robert Kohn, 2006. "Efficient Bayesian inference for Gaussian copula regression models," Biometrika, Biometrika Trust, vol. 93(3), pages 537-554, September.
    7. Sonia Petrone, 1999. "Random Bernstein Polynomials," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 26(3), pages 373-393, September.
    8. Conley, Timothy G. & Hansen, Christian B. & McCulloch, Robert E. & Rossi, Peter E., 2008. "A semi-parametric Bayesian approach to the instrumental variable problem," Journal of Econometrics, Elsevier, vol. 144(1), pages 276-305, May.
    9. Leisen, Fabrizio & Lijoi, Antonio, 2011. "Vectors of two-parameter Poisson-Dirichlet processes," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 482-495, March.
    10. A. Azzalini & A. Capitanio, 1999. "Statistical applications of the multivariate skew normal distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(3), pages 579-602.
    11. Chib, Siddhartha & Hamilton, Barton H., 2002. "Semiparametric Bayes analysis of longitudinal data treatment models," Journal of Econometrics, Elsevier, vol. 110(1), pages 67-89, September.
    12. Sonia Petrone & Larry Wasserman, 2002. "Consistency of Bernstein polynomial posteriors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(1), pages 79-100, January.
    13. Zheng, Yanbing, 2011. "Shape restriction of the multi-dimensional Bernstein prior for density functions," Statistics & Probability Letters, Elsevier, vol. 81(6), pages 647-651, June.
    14. Kim Jin Gyo & Menzefricke Ulrich & Feinberg Fred M., 2004. "Assessing Heterogeneity in Discrete Choice Models Using a Dirichlet Process Prior," Review of Marketing Science, De Gruyter, vol. 2(1), pages 1-41, January.
    15. Burda, Martin & Harding, Matthew & Hausman, Jerry, 2008. "A Bayesian mixed logit-probit model for multinomial choice," Journal of Econometrics, Elsevier, vol. 147(2), pages 232-246, December.
    16. Yanbing Zheng & Jun Zhu & Anindya Roy, 2010. "Nonparametric Bayesian inference for the spectral density function of a random field," Biometrika, Biometrika Trust, vol. 97(1), pages 238-245.
    17. Sancetta, Alessio & Satchell, Stephen, 2004. "The Bernstein Copula And Its Applications To Modeling And Approximations Of Multivariate Distributions," Econometric Theory, Cambridge University Press, vol. 20(3), pages 535-562, June.
    18. Rodríguez, Abel & Dunson, David B. & Gelfand, Alan E., 2010. "Latent Stick-Breaking Processes," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 647-659.
    19. Ausin, M. Concepcion & Lopes, Hedibert F., 2010. "Time-varying joint distribution through copulas," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2383-2399, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Norets, Andriy, 2015. "Bayesian regression with nonparametric heteroskedasticity," Journal of Econometrics, Elsevier, vol. 185(2), pages 409-419.
    2. Jensen, Mark J. & Maheu, John M., 2014. "Estimating a semiparametric asymmetric stochastic volatility model with a Dirichlet process mixture," Journal of Econometrics, Elsevier, vol. 178(P3), pages 523-538.
    3. Lu Lu & Sujit Ghosh, 2023. "Nonparametric Estimation of Multivariate Copula Using Empirical Bayes Methods," Mathematics, MDPI, vol. 11(20), pages 1-22, October.
    4. Dellaportas, Petros & Tsionas, Mike G., 2019. "Importance sampling from posterior distributions using copula-like approximations," Journal of Econometrics, Elsevier, vol. 210(1), pages 45-57.
    5. Eddie Anderson & Artem Prokhorov & Yajing Zhu, 2020. "A Simple Estimator of Two‐Dimensional Copulas, with Applications," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(6), pages 1375-1412, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jensen, Mark J. & Maheu, John M., 2010. "Bayesian semiparametric stochastic volatility modeling," Journal of Econometrics, Elsevier, vol. 157(2), pages 306-316, August.
    2. repec:cte:wsrepe:ws131211 is not listed on IDEAS
    3. Bassetti, Federico & Casarin, Roberto & Leisen, Fabrizio, 2014. "Beta-product dependent Pitman–Yor processes for Bayesian inference," Journal of Econometrics, Elsevier, vol. 180(1), pages 49-72.
    4. Fisher, Mark & Jensen, Mark J., 2019. "Bayesian inference and prediction of a multiple-change-point panel model with nonparametric priors," Journal of Econometrics, Elsevier, vol. 210(1), pages 187-202.
    5. Mark J. Jensen & John M. Maheu, 2018. "Risk, Return and Volatility Feedback: A Bayesian Nonparametric Analysis," JRFM, MDPI, vol. 11(3), pages 1-29, September.
    6. Ouimet, Frédéric, 2021. "Asymptotic properties of Bernstein estimators on the simplex," Journal of Multivariate Analysis, Elsevier, vol. 185(C).
    7. Patton, Andrew J., 2012. "A review of copula models for economic time series," Journal of Multivariate Analysis, Elsevier, vol. 110(C), pages 4-18.
    8. Cem Çakmakli, 2012. "Bayesian Semiparametric Dynamic Nelson-Siegel Model," Working Paper series 59_12, Rimini Centre for Economic Analysis, revised Sep 2012.
    9. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    10. Burda, Martin & Harding, Matthew & Hausman, Jerry, 2008. "A Bayesian mixed logit-probit model for multinomial choice," Journal of Econometrics, Elsevier, vol. 147(2), pages 232-246, December.
    11. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2013. "Historical Developments in Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 13-191/III, Tinbergen Institute.
    12. Jin, Xin & Maheu, John M., 2016. "Bayesian semiparametric modeling of realized covariance matrices," Journal of Econometrics, Elsevier, vol. 192(1), pages 19-39.
    13. Fisher, Mark & Jensen, Mark J., 2022. "Bayesian nonparametric learning of how skill is distributed across the mutual fund industry," Journal of Econometrics, Elsevier, vol. 230(1), pages 131-153.
    14. Federico Bassetti & Roberto Casarin & Marco Del Negro, 2022. "A Bayesian Approach to Inference on Probabilistic Surveys," Staff Reports 1025, Federal Reserve Bank of New York.
    15. Bouezmarni, Taoufik & Rombouts, Jeroen V.K. & Taamouti, Abderrahim, 2010. "Asymptotic properties of the Bernstein density copula estimator for [alpha]-mixing data," Journal of Multivariate Analysis, Elsevier, vol. 101(1), pages 1-10, January.
    16. Alexandre Leblanc, 2010. "A bias-reduced approach to density estimation using Bernstein polynomials," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(4), pages 459-475.
    17. Billio, Monica & Casarin, Roberto & Rossini, Luca, 2019. "Bayesian nonparametric sparse VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 97-115.
    18. Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2018. "Bayesian Nonparametric Calibration and Combination of Predictive Distributions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 675-685, April.
    19. Bouezmarni Taoufik & Ghouch El & Taamouti Abderrahim, 2013. "Bernstein estimator for unbounded copula densities," Statistics & Risk Modeling, De Gruyter, vol. 30(4), pages 343-360, December.
    20. Griffin, J.E. & Steel, M.F.J., 2011. "Stick-breaking autoregressive processes," Journal of Econometrics, Elsevier, vol. 162(2), pages 383-396, June.
    21. Monica Billio & Roberto Casarin & Luca Rossini, 2016. "Bayesian nonparametric sparse seemingly unrelated regression model (SUR)," Working Papers 2016:20, Department of Economics, University of Venice "Ca' Foscari".

    More about this item

    Keywords

    Nonparametric copula; nonparametric consistency; mixture modeling;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tor:tecipa:tecipa-473. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePEc Maintainer (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.