IDEAS home Printed from https://ideas.repec.org/p/tky/fseres/2012cf866.html
   My bibliography  Save this paper

Nonparametric Identification and Estimation of the Number of Components in Multivariate Mixtures

Author

Listed:
  • Hiroyuki Kasahara

    (Department of Economics, University of British Columbia)

  • Katsumi Shimotsu

    (Faculty of Economics, University of Tokyo)

Abstract

This article analyzes the identifiability of the number of components in k-variate, M-component finite mixture models in which each component distribution has independent marginals, including models in latent class analysis. Without making parametric assumptions on the component distributions, we investigate how one can identify the number of components from the distribution function of the observed data. When k>=2, a lower bound on the number of components (M) is nonparametrically identifiable from the rank of a matrix constructed from the distribution function of the observed variables. Building on this identification condition, we develop a procedure to consistently estimate a lower bound on the number of components.

Suggested Citation

  • Hiroyuki Kasahara & Katsumi Shimotsu, 2012. "Nonparametric Identification and Estimation of the Number of Components in Multivariate Mixtures," CIRJE F-Series CIRJE-F-866, CIRJE, Faculty of Economics, University of Tokyo.
    • Handle: RePEc:tky:fseres:2012cf866
    as

    Download full text from publisher

    File URL: http://www.cirje.e.u-tokyo.ac.jp/research/dp/2012/2012cf866.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andrews, Donald W. K., 1987. "Asymptotic Results for Generalized Wald Tests," Econometric Theory, Cambridge University Press, vol. 3(3), pages 348-358, June.
    2. Kleibergen, Frank & Paap, Richard, 2006. "Generalized reduced rank tests using the singular value decomposition," Journal of Econometrics, Elsevier, vol. 133(1), pages 97-126, July.
    3. T. P. Hettmansperger & Hoben Thomas, 2000. "Almost nonparametric inference for repeated measures in mixture models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(4), pages 811-825.
    4. Peter Hall & Amnon Neeman & Reza Pakyari & Ryan Elmore, 2005. "Nonparametric inference in multivariate mixtures," Biometrika, Biometrika Trust, vol. 92(3), pages 667-678, September.
    5. Dunson, David B. & Xing, Chuanhua, 2009. "Nonparametric Bayes Modeling of Multivariate Categorical Data," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1042-1051.
    6. Hiroyuki Kasahara & Katsumi Shimotsu, 2009. "Nonparametric Identification of Finite Mixture Models of Dynamic Discrete Choices," Econometrica, Econometric Society, vol. 77(1), pages 135-175, January.
    7. Lutkepohl, Helmut & Burda, Maike M., 1997. "Modified Wald tests under nonregular conditions," Journal of Econometrics, Elsevier, vol. 78(2), pages 315-332, June.
    8. I. R. Cruz‐Medina & T. P. Hettmansperger & H. Thomas, 2004. "Semiparametric mixture models and repeated measures: the multinomial cut point model," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 53(3), pages 463-474, August.
    9. Woo, Mi-Ja & Sriram, T.N., 2006. "Robust Estimation of Mixture Complexity," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1475-1486, December.
    10. M. Levine & D. R. Hunter & D. Chauveau, 2011. "Maximum smoothed likelihood for multivariate mixtures," Biometrika, Biometrika Trust, vol. 98(2), pages 403-416.
    11. Robert Mislevy, 1984. "Estimating latent distributions," Psychometrika, Springer;The Psychometric Society, vol. 49(3), pages 359-381, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bonhomme, Stéphane & Jochmans, Koen & Robin, Jean-Marc, 2017. "Nonparametric estimation of non-exchangeable latent-variable models," Journal of Econometrics, Elsevier, vol. 201(2), pages 237-248.
    2. Jean-Marc Robin & Stéphane Bonhomme & Koen Jochmans, 2014. "Estimating Multivariate Latent-Structure Models," Sciences Po Economics Discussion Papers 2014-18, Sciences Po Departement of Economics.
    3. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2014. "Nonparametric spectral-based estimation of latent structures," CeMMAP working papers 18/14, Institute for Fiscal Studies.
    4. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2016. "Non-parametric estimation of finite mixtures from repeated measurements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 211-229, January.
    5. Aureo de Paula & Xun Tang, 2020. "Testable Implications of Multiple Equilibria in Discrete Games with Correlated Types," Papers 2012.00787, arXiv.org.
    6. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2017. "Nonparametric estimation of non-exchangeable latent-variable models," Sciences Po publications info:hdl:2441/4m4fqk908d9, Sciences Po.
    7. Xu, Ke-Li, 2018. "A semi-nonparametric estimator of regression discontinuity design with discrete duration outcomes," Journal of Econometrics, Elsevier, vol. 206(1), pages 258-278.
    8. David Balan & Patrick DeGraba & Francine Lafontaine & Patrick McAlvanah & Devesh Raval & David Schmidt, 2015. "Economics at the FTC: Fraud, Mergers and Exclusion," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 47(4), pages 371-398, December.
    9. Krasnokutskaya, Elena & Song, Kyungchul & Tang, Xun, 2022. "Estimating unobserved individual heterogeneity using pairwise comparisons," Journal of Econometrics, Elsevier, vol. 226(2), pages 477-497.
    10. repec:hal:spmain:info:hdl:2441/etefo8s8r89oamhnhiclqr530 is not listed on IDEAS
    11. Konstantin T. Matchev & Prasanth Shyamsundar, 2020. "InClass Nets: Independent Classifier Networks for Nonparametric Estimation of Conditional Independence Mixture Models and Unsupervised Classification," Papers 2009.00131, arXiv.org.
    12. Paul Schrimpf & Michio Suzuki & Hiroyuki Kasahara, 2015. "Identification and Estimation of Production Function with Unobserved Heterogeneity," 2015 Meeting Papers 924, Society for Economic Dynamics.
    13. repec:hal:spmain:info:hdl:2441/lpag9391598uoauqu4u9opq76 is not listed on IDEAS
    14. Qihui Chen & Zheng Fang, 2018. "Improved Inference on the Rank of a Matrix," Papers 1812.02337, arXiv.org, revised Mar 2019.
    15. Jean-Marc Robin & Stéphane Bonhomme & Koen Jochmans, 2014. "Estimating Multivariate Latent-Structure Models," Sciences Po Economics Discussion Papers 2014-18, Sciences Po Departement of Economics.
    16. repec:hal:wpspec:info:hdl:2441/2i27dd3b6h94aarftq0slq652a is not listed on IDEAS
    17. repec:hal:spmain:info:hdl:2441/4m4fqk908d9obqasu0uhft7t94 is not listed on IDEAS
    18. Johannes F. Jörg & Catherine Cleophas, 2022. "Nonparametric estimation of customer segments from censored sales panel data," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 21(4), pages 393-417, August.
    19. Erhao Xie, 2018. "Inference in Games Without Nash Equilibrium: An Application to Restaurants, Competition in Opening Hours," Staff Working Papers 18-60, Bank of Canada.
    20. Bonhomme, Stéphane & Jochmans, Koen & Robin, Jean-Marc, 2017. "Nonparametric estimation of non-exchangeable latent-variable models," Journal of Econometrics, Elsevier, vol. 201(2), pages 237-248.
    21. Yu Hao & Hiroyuki Kasahara, 2022. "Testing the Number of Components in Finite Mixture Normal Regression Model with Panel Data," Papers 2210.02824, arXiv.org, revised Jun 2023.
    22. repec:hal:spmain:info:hdl:2441/2i27dd3b6h94aarftq0slq652a is not listed on IDEAS
    23. Bagkavos, Dimitrios & Patil, Prakash N., 2023. "Goodness-of-fit testing for normal mixture densities," Computational Statistics & Data Analysis, Elsevier, vol. 188(C).
    24. Hiroaki Masuhara, 2019. "Identifying finite mixture models in the presence of moment-generating function: application in medical care using a zero-inflated binomial model," Economics Bulletin, AccessEcon, vol. 39(2), pages 1529-1537.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2016. "Non-parametric estimation of finite mixtures from repeated measurements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 211-229, January.
    2. repec:hal:spmain:info:hdl:2441/etefo8s8r89oamhnhiclqr530 is not listed on IDEAS
    3. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2014. "Estimating Multivariate Latent-Structure Models," SciencePo Working papers Main hal-01097135, HAL.
    4. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2014. "Nonparametric spectral-based estimation of latent structures," CeMMAP working papers 18/14, Institute for Fiscal Studies.
    5. repec:hal:spmain:info:hdl:2441/2i27dd3b6h94aarftq0slq652a is not listed on IDEAS
    6. Jean-Marc Robin & Stéphane Bonhomme & Koen Jochmans, 2014. "Estimating Multivariate Latent-Structure Models," Sciences Po Economics Discussion Papers 2014-18, Sciences Po Departement of Economics.
    7. repec:hal:wpspec:info:hdl:2441/2i27dd3b6h94aarftq0slq652a is not listed on IDEAS
    8. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2013. "Nonparametric estimation of finite mixtures," SciencePo Working papers Main hal-00972868, HAL.
    9. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2014. "Nonparametric estimation of finite measures," CeMMAP working papers 11/14, Institute for Fiscal Studies.
    10. repec:hal:wpspec:info:hdl:2441/7o52iohb7k6srk09n8t4k21sm is not listed on IDEAS
    11. Majid M. Al-Sadoon, 2014. "A general theory of rank testing," Economics Working Papers 1411, Department of Economics and Business, Universitat Pompeu Fabra, revised Feb 2015.
    12. Hiroyuki Kasahara & Katsumi Shimotsu, 2007. "Nonparametric Identification And Estimation Of Multivariate Mixtures," Working Paper 1153, Economics Department, Queen's University.
    13. repec:hal:spmain:info:hdl:2441/7o52iohb7k6srk09n8t4k21sm is not listed on IDEAS
    14. Hema Yoganarasimhan, 2016. "Estimation of Beauty Contest Auctions," Marketing Science, INFORMS, vol. 35(1), pages 27-54, January.
    15. Konstantin T. Matchev & Prasanth Shyamsundar, 2020. "InClass Nets: Independent Classifier Networks for Nonparametric Estimation of Conditional Independence Mixture Models and Unsupervised Classification," Papers 2009.00131, arXiv.org.
    16. Al-Sadoon, Majid M., 2017. "A unifying theory of tests of rank," Journal of Econometrics, Elsevier, vol. 199(1), pages 49-62.
    17. Kasahara, Hiroyuki & 笠原, 博幸 & Shimotsu, Katsumi & 下津, 克己, 2010. "Nonparametric Identification of Multivariate Mixtures," Discussion Papers 2010-09, Graduate School of Economics, Hitotsubashi University.
    18. Xu, Ke-Li, 2018. "A semi-nonparametric estimator of regression discontinuity design with discrete duration outcomes," Journal of Econometrics, Elsevier, vol. 206(1), pages 258-278.
    19. repec:hal:spmain:info:hdl:2441/lpag9391598uoauqu4u9opq76 is not listed on IDEAS
    20. Qihui Chen & Zheng Fang, 2018. "Improved Inference on the Rank of a Matrix," Papers 1812.02337, arXiv.org, revised Mar 2019.
    21. Ruli Xiao, 2016. "Nonparametric Identification of Dynamic Games with Multiple Equilibria and Unobserved Heterogeneity," CAEPR Working Papers 2016-002, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    22. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2017. "Nonparametric estimation of non-exchangeable latent-variable models," Sciences Po publications info:hdl:2441/4m4fqk908d9, Sciences Po.
    23. Al-Sadoon, Majid M., 2019. "Testing subspace Granger causality," Econometrics and Statistics, Elsevier, vol. 9(C), pages 42-61.
    24. Ruli Xiao, 2015. "Identification and Estimation of Incomplete Information Games with Multiple Equilibria," CAEPR Working Papers 2015-007, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    25. Xiaotian Zhu & David R. Hunter, 2016. "Theoretical grounding for estimation in conditional independence multivariate finite mixture models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(4), pages 683-701, October.
    26. Bonhomme, Stéphane & Jochmans, Koen & Robin, Jean-Marc, 2017. "Nonparametric estimation of non-exchangeable latent-variable models," Journal of Econometrics, Elsevier, vol. 201(2), pages 237-248.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tky:fseres:2012cf866. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CIRJE administrative office (email available below). General contact details of provider: https://edirc.repec.org/data/ritokjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.