IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/39-17.html
   My bibliography  Save this paper

Testing for homogeneity in mixture models

Author

Listed:
  • Jiaying Gu

    (Institute for Fiscal Studies and University of Toronto)

  • Roger Koenker

    (Institute for Fiscal Studies and UCL)

  • Stanislav Volgushev

    (Institute for Fiscal Studies)

Abstract

Statistical models of unobserved heterogeneity are typically formalized as mixtures of simple parametric models and interest naturally focuses on testing for homogeneity versus general mixture alternatives. Many tests of this type can be interpreted as C(a) tests, as in Neyman (1959), and shown to be locally, asymptotically optimal. These C(a) tests will be contrasted with a new approach to likelihood ratio testing for general mixture models. The latter tests are based on estimation of general nonparametric mixing distribution with the Kiefer and Wolfowitz (1956) maximum likelihood estimator. Recent developments in convex optimization have dramatically improved upon earlier EM methods for computation of these estimators, and recent results on the large sample behavior of likelihood ratios involving such estimators yield a tractable form of asymptotic inference. Improvement in computation efficiency also facilitates the use of a bootstrap method to determine critical values that are shown to work better than the asymptotic critical values in fi nite samples. Consistency of the bootstrap procedure is also formally established. We compare performance of the two approaches identifying circumstances in which each is preferred. This paper was published in Econometric Theory, 34, 850-95, (2018).

Suggested Citation

  • Jiaying Gu & Roger Koenker & Stanislav Volgushev, 2017. "Testing for homogeneity in mixture models," CeMMAP working papers CWP39/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:39/17
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/cemmap/wps/CWP391717.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    2. Giacomini, Raffaella & Politis, Dimitris N. & White, Halbert, 2013. "A Warp-Speed Method For Conducting Monte Carlo Experiments Involving Bootstrap Estimators," Econometric Theory, Cambridge University Press, vol. 29(3), pages 567-589, June.
    3. Piet Groeneboom & Geurt Jongbloed & Jon A. Wellner, 2008. "The Support Reduction Algorithm for Computing Nonā€Parametric Function Estimates in Mixture Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 35(3), pages 385-399, September.
    4. Chen, Xiaohong & Ponomareva, Maria & Tamer, Elie, 2014. "Likelihood inference in some finite mixture models," Journal of Econometrics, Elsevier, vol. 182(1), pages 87-99.
    5. Chen, Hanfeng & Chen, Jiahua, 2001. "Large sample distribution of the likelihood ratio test for normal mixtures," Statistics & Probability Letters, Elsevier, vol. 52(2), pages 125-133, April.
    6. Chesher, Andrew D, 1984. "Testing for Neglected Heterogeneity," Econometrica, Econometric Society, vol. 52(4), pages 865-872, July.
    7. Roger Koenker & Ivan Mizera, 2014. "Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 674-685, June.
    8. Jin Seo Cho & Halbert White, 2007. "Testing for Regime Switching," Econometrica, Econometric Society, vol. 75(6), pages 1671-1720, November.
    9. P. Li & J. Chen & P. Marriott, 2009. "Non-finite Fisher information and homogeneity: an EM approach," Biometrika, Biometrika Trust, vol. 96(2), pages 411-426.
    10. Koenker, Roger & Mizera, Ivan, 2014. "Convex Optimization in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 60(i05).
    11. Hanfeng Chen & Jiahua Chen & John D. Kalbfleisch, 2001. "A modified likelihood ratio test for homogeneity in finite mixture models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(1), pages 19-29.
    12. Li, Pengfei & Chen, Jiahua, 2010. "Testing the Order of a Finite Mixture," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1084-1092.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hiroyuki Kasahara & Katsumi Shimotsu, 2018. "Testing the Number of Regimes in Markov Regime Switching Models," Papers 1801.06862, arXiv.org, revised Jan 2018.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiaying Gu & Roger Koenker & Stanislav Volgushev, 2017. "Testing for homogeneity in mixture models," CeMMAP working papers 39/17, Institute for Fiscal Studies.
    2. Kasahara Hiroyuki & Shimotsu Katsumi, 2012. "Testing the Number of Components in Finite Mixture Models," Global COE Hi-Stat Discussion Paper Series gd12-259, Institute of Economic Research, Hitotsubashi University.
    3. Jiaying Gu & Roger Koenker, 2014. "Unobserved heterogeneity in income dynamics: an empirical Bayes perspective," CeMMAP working papers 43/14, Institute for Fiscal Studies.
    4. Cho, Jin Seo & White, Halbert, 2010. "Testing for unobserved heterogeneity in exponential and Weibull duration models," Journal of Econometrics, Elsevier, vol. 157(2), pages 458-480, August.
    5. Jiaying Gu & Roger Koenker, 2014. "Unobserved heterogeneity in income dynamics: an empirical Bayes perspective," CeMMAP working papers CWP43/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    6. Sergei Koulayev & Marc Rysman & Scott Schuh & Joanna Stavins, 2016. "Explaining adoption and use of payment instruments by US consumers," RAND Journal of Economics, RAND Corporation, vol. 47(2), pages 293-325, May.
    7. Charnigo, Richard & Fan, Qian & Bittel, Douglas & Dai, Hongying, 2013. "Testing unilateral versus bilateral normal contamination," Statistics & Probability Letters, Elsevier, vol. 83(1), pages 163-167.
    8. Michael Gilraine & Jiaying Gu & Robert McMillan, 2021. "A Nonparametric Method for Estimating Teacher Value-Added," Working Papers tecipa-689, University of Toronto, Department of Economics.
    9. Hiroyuki Kasahara & Katsumi Shimotsu, 2017. "Testing the Order of Multivariate Normal Mixture Models," CIRJE F-Series CIRJE-F-1044, CIRJE, Faculty of Economics, University of Tokyo.
    10. Yu Hao & Hiroyuki Kasahara, 2022. "Testing the Number of Components in Finite Mixture Normal Regression Model with Panel Data," Papers 2210.02824, arXiv.org, revised Jun 2023.
    11. Jiaying Gu & Roger Koenker, 2017. "Rebayes: an R package for empirical bayes mixture methods," CeMMAP working papers 37/17, Institute for Fiscal Studies.
    12. Jiaying Gu & Roger Koenker, 2017. "Rebayes: an R package for empirical bayes mixture methods," CeMMAP working papers CWP37/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Michael Gilraine & Jiaying Gu & Robert McMillan, 2020. "A New Method for Estimating Teacher Value-Added," NBER Working Papers 27094, National Bureau of Economic Research, Inc.
    14. Roger Koenker & Jiaying Gu, 2019. "Minimalist G-modelling: A comment on Efron," CeMMAP working papers CWP13/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    15. Mike Gilraine & Jiaying Gu & Robert McMillan, 2022. "A Nonparametric Approach for Studying Teacher Impacts," Working Papers tecipa-716, University of Toronto, Department of Economics.
    16. Ye, Mao & Lu, Zhao-Hua & Li, Yimei & Song, Xinyuan, 2019. "Finite mixture of varying coefficient model: Estimation and component selection," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 452-474.
    17. Donald W. K. Andrews & Patrik Guggenberger, 2015. "Identification- and Singularity-Robust Inference for Moment Condition," Cowles Foundation Discussion Papers 1978R2, Cowles Foundation for Research in Economics, Yale University, revised Jan 2019.
    18. Wang, Yihe & Zhao, Sihai Dave, 2021. "A nonparametric empirical Bayes approach to large-scale multivariate regression," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    19. Giovanni Compiani & Yuichi Kitamura, 2016. "Using mixtures in econometric models: a brief review and some new results," Econometrics Journal, Royal Economic Society, vol. 19(3), pages 95-127, October.
    20. Meng Li & Sijia Xiang & Weixin Yao, 2016. "Robust estimation of the number of components for mixtures of linear regression models," Computational Statistics, Springer, vol. 31(4), pages 1539-1555, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:39/17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.