IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v249y2025ipbs0304407625000120.html

Penalized estimation of finite mixture models

Author

Listed:
  • Budanova, Sofya

Abstract

Economists often model unobserved heterogeneity using finite mixtures. In practice, the number of mixture components is rarely known. Model parameters lack point-identification if the estimation includes too many components, thus invalidating the classic properties of maximum likelihood estimation. I propose a penalized likelihood method to estimate finite mixtures with an unknown number of components. The resulting Order-Selection-Consistent Estimator (OSCE) consistently estimates the true number of components and achieves oracle efficiency. This paper extends penalized estimation to models without point-identification and to mixtures with growing number of components. I apply the OSCE to estimate players’ rationality levels in a coordination game.

Suggested Citation

  • Budanova, Sofya, 2025. "Penalized estimation of finite mixture models," Journal of Econometrics, Elsevier, vol. 249(PB).
  • Handle: RePEc:eee:econom:v:249:y:2025:i:pb:s0304407625000120
    DOI: 10.1016/j.jeconom.2025.105958
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407625000120
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2025.105958?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Hajo Holzmann & Axel Munk & Tilmann Gneiting, 2006. "Identifiability of Finite Mixtures of Elliptical Distributions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(4), pages 753-763, December.
    3. Donald W. K. Andrews & Xu Cheng, 2012. "Estimation and Inference With Weak, Semi‐Strong, and Strong Identification," Econometrica, Econometric Society, vol. 80(5), pages 2153-2211, September.
    4. Stahl Dale O. & Wilson Paul W., 1995. "On Players' Models of Other Players: Theory and Experimental Evidence," Games and Economic Behavior, Elsevier, vol. 10(1), pages 218-254, July.
    5. Woo, Mi-Ja & Sriram, T.N., 2006. "Robust Estimation of Mixture Complexity," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1475-1486, December.
    6. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    7. Marc Henry & Yuichi Kitamura & Bernard Salanié, 2014. "Partial identification of finite mixtures in econometric models," Quantitative Economics, Econometric Society, vol. 5, pages 123-144, March.
    8. P. Li & J. Chen & P. Marriott, 2009. "Non-finite Fisher information and homogeneity: an EM approach," Biometrika, Biometrika Trust, vol. 96(2), pages 411-426.
    9. Horowitz, Joel L & Manski, Charles F, 1995. "Identification and Robustness with Contaminated and Corrupted Data," Econometrica, Econometric Society, vol. 63(2), pages 281-302, March.
    10. Keane, Michael P & Wolpin, Kenneth I, 1997. "The Career Decisions of Young Men," Journal of Political Economy, University of Chicago Press, vol. 105(3), pages 473-522, June.
    11. Camille Cornand & Frank Heinemann, 2014. "Measuring agents’ reaction to private and public information in games with strategic complementarities," Experimental Economics, Springer;Economic Science Association, vol. 17(1), pages 61-77, March.
    12. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    13. Antoni Bosch-Domènech & José Montalvo & Rosemarie Nagel & Albert Satorra, 2010. "A finite mixture analysis of beauty-contest data using generalized beta distributions," Experimental Economics, Springer;Economic Science Association, vol. 13(4), pages 461-475, December.
    14. Larbi Alaoui & Antonio Penta, 2016. "Endogenous Depth of Reasoning," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1297-1333.
    15. Hiroyuki Kasahara & Katsumi Shimotsu, 2015. "Testing the Number of Components in Normal Mixture Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1632-1645, December.
    16. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2016. "Non-parametric estimation of finite mixtures from repeated measurements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 211-229, January.
    17. Stephen Morris & Hyun Song Shin, 2002. "Social Value of Public Information," American Economic Review, American Economic Association, vol. 92(5), pages 1521-1534, December.
    18. Broda, Simon A. & Haas, Markus & Krause, Jochen & Paolella, Marc S. & Steude, Sven C., 2013. "Stable mixture GARCH models," Journal of Econometrics, Elsevier, vol. 172(2), pages 292-306.
    19. Chen, Jiahua & Khalili, Abbas, 2009. "Order Selection in Finite Mixture Models With a Nonsmooth Penalty," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 187-196.
    20. Hiroyuki Kasahara & Katsumi Shimotsu, 2009. "Nonparametric Identification of Finite Mixture Models of Dynamic Discrete Choices," Econometrica, Econometric Society, vol. 77(1), pages 135-175, January.
    21. Pötscher, Benedikt M. & Leeb, Hannes, 2009. "On the distribution of penalized maximum likelihood estimators: The LASSO, SCAD, and thresholding," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2065-2082, October.
    22. Molinari, Francesca, 2008. "Partial identification of probability distributions with misclassified data," Journal of Econometrics, Elsevier, vol. 144(1), pages 81-117, May.
    23. Chen, Xiaohong & Ponomareva, Maria & Tamer, Elie, 2014. "Likelihood inference in some finite mixture models," Journal of Econometrics, Elsevier, vol. 182(1), pages 87-99.
    24. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    25. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    26. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2016. "Non-parametric estimation of finite mixtures from repeated measurements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 211-229, January.
    27. Hansheng Wang & Runze Li & Chih-Ling Tsai, 2007. "Tuning parameter selectors for the smoothly clipped absolute deviation method," Biometrika, Biometrika Trust, vol. 94(3), pages 553-568.
    28. repec:bge:wpaper:455 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    2. Shapiro, Dmitry & Shi, Xianwen & Zillante, Artie, 2014. "Level-k reasoning in a generalized beauty contest," Games and Economic Behavior, Elsevier, vol. 86(C), pages 308-329.
    3. Giovanni Compiani & Yuichi Kitamura, 2016. "Using mixtures in econometric models: a brief review and some new results," Econometrics Journal, Royal Economic Society, vol. 19(3), pages 95-127, October.
    4. Trabelsi, Emna & Hichri, Walid, 2021. "Central Bank Transparency with (semi-)public Information: Laboratory Experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    5. Ballester, Coralio & Rodriguez-Moral, Antonio & Vorsatz, Marc, 2024. "Cognitive reflection in experimental anchored guessing games," Games and Economic Behavior, Elsevier, vol. 148(C), pages 179-195.
    6. Ye, Mao & Lu, Zhao-Hua & Li, Yimei & Song, Xinyuan, 2019. "Finite mixture of varying coefficient model: Estimation and component selection," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 452-474.
    7. Bayer, Ralph C. & Renou, Ludovic, 2016. "Logical omniscience at the laboratory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 41-49.
    8. Teeple, Keisuke, 2023. "Level-k predatory trading," Journal of Mathematical Economics, Elsevier, vol. 106(C).
    9. repec:osf:socarx:ymzrd_v1 is not listed on IDEAS
    10. Martin, Daniel, 2017. "Strategic pricing with rational inattention to quality," Games and Economic Behavior, Elsevier, vol. 104(C), pages 131-145.
    11. Kohei Kawamura & Vasileios Vlaseros, 2015. "Expert Information and Majority Decisions," Edinburgh School of Economics Discussion Paper Series 261, Edinburgh School of Economics, University of Edinburgh.
    12. Amengual, Dante & Bei, Xinyue & Carrasco, Marine & Sentana, Enrique, 2025. "Score-type tests for normal mixtures," Journal of Econometrics, Elsevier, vol. 248(C).
    13. Jacob K Goeree & Bernardo Garcia-Pola, 2023. "S Equilibrium: A Synthesis of (Behavioral) Game Theory," Papers 2307.06309, arXiv.org.
    14. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    15. Ruiz-Buforn, Alba & Alfarano, Simone & Camacho-Cuena, Eva & Morone, Andrea, 2018. "Crowding out effect and traders' overreliance on public information in financial markets: a lesson from the lab," MPRA Paper 88866, University Library of Munich, Germany.
    16. Marcus Giamattei & Johann Lambsdorff, 2015. "Balancing the current account: experimental evidence on underconsumption," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 670-696, December.
    17. Peter G Moffatt & Ganna Pogrebna & Graciela Zevallos-Porles, 2020. "Depth of Reasoning Models with Sophisticated Agents," Working Paper series, University of East Anglia, Centre for Behavioural and Experimental Social Science (CBESS) 20-06, School of Economics, University of East Anglia, Norwich, UK..
    18. Chen, Xiaohong & Ponomareva, Maria & Tamer, Elie, 2014. "Likelihood inference in some finite mixture models," Journal of Econometrics, Elsevier, vol. 182(1), pages 87-99.
    19. Burkhard C. Schipper & Hang Zhou, 2022. "Level-k Thinking in the Extensive Form," Working Papers 352, University of California, Davis, Department of Economics.
    20. Dmitry Shapiro & Xianwen Shi & Artie Zillante, 2009. "Robustness of Level-k Reasoning in Generalized Beauty Contest Games," Working Papers tecipa-380, University of Toronto, Department of Economics.
    21. Burchardi, Konrad B. & Penczynski, Stefan P., 2014. "Out of your mind: Eliciting individual reasoning in one shot games," Games and Economic Behavior, Elsevier, vol. 84(C), pages 39-57.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:249:y:2025:i:pb:s0304407625000120. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.