IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v66y2020i8p3635-3656.html

A Conditional Gradient Approach for Nonparametric Estimation of Mixing Distributions

Author

Listed:
  • Srikanth Jagabathula

    (Stern School of Business, New York University, New York, New York 10012; Harvard Business School, Harvard University, Boston, Massachusetts 02163)

  • Lakshminarayanan Subramanian

    (Courant Institute of Mathematical Sciences, New York University, New York, New York 10012)

  • Ashwin Venkataraman

    (Courant Institute of Mathematical Sciences, New York University, New York, New York 10012; Harvard Institute for Quantitative Social Science, Harvard University, Cambridge, Massachusetts 02138)

Abstract

Mixture models are versatile tools that are used extensively in many fields, including operations, marketing, and econometrics. The main challenge in estimating mixture models is that the mixing distribution is often unknown, and imposing a priori parametric assumptions can lead to model misspecification issues. In this paper, we propose a new methodology for nonparametric estimation of the mixing distribution of a mixture of logit models. We formulate the likelihood-based estimation problem as a constrained convex program and apply the conditional gradient (also known as Frank–Wolfe) algorithm to solve this convex program. We show that our method iteratively generates the support of the mixing distribution and the mixing proportions. Theoretically, we establish the sublinear convergence rate of our estimator and characterize the structure of the recovered mixing distribution. Empirically, we test our approach on real-world datasets. We show that it outperforms the standard expectation-maximization (EM) benchmark on speed (16 times faster), in-sample fit (up to 24% reduction in the log-likelihood loss), and predictive (average 28% reduction in standard error metrics) and decision accuracies (extracts around 23% more revenue). On synthetic data, we show that our estimator is robust to different ground-truth mixing distributions and can also account for endogeneity.

Suggested Citation

  • Srikanth Jagabathula & Lakshminarayanan Subramanian & Ashwin Venkataraman, 2020. "A Conditional Gradient Approach for Nonparametric Estimation of Mixing Distributions," Management Science, INFORMS, vol. 66(8), pages 3635-3656, August.
  • Handle: RePEc:inm:ormnsc:v:66:y:2020:i:8:p:3635-3656
    DOI: 10.1287/mnsc.2019.3373
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2019.3373
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2019.3373?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Feng, Long & Dicker, Lee H., 2018. "Approximate nonparametric maximum likelihood for mixture models: A convex optimization approach to fitting arbitrary multivariate mixing distributions," Computational Statistics & Data Analysis, Elsevier, vol. 122(C), pages 80-91.
    2. Hauser, John R., 2014. "Consideration-set heuristics," Journal of Business Research, Elsevier, vol. 67(8), pages 1688-1699.
    3. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, August.
    4. Jeremy T. Fox & Kyoo il Kim & Stephen P. Ryan & Patrick Bajari, 2011. "A simple estimator for the distribution of random coefficients," Quantitative Economics, Econometric Society, vol. 2(3), pages 381-418, November.
    5. Chandra R. Bhat, 1997. "An Endogenous Segmentation Mode Choice Model with an Application to Intercity Travel," Transportation Science, INFORMS, vol. 31(1), pages 34-48, February.
    6. Jonathan James, 2017. "MM Algorithm for General Mixed Multinomial Logit Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(4), pages 841-857, June.
    7. Marguerite Frank & Philip Wolfe, 1956. "An algorithm for quadratic programming," Naval Research Logistics Quarterly, John Wiley & Sons, vol. 3(1‐2), pages 95-110, March.
    8. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    9. Gilles Laurent & Eric Lapersonne & Jean-Jacques Le Goff, 1995. "Consideration sets of size one: An empirical investigation of automobile purchases," Post-Print hal-00458463, HAL.
    10. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ali Aouad & Jacob Feldman & Danny Segev, 2023. "The Exponomial Choice Model for Assortment Optimization: An Alternative to the MNL Model?," Management Science, INFORMS, vol. 69(5), pages 2814-2832, May.
    2. Gerardo Berbeglia & Agustín Garassino & Gustavo Vulcano, 2022. "A Comparative Empirical Study of Discrete Choice Models in Retail Operations," Management Science, INFORMS, vol. 68(6), pages 4005-4023, June.
    3. Qi Feng & J. George Shanthikumar & Mengying Xue, 2022. "Consumer Choice Models and Estimation: A Review and Extension," Production and Operations Management, Production and Operations Management Society, vol. 31(2), pages 847-867, February.
    4. Yanlong Wang & Jian Xu & Shao-Lun Huang & Danny Dongning Sun & Xiao-Ping Zhang, 2025. "Assessing Uncertainty in Stock Returns: A Gaussian Mixture Distribution-Based Method," Papers 2503.06929, arXiv.org.
    5. Milind Dawande & Sameer Mehta & Liying Mu, 2023. "Robin Hood to the Rescue: Sustainable Revenue‐Allocation Schemes for Data Cooperatives," Production and Operations Management, Production and Operations Management Society, vol. 32(8), pages 2560-2577, August.
    6. Xiyuan Ren & Joseph Y. J. Chow & Prateek Bansal, 2023. "Nonparametric mixed logit model with market-level parameters estimated from market share data," Papers 2309.13159, arXiv.org, revised Apr 2025.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bansal, Prateek & Daziano, Ricardo A & Guerra, Erick, 2018. "Minorization-Maximization (MM) algorithms for semiparametric logit models: Bottlenecks, extensions, and comparisons," Transportation Research Part B: Methodological, Elsevier, vol. 115(C), pages 17-40.
    2. Martin O'Connell & Pierre Dubois & Rachel Griffith, 2022. "The Use of Scanner Data for Economics Research," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 723-745, August.
    3. Bansal, Prateek & Daziano, Ricardo A. & Achtnicht, Martin, 2018. "Comparison of parametric and semiparametric representations of unobserved preference heterogeneity in logit models," Journal of choice modelling, Elsevier, vol. 27(C), pages 97-113.
    4. Xiyuan Ren & Joseph Y. J. Chow & Prateek Bansal, 2023. "Nonparametric mixed logit model with market-level parameters estimated from market share data," Papers 2309.13159, arXiv.org, revised Apr 2025.
    5. Heiss, Florian & Hetzenecker, Stephan & Osterhaus, Maximilian, 2022. "Nonparametric estimation of the random coefficients model: An elastic net approach," Journal of Econometrics, Elsevier, vol. 229(2), pages 299-321.
    6. Frith, Michael J., 2019. "Modelling taste heterogeneity regarding offence location choices," Journal of choice modelling, Elsevier, vol. 33(C).
    7. Sofia Berto Villas-Boas, 2007. "Vertical Relationships between Manufacturers and Retailers: Inference with Limited Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(2), pages 625-652.
    8. Allais, Olivier & Etilé, Fabrice & Lecocq, Sébastien, 2015. "Mandatory labels, taxes and market forces: An empirical evaluation of fat policies," Journal of Health Economics, Elsevier, vol. 43(C), pages 27-44.
    9. Pietro Tebaldi & Alexander Torgovitsky & Hanbin Yang, 2023. "Nonparametric Estimates of Demand in the California Health Insurance Exchange," Econometrica, Econometric Society, vol. 91(1), pages 107-146, January.
    10. Peter Davis & Pasquale Schiraldi, 2014. "The flexible coefficient multinomial logit (FC-MNL) model of demand for differentiated products," RAND Journal of Economics, RAND Corporation, vol. 45(1), pages 32-63, March.
    11. Guevara, C. Angelo & Tang, Yue & Gao, Song, 2018. "The initial condition problem with complete history dependency in learning models for travel choices," Transportation Research Part B: Methodological, Elsevier, vol. 117(PB), pages 850-861.
    12. Georges Sfeir & Filipe Rodrigues & Maya Abou-Zeid, 2021. "Gaussian Process Latent Class Choice Models," Papers 2101.12252, arXiv.org.
    13. Florian Heiss & Stephan Hetzenecker & Maximilian Osterhaus, 2019. "Nonparametric Estimation of the Random Coefficients Model: An Elastic Net Approach," Papers 1909.08434, arXiv.org, revised Sep 2019.
    14. Helveston, John Paul & Liu, Yimin & Feit, Elea McDonnell & Fuchs, Erica & Klampfl, Erica & Michalek, Jeremy J., 2015. "Will subsidies drive electric vehicle adoption? Measuring consumer preferences in the U.S. and China," Transportation Research Part A: Policy and Practice, Elsevier, vol. 73(C), pages 96-112.
    15. Pereira, Pedro & Ribeiro, Tiago, 2011. "The impact on broadband access to the Internet of the dual ownership of telephone and cable networks," International Journal of Industrial Organization, Elsevier, vol. 29(2), pages 283-293, March.
    16. Rachel Griffith & Lars Nesheim & Martin O'Connell, 2018. "Income effects and the welfare consequences of tax in differentiated product oligopoly," Quantitative Economics, Econometric Society, vol. 9(1), pages 305-341, March.
    17. Yuyang Tan & Hao Gong & Chunxiang Guo, 2025. "Bi-Objective Optimization of Product Selection and Ranking Considering Sequential Search," SAGE Open, , vol. 15(3), pages 21582440251, August.
    18. Caroline Dieckhoener & Harald Hecking, 2012. "Greenhouse Gas Abatement Cost Curves of the Residential Heating Market – a Microeconomic Approach," EWI Working Papers 2012-16, Energiewirtschaftliches Institut an der Universitaet zu Koeln (EWI).
    19. Odran Bonnet & Alfred Galichon & Yu-Wei Hsieh & Keith O’Hara & Matt Shum, 2022. "Yogurts Choose Consumers? Estimation of Random-Utility Models via Two-Sided Matching," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(6), pages 3085-3114.
    20. Bonnet, Céline & Richards, Timothy J., 2016. "Models of Consumer Demand for Differentiated Products," TSE Working Papers 16-741, Toulouse School of Economics (TSE).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:66:y:2020:i:8:p:3635-3656. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.