IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2019-19.html
   My bibliography  Save this paper

A High-dimensional Multinomial Choice Model

Author

Listed:
  • Didier Nibbering

Abstract

The number of parameters in a standard multinomial choice model increases linearly with the number of choice alternatives and number of explanatory variables. Since many modern applications involve large choice sets with categorical explanatory variables, which enter the model as large sets of binary dummies, the number of parameters easily approaches the sample size. This paper proposes a new method for data-driven parameter clustering over outcome categories and explanatory dummy categories in a multinomial probit setting. A Dirichlet process mixture encourages parameters to cluster over the categories, which favours a parsimonious model specification without a priori imposing model restrictions. An application to a dataset of holiday destinations shows a decrease in parameter uncertainty, an enhancement of the parameter interpretability, and an increase in predictive performance, relative to a standard multinomial choice model.

Suggested Citation

  • Didier Nibbering, 2019. "A High-dimensional Multinomial Choice Model," Monash Econometrics and Business Statistics Working Papers 19/19, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2019-19
    as

    Download full text from publisher

    File URL: https://www.monash.edu/business/ebs/research/publications/ebs/wp19-2019.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Luc Bauwens & Jean-François Carpantier & Arnaud Dufays, 2017. "Autoregressive Moving Average Infinite Hidden Markov-Switching Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 162-182, April.
    2. McCulloch, Robert E. & Polson, Nicholas G. & Rossi, Peter E., 2000. "A Bayesian analysis of the multinomial probit model with fully identified parameters," Journal of Econometrics, Elsevier, vol. 99(1), pages 173-193, November.
    3. Manuel Wiesenfarth & Carlos Matías Hisgen & Thomas Kneib & Carmen Cadarso-Suarez, 2014. "Bayesian Nonparametric Instrumental Variables Regression Based on Penalized Splines and Dirichlet Process Mixtures," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(3), pages 468-482, July.
    4. Imai, Kosuke & van Dyk, David A., 2005. "A Bayesian analysis of the multinomial probit model using marginal data augmentation," Journal of Econometrics, Elsevier, vol. 124(2), pages 311-334, February.
    5. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Oxford University Press, vol. 65(3), pages 361-393.
    6. Conley, Timothy G. & Hansen, Christian B. & McCulloch, Robert E. & Rossi, Peter E., 2008. "A semi-parametric Bayesian approach to the instrumental variable problem," Journal of Econometrics, Elsevier, vol. 144(1), pages 276-305, May.
    7. Chib, Siddhartha & Hamilton, Barton H., 2002. "Semiparametric Bayes analysis of longitudinal data treatment models," Journal of Econometrics, Elsevier, vol. 110(1), pages 67-89, September.
    8. Bunch, David S., 1991. "Estimability in the Multinomial Probit Model," University of California Transportation Center, Working Papers qt1gf1t128, University of California Transportation Center.
    9. Nobuhiko Terui & Masataka Ban & Greg M. Allenby, 2011. "The Effect of Media Advertising on Brand Consideration and Choice," Marketing Science, INFORMS, vol. 30(1), pages 74-91, 01-02.
    10. Burda, Martin & Harding, Matthew & Hausman, Jerry, 2008. "A Bayesian mixed logit-probit model for multinomial choice," Journal of Econometrics, Elsevier, vol. 147(2), pages 232-246, December.
    11. Bruno J.D. Jacobs & Bas Donkers & Dennis Fok, 2016. "Model-Based Purchase Predictions for Large Assortments," Marketing Science, INFORMS, vol. 35(3), pages 389-404, May.
    12. Timothy J. Gilbride & Greg M. Allenby, 2004. "A Choice Model with Conjunctive, Disjunctive, and Compensatory Screening Rules," Marketing Science, INFORMS, vol. 23(3), pages 391-406, October.
    13. Xuequn Hu & Murat K. Munkin & Pravin K. Trivedi, 2015. "Estimating Incentive and Selection Effects in the Medigap Insurance Market: An Application with Dirichlet Process Mixture Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(7), pages 1115-1143, November.
    14. Keane, Michael P, 1992. "A Note on Identification in the Multinomial Probit Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(2), pages 193-200, April.
    15. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    16. McCulloch, Robert & Rossi, Peter E., 1994. "An exact likelihood analysis of the multinomial probit model," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 207-240.
    17. Howard D. Bondell & Brian J. Reich, 2009. "Simultaneous Factor Selection and Collapsing Levels in ANOVA," Biometrics, The International Biometric Society, vol. 65(1), pages 169-177, March.
    18. Lane F. Burgette & Erik V. Nordheim, 2012. "The Trace Restriction: An Alternative Identification Strategy for the Bayesian Multinomial Probit Model," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 404-410, February.
    19. van Hasselt, Martijn, 2011. "Bayesian inference in a sample selection model," Journal of Econometrics, Elsevier, vol. 165(2), pages 221-232.
    20. Bunch, David S., 1991. "Estimability in the multinomial probit model," Transportation Research Part B: Methodological, Elsevier, vol. 25(1), pages 1-12, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nibbering, Didier & Hastie, Trevor J., 2022. "Multiclass-penalized logistic regression," Computational Statistics & Data Analysis, Elsevier, vol. 169(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rub'en Loaiza-Maya & Didier Nibbering, 2022. "Fast variational Bayes methods for multinomial probit models," Papers 2202.12495, arXiv.org, revised Oct 2022.
    2. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    3. Ruben Loaiza-Maya & Didier Nibbering, 2020. "Scalable Bayesian estimation in the multinomial probit model," Papers 2007.13247, arXiv.org, revised Mar 2021.
    4. Gael M. Martin & David T. Frazier & Worapree Maneesoonthorn & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2022. "Bayesian Forecasting in Economics and Finance: A Modern Review," Papers 2212.03471, arXiv.org, revised Jul 2023.
    5. Didier Nibbering, 2023. "A High-dimensional Multinomial Logit Model," Monash Econometrics and Business Statistics Working Papers 19/23, Monash University, Department of Econometrics and Business Statistics.
    6. Piatek, Rémi & Gensowski, Miriam, 2017. "A Multinomial Probit Model with Latent Factors: Identification and Interpretation without a Measurement System," IZA Discussion Papers 11042, Institute of Labor Economics (IZA).
    7. Zhang, Rong & Inder, Brett A. & Zhang, Xibin, 2015. "Bayesian estimation of a discrete response model with double rules of sample selection," Computational Statistics & Data Analysis, Elsevier, vol. 86(C), pages 81-96.
    8. Daziano, Ricardo A., 2015. "Inference on mode preferences, vehicle purchases, and the energy paradox using a Bayesian structural choice model," Transportation Research Part B: Methodological, Elsevier, vol. 76(C), pages 1-26.
    9. Ricardo A. Daziano & Martin Achtnicht, 2014. "Forecasting Adoption of Ultra-Low-Emission Vehicles Using Bayes Estimates of a Multinomial Probit Model and the GHK Simulator," Transportation Science, INFORMS, vol. 48(4), pages 671-683, November.
    10. Cohen, Michael, 2010. "A Structured Covariance Probit Demand Model," Research Reports 149970, University of Connecticut, Food Marketing Policy Center.
    11. Dogan, Osman & Taspinar, Suleyman, 2016. "Bayesian Inference in Spatial Sample Selection Models," MPRA Paper 82829, University Library of Munich, Germany.
    12. Rinus Haaijer & Michel Wedel & Marco Vriens & Tom Wansbeek, 1998. "Utility Covariances and Context Effects in Conjoint MNP Models," Marketing Science, INFORMS, vol. 17(3), pages 236-252.
    13. Daziano, Ricardo A. & Achtnicht, Martin, 2012. "Forecasting adoption of ultra-low-emission vehicles using the GHK simulator and Bayes estimates of a multinomial probit model," ZEW Discussion Papers 12-017, ZEW - Leibniz Centre for European Economic Research.
    14. Peter Lenk, 2014. "Bayesian estimation of random utility models," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 20, pages 457-497, Edward Elgar Publishing.
    15. Duncan Fong & Sunghoon Kim & Zhe Chen & Wayne DeSarbo, 2016. "A Bayesian Multinomial Probit MODEL FOR THE ANALYSIS OF PANEL CHOICE DATA," Psychometrika, Springer;The Psychometric Society, vol. 81(1), pages 161-183, March.
    16. Rong Zhang & Brett A. Inder & Xibin Zhang, 2013. "Bayesian estimation of a discrete response model with double rules of sample selection," Monash Econometrics and Business Statistics Working Papers 24/13, Monash University, Department of Econometrics and Business Statistics.
    17. Munkin, Murat K. & Trivedi, Pravin K., 2008. "Bayesian analysis of the ordered probit model with endogenous selection," Journal of Econometrics, Elsevier, vol. 143(2), pages 334-348, April.
    18. McCulloch, Robert E. & Polson, Nicholas G. & Rossi, Peter E., 2000. "A Bayesian analysis of the multinomial probit model with fully identified parameters," Journal of Econometrics, Elsevier, vol. 99(1), pages 173-193, November.
    19. Jensen, Mark J. & Maheu, John M., 2010. "Bayesian semiparametric stochastic volatility modeling," Journal of Econometrics, Elsevier, vol. 157(2), pages 306-316, August.
    20. Robert Zeithammer & Peter Lenk, 2006. "Bayesian estimation of multivariate-normal models when dimensions are absent," Quantitative Marketing and Economics (QME), Springer, vol. 4(3), pages 241-265, September.

    More about this item

    Keywords

    large choice sets; Dirichlet process prior; multinomial probit model; high-dimensional models;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2019-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.