IDEAS home Printed from https://ideas.repec.org/a/eee/transb/v158y2022icp1-17.html
   My bibliography  Save this article

Scaling Bayesian inference of mixed multinomial logit models to large datasets

Author

Listed:
  • Rodrigues, Filipe

Abstract

Variational inference methods have been shown to lead to significant improvements in the computational efficiency of approximate Bayesian inference in mixed multinomial logit models when compared to standard Markov-chain Monte Carlo (MCMC) methods without increasing estimation bias. However, despite their demonstrated efficiency gains, existing methods still suffer from important limitations that prevent them to scale to large datasets, while providing the flexibility to allow for rich prior distributions and to capture complex posterior distributions. To effectively scale Bayesian inference in Mixed Multinomial Logit models to large datasets, we propose an Amortized Variational Inference approach that leverages stochastic backpropagation, automatic differentiation and GPU-accelerated computation. Moreover, we show how normalizing flows can be used to increase the flexibility of the variational posterior approximations. Through an extensive simulation study and real data for transport mode choice from London, we empirically show that the proposed approach is able to achieve computational speedups of multiple orders of magnitude over traditional maximum simulated likelihood estimation (MSLE) and MCMC approaches for large datasets without compromising estimation accuracy.

Suggested Citation

  • Rodrigues, Filipe, 2022. "Scaling Bayesian inference of mixed multinomial logit models to large datasets," Transportation Research Part B: Methodological, Elsevier, vol. 158(C), pages 1-17.
  • Handle: RePEc:eee:transb:v:158:y:2022:i:c:p:1-17
    DOI: 10.1016/j.trb.2022.01.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S019126152200011X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.trb.2022.01.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Akinc, Deniz & Vandebroek, Martina, 2018. "Bayesian estimation of mixed logit models: Selecting an appropriate prior for the covariance matrix," Journal of choice modelling, Elsevier, vol. 29(C), pages 133-151.
    2. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    3. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, January.
    4. Bansal, Prateek & Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H., 2020. "Bayesian estimation of mixed multinomial logit models: Advances and simulation-based evaluations," Transportation Research Part B: Methodological, Elsevier, vol. 131(C), pages 124-142.
    5. Brathwaite, Timothy & Walker, Joan L., 2018. "Asymmetric, closed-form, finite-parameter models of multinomial choice," Journal of choice modelling, Elsevier, vol. 29(C), pages 78-112.
    6. David M. Blei & Alp Kucukelbir & Jon D. McAuliffe, 2017. "Variational Inference: A Review for Statisticians," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 859-877, April.
    7. Lewandowski, Daniel & Kurowicka, Dorota & Joe, Harry, 2009. "Generating random correlation matrices based on vines and extended onion method," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 1989-2001, October.
    8. Bhat, Chandra R. & Sidharthan, Raghuprasad, 2011. "A simulation evaluation of the maximum approximate composite marginal likelihood (MACML) estimator for mixed multinomial probit models," Transportation Research Part B: Methodological, Elsevier, vol. 45(7), pages 940-953, August.
    9. Patil, Priyadarshan N. & Dubey, Subodh K. & Pinjari, Abdul R. & Cherchi, Elisabetta & Daziano, Ricardo & Bhat, Chandra R., 2017. "Simulation evaluation of emerging estimation techniques for multinomial probit models," Journal of choice modelling, Elsevier, vol. 23(C), pages 9-20.
    10. Braun, Michael & McAuliffe, Jon, 2010. "Variational Inference for Large-Scale Models of Discrete Choice," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 324-335.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bansal, Prateek & Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H., 2020. "Bayesian estimation of mixed multinomial logit models: Advances and simulation-based evaluations," Transportation Research Part B: Methodological, Elsevier, vol. 131(C), pages 124-142.
    2. Prateek Bansal & Rico Krueger & Michel Bierlaire & Ricardo A. Daziano & Taha H. Rashidi, 2019. "Bayesian Estimation of Mixed Multinomial Logit Models: Advances and Simulation-Based Evaluations," Papers 1904.03647, arXiv.org, revised Dec 2019.
    3. Daziano, Ricardo A., 2022. "Willingness to delay charging of electric vehicles," Research in Transportation Economics, Elsevier, vol. 94(C).
    4. Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H. & Bansal, Prateek, 2021. "Evaluating the predictive abilities of mixed logit models with unobserved inter- and intra-individual heterogeneity," Journal of choice modelling, Elsevier, vol. 41(C).
    5. Krueger, Rico & Rashidi, Taha H. & Vij, Akshay, 2020. "A Dirichlet process mixture model of discrete choice: Comparisons and a case study on preferences for shared automated vehicles," Journal of choice modelling, Elsevier, vol. 36(C).
    6. Rico Krueger & Taha H. Rashidi & Akshay Vij, 2019. "Semi-Parametric Hierarchical Bayes Estimates of New Yorkers' Willingness to Pay for Features of Shared Automated Vehicle Services," Papers 1907.09639, arXiv.org.
    7. Rico Krueger & Prateek Bansal & Michel Bierlaire & Ricardo A. Daziano & Taha H. Rashidi, 2019. "Variational Bayesian Inference for Mixed Logit Models with Unobserved Inter- and Intra-Individual Heterogeneity," Papers 1905.00419, arXiv.org, revised Jan 2020.
    8. Tinessa, Fiore & Marzano, Vittorio & Papola, Andrea, 2020. "Mixing distributions of tastes with a Combination of Nested Logit (CoNL) kernel: Formulation and performance analysis," Transportation Research Part B: Methodological, Elsevier, vol. 141(C), pages 1-23.
    9. Rico Krueger & Akshay Vij & Taha H. Rashidi, 2018. "A Dirichlet Process Mixture Model of Discrete Choice," Papers 1801.06296, arXiv.org.
    10. Tinessa, Fiore, 2021. "Closed-form random utility models with mixture distributions of random utilities: Exploring finite mixtures of qGEV models," Transportation Research Part B: Methodological, Elsevier, vol. 146(C), pages 262-288.
    11. Batram, Manuel & Bauer, Dietmar, 2019. "On consistency of the MACML approach to discrete choice modelling," Journal of choice modelling, Elsevier, vol. 30(C), pages 1-16.
    12. Kassie, Girma T. & Zeleke, Fresenbet & Birhanu, Mulugeta Y. & Scarpa, Riccardo, 2020. "Reminder Nudge, Attribute Nonattendance, and Willingness to Pay in a Discrete Choice Experiment," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304208, Agricultural and Applied Economics Association.
    13. Paleti, Rajesh, 2018. "Generalized multinomial probit Model: Accommodating constrained random parameters," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 248-262.
    14. Bansal, Prateek & Krueger, Rico & Graham, Daniel J., 2021. "Fast Bayesian estimation of spatial count data models," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    15. Robert Donnelly & Francisco J.R. Ruiz & David Blei & Susan Athey, 2021. "Counterfactual inference for consumer choice across many product categories," Quantitative Marketing and Economics (QME), Springer, vol. 19(3), pages 369-407, December.
    16. Czajkowski, Mikołaj & Budziński, Wiktor, 2019. "Simulation error in maximum likelihood estimation of discrete choice models," Journal of choice modelling, Elsevier, vol. 31(C), pages 73-85.
    17. Prateek Bansal & Rico Krueger & Michel Bierlaire & Ricardo A. Daziano & Taha H. Rashidi, 2019. "P\'olygamma Data Augmentation to address Non-conjugacy in the Bayesian Estimation of Mixed Multinomial Logit Models," Papers 1904.07688, arXiv.org.
    18. Melvin Wong & Bilal Farooq, 2019. "Information processing constraints in travel behaviour modelling: A generative learning approach," Papers 1907.07036, arXiv.org, revised Jul 2019.
    19. Akshay Vij & Rico Krueger, 2018. "Random taste heterogeneity in discrete choice models: Flexible nonparametric finite mixture distributions," Papers 1802.02299, arXiv.org.
    20. Cherchi, Elisabetta & Guevara, Cristian Angelo, 2012. "A Monte Carlo experiment to analyze the curse of dimensionality in estimating random coefficients models with a full variance–covariance matrix," Transportation Research Part B: Methodological, Elsevier, vol. 46(2), pages 321-332.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transb:v:158:y:2022:i:c:p:1-17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/548/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.