IDEAS home Printed from https://ideas.repec.org/a/eee/transb/v158y2022icp1-17.html
   My bibliography  Save this article

Scaling Bayesian inference of mixed multinomial logit models to large datasets

Author

Listed:
  • Rodrigues, Filipe

Abstract

Variational inference methods have been shown to lead to significant improvements in the computational efficiency of approximate Bayesian inference in mixed multinomial logit models when compared to standard Markov-chain Monte Carlo (MCMC) methods without increasing estimation bias. However, despite their demonstrated efficiency gains, existing methods still suffer from important limitations that prevent them to scale to large datasets, while providing the flexibility to allow for rich prior distributions and to capture complex posterior distributions. To effectively scale Bayesian inference in Mixed Multinomial Logit models to large datasets, we propose an Amortized Variational Inference approach that leverages stochastic backpropagation, automatic differentiation and GPU-accelerated computation. Moreover, we show how normalizing flows can be used to increase the flexibility of the variational posterior approximations. Through an extensive simulation study and real data for transport mode choice from London, we empirically show that the proposed approach is able to achieve computational speedups of multiple orders of magnitude over traditional maximum simulated likelihood estimation (MSLE) and MCMC approaches for large datasets without compromising estimation accuracy.

Suggested Citation

  • Rodrigues, Filipe, 2022. "Scaling Bayesian inference of mixed multinomial logit models to large datasets," Transportation Research Part B: Methodological, Elsevier, vol. 158(C), pages 1-17.
  • Handle: RePEc:eee:transb:v:158:y:2022:i:c:p:1-17
    DOI: 10.1016/j.trb.2022.01.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S019126152200011X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.trb.2022.01.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David M. Blei & Alp Kucukelbir & Jon D. McAuliffe, 2017. "Variational Inference: A Review for Statisticians," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 859-877, April.
    2. Lewandowski, Daniel & Kurowicka, Dorota & Joe, Harry, 2009. "Generating random correlation matrices based on vines and extended onion method," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 1989-2001, October.
    3. Bhat, Chandra R. & Sidharthan, Raghuprasad, 2011. "A simulation evaluation of the maximum approximate composite marginal likelihood (MACML) estimator for mixed multinomial probit models," Transportation Research Part B: Methodological, Elsevier, vol. 45(7), pages 940-953, August.
    4. Patil, Priyadarshan N. & Dubey, Subodh K. & Pinjari, Abdul R. & Cherchi, Elisabetta & Daziano, Ricardo & Bhat, Chandra R., 2017. "Simulation evaluation of emerging estimation techniques for multinomial probit models," Journal of choice modelling, Elsevier, vol. 23(C), pages 9-20.
    5. Akinc, Deniz & Vandebroek, Martina, 2018. "Bayesian estimation of mixed logit models: Selecting an appropriate prior for the covariance matrix," Journal of choice modelling, Elsevier, vol. 29(C), pages 133-151.
    6. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    7. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387.
    8. Bansal, Prateek & Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H., 2020. "Bayesian estimation of mixed multinomial logit models: Advances and simulation-based evaluations," Transportation Research Part B: Methodological, Elsevier, vol. 131(C), pages 124-142.
    9. Braun, Michael & McAuliffe, Jon, 2010. "Variational Inference for Large-Scale Models of Discrete Choice," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 324-335.
    10. Brathwaite, Timothy & Walker, Joan L., 2018. "Asymmetric, closed-form, finite-parameter models of multinomial choice," Journal of choice modelling, Elsevier, vol. 29(C), pages 78-112.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bansal, Prateek & Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H., 2020. "Bayesian estimation of mixed multinomial logit models: Advances and simulation-based evaluations," Transportation Research Part B: Methodological, Elsevier, vol. 131(C), pages 124-142.
    2. Prateek Bansal & Rico Krueger & Michel Bierlaire & Ricardo A. Daziano & Taha H. Rashidi, 2019. "Bayesian Estimation of Mixed Multinomial Logit Models: Advances and Simulation-Based Evaluations," Papers 1904.03647, arXiv.org, revised Dec 2019.
    3. Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H. & Bansal, Prateek, 2021. "Evaluating the predictive abilities of mixed logit models with unobserved inter- and intra-individual heterogeneity," Journal of choice modelling, Elsevier, vol. 41(C).
    4. Daziano, Ricardo A., 2022. "Willingness to delay charging of electric vehicles," Research in Transportation Economics, Elsevier, vol. 94(C).
    5. Krueger, Rico & Rashidi, Taha H. & Vij, Akshay, 2020. "A Dirichlet process mixture model of discrete choice: Comparisons and a case study on preferences for shared automated vehicles," Journal of choice modelling, Elsevier, vol. 36(C).
    6. Rico Krueger & Taha H. Rashidi & Akshay Vij, 2019. "Semi-Parametric Hierarchical Bayes Estimates of New Yorkers' Willingness to Pay for Features of Shared Automated Vehicle Services," Papers 1907.09639, arXiv.org.
    7. Rico Krueger & Prateek Bansal & Michel Bierlaire & Ricardo A. Daziano & Taha H. Rashidi, 2019. "Variational Bayesian Inference for Mixed Logit Models with Unobserved Inter- and Intra-Individual Heterogeneity," Papers 1905.00419, arXiv.org, revised Jan 2020.
    8. Tinessa, Fiore & Marzano, Vittorio & Papola, Andrea, 2020. "Mixing distributions of tastes with a Combination of Nested Logit (CoNL) kernel: Formulation and performance analysis," Transportation Research Part B: Methodological, Elsevier, vol. 141(C), pages 1-23.
    9. Rico Krueger & Akshay Vij & Taha H. Rashidi, 2018. "A Dirichlet Process Mixture Model of Discrete Choice," Papers 1801.06296, arXiv.org.
    10. Tinessa, Fiore, 2021. "Closed-form random utility models with mixture distributions of random utilities: Exploring finite mixtures of qGEV models," Transportation Research Part B: Methodological, Elsevier, vol. 146(C), pages 262-288.
    11. Batram, Manuel & Bauer, Dietmar, 2019. "On consistency of the MACML approach to discrete choice modelling," Journal of choice modelling, Elsevier, vol. 30(C), pages 1-16.
    12. Kassie, Girma T. & Zeleke, Fresenbet & Birhanu, Mulugeta Y. & Scarpa, Riccardo, 2020. "Reminder Nudge, Attribute Nonattendance, and Willingness to Pay in a Discrete Choice Experiment," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304208, Agricultural and Applied Economics Association.
    13. Paleti, Rajesh, 2018. "Generalized multinomial probit Model: Accommodating constrained random parameters," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 248-262.
    14. Loaiza-Maya, Rubén & Smith, Michael Stanley & Nott, David J. & Danaher, Peter J., 2022. "Fast and accurate variational inference for models with many latent variables," Journal of Econometrics, Elsevier, vol. 230(2), pages 339-362.
    15. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    16. Bansal, Prateek & Krueger, Rico & Graham, Daniel J., 2021. "Fast Bayesian estimation of spatial count data models," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    17. Robert Donnelly & Francisco J.R. Ruiz & David Blei & Susan Athey, 2021. "Counterfactual inference for consumer choice across many product categories," Quantitative Marketing and Economics (QME), Springer, vol. 19(3), pages 369-407, December.
    18. Bruno Jacobs & Dennis Fok & Bas Donkers, 2021. "Understanding Large-Scale Dynamic Purchase Behavior," Marketing Science, INFORMS, vol. 40(5), pages 844-870, September.
    19. Moon, Sungho & Kim, Youngwoo & Kim, Minsang & Lee, Jongsu, 2023. "Policy designs to increase public and local acceptance for energy transition in South Korea," Energy Policy, Elsevier, vol. 182(C).
    20. Becker, Felix & Danaf, Mazen & Song, Xiang & Atasoy, Bilge & Ben-Akiva, Moshe, 2018. "Bayesian estimator for Logit Mixtures with inter- and intra-consumer heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 117(PA), pages 1-17.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transb:v:158:y:2022:i:c:p:1-17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/548/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.