IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2505.18077.html
   My bibliography  Save this paper

Bayesian Deep Learning for Discrete Choice

Author

Listed:
  • Daniel F. Villarraga
  • Ricardo A. Daziano

Abstract

Discrete choice models (DCMs) are used to analyze individual decision-making in contexts such as transportation choices, political elections, and consumer preferences. DCMs play a central role in applied econometrics by enabling inference on key economic variables, such as marginal rates of substitution, rather than focusing solely on predicting choices on new unlabeled data. However, while traditional DCMs offer high interpretability and support for point and interval estimation of economic quantities, these models often underperform in predictive tasks compared to deep learning (DL) models. Despite their predictive advantages, DL models remain largely underutilized in discrete choice due to concerns about their lack of interpretability, unstable parameter estimates, and the absence of established methods for uncertainty quantification. Here, we introduce a deep learning model architecture specifically designed to integrate with approximate Bayesian inference methods, such as Stochastic Gradient Langevin Dynamics (SGLD). Our proposed model collapses to behaviorally informed hypotheses when data is limited, mitigating overfitting and instability in underspecified settings while retaining the flexibility to capture complex nonlinear relationships when sufficient data is available. We demonstrate our approach using SGLD through a Monte Carlo simulation study, evaluating both predictive metrics--such as out-of-sample balanced accuracy--and inferential metrics--such as empirical coverage for marginal rates of substitution interval estimates. Additionally, we present results from two empirical case studies: one using revealed mode choice data in NYC, and the other based on the widely used Swiss train choice stated preference data.

Suggested Citation

  • Daniel F. Villarraga & Ricardo A. Daziano, 2025. "Bayesian Deep Learning for Discrete Choice," Papers 2505.18077, arXiv.org.
  • Handle: RePEc:arx:papers:2505.18077
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2505.18077
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, Enero-Abr.
    2. Villarraga, Daniel F. & Daziano, Ricardo A., 2025. "Hierarchical Nearest Neighbor Gaussian Process models for discrete choice: Mode choice in New York City," Transportation Research Part B: Methodological, Elsevier, vol. 191(C).
    3. Melvin Wong & Bilal Farooq, 2019. "ResLogit: A residual neural network logit model for data-driven choice modelling," Papers 1912.10058, arXiv.org, revised Feb 2021.
    4. Daniel F. Villarraga & Ricardo A. Daziano, 2025. "Designing Graph Convolutional Neural Networks for Discrete Choice with Network Effects," Papers 2503.09786, arXiv.org.
    5. Han, Yafei & Pereira, Francisco Camara & Ben-Akiva, Moshe & Zegras, Christopher, 2022. "A neural-embedded discrete choice model: Learning taste representation with strengthened interpretability," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 166-186.
    6. Sarrias, Mauricio & Daziano, Ricardo A., 2018. "Individual-specific point and interval conditional estimates of latent class logit parameters," Journal of choice modelling, Elsevier, vol. 27(C), pages 50-61.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Eui-Jin & Bansal, Prateek, 2024. "A new flexible and partially monotonic discrete choice model," Transportation Research Part B: Methodological, Elsevier, vol. 183(C).
    2. Scaccia, Luisa & Marcucci, Edoardo & Gatta, Valerio, 2023. "Prediction and confidence intervals of willingness-to-pay for mixed logit models," Transportation Research Part B: Methodological, Elsevier, vol. 167(C), pages 54-78.
    3. Vásquez Lavin, Felipe & Barrientos, Manuel & Castillo, Álvaro & Herrera, Iván & Ponce Oliva, Roberto D., 2020. "Firewood certification programs: Key attributes and policy implications," Energy Policy, Elsevier, vol. 137(C).
    4. Mauricio Sarrias, 2020. "Random Parameters and Spatial Heterogeneity using Rchoice in R," REGION, European Regional Science Association, vol. 7, pages 1-19.
    5. Daniel F. Villarraga & Ricardo A. Daziano, 2025. "Designing Graph Convolutional Neural Networks for Discrete Choice with Network Effects," Papers 2503.09786, arXiv.org.
    6. Lauren Chenarides & Carola Grebitus & Jayson L Lusk & Iryna Printezis, 2022. "A calibrated choice experiment method," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(5), pages 971-1004.
    7. Ali, Azam & Kalatian, Arash & Choudhury, Charisma F., 2023. "Comparing and contrasting choice model and machine learning techniques in the context of vehicle ownership decisions," Transportation Research Part A: Policy and Practice, Elsevier, vol. 173(C).
    8. Kim, Kyungah & Kim, Jinseok & Park, Subin & Lee, Jongsu & Kim, Junghun, 2025. "A machine learning technique embedded reference-dependent choice model for explanatory power improvement: Shifting of reference point as a key factor in vehicle purchase decision-making," Transportation Research Part B: Methodological, Elsevier, vol. 191(C).
    9. Wang, Shenhao & Mo, Baichuan & Zheng, Yunhan & Hess, Stephane & Zhao, Jinhua, 2024. "Comparing hundreds of machine learning and discrete choice models for travel demand modeling: An empirical benchmark," Transportation Research Part B: Methodological, Elsevier, vol. 190(C).
    10. Tham, Pham Ngoc & Thuy, Truong Dang & Nam, Pham Khanh & Papyrakis, Elissaios, 2025. "Policy uncertainty, public perception, and the preferences for rooftop solar power systems: A choice experiment study in Vietnam," Renewable and Sustainable Energy Reviews, Elsevier, vol. 208(C).
    11. Georges Sfeir & Filipe Rodrigues & Maya Abou-Zeid, 2021. "Gaussian Process Latent Class Choice Models," Papers 2101.12252, arXiv.org.
    12. Niousha Bagheri & Milad Ghasri & Michael Barlow, 2025. "RUM-NN: A Neural Network Model Compatible with Random Utility Maximisation for Discrete Choice Setups," Papers 2501.05221, arXiv.org.
    13. Xuli Wen & Xin Chen, 2025. "A New Breakthrough in Travel Behavior Modeling Using Deep Learning: A High-Accuracy Prediction Method Based on a CNN," Sustainability, MDPI, vol. 17(2), pages 1-14, January.
    14. Sarrias, Mauricio, 2020. "Individual-specific posterior distributions from Mixed Logit models: Properties, limitations and diagnostic checks," Journal of choice modelling, Elsevier, vol. 36(C).
    15. Masiero, Mauro & Franceschinis, Cristiano & Mattea, Stefania & Thiene, Mara & Pettenella, Davide & Scarpa, Riccardo, 2018. "Ecosystem services’ values and improved revenue collection for regional protected areas," Ecosystem Services, Elsevier, vol. 34(PA), pages 136-153.
    16. Dubey, Subodh & Cats, Oded & Hoogendoorn, Serge & Bansal, Prateek, 2022. "A multinomial probit model with Choquet integral and attribute cut-offs," Transportation Research Part B: Methodological, Elsevier, vol. 158(C), pages 140-163.
    17. Zhifeng Gao & Ted C. Schroeder, 2009. "Consumer responses to new food quality information: are some consumers more sensitive than others?," Agricultural Economics, International Association of Agricultural Economists, vol. 40(3), pages 339-346, May.
    18. Cheng, Leilei & Yin, Changbin & Chien, Hsiaoping, 2015. "Demand for milk quantity and safety in urban China: evidence from Beijing and Harbin," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 59(2), April.
    19. Wen, Chieh-Hua & Huang, Chia-Jung & Fu, Chiang, 2020. "Incorporating continuous representation of preferences for flight departure times into stated itinerary choice modeling," Transport Policy, Elsevier, vol. 98(C), pages 10-20.
    20. Johannes Buggle & Thierry Mayer & Seyhun Orcan Sakalli & Mathias Thoenig, 2023. "The Refugee’s Dilemma: Evidence from Jewish Migration out of Nazi Germany," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(2), pages 1273-1345.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2505.18077. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.