IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1912.10058.html
   My bibliography  Save this paper

ResLogit: A residual neural network logit model for data-driven choice modelling

Author

Listed:
  • Melvin Wong
  • Bilal Farooq

Abstract

This paper presents a novel deep learning-based travel behaviour choice model.Our proposed Residual Logit (ResLogit) model formulation seamlessly integrates a Deep Neural Network (DNN) architecture into a multinomial logit model. Recently, DNN models such as the Multi-layer Perceptron (MLP) and the Recurrent Neural Network (RNN) have shown remarkable success in modelling complex and noisy behavioural data. However, econometric studies have argued that machine learning techniques are a `black-box' and difficult to interpret for use in the choice analysis.We develop a data-driven choice model that extends the systematic utility function to incorporate non-linear cross-effects using a series of residual layers and using skipped connections to handle model identifiability in estimating a large number of parameters.The model structure accounts for cross-effects and choice heterogeneity arising from substitution, interactions with non-chosen alternatives and other effects in a non-linear manner.We describe the formulation, model estimation, interpretability and examine the relative performance and econometric implications of our proposed model.We present an illustrative example of the model on a classic red/blue bus choice scenario example. For a real-world application, we use a travel mode choice dataset to analyze the model characteristics compared to traditional neural networks and Logit formulations.Our findings show that our ResLogit approach significantly outperforms MLP models while providing similar interpretability as a Multinomial Logit model.

Suggested Citation

  • Melvin Wong & Bilal Farooq, 2019. "ResLogit: A residual neural network logit model for data-driven choice modelling," Papers 1912.10058, arXiv.org, revised Feb 2021.
  • Handle: RePEc:arx:papers:1912.10058
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1912.10058
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jordan Louviere & Kenneth Train & Moshe Ben-Akiva & Chandra Bhat & David Brownstone & Trudy Cameron & Richard Carson & J. Deshazo & Denzil Fiebig & William Greene & David Hensher & Donald Waldman, 2005. "Recent Progress on Endogeneity in Choice Modeling," Marketing Letters, Springer, vol. 16(3), pages 255-265, December.
    2. Wong, Melvin & Farooq, Bilal & Bilodeau, Guillaume-Alexandre, 2018. "Discriminative conditional restricted Boltzmann machine for discrete choice and latent variable modelling," Journal of choice modelling, Elsevier, vol. 29(C), pages 152-168.
    3. Mikkel Thorhauge & Elisabetta Cherchi & Joan L. Walker & Jeppe Rich, 2019. "The role of intention as mediator between latent effects and behavior: application of a hybrid choice model to study departure time choices," Transportation, Springer, vol. 46(4), pages 1421-1445, August.
    4. Shenhao Wang & Qingyi Wang & Jinhua Zhao, 2019. "Multitask Learning Deep Neural Networks to Combine Revealed and Stated Preference Data," Papers 1901.00227, arXiv.org, revised Aug 2019.
    5. Lothlorien Redmond & Patricia Mokhtarian, 2001. "The positive utility of the commute: modeling ideal commute time and relative desired commute amount," Transportation, Springer, vol. 28(2), pages 179-205, May.
    6. Filip Matêjka & Alisdair McKay, 2015. "Rational Inattention to Discrete Choices: A New Foundation for the Multinomial Logit Model," American Economic Review, American Economic Association, vol. 105(1), pages 272-298, January.
    7. Alwosheel, Ahmad & van Cranenburgh, Sander & Chorus, Caspar G., 2018. "Is your dataset big enough? Sample size requirements when using artificial neural networks for discrete choice analysis," Journal of choice modelling, Elsevier, vol. 28(C), pages 167-182.
    8. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    9. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    10. Moshe Ben-Akiva & André Palma & Daniel McFadden & Maya Abou-Zeid & Pierre-André Chiappori & Matthieu Lapparent & Steven Durlauf & Mogens Fosgerau & Daisuke Fukuda & Stephane Hess & Charles Manski & Ar, 2012. "Process and context in choice models," Marketing Letters, Springer, vol. 23(2), pages 439-456, June.
    11. Hensher, David A. & Ton, Tu T., 2000. "A comparison of the predictive potential of artificial neural networks and nested logit models for commuter mode choice," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 36(3), pages 155-172, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Qingyi Wang & Shenhao Wang & Yunhan Zheng & Hongzhou Lin & Xiaohu Zhang & Jinhua Zhao & Joan Walker, 2023. "Deep hybrid model with satellite imagery: how to combine demand modeling and computer vision for behavior analysis?," Papers 2303.04204, arXiv.org, revised Feb 2024.
    2. Georges Sfeir & Filipe Rodrigues & Maya Abou-Zeid, 2021. "Gaussian Process Latent Class Choice Models," Papers 2101.12252, arXiv.org.
    3. Kim, Eui-Jin & Bansal, Prateek, 2024. "A new flexible and partially monotonic discrete choice model," Transportation Research Part B: Methodological, Elsevier, vol. 183(C).
    4. Sifringer, Brian & Lurkin, Virginie & Alahi, Alexandre, 2020. "Enhancing discrete choice models with representation learning," Transportation Research Part B: Methodological, Elsevier, vol. 140(C), pages 236-261.
    5. Ibrahim A. Nafisah & Irsa Sajjad & Mohammed A. Alshahrani & Osama Abdulaziz Alamri & Mohammed M. A. Almazah & Javid Gani Dar, 2024. "Statistical Predictive Hybrid Choice Modeling: Exploring Embedded Neural Architecture," Mathematics, MDPI, vol. 12(19), pages 1-20, October.
    6. Wang, Qingyi & Wang, Shenhao & Zheng, Yunhan & Lin, Hongzhou & Zhang, Xiaohu & Zhao, Jinhua & Walker, Joan, 2024. "Deep hybrid model with satellite imagery: How to combine demand modeling and computer vision for travel behavior analysis?," Transportation Research Part B: Methodological, Elsevier, vol. 179(C).
    7. Zhongze Cai & Hanzhao Wang & Kalyan Talluri & Xiaocheng Li, 2022. "Deep Learning for Choice Modeling," Papers 2208.09325, arXiv.org.
    8. Dubey, Subodh & Cats, Oded & Hoogendoorn, Serge & Bansal, Prateek, 2022. "A multinomial probit model with Choquet integral and attribute cut-offs," Transportation Research Part B: Methodological, Elsevier, vol. 158(C), pages 140-163.
    9. Smeele, Nicholas V.R. & Chorus, Caspar G. & Schermer, Maartje H.N. & de Bekker-Grob, Esther W., 2023. "Towards machine learning for moral choice analysis in health economics: A literature review and research agenda," Social Science & Medicine, Elsevier, vol. 326(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Melvin Wong & Bilal Farooq, 2019. "Information processing constraints in travel behaviour modelling: A generative learning approach," Papers 1907.07036, arXiv.org, revised Jul 2019.
    2. Mogens Fosgerau & Emerson Melo & André de Palma & Matthew Shum, 2020. "Discrete Choice And Rational Inattention: A General Equivalence Result," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(4), pages 1569-1589, November.
    3. Han, Yafei & Pereira, Francisco Camara & Ben-Akiva, Moshe & Zegras, Christopher, 2022. "A neural-embedded discrete choice model: Learning taste representation with strengthened interpretability," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 166-186.
    4. Smeele, Nicholas V.R. & Chorus, Caspar G. & Schermer, Maartje H.N. & de Bekker-Grob, Esther W., 2023. "Towards machine learning for moral choice analysis in health economics: A literature review and research agenda," Social Science & Medicine, Elsevier, vol. 326(C).
    5. Paleti, Rajesh, 2018. "Generalized multinomial probit Model: Accommodating constrained random parameters," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 248-262.
    6. Sushant Acharya & Shu Lin Wee, 2020. "Rational Inattention in Hiring Decisions," American Economic Journal: Macroeconomics, American Economic Association, vol. 12(1), pages 1-40, January.
    7. Philippe Jehiel & Jakub Steiner, 2020. "Selective Sampling with Information-Storage Constraints [On interim rationality, belief formation and learning in decision problems with bounded memory]," The Economic Journal, Royal Economic Society, vol. 130(630), pages 1753-1781.
    8. Luminita Stevens, 2020. "Coarse Pricing Policies," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(1), pages 420-453.
    9. Atahan Afsar; José Elías Gallegos; Richard Jaimes; Edgar Silgado Gómez & José Elías Gallegos & Richard Jaimes & Edgar Silgado Gómez, 2020. "Reconciling Empirics and Theory: The Behavioral Hybrid New Keynesian Model," Vniversitas Económica, Universidad Javeriana - Bogotá, vol. 0(0), pages 1-41, December.
    10. Larionov, Daniil & Pham, Hien & Yamashita, Takuro & Zhu, Shuguang, 2021. "First Best Implementation with Costly Information Acquisition," TSE Working Papers 21-1261, Toulouse School of Economics (TSE), revised Apr 2022.
    11. Lindbeck, Assar & Weibull, Jörgen, 2020. "Delegation of investment decisions, and optimal remuneration of agents," European Economic Review, Elsevier, vol. 129(C).
    12. Brocas, Isabelle & Carrillo, Juan D., 2021. "Value computation and modulation: A neuroeconomic theory of self-control as constrained optimization," Journal of Economic Theory, Elsevier, vol. 198(C).
    13. Scharfenaker, Ellis, 2020. "Implications of quantal response statistical equilibrium," Journal of Economic Dynamics and Control, Elsevier, vol. 119(C).
    14. Alex Nikolsko‐Rzhevskyy & Oleksandr Talavera & Nam Vu, 2023. "The flood that caused a drought," Economic Inquiry, Western Economic Association International, vol. 61(4), pages 965-981, October.
    15. Sosung Baik & Sung-Ha Hwang, 2021. "Auction design with ambiguity: Optimality of the first-price and all-pay auctions," Papers 2110.08563, arXiv.org.
    16. Bartosz Maćkowiak & Filip Matějka & Mirko Wiederholt, 2023. "Rational Inattention: A Review," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 226-273, March.
    17. Kondor, Péter & Zawadowski, Adam, 2019. "Learning in crowded markets," Journal of Economic Theory, Elsevier, vol. 184(C).
    18. Jianjun Miao, 2019. "Multivariate LQG Control under Rational Inattention in Continuous Time," Boston University - Department of Economics - Working Papers Series WP2019-06, Boston University - Department of Economics.
    19. Tommaso Denti & Doron Ravid, 2023. "Robust Predictions in Games with Rational Inattention," Papers 2306.09964, arXiv.org.
    20. Emerson Melo, 2022. "On the Distributional Robustness of Finite Rational Inattention Models," Papers 2208.03370, arXiv.org, revised May 2023.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1912.10058. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.