IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1912.10058.html
   My bibliography  Save this paper

ResLogit: A residual neural network logit model for data-driven choice modelling

Author

Listed:
  • Melvin Wong
  • Bilal Farooq

Abstract

This paper presents a novel deep learning-based travel behaviour choice model.Our proposed Residual Logit (ResLogit) model formulation seamlessly integrates a Deep Neural Network (DNN) architecture into a multinomial logit model. Recently, DNN models such as the Multi-layer Perceptron (MLP) and the Recurrent Neural Network (RNN) have shown remarkable success in modelling complex and noisy behavioural data. However, econometric studies have argued that machine learning techniques are a `black-box' and difficult to interpret for use in the choice analysis.We develop a data-driven choice model that extends the systematic utility function to incorporate non-linear cross-effects using a series of residual layers and using skipped connections to handle model identifiability in estimating a large number of parameters.The model structure accounts for cross-effects and choice heterogeneity arising from substitution, interactions with non-chosen alternatives and other effects in a non-linear manner.We describe the formulation, model estimation, interpretability and examine the relative performance and econometric implications of our proposed model.We present an illustrative example of the model on a classic red/blue bus choice scenario example. For a real-world application, we use a travel mode choice dataset to analyze the model characteristics compared to traditional neural networks and Logit formulations.Our findings show that our ResLogit approach significantly outperforms MLP models while providing similar interpretability as a Multinomial Logit model.

Suggested Citation

  • Melvin Wong & Bilal Farooq, 2019. "ResLogit: A residual neural network logit model for data-driven choice modelling," Papers 1912.10058, arXiv.org, revised Feb 2021.
  • Handle: RePEc:arx:papers:1912.10058
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1912.10058
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jordan Louviere & Kenneth Train & Moshe Ben-Akiva & Chandra Bhat & David Brownstone & Trudy Cameron & Richard Carson & J. Deshazo & Denzil Fiebig & William Greene & David Hensher & Donald Waldman, 2005. "Recent Progress on Endogeneity in Choice Modeling," Marketing Letters, Springer, vol. 16(3), pages 255-265, December.
    2. Wong, Melvin & Farooq, Bilal & Bilodeau, Guillaume-Alexandre, 2018. "Discriminative conditional restricted Boltzmann machine for discrete choice and latent variable modelling," Journal of choice modelling, Elsevier, vol. 29(C), pages 152-168.
    3. Filip Matêjka & Alisdair McKay, 2015. "Rational Inattention to Discrete Choices: A New Foundation for the Multinomial Logit Model," American Economic Review, American Economic Association, vol. 105(1), pages 272-298, January.
    4. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    5. Mikkel Thorhauge & Elisabetta Cherchi & Joan L. Walker & Jeppe Rich, 2019. "The role of intention as mediator between latent effects and behavior: application of a hybrid choice model to study departure time choices," Transportation, Springer, vol. 46(4), pages 1421-1445, August.
    6. Shenhao Wang & Qingyi Wang & Jinhua Zhao, 2019. "Multitask Learning Deep Neural Networks to Combine Revealed and Stated Preference Data," Papers 1901.00227, arXiv.org, revised Aug 2019.
    7. Lothlorien Redmond & Patricia Mokhtarian, 2001. "The positive utility of the commute: modeling ideal commute time and relative desired commute amount," Transportation, Springer, vol. 28(2), pages 179-205, May.
    8. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    9. Moshe Ben-Akiva & André Palma & Daniel McFadden & Maya Abou-Zeid & Pierre-André Chiappori & Matthieu Lapparent & Steven Durlauf & Mogens Fosgerau & Daisuke Fukuda & Stephane Hess & Charles Manski & Ar, 2012. "Process and context in choice models," Marketing Letters, Springer, vol. 23(2), pages 439-456, June.
    10. Alwosheel, Ahmad & van Cranenburgh, Sander & Chorus, Caspar G., 2018. "Is your dataset big enough? Sample size requirements when using artificial neural networks for discrete choice analysis," Journal of choice modelling, Elsevier, vol. 28(C), pages 167-182.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sifringer, Brian & Lurkin, Virginie & Alahi, Alexandre, 2020. "Enhancing discrete choice models with representation learning," Transportation Research Part B: Methodological, Elsevier, vol. 140(C), pages 236-261.
    2. Georges Sfeir & Filipe Rodrigues & Maya Abou-Zeid, 2021. "Gaussian Process Latent Class Choice Models," Papers 2101.12252, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Melvin Wong & Bilal Farooq, 2019. "Information processing constraints in travel behaviour modelling: A generative learning approach," Papers 1907.07036, arXiv.org, revised Jul 2019.
    2. Mogens Fosgerau & Emerson Melo & André de Palma & Matthew Shum, 2020. "Discrete Choice And Rational Inattention: A General Equivalence Result," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(4), pages 1569-1589, November.
    3. Paleti, Rajesh, 2018. "Generalized multinomial probit Model: Accommodating constrained random parameters," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 248-262.
    4. Philippe Jehiel & Jakub Steiner, 2020. "Selective Sampling with Information-Storage Constraints [On interim rationality, belief formation and learning in decision problems with bounded memory]," Economic Journal, Royal Economic Society, vol. 130(630), pages 1753-1781.
    5. Kwiek, Maksymilian, 2020. "Communication via intermediaries," Games and Economic Behavior, Elsevier, vol. 121(C), pages 190-203.
    6. Lindbeck, Assar & Weibull, Jörgen, 2020. "Delegation of investment decisions, and optimal remuneration of agents," European Economic Review, Elsevier, vol. 129(C).
    7. Scharfenaker, Ellis, 2020. "Implications of quantal response statistical equilibrium," Journal of Economic Dynamics and Control, Elsevier, vol. 119(C).
    8. Nimark, Kristoffer P. & Sundaresan, Savitar, 2019. "Inattention and belief polarization," Journal of Economic Theory, Elsevier, vol. 180(C), pages 203-228.
    9. André Palma & Nathalie Picard & Moshe Ben-Akiva, 2018. "Special issue in the honor of Daniel McFadden: introduction," Theory and Decision, Springer, vol. 84(2), pages 143-148, March.
    10. Georges Sfeir & Filipe Rodrigues & Maya Abou-Zeid, 2021. "Gaussian Process Latent Class Choice Models," Papers 2101.12252, arXiv.org.
    11. Jehiel, Philippe & Steiner, Jakub, 2017. "On Second Thoughts, Selective Memory, and Resulting Behavioral Biases," CEPR Discussion Papers 12546, C.E.P.R. Discussion Papers.
    12. Penghui Yin, 2018. "Optimal Amount of Attention to Capital Income Risk and Heterogeneous Precautionary Saving Behavior," CESifo Working Paper Series 7413, CESifo.
    13. Janků, Jan & Libich, Jan, 2019. "Ignorance isn't bliss: Uninformed voters drive budget cycles," Journal of Public Economics, Elsevier, vol. 173(C), pages 21-43.
    14. Jianjun Miao, 2019. "Multivariate LQG Control under Rational Inattention in Continuous Time," Boston University - Department of Economics - Working Papers Series WP2019-06, Boston University - Department of Economics.
    15. Ubøe, Jan & Andersson, Jonas & Jörnsten, Kurt & Lillestøl, Jostein & Sandal, Leif K., 2014. "Probabilistic cost efficiency and bounded rationality in the newsvendor model," Discussion Papers 2014/41, Norwegian School of Economics, Department of Business and Management Science.
    16. Ubøe, Jan & Andersson, Jonas & Jörnsten, Kurt & Lillestøl, Jostein & Sandal, Leif, 2017. "Statistical testing of bounded rationality with applications to the newsvendor model," European Journal of Operational Research, Elsevier, vol. 259(1), pages 251-261.
    17. Tsakas, Elias, 0. "Robust scoring rules," Theoretical Economics, Econometric Society.
    18. Florian Gauer & Christoph Kuzmics, 2020. "Cognitive Empathy In Conflict Situations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(4), pages 1659-1678, November.
    19. Michael Grubb, 2015. "Failing to Choose the Best Price: Theory, Evidence, and Policy," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 47(3), pages 303-340, November.
    20. Dasgupta, Kunal & Mondria, Jordi, 2018. "Inattentive importers," Journal of International Economics, Elsevier, vol. 112(C), pages 150-165.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1912.10058. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (arXiv administrators). General contact details of provider: http://arxiv.org/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.