IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.26432.html

Embedding Foundation Model Predictions in Discrete-Choice Models with Structural Guarantees

Author

Listed:
  • Yingshuo Wang
  • Xian Sun
  • Yanhang Li
  • Zhichao Fan
  • Zexin Zhuang

Abstract

Tabular foundation models achieve strong accuracy on choice prediction tasks, but their predictions often violate the economic logic those tasks require: raising a price can increase predicted demand, implied willingness-to-pay estimates are frequently negative or implausible, and unavailable alternatives receive nonzero probability. We propose a two-stage adapter that takes a foundation model's predicted choice probabilities as a precomputed feature and embeds them inside a multinomial logit's utility. In Stage 1, we fit the multinomial logit's structural coefficients by maximum likelihood with sign constraints; in Stage 2, we freeze those coefficients and fit a small neural correction operating on the foundation model's predictions. We prove that this composition exactly preserves the multinomial logit's marginal rate of substitution, so analytically computable value-of-time becomes a mathematical guarantee rather than an empirical accident. Across three datasets and two foundation models, the adapter gains 6.4 percentage points (pp) of test accuracy on average over the multinomial logit and up to 12.8 pp, maintains 100% cost monotonicity, and produces values of time within the published transportation-economics range on the transportation datasets. Performance degrades gracefully under foundation-model context restriction, retaining at least 6 pp of accuracy gain even at 10% of the original foundation-model context.

Suggested Citation

  • Yingshuo Wang & Xian Sun & Yanhang Li & Zhichao Fan & Zexin Zhuang, 2026. "Embedding Foundation Model Predictions in Discrete-Choice Models with Structural Guarantees," Papers 2606.26432, arXiv.org.
  • Handle: RePEc:arx:papers:2606.26432
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.26432
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hillel, Tim & Bierlaire, Michel & Elshafie, Mohammed Z.E.B. & Jin, Ying, 2021. "A systematic review of machine learning classification methodologies for modelling passenger mode choice," Journal of choice modelling, Elsevier, vol. 38(C).
    2. Han, Yafei & Pereira, Francisco Camara & Ben-Akiva, Moshe & Zegras, Christopher, 2022. "A neural-embedded discrete choice model: Learning taste representation with strengthened interpretability," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 166-186.
    3. Yingshuo Wang & Xian Sun & Yanhang Li & Zhichao Fan & Zexin Zhuang, 2026. "Auditing and Fixing Economic Validity in Tabular Foundation Models for Discrete Choice," Papers 2605.26559, arXiv.org.
    4. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    5. Noah Hollmann & Samuel Müller & Lennart Purucker & Arjun Krishnakumar & Max Körfer & Shi Bin Hoo & Robin Tibor Schirrmeister & Frank Hutter, 2025. "Accurate predictions on small data with a tabular foundation model," Nature, Nature, vol. 637(8045), pages 319-326, January.
    6. repec:plo:pone00:0227800 is not listed on IDEAS
    7. Quinn McNemar, 1947. "Note on the sampling error of the difference between correlated proportions or percentages," Psychometrika, Springer;The Psychometric Society, vol. 12(2), pages 153-157, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xuli Wen & Xin Chen, 2025. "A New Breakthrough in Travel Behavior Modeling Using Deep Learning: A High-Accuracy Prediction Method Based on a CNN," Sustainability, MDPI, vol. 17(2), pages 1-14, January.
    2. Daniel F. Villarraga & Ricardo A. Daziano, 2025. "Designing Graph Convolutional Neural Networks for Discrete Choice with Network Effects," Papers 2503.09786, arXiv.org.
    3. Ali, Azam & Kalatian, Arash & Choudhury, Charisma F., 2023. "Comparing and contrasting choice model and machine learning techniques in the context of vehicle ownership decisions," Transportation Research Part A: Policy and Practice, Elsevier, vol. 173(C).
    4. Mabit, Stefan E., 2026. "Mixed logit applications in travel behaviour research," Transportation Research Part A: Policy and Practice, Elsevier, vol. 203(C).
    5. Tanmay Ghosh & Nithin Nagaraj, 2024. "Evaluating the Determinants of Mode Choice Using Statistical and Machine Learning Techniques in the Indian Megacity of Bengaluru," Papers 2401.13977, arXiv.org.
    6. Kim, Kyungah & Kim, Jinseok & Park, Subin & Lee, Jongsu & Kim, Junghun, 2025. "A machine learning technique embedded reference-dependent choice model for explanatory power improvement: Shifting of reference point as a key factor in vehicle purchase decision-making," Transportation Research Part B: Methodological, Elsevier, vol. 191(C).
    7. Bagheri, Niousha & Ghasri, Milad & Barlow, Michael, 2025. "A neural estimation framework for discrete choice models with arbitrary error distributions," Journal of choice modelling, Elsevier, vol. 57(C).
    8. Hemang Subramanian & Eric Overby, 2017. "Electronic Commerce, Spatial Arbitrage, and Market Efficiency," Information Systems Research, INFORMS, vol. 28(1), pages 97-116, March.
    9. Niousha Bagheri & Milad Ghasri & Michael Barlow, 2025. "RUM-NN: A Neural Network Model Compatible with Random Utility Maximisation for Discrete Choice Setups," Papers 2501.05221, arXiv.org.
    10. Easton K. Huch & Michael P. Keane, 2026. "Amortized Inference for Correlated Discrete Choice Models via Equivariant Neural Networks," NBER Working Papers 35037, National Bureau of Economic Research, Inc.
    11. Daniel F. Villarraga & Ricardo A. Daziano, 2025. "Bayesian Deep Learning for Discrete Choice," Papers 2505.18077, arXiv.org, revised Jul 2026.
    12. Dubey, Subodh & Cats, Oded & Hoogendoorn, Serge & Bansal, Prateek, 2022. "A multinomial probit model with Choquet integral and attribute cut-offs," Transportation Research Part B: Methodological, Elsevier, vol. 158(C), pages 140-163.
    13. Kim, Eui-Jin & Bansal, Prateek, 2024. "A new flexible and partially monotonic discrete choice model," Transportation Research Part B: Methodological, Elsevier, vol. 183(C).
    14. Kim, Kyungah & Lee, Jongsu & Kim, Junghun, 2025. "Beyond the status quo: Leveraging reference-dependent theory in a neural network for consumer choice analysis," Journal of choice modelling, Elsevier, vol. 57(C).
    15. Gutiérrez-Vargas, Álvaro A. & Meulders, Michel & Vandebroek, Martina, 2023. "Modeling preference heterogeneity using model-based decision trees," Journal of choice modelling, Elsevier, vol. 46(C).
    16. Cheng, Leilei & Yin, Changbin & Chien, Hsiaoping, 2015. "Demand for milk quantity and safety in urban China: evidence from Beijing and Harbin," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 59(2), April.
    17. Wen, Chieh-Hua & Huang, Chia-Jung & Fu, Chiang, 2020. "Incorporating continuous representation of preferences for flight departure times into stated itinerary choice modeling," Transport Policy, Elsevier, vol. 98(C), pages 10-20.
    18. Johannes Buggle & Thierry Mayer & Seyhun Orcan Sakalli & Mathias Thoenig, 2023. "The Refugee’s Dilemma: Evidence from Jewish Migration out of Nazi Germany," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(2), pages 1273-1345.
    19. Christelis, Dimitris & Dobrescu, Loretti I. & Motta, Alberto, 2020. "Early life conditions and financial risk-taking in older age," The Journal of the Economics of Ageing, Elsevier, vol. 17(C).
    20. Ortega, David L. & Wang, H. Holly & Wu, Laping & Hong, Soo Jeong, 2015. "Retail channel and consumer demand for food quality in China," China Economic Review, Elsevier, vol. 36(C), pages 359-366.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.26432. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.