IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2604.09736.html

Training Neural Networks Embedded in Dynamic Discrete Choice Models

Author

Listed:
  • Ecenur Oguz
  • Robert L. Bray

Abstract

We develop the first general-purpose estimator for infinite-horizon dynamic discrete choice models whose estimation problem, after pre-computation, is unencumbered by large systems of linear equations -- either imposed as constraints, or embedded in the objective function. Our unnested fixed point (UFXP) and optimal unnested fixed point (OUFXP) estimators exploit a dual representation of Bellman's equation to separate the utility parameters from the dynamic programming fixed point. We establish the consistency and asymptotic normality of UFXP and OUFXP, as well as the efficiency of the latter. Our estimators enable researchers to model utility functions non-parametrically via flexible neural-network approximations.

Suggested Citation

  • Ecenur Oguz & Robert L. Bray, 2026. "Training Neural Networks Embedded in Dynamic Discrete Choice Models," Papers 2604.09736, arXiv.org.
    • Handle: RePEc:arx:papers:2604.09736
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2604.09736
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    2. Ariel Pakes & Michael Ostrovsky & Steven Berry, 2007. "Simple estimators for the parameters of discrete dynamic games (with entry/exit examples)," RAND Journal of Economics, RAND Corporation, vol. 38(2), pages 373-399, June.
    3. Arkoudi, Ioanna & Krueger, Rico & Azevedo, Carlos Lima & Pereira, Francisco C., 2023. "Combining discrete choice models and neural networks through embeddings: Formulation, interpretability and performance," Transportation Research Part B: Methodological, Elsevier, vol. 175(C).
    4. Peter Arcidiacono & Paul B. Ellickson, 2011. "Practical Methods for Estimation of Dynamic Discrete Choice Models," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 363-394, September.
    5. Fedor Iskhakov & Jinhyuk Lee & John Rust & Bertel Schjerning & Kyoungwon Seo, 2016. "Comment on “Constrained Optimization Approaches to Estimation of Structural Models”," Econometrica, Econometric Society, vol. 84, pages 365-370, January.
    6. V. Joseph Hotz & Robert A. Miller & Seth Sanders & Jeffrey Smith, 1994. "A Simulation Estimator for Dynamic Models of Discrete Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(2), pages 265-289.
    7. Fabio A. Miessi Sanches & Daniel Junior Silva & Sorawoot Srisuma, 2016. "Ordinary Least Squares Estimation Of A Dynamic Game Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 57, pages 623-634, May.
    8. Robert L. Bray & Yuliang Yao & Yongrui Duan & Jiazhen Huo, 2019. "Ration Gaming and the Bullwhip Effect," Operations Research, INFORMS, vol. 67(2), pages 453-467, March.
    9. Yanhao & Wei & Zhenling Jiang, 2025. "Estimating Parameters of Structural Models Using Neural Networks," Papers 2502.04945, arXiv.org.
    10. Robert L. Bray, 2019. "Markov Decision Processes with Exogenous Variables," Management Science, INFORMS, vol. 65(10), pages 4598-4606, October.
    11. Han, Yafei & Pereira, Francisco Camara & Ben-Akiva, Moshe & Zegras, Christopher, 2022. "A neural-embedded discrete choice model: Learning taste representation with strengthened interpretability," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 166-186.
    12. Victor Aguirregabiria & Pedro Mira, 2007. "Sequential Estimation of Dynamic Discrete Games," Econometrica, Econometric Society, vol. 75(1), pages 1-53, January.
    13. Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711, December.
    14. Robert L. Bray, 2019. "Strong convergence and dynamic economic models," Quantitative Economics, Econometric Society, vol. 10(1), pages 43-65, January.
    15. Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, vol. 75(5), pages 1331-1370, September.
    16. Victor Aguirregabiria, 1999. "The Dynamics of Markups and Inventories in Retailing Firms," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(2), pages 275-308.
    17. Peter Arcidiacono & Robert A. Miller, 2011. "Conditional Choice Probability Estimation of Dynamic Discrete Choice Models With Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 79(6), pages 1823-1867, November.
    18. V. Joseph Hotz & Robert A. Miller, 1993. "Conditional Choice Probabilities and the Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 497-529.
    19. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    20. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    21. Che‐Lin Su & Kenneth L. Judd, 2012. "Constrained Optimization Approaches to Estimation of Structural Models," Econometrica, Econometric Society, vol. 80(5), pages 2213-2230, September.
    22. Martin Pesendorfer & Philipp Schmidt-Dengler, 2008. "Asymptotic Least Squares Estimators for Dynamic Games -super-1," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 901-928.
    23. Hiroyuki Kasahara & Katsumi Shimotsu, 2018. "Estimation of Discrete Choice Dynamic Programming Models," The Japanese Economic Review, Japanese Economic Association, vol. 69(1), pages 28-58, March.
    24. Fabio A. Miessi Sanches & Daniel Junior Silva & Sorawoot Srisuma, 2016. "Ordinary Least Squares Estimation Of A Dynamic Game Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 57(2), pages 623-634, May.
    25. Yanhao (Max) Wei & Zhenling Jiang, 2025. "Estimating Parameters of Structural Models Using Neural Networks," Marketing Science, INFORMS, vol. 44(1), pages 102-128, January.
    26. Hsieh, Sung-Lin & Ke, Shaowei & Wang, Zhaoran & Zhao, Chen, 2025. "Logit neural-network utility," Journal of Economic Behavior & Organization, Elsevier, vol. 236(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ahmed Khwaja & Sonal Srivastava, 2026. "Reinforcement Learning Based Computationally Efficient Conditional Choice Simulation Estimation of Dynamic Discrete Choice Models," Papers 2601.02069, arXiv.org.
    2. Srisuma, Sorawoot & Linton, Oliver, 2012. "Semiparametric estimation of Markov decision processes with continuous state space," Journal of Econometrics, Elsevier, vol. 166(2), pages 320-341.
    3. Peter Arcidiacono & Patrick Bayer & Jason R. Blevins & Paul B. Ellickson, 2016. "Estimation of Dynamic Discrete Choice Models in Continuous Time with an Application to Retail Competition," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(3), pages 889-931.
    4. Adam Dearing S.C. & Jason R Blevins, 2025. "Efficient and Convergent Sequential Pseudo-Likelihood Estimation of Dynamic Discrete Games," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 92(2), pages 981-1021.
    5. Joao Macieira, 2010. "Oblivious Equilibrium in Dynamic Discrete Games," 2010 Meeting Papers 680, Society for Economic Dynamics.
    6. Hiroyuki Kasahara & Katsumi Shimotsu, 2012. "Sequential Estimation of Structural Models With a Fixed Point Constraint," Econometrica, Econometric Society, vol. 80(5), pages 2303-2319, September.
    7. Arcidiacono, Peter & Miller, Robert A., 2020. "Identifying dynamic discrete choice models off short panels," Journal of Econometrics, Elsevier, vol. 215(2), pages 473-485.
    8. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    9. Federico A. Bugni & Jackson Bunting & Takuya Ura, 2025. "Testing homogeneity in dynamic discrete games in finite samples," Quantitative Economics, Econometric Society, vol. 16(4), pages 1267-1320, November.
    10. Komarova, Tatiana & Sanches, Fábio & Silva Junior, Daniel & Srisuma, Sorawoot, 2018. "Joint analysis of the discount factor and payoff parameters in dynamic discrete choice games," LSE Research Online Documents on Economics 86858, London School of Economics and Political Science, LSE Library.
    11. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    12. Sasaki, Yuya & Takahashi, Yuya & Xin, Yi & Hu, Yingyao, 2023. "Dynamic discrete choice models with incomplete data: Sharp identification," Journal of Econometrics, Elsevier, vol. 236(1).
    13. Jason R. Blevins, 2026. "Identification and estimation of continuous‐time dynamic discrete choice games," Quantitative Economics, Econometric Society, vol. 17(1), pages 254-296, January.
    14. Victor Aguirregabiria & Victor Aguirregabiria & Aviv Nevo & Aviv Nevo, 2010. "Recent Developments in Empirical IO: Dynamic Demand and Dynamic Games," Working Papers tecipa-419, University of Toronto, Department of Economics.
    15. Paul B. Ellickson & Sanjog Misra, 2011. "Structural Workshop Paper --Estimating Discrete Games," Marketing Science, INFORMS, vol. 30(6), pages 997-1010, November.
    16. Taisuke Otsu & Martin Pesendorfer, 2021. "Equilibrium multiplicity in dynamic games: testing and estimation," STICERD - Econometrics Paper Series 618, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    17. Abbring, Jaap & Campbell, J.R. & Tilly, J. & Yang, N., 2018. "Very Simple Markov-Perfect Industry Dynamics (revision of 2017-021) : Empirics," Discussion Paper 2018-040, Tilburg University, Center for Economic Research.
    18. Jason R. Blevins, 2024. "Leveraging Uniformization and Sparsity for Estimation and Computation of Continuous Time Dynamic Discrete Choice Games," Papers 2407.14914, arXiv.org, revised Nov 2025.
    19. Peter Arcidiacono & Paul B. Ellickson, 2011. "Practical Methods for Estimation of Dynamic Discrete Choice Models," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 363-394, September.
    20. Hu, Yingyao & Xin, Yi, 2024. "Identification and estimation of dynamic structural models with unobserved choices," Journal of Econometrics, Elsevier, vol. 242(2).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2604.09736. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.