IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v223y2021i2p328-360.html
   My bibliography  Save this article

Solving dynamic discrete choice models using smoothing and sieve methods

Author

Listed:
  • Kristensen, Dennis
  • Mogensen, Patrick K.
  • Moon, Jong Myun
  • Schjerning, Bertel

Abstract

We propose to combine smoothing, simulations and sieve approximations to solve for either the integrated or expected value function in a general class of dynamic discrete choice (DDC) models. We use importance sampling to approximate the Bellman operators defining the two functions. The random Bellman operators, and therefore also the corresponding solutions, are generally non-smooth which is undesirable. To circumvent this issue, we introduce smoothed versions of the random Bellman operators and solve for the corresponding smoothed value functions using sieve methods. We also show that one can avoid using sieves by generalizing and adapting the “self-approximating” method of Rust (1997b) to our setting. We provide an asymptotic theory for both approximate solution methods and show that they converge with N-rate, where N is number of Monte Carlo draws, towards Gaussian processes. We examine their performance in practice through a set of numerical experiments and find that both methods perform well with the sieve method being particularly attractive in terms of computational speed and accuracy.

Suggested Citation

  • Kristensen, Dennis & Mogensen, Patrick K. & Moon, Jong Myun & Schjerning, Bertel, 2021. "Solving dynamic discrete choice models using smoothing and sieve methods," Journal of Econometrics, Elsevier, vol. 223(2), pages 328-360.
  • Handle: RePEc:eee:econom:v:223:y:2021:i:2:p:328-360
    DOI: 10.1016/j.jeconom.2020.02.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407620303298
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2020.02.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andriy Norets, 2010. "Continuity and differentiability of expected value functions in dynamic discrete choice models," Quantitative Economics, Econometric Society, vol. 1(2), pages 305-322, November.
    2. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    3. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    4. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    5. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6a.
    6. Andriy Norets, 2012. "Estimation of Dynamic Discrete Choice Models Using Artificial Neural Network Approximations," Econometric Reviews, Taylor & Francis Journals, vol. 31(1), pages 84-106.
    7. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    8. Fermanian, Jean-David & Salanié, Bernard, 2004. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Econometric Theory, Cambridge University Press, vol. 20(4), pages 701-734, August.
    9. repec:spr:compst:v:77:y:2013:i:3:p:407-421 is not listed on IDEAS
    10. Yongyang Cai & Kenneth Judd, 2013. "Shape-preserving dynamic programming," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 77(3), pages 407-421, June.
    11. Robin L. Lumsdaine & James H. Stock & David A. Wise, 1992. "Three Models of Retirement: Computational Complexity versus Predictive Validity," NBER Chapters, in: Topics in the Economics of Aging, pages 21-60, National Bureau of Economic Research, Inc.
    12. Van Than Dung & Tegoeh Tjahjowidodo, 2017. "A direct method to solve optimal knots of B-spline curves: An application for non-uniform B-spline curves fitting," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-24, March.
    13. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6b.
    14. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    15. Keane, Michael P & Wolpin, Kenneth I, 1994. "The Solution and Estimation of Discrete Choice Dynamic Programming Models by Simulation and Interpolation: Monte Carlo Evidence," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 648-672, November.
    16. John Rust, 1997. "Using Randomization to Break the Curse of Dimensionality," Econometrica, Econometric Society, vol. 65(3), pages 487-516, May.
    17. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    18. John Rust, 1997. "A Comparison of Policy Iteration Methods for Solving Continuous-State, Infinite-Horizon Markovian Decision Problems Using Random, Quasi-random, and Deterministic Discretizations," Computational Economics 9704001, University Library of Munich, Germany.
    19. Judd, Kenneth L. & Maliar, Lilia & Maliar, Serguei & Valero, Rafael, 2014. "Smolyak method for solving dynamic economic models: Lagrange interpolation, anisotropic grid and adaptive domain," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 92-123.
    20. J. Rust & J. F. Traub & H. Wozniakowski, 2002. "Is There a Curse of Dimensionality for Contraction Fixed Points in the Worst Case?," Econometrica, Econometric Society, vol. 70(1), pages 285-329, January.
    21. Fedor Iskhakov & Thomas H. Jørgensen & John Rust & Bertel Schjerning, 2017. "The endogenous grid method for discrete‐continuous dynamic choice models with (or without) taste shocks," Quantitative Economics, Econometric Society, vol. 8(2), pages 317-365, July.
    22. Pál, Jenő & Stachurski, John, 2013. "Fitted value function iteration with probability one contractions," Journal of Economic Dynamics and Control, Elsevier, vol. 37(1), pages 251-264.
    23. Johannes Brumm & Simon Scheidegger, 2017. "Using Adaptive Sparse Grids to Solve High‐Dimensional Dynamic Models," Econometrica, Econometric Society, vol. 85, pages 1575-1612, September.
    24. Chen, Victoria C. P., 1999. "Application of orthogonal arrays and MARS to inventory forecasting stochastic dynamic programs," Computational Statistics & Data Analysis, Elsevier, vol. 30(3), pages 317-341, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jackson Bunting, 2022. "Continuous permanent unobserved heterogeneity in dynamic discrete choice models," Papers 2202.03960, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    2. Jean-Jacques Forneron, 2019. "A Sieve-SMM Estimator for Dynamic Models," Papers 1902.01456, arXiv.org, revised Jul 2020.
    3. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    4. Lee, Donghoon & Song, Kyungchul, 2015. "Simulated maximum likelihood estimation for discrete choices using transformed simulated frequencies," Journal of Econometrics, Elsevier, vol. 187(1), pages 131-153.
    5. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    6. Panle Jia Barwick & Parag A. Pathak, 2015. "The costs of free entry: an empirical study of real estate agents in Greater Boston," RAND Journal of Economics, RAND Corporation, vol. 46(1), pages 103-145, March.
    7. Chang, Jinyuan & Chen, Song Xi & Chen, Xiaohong, 2015. "High dimensional generalized empirical likelihood for moment restrictions with dependent data," Journal of Econometrics, Elsevier, vol. 185(1), pages 283-304.
    8. Peñaranda, Francisco & Sentana, Enrique, 2016. "Duality in mean-variance frontiers with conditioning information," Journal of Empirical Finance, Elsevier, vol. 38(PB), pages 762-785.
    9. Hu Yingyao & Shum Matthew & Tan Wei & Xiao Ruli, 2017. "A Simple Estimator for Dynamic Models with Serially Correlated Unobservables," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-16, January.
    10. Andrew Ching & Susumu Imai & Masakazu Ishihara & Neelam Jain, 2012. "A practitioner’s guide to Bayesian estimation of discrete choice dynamic programming models," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 151-196, June.
    11. Peñaranda, Francisco & Sentana, Enrique, 2012. "Spanning tests in return and stochastic discount factor mean–variance frontiers: A unifying approach," Journal of Econometrics, Elsevier, vol. 170(2), pages 303-324.
    12. Li, Shengyu, 2018. "A structural model of productivity, uncertain demand, and export dynamics," Journal of International Economics, Elsevier, vol. 115(C), pages 1-15.
    13. Andriy Norets, 2009. "Inference in Dynamic Discrete Choice Models With Serially orrelated Unobserved State Variables," Econometrica, Econometric Society, vol. 77(5), pages 1665-1682, September.
    14. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    15. Hu, Yingyao, 2017. "The Econometrics of Unobservables -- Latent Variable and Measurement Error Models and Their Applications in Empirical Industrial Organization and Labor Economics [The Econometrics of Unobservables]," Economics Working Paper Archive 64578, The Johns Hopkins University,Department of Economics, revised 2021.
    16. Ai, Chunrong & Chen, Xiaohong, 2012. "The semiparametric efficiency bound for models of sequential moment restrictions containing unknown functions," Journal of Econometrics, Elsevier, vol. 170(2), pages 442-457.
    17. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona Graduate School of Economics.
    18. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    19. Zhao, Puying & Haziza, David & Wu, Changbao, 2020. "Survey weighted estimating equation inference with nuisance functionals," Journal of Econometrics, Elsevier, vol. 216(2), pages 516-536.
    20. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:223:y:2021:i:2:p:328-360. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/locate/jeconom .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.