IDEAS home Printed from https://ideas.repec.org/p/fip/fedmsr/181.html
   My bibliography  Save this paper

The solution and estimation of discrete choice dynamic programming models by simulation and interpolation: Monte Carlo evidence

Author

Listed:
  • Michael P. Keane
  • Kenneth I. Wolpin

Abstract

Over the past decade, a substantial literature on the estimation of discrete choice dynamic programming (DC-DP) models of behavior has developed. However, this literature now faces major computational barriers. Specifically, in order to solve the dynamic programming (DP) problems that generate agents' decision rules in DC-DP models, high dimensional integrations must be performed at each point in the state space of the DP problem. In this paper we explore the performance of approximate solutions to DP problems. Our approximation method consists of: 1) using Monte Carlo integration to simulate the required multiple integrals at a subset of the state points, and 2) interpolating the non-simulated values using a regression function. The overall performance of this approximation method appears to be excellent, both in terms of the degree to which it mimics the exact solution, and in terms of the parameter estimates it generates when embedded in an estimation algorithm.

Suggested Citation

  • Michael P. Keane & Kenneth I. Wolpin, 1994. "The solution and estimation of discrete choice dynamic programming models by simulation and interpolation: Monte Carlo evidence," Staff Report 181, Federal Reserve Bank of Minneapolis.
  • Handle: RePEc:fip:fedmsr:181
    as

    Download full text from publisher

    File URL: http://minneapolisfed.org/research/sr/sr181.pdf
    Download Restriction: no

    File URL: http://www.minneapolisfed.org/research/common/pub_detail.cfm?pb_autonum_id=462
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    2. Berkovec, James & Stern, Steven, 1991. "Job Exit Behavior of Older Men," Econometrica, Econometric Society, vol. 59(1), pages 189-210, January.
    3. V. Joseph Hotz & Robert A. Miller & Seth Sanders & Jeffrey Smith, 1994. "A Simulation Estimator for Dynamic Models of Discrete Choice," Review of Economic Studies, Oxford University Press, vol. 61(2), pages 265-289.
    4. Keane, Michael P, 1994. "A Computationally Practical Simulation Estimator for Panel Data," Econometrica, Econometric Society, vol. 62(1), pages 95-116, January.
    5. Robin L. Lumsdaine & James H. Stock & David A. Wise, 1992. "Three Models of Retirement: Computational Complexity versus Predictive Validity," NBER Chapters, in: Topics in the Economics of Aging, pages 21-60, National Bureau of Economic Research, Inc.
    6. Hotz, V Joseph & Miller, Robert A, 1988. "An Empirical Analysis of Life Cycle Fertility and Female Labor Supply," Econometrica, Econometric Society, vol. 56(1), pages 91-118, January.
    7. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    8. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    9. Miller, Robert A, 1984. "Job Matching and Occupational Choice," Journal of Political Economy, University of Chicago Press, vol. 92(6), pages 1086-1120, December.
    10. Pakes, Ariel S, 1986. "Patents as Options: Some Estimates of the Value of Holding European Patent Stocks," Econometrica, Econometric Society, vol. 54(4), pages 755-784, July.
    11. Zvi Eckstein & Kenneth I. Wolpin, 1989. "The Specification and Estimation of Dynamic Stochastic Discrete Choice Models: A Survey," Journal of Human Resources, University of Wisconsin Press, vol. 24(4), pages 562-598.
    12. Wolpin, Kenneth I, 1984. "An Estimable Dynamic Stochastic Model of Fertility and Child Mortality," Journal of Political Economy, University of Chicago Press, vol. 92(5), pages 852-874, October.
    13. Stock, James H & Wise, David A, 1990. "Pensions, the Option Value of Work, and Retirement," Econometrica, Econometric Society, vol. 58(5), pages 1151-1180, September.
    14. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    15. Heckman, James J & Sedlacek, Guilherme, 1985. "Heterogeneity, Aggregation, and Market Wage Functions: An Empirical Model of Self-selection in the Labor Market," Journal of Political Economy, University of Chicago Press, vol. 93(6), pages 1077-1125, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    2. Keane, Michael P. & Todd, Petra E. & Wolpin, Kenneth I., 2011. "The Structural Estimation of Behavioral Models: Discrete Choice Dynamic Programming Methods and Applications," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 4, pages 331-461, Elsevier.
    3. George‐Levi Gayle & Limor Golan & Mehmet A. Soytas, 2018. "Estimation of dynastic life‐cycle discrete choice models," Quantitative Economics, Econometric Society, vol. 9(3), pages 1195-1241, November.
    4. Houser, Daniel, 2003. "Bayesian analysis of a dynamic stochastic model of labor supply and saving," Journal of Econometrics, Elsevier, vol. 113(2), pages 289-335, April.
    5. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    6. Geweke, John & Houser, Dan & Keane, Michael, 1999. "Simulation Based Inference for Dynamic Multinomial Choice Models," MPRA Paper 54279, University Library of Munich, Germany.
    7. David H. Good & M. Ishaq Nadiri & Robin C. Sickles, 1996. "Index Number and Factor Demand Approaches to the Estimation of Productivity," NBER Working Papers 5790, National Bureau of Economic Research, Inc.
    8. Jaap Abbring & James Heckman, 2008. "Dynamic policy analysis," CeMMAP working papers CWP05/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Pietola, Kyosti & Vare, Minna & Oude Lansink, Alfons G.J.M., 2002. "Farmers' Exit Decisions and Early Retirement Programs in Finland," 2002 International Congress, August 28-31, 2002, Zaragoza, Spain 24825, European Association of Agricultural Economists.
    10. Yusuke Hara & Eiji Hato, 2019. "Analysis of dynamic decision-making in a bicycle-sharing auction using a dynamic discrete choice model," Transportation, Springer, vol. 46(1), pages 147-173, February.
    11. Catherine Cazals, 1994. "La retraite dans les modèles d'offre de travail : un survol de la littérature," Économie et Prévision, Programme National Persée, vol. 115(4), pages 43-62.
    12. George-Levi Gayle & Limor Golan & Mehmet A. Soytas, 2015. "What is the source of the intergenerational correlation in earnings?," Working Papers 2015-19, Federal Reserve Bank of St. Louis.
    13. De Pinto, Alessandro & Nelson, Gerald C., 2004. "A Dynamic Model Of Land Use Change With Spatially Explicit Data," 2004 Annual meeting, August 1-4, Denver, CO 20314, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    14. Arcidiacono, Peter & Miller, Robert A., 2020. "Identifying dynamic discrete choice models off short panels," Journal of Econometrics, Elsevier, vol. 215(2), pages 473-485.
    15. Le-Yu Chen, 2009. "Identification of structural dynamic discrete choice models," CeMMAP working papers CWP08/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    16. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    17. Belzil, Christian, 2007. "The return to schooling in structural dynamic models: a survey," European Economic Review, Elsevier, vol. 51(5), pages 1059-1105, July.
    18. Zvi Eckstein & Osnat Lifshitz, 2011. "Dynamic Female Labor Supply," Econometrica, Econometric Society, vol. 79(6), pages 1675-1726, November.
    19. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Manuel S. Santos, 2006. "Convergence Properties of the Likelihood of Computed Dynamic Models," Econometrica, Econometric Society, vol. 74(1), pages 93-119, January.
    20. Stern, Steven, 1994. "Two Dynamic Discrete Choice Estimation Problems and Simulation Method Solutions," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 695-702, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedmsr:181. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/cfrbmus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/cfrbmus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.