IDEAS home Printed from https://ideas.repec.org/p/fip/fedmsr/181.html

Some searches may not work properly. We apologize for the inconvenience.

   My bibliography  Save this paper

The solution and estimation of discrete choice dynamic programming models by simulation and interpolation: Monte Carlo evidence

Author

Listed:
  • Michael P. Keane
  • Kenneth I. Wolpin

Abstract

Over the past decade, a substantial literature on the estimation of discrete choice dynamic programming (DC-DP) models of behavior has developed. However, this literature now faces major computational barriers. Specifically, in order to solve the dynamic programming (DP) problems that generate agents' decision rules in DC-DP models, high dimensional integrations must be performed at each point in the state space of the DP problem. In this paper we explore the performance of approximate solutions to DP problems. Our approximation method consists of: 1) using Monte Carlo integration to simulate the required multiple integrals at a subset of the state points, and 2) interpolating the non-simulated values using a regression function. The overall performance of this approximation method appears to be excellent, both in terms of the degree to which it mimics the exact solution, and in terms of the parameter estimates it generates when embedded in an estimation algorithm.

Suggested Citation

  • Michael P. Keane & Kenneth I. Wolpin, . "The solution and estimation of discrete choice dynamic programming models by simulation and interpolation: Monte Carlo evidence," Staff Report, Federal Reserve Bank of Minneapolis.
    • Handle: RePEc:fip:fedmsr:181
    as

    Download full text from publisher

    File URL: http://minneapolisfed.org/research/sr/sr181.pdf
    Download Restriction: no
    File URL: http://www.minneapolisfed.org/research/common/pub_detail.cfm?pb_autonum_id=462
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Miller, Robert A, 1984. "Job Matching and Occupational Choice," Journal of Political Economy, University of Chicago Press, vol. 92(6), pages 1086-1120, December.
    2. Rust, John, 1987. "Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher," Econometrica, Econometric Society, vol. 55(5), pages 999-1033, September.
    3. Berkovec, James & Stern, Steven, 1991. "Job Exit Behavior of Older Men," Econometrica, Econometric Society, vol. 59(1), pages 189-210, January.
    4. V. Joseph Hotz & Robert A. Miller & Seth Sanders & Jeffrey Smith, 1994. "A Simulation Estimator for Dynamic Models of Discrete Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(2), pages 265-289.
    5. Wolpin, Kenneth I, 1984. "An Estimable Dynamic Stochastic Model of Fertility and Child Mortality," Journal of Political Economy, University of Chicago Press, vol. 92(5), pages 852-874, October.
    6. Stock, James H & Wise, David A, 1990. "Pensions, the Option Value of Work, and Retirement," Econometrica, Econometric Society, vol. 58(5), pages 1151-1180, September.
    7. Keane, Michael P, 1994. "A Computationally Practical Simulation Estimator for Panel Data," Econometrica, Econometric Society, vol. 62(1), pages 95-116, January.
    8. Pakes, Ariel S, 1986. "Patents as Options: Some Estimates of the Value of Holding European Patent Stocks," Econometrica, Econometric Society, vol. 54(4), pages 755-784, July.
    9. Robin L. Lumsdaine & James H. Stock & David A. Wise, 1992. "Three Models of Retirement: Computational Complexity versus Predictive Validity," NBER Chapters, in: Topics in the Economics of Aging, pages 21-60, National Bureau of Economic Research, Inc.
    10. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    11. Hotz, V Joseph & Miller, Robert A, 1988. "An Empirical Analysis of Life Cycle Fertility and Female Labor Supply," Econometrica, Econometric Society, vol. 56(1), pages 91-118, January.
    12. Zvi Eckstein & Kenneth I. Wolpin, 1989. "The Specification and Estimation of Dynamic Stochastic Discrete Choice Models: A Survey," Journal of Human Resources, University of Wisconsin Press, vol. 24(4), pages 562-598.
    13. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    14. Heckman, James J & Sedlacek, Guilherme, 1985. "Heterogeneity, Aggregation, and Market Wage Functions: An Empirical Model of Self-selection in the Labor Market," Journal of Political Economy, University of Chicago Press, vol. 93(6), pages 1077-1125, December.
    15. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    2. Keane, Michael P. & Todd, Petra E. & Wolpin, Kenneth I., 2011. "The Structural Estimation of Behavioral Models: Discrete Choice Dynamic Programming Methods and Applications," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 4, pages 331-461, Elsevier.
    3. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    4. Catherine Cazals, 1994. "La retraite dans les modèles d'offre de travail : un survol de la littérature," Économie et Prévision, Programme National Persée, vol. 115(4), pages 43-62.
    5. George‐Levi Gayle & Limor Golan & Mehmet A. Soytas, 2018. "Estimation of dynastic life‐cycle discrete choice models," Quantitative Economics, Econometric Society, vol. 9(3), pages 1195-1241, November.
    6. Stern, Steven, 1994. "Two Dynamic Discrete Choice Estimation Problems and Simulation Method Solutions," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 695-702, November.
    7. Gayle, George-Levi & Golan, Limor & Soytas, Mehmet A., 2022. "What is the source of the intergenerational correlation in earnings?," Journal of Monetary Economics, Elsevier, vol. 129(C), pages 24-45.
    8. Good, D. & Nadiri, M.I. & Sickles, R., 1996. "Index Number and Factor Demand Approaches to the Estimarion of Productivity," Working Papers 96-34, C.V. Starr Center for Applied Economics, New York University.
    9. Jaap Abbring & James Heckman, 2008. "Dynamic policy analysis," CeMMAP working papers CWP05/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Pietola, Kyosti & Vare, Minna & Oude Lansink, Alfons G.J.M., 2002. "Farmers' Exit Decisions and Early Retirement Programs in Finland," 2002 International Congress, August 28-31, 2002, Zaragoza, Spain 24825, European Association of Agricultural Economists.
    11. Houser, Daniel, 2003. "Bayesian analysis of a dynamic stochastic model of labor supply and saving," Journal of Econometrics, Elsevier, vol. 113(2), pages 289-335, April.
    12. Yusuke Hara & Eiji Hato, 2019. "Analysis of dynamic decision-making in a bicycle-sharing auction using a dynamic discrete choice model," Transportation, Springer, vol. 46(1), pages 147-173, February.
    13. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    14. Geweke, John & Houser, Dan & Keane, Michael, 1999. "Simulation Based Inference for Dynamic Multinomial Choice Models," MPRA Paper 54279, University Library of Munich, Germany.
    15. Belzil, Christian, 2007. "The return to schooling in structural dynamic models: a survey," European Economic Review, Elsevier, vol. 51(5), pages 1059-1105, July.
    16. Peter Arcidiacono & Paul B. Ellickson, 2011. "Practical Methods for Estimation of Dynamic Discrete Choice Models," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 363-394, September.
    17. Concepció Patxot & Meritxell Solé & Guadalupe Souto & Martin Spielauer, 2018. "The Impact of the Retirement Decision and Demographics on Pension Sustainability: A Dynamic Microsimulation Analysis," International Journal of Microsimulation, International Microsimulation Association, vol. 11(2), pages 84-108.
    18. Victor Aguirregabiria & Arvind Magesan, 2013. "Euler Equations for the Estimation of Dynamic Discrete Choice Structural Models," Advances in Econometrics, in: Structural Econometric Models, volume 31, pages 3-44, Emerald Group Publishing Limited.
    19. Arcidiacono, Peter & Miller, Robert A., 2020. "Identifying dynamic discrete choice models off short panels," Journal of Econometrics, Elsevier, vol. 215(2), pages 473-485.
    20. Zvi Eckstein & Osnat Lifshitz, 2011. "Dynamic Female Labor Supply," Econometrica, Econometric Society, vol. 79(6), pages 1675-1726, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedmsr:181. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kate Hansel (email available below). General contact details of provider: https://edirc.repec.org/data/cfrbmus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.