Stochastic Algorithms for Dynamic Models: Markov Perfect Equilibrium, and the 'Curse' of Dimensionality
AbstractThis paper provides an algorithm for computing policies for dynamic economic models whose state vectors evolve as ergodic Markov processes. The algorithm can be described as a simple learning process (one that agents might actually use). It has two features which break the relationship between its computational requirements and the dimension of the model's state space. First the integral over future states needed to determine policies is never calculated; rather it is estimated by a simple average of past outcomes. Second, the algorithm never computes policies at all points. Iterations are defined by a location and only policies at that location are computed. Random draws from the distribution determined by those policies determine the next location. This selection only repeatedly hits the recurrent class of points, a subset of the feasible set whose cardinality is not directly tied to the dimension of the state space. Our motivating example is Markov Perfect Equilibria (a leading model of industry dynamics; see Maskin and Tirole, 1988). Though estimators for the primitive parameters of these models are often available, computational problems have made it difficult to use them in applied analysis. We provide numerical results which show that our algorithm can be several orders of magnitude faster than standard algorithms in this case; opening up new possibilities for applied work.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Cowles Foundation for Research in Economics, Yale University in its series Cowles Foundation Discussion Papers with number 1144.
Length: 32 pages
Date of creation: Jan 1997
Date of revision:
Publication status: Published in Econometrica (2001), 69(5): 1261-1281
Contact details of provider:
Postal: Yale University, Box 208281, New Haven, CT 06520-8281 USA
Phone: (203) 432-3702
Fax: (203) 432-6167
Web page: http://cowles.econ.yale.edu/
More information through EDIRC
Postal: Cowles Foundation, Yale University, Box 208281, New Haven, CT 06520-8281 USA
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- John Rust, 1997.
"Using Randomization to Break the Curse of Dimensionality,"
Econometric Society, vol. 65(3), pages 487-516, May.
- John Rust & Department of Economics & University of Wisconsin, 1994. "Using Randomization to Break the Curse of Dimensionality," Computational Economics 9403001, EconWPA, revised 04 Jul 1994.
- Victor Aguirregabiria & Pedro Mira, 2000. "Structural Models Involving Highly Dimensional Fixed Point Problems: An Asymptotically Efficient Two-Stage Estimator," Econometric Society World Congress 2000 Contributed Papers 1702, Econometric Society.
- Victor Aguirregabiria & Pedro Mira, 2004.
"Sequential Estimation Of Dynamic Discrete Games,"
- Jonathan Levin (Stanford University) & Pat Bajari & Lanier Benkard, 2004.
"Estimating Dynamic Models of Imperfect Competition,"
Econometric Society 2004 North American Winter Meetings
627, Econometric Society.
- Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, vol. 75(5), pages 1331-1370, 09.
- Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2004. "Estimating Dynamic Models of Imperfect Competition," NBER Working Papers 10450, National Bureau of Economic Research, Inc.
- J. Levin & P. Bajari, 2004. "Estimating Dynamic Models of Imperfect Competition," 2004 Meeting Papers 579, Society for Economic Dynamics.
- Bajari, Patrick & Benkard, C. Lanier & Levin, Jonathan, 2007. "Estimating Dynamic Models of Imperfect Competition," Research Papers 1852r1, Stanford University, Graduate School of Business.
- Sangin Park, 2000. "Semiparametric Instrumental Variables Estimation and Its Application to Dynamic Oligopoly," Econometric Society World Congress 2000 Contributed Papers 0432, Econometric Society.
- John Rust, 1997. "A Comparison of Policy Iteration Methods for Solving Continuous-State, Infinite-Horizon Markovian Decision Problems Using Random, Quasi-random, and Deterministic Discretizations," Computational Economics 9704001, EconWPA.
- C. Lanier Benkard, 2000. "A Dynamic Analysis of the Market for Wide-Bodied Commercial Aircraft," NBER Working Papers 7710, National Bureau of Economic Research, Inc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Glena Ames).
If references are entirely missing, you can add them using this form.