Avoiding the Curse of Dimensionality in Dynamic Stochastic Games
Abstract
Discrete-time stochastic games with a finite number of states have been widely ap- plied to study the strategic interactions among forward-looking players in dynamic en- vironments. However, these games suffer from a "curse of dimensionality" since the cost of computing players' expectations over all possible future states increases exponentially in the number of state variables. We explore the alternative of continuous-time stochas- tic games with a finite number of states, and show that continuous time has substantial computational and conceptual advantages. Most important, continuous time avoids the curse of dimensionality, thereby speeding up the computations by orders of magnitude in games with more than a few state variables. Overall, the continuous-time approach opens the way to analyze more complex and realistic stochastic games than currently feasible.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Harvard - Institute of Economic Research in its series Harvard Institute of Economic Research Working Papers with number 2059.Length:
Date of creation: 2005
Date of revision:
Handle: RePEc:fth:harver:2059
Contact details of provider:
Postal: 200 Littauer Center, Cambridge, MA 02138
Phone: 617-495-2144
Fax: 617-495-7730
Web page: http://www.economics.harvard.edu/journals/hier
More information through EDIRC
Related research
Keywords:Other versions of this item:
- Ulrich Doraszelski & Kenneth L. Judd, 2012. "Avoiding the curse of dimensionality in dynamic stochastic games," Quantitative Economics, Econometric Society, vol. 3(1), pages 53-93, 03.
- Ulrich Doraszelski & Kenneth L. Judd, 2005. "Avoiding the Curse of Dimensionality in Dynamic Stochastic Games," NBER Technical Working Papers 0304, National Bureau of Economic Research, Inc.
- C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Ariel Pakes & Michael Ostrovsky & Steve Berry, 2004.
"Simple Estimators for the Parameters of Discrete Dynamic Games (with Entry/Exit Samples),"
NBER Working Papers
10506, National Bureau of Economic Research, Inc.
- Ariel Pakes & Michael Ostrovsky & Steve Berry, 2004. "Simple Estimators for the Parameters of Discrete Dynamic Games (with Entry/Exit Examples)," Harvard Institute of Economic Research Working Papers 2036, Harvard - Institute of Economic Research.
- Caplin, A. & Nalebuff, B., 1989.
"Aggregation And Imperfect Competition: On The Existence Of Equilibrium,"
Discussion Papers
1989_30, Columbia University, Department of Economics.
- Caplin, Andrew & Nalebuff, Barry, 1991. "Aggregation and Imperfect Competition: On the Existence of Equilibrium," Econometrica, Econometric Society, vol. 59(1), pages 25-59, January.
- Andrew Caplin & Barry Nalebuff, 1990. "Aggregation and Imperfect Competition: On the Existence of Equilibrium," Cowles Foundation Discussion Papers 937, Cowles Foundation for Research in Economics, Yale University.
- David Besanko & Ulrich Doraszelski, 2002.
"Capacity Dynamics and Endogenous Asymmetries in Firm Size,"
Computing in Economics and Finance 2002
196, Society for Computational Economics.
- David Besanko & Ulrich Doraszelski, 2004. "Capacity Dynamics and Endogenous Asymmetries in Firm Size," RAND Journal of Economics, The RAND Corporation, vol. 35(1), pages 23-49, Spring.
- Ronald L. Goettler & Christine A. Parlour, 2004. "Equilibrium in a Dynamic Limit Order Market," 2004 Meeting Papers 757, Society for Economic Dynamics.
- J. Levin & P. Bajari, 2004.
"Estimating Dynamic Models of Imperfect Competition,"
2004 Meeting Papers
579, Society for Economic Dynamics.
- Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2007. "Estimating Dynamic Models of Imperfect Competition," Econometrica, Econometric Society, vol. 75(5), pages 1331-1370, 09.
- Bajari, Patrick & Benkard, C. Lanier & Levin, Jonathan, 2007. "Estimating Dynamic Models of Imperfect Competition," Research Papers 1852r1, Stanford University, Graduate School of Business.
- Jonathan Levin (Stanford University) & Pat Bajari & Lanier Benkard, 2004. "Estimating Dynamic Models of Imperfect Competition," Econometric Society 2004 North American Winter Meetings 627, Econometric Society.
- Patrick Bajari & C. Lanier Benkard & Jonathan Levin, 2004. "Estimating Dynamic Models of Imperfect Competition," NBER Working Papers 10450, National Bureau of Economic Research, Inc.
- Pesendorfer, Martin & Schmidt-Dengler, Philipp, 2003.
"Identification and Estimation of Dynamic Games,"
CEPR Discussion Papers
3965, C.E.P.R. Discussion Papers.
- Martin Pesendorfer & Philipp Schmidt-Dengler, 2003. "Identification and Estimation of Dynamic Games," NBER Working Papers 9726, National Bureau of Economic Research, Inc.
- Ariel Pakes & Paul McGuire, 1992.
"Computing Markov perfect Nash equilibria: numerical implications of a dynamic differentiated product model,"
Discussion Paper / Institute for Empirical Macroeconomics
58, Federal Reserve Bank of Minneapolis.
- Ariel Pakes & Paul McGuire, 1994. "Computing Markov-Perfect Nash Equilibria: Numerical Implications of a Dynamic Differentiated Product Model," RAND Journal of Economics, The RAND Corporation, vol. 25(4), pages 555-589, Winter.
- Ariel Pakes & Paul McGuire, 1992. "Computing Markov Perfect Nash Equilibria: Numerical Implications of a Dynamic Differentiated Product Model," NBER Technical Working Papers 0119, National Bureau of Economic Research, Inc.
- Fershtman, C. & Pakes, A., 1998.
"A Dynamic Oligopoly with Collusion and Price Wars,"
Papers
26-98, Tel Aviv.
- Chaim Fershtman & Ariel Pakes, 2000. "A Dynamic Oligopoly with Collusion and Price Wars," RAND Journal of Economics, The RAND Corporation, vol. 31(2), pages 207-236, Summer.
- Chaim Fershtman & Ariel Pakes, 1999. "A Dynamic Oligopoly with Collusion and Price Wars," NBER Working Papers 6936, National Bureau of Economic Research, Inc.
- Fershtman, C. & Pakes, A., 1999. "A dynamic oligopoly with collusion and price wars," Discussion Paper 1999-48, Tilburg University, Center for Economic Research.
- C. Lanier Benkard, 2004. "A Dynamic Analysis of the Market for Wide-Bodied Commercial Aircraft," Review of Economic Studies, Wiley Blackwell, vol. 71, pages 581-611, 07.
- Dockner,Engelbert J. & Jorgensen,Steffen & Long,Ngo Van & Sorger,Gerhard, 2000. "Differential Games in Economics and Management Science," Cambridge Books, Cambridge University Press, number 9780521637329.
- Ericson, Richard & Pakes, Ariel, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," Review of Economic Studies, Wiley Blackwell, vol. 62(1), pages 53-82, January.
- Kenneth L. Judd, 1998. "Numerical Methods in Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262100711.
- Ulrich Doraszelski & Sarit Markovich, 2004. "Advertising Dynamics and Competitive Advantage," Computing in Economics and Finance 2004 61, Society for Computational Economics.
- Pakes, Ariel & McGuire, Paul, 2001. "Stochastic Algorithms, Symmetric Markov Perfect Equilibrium, and the 'Curse' of Dimensionality," Econometrica, Econometric Society, vol. 69(5), pages 1261-81, September.
- Ulrich Doraszelski & Sarit Markovich, 2004. "Advertising Dynamics and Competitive Advantage," Econometric Society 2004 North American Summer Meetings 162, Econometric Society.
- Patricia Langohr, 2003. "Competitive Convergence and Divergence: Capability and Position Dynamics," Computing in Economics and Finance 2003 229, Society for Computational Economics.
- Gowrisankaran, Gautam, 1999. "Efficient representation of state spaces for some dynamic models," Journal of Economic Dynamics and Control, Elsevier, vol. 23(8), pages 1077-1098, August.
- Ariel Pakes, 2000. "A Framework for Applied Dynamic Analysis in I.O," NBER Working Papers 8024, National Bureau of Economic Research, Inc.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Besanko, David & Doraszelski, Ulrich & Kryukov, Yaroslav & Satterthwaite, Mark, 2007.
"Learning-by-Doing, Organizational Forgetting and Industry Dynamics,"
CEPR Discussion Papers
6160, C.E.P.R. Discussion Papers.
- David Besanko & Ulrich Doraszelski & Yaroslav Kryukov & Mark Satterthwaite, 2007. "Learning-by-Doing, Organizational Forgetting, and Industry Dynamics," Levine's Bibliography 321307000000000903, UCLA Department of Economics.
- David Besanko & Ulrich Doraszelski, 2005. "Learning-by-Doing, Organizational Forgetting, and Industry Dynanmics," Computing in Economics and Finance 2005 236, Society for Computational Economics.
- Pichler, Paul, 2011. "Solving the multi-country Real Business Cycle model using a monomial rule Galerkin method," Journal of Economic Dynamics and Control, Elsevier, vol. 35(2), pages 240-251, February.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:fth:harver:2059For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Thomas Krichel).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

