IDEAS home Printed from https://ideas.repec.org/a/kap/qmktec/v17y2019i1d10.1007_s11129-018-9200-x.html
   My bibliography  Save this article

Dynamic stochastic games with random moves

Author

Listed:
  • Ulrich Doraszelski

    () (University of Pennsylvania)

  • Kenneth L. Judd

    () (Stanford University)

Abstract

Abstract We reformulate the quality ladder model of Pakes and McGuire, Rand Journal of Economics, 25(4), 555–589 (1994) as a dynamic stochastic game with random moves in which each period one firm is picked at random to make an investment decision. Contrasting this model to the standard version with simultaneous moves illustrates the computational advantages of random moves. In particular, the quality ladder model with random moves avoids the curse of dimensionality in computing firms’ expectations over all possible future states and is therefore orders of magnitude faster to solve than its counterpart with simultaneous moves when there are more than just a few firms. Perhaps unexpectedly, the equilibria of the quality ladder model with random moves are practically indistinguishable from those of the model with simultaneous moves.

Suggested Citation

  • Ulrich Doraszelski & Kenneth L. Judd, 2019. "Dynamic stochastic games with random moves," Quantitative Marketing and Economics (QME), Springer, vol. 17(1), pages 59-79, March.
  • Handle: RePEc:kap:qmktec:v:17:y:2019:i:1:d:10.1007_s11129-018-9200-x
    DOI: 10.1007/s11129-018-9200-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11129-018-9200-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Maskin, Eric & Tirole, Jean, 1987. "A theory of dynamic oligopoly, III : Cournot competition," European Economic Review, Elsevier, vol. 31(4), pages 947-968, June.
    2. Sridhar Narayanan & Puneet Manchanda, 2009. "Heterogeneous Learning and the Targeting of Marketing Communication for New Products," Marketing Science, INFORMS, vol. 28(3), pages 424-441, 05-06.
    3. David Besanko & Ulrich Doraszelski, 2004. "Capacity Dynamics and Endogenous Asymmetries in Firm Size," RAND Journal of Economics, The RAND Corporation, vol. 35(1), pages 23-49, Spring.
    4. Ariel Pakes & Paul McGuire, 1994. "Computing Markov-Perfect Nash Equilibria: Numerical Implications of a Dynamic Differentiated Product Model," RAND Journal of Economics, The RAND Corporation, vol. 25(4), pages 555-589, Winter.
    5. Ulrich Doraszelski & Mark Satterthwaite, 2010. "Computable Markov-perfect industry dynamics," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 215-243.
    6. Markovich, Sarit & Moenius, Johannes, 2009. "Winning while losing: Competition dynamics in the presence of indirect network effects," International Journal of Industrial Organization, Elsevier, vol. 27(3), pages 346-357, May.
    7. Pakes, Ariel & McGuire, Paul, 2001. "Stochastic Algorithms, Symmetric Markov Perfect Equilibrium, and the 'Curse' of Dimensionality," Econometrica, Econometric Society, vol. 69(5), pages 1261-1281, September.
    8. repec:ucp:jpolec:doi:10.1086/691524 is not listed on IDEAS
    9. Ulrich Doraszelski & Sarit Markovich, 2007. "Advertising dynamics and competitive advantage," RAND Journal of Economics, RAND Corporation, vol. 38(3), pages 557-592, September.
    10. Ben Mermelstein & Volker Nocke & Mark A. Satterthwaite & Michael D. Whinston, 2014. "Internal versus External Growth in Industries with Scale Economies: A Computational Model of Optimal Merger Policy," NBER Working Papers 20051, National Bureau of Economic Research, Inc.
    11. Peter Arcidiacono & Patrick Bayer & Jason R. Blevins & Paul B. Ellickson, 2016. "Estimation of Dynamic Discrete Choice Models in Continuous Time with an Application to Retail Competition," Review of Economic Studies, Oxford University Press, vol. 83(3), pages 889-931.
    12. Ronald L. Goettler & Brett R. Gordon, 2011. "Does AMD Spur Intel to Innovate More?," Journal of Political Economy, University of Chicago Press, vol. 119(6), pages 1141-1200.
    13. Christopher Harris & John Vickers, 1987. "Racing with Uncertainty," Review of Economic Studies, Oxford University Press, vol. 54(1), pages 1-21.
    14. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," Review of Economic Studies, Oxford University Press, vol. 62(1), pages 53-82.
    15. Maskin, Eric & Tirole, Jean, 1988. "A Theory of Dynamic Oligopoly, II: Price Competition, Kinked Demand Curves, and Edgeworth Cycles," Econometrica, Econometric Society, vol. 56(3), pages 571-599, May.
    16. Jiawei Chen & Ulrich Doraszelski & Joseph E. Harrington, Jr., 2009. "Avoiding market dominance: product compatibility in markets with network effects," RAND Journal of Economics, RAND Corporation, vol. 40(3), pages 455-485.
    17. Maskin, Eric & Tirole, Jean, 1988. "A Theory of Dynamic Oligopoly, I: Overview and Quantity Competition with Large Fixed Costs," Econometrica, Econometric Society, vol. 56(3), pages 549-569, May.
    18. Markovich, Sarit, 2008. "Snowball: A dynamic oligopoly model with indirect network effects," Journal of Economic Dynamics and Control, Elsevier, vol. 32(3), pages 909-938, March.
    19. C. Lanier Benkard, 2004. "A Dynamic Analysis of the Market for Wide-Bodied Commercial Aircraft," Review of Economic Studies, Oxford University Press, vol. 71(3), pages 581-611.
    20. Caplin, Andrew & Nalebuff, Barry, 1991. "Aggregation and Imperfect Competition: On the Existence of Equilibrium," Econometrica, Econometric Society, vol. 59(1), pages 25-59, January.
    21. repec:aea:aejmic:v:10:y:2018:i:1:p:67-101 is not listed on IDEAS
    22. Ron Borkovsky & Ulrich Doraszelski & Yaroslav Kryukov, 2012. "A dynamic quality ladder model with entry and exit: Exploring the equilibrium correspondence using the homotopy method," Quantitative Marketing and Economics (QME), Springer, vol. 10(2), pages 197-229, June.
    23. Fudenberg, Drew & Gilbert, Richard & Stiglitz, Joseph & Tirole, Jean, 1983. "Preemption, leapfrogging and competition in patent races," European Economic Review, Elsevier, vol. 22(1), pages 3-31, June.
    24. repec:wly:iecrev:v:59:y:2018:i:4:p:1681-1731 is not listed on IDEAS
    25. repec:kap:qmktec:v:15:y:2017:i:3:d:10.1007_s11129-017-9186-9 is not listed on IDEAS
    26. Minjae Song, 2011. "A Dynamic Analysis Of Cooperative Research In The Semiconductor Industry," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 52(4), pages 1157-1177, November.
    27. David Besanko & Ulrich Doraszelski & Lauren Xiaoyuan Lu & Mark Satterthwaite, 2010. "Lumpy Capacity Investment and Disinvestment Dynamics," Operations Research, INFORMS, vol. 58(4-part-2), pages 1178-1193, August.
    28. Jean-Pierre Dubé & Günter Hitsch & Puneet Manchanda, 2005. "An Empirical Model of Advertising Dynamics," Quantitative Marketing and Economics (QME), Springer, vol. 3(2), pages 107-144, June.
    29. Fedor Iskhakov & John Rust & Bertel Schjerning, 2018. "The Dynamics Of Bertrand Price Competition With Cost‐Reducing Investments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(4), pages 1681-1731, November.
    30. Gautam Gowrisankaran & Thomas J. Holmes, 2004. "Mergers and the Evolution of Industry Concentration: Results from the Dominant-Firm Model," RAND Journal of Economics, The RAND Corporation, vol. 35(3), pages 561-582, Autumn.
    31. R. M. Cyert & M. H. DeGroot, 1970. "Multiperiod Decision Models with Alternating Choice as a Solution to the Duopoly Problem," The Quarterly Journal of Economics, Oxford University Press, vol. 84(3), pages 410-429.
    32. Gautam Gowrisankaran, 1999. "A Dynamic Model of Endogenous Horizonal Mergers," RAND Journal of Economics, The RAND Corporation, vol. 30(1), pages 56-83, Spring.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    Dynamic stochastic games; Markov perfect equilibrium; Curse of dimensionality; Protocol of moves;

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • L13 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Oligopoly and Other Imperfect Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:qmktec:v:17:y:2019:i:1:d:10.1007_s11129-018-9200-x. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla) or (Mallaigh Nolan). General contact details of provider: http://www.springer.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.