IDEAS home Printed from https://ideas.repec.org/a/eee/jetheo/v150y2014icp815-840.html
   My bibliography  Save this article

A constructive study of Markov equilibria in stochastic games with strategic complementarities

Author

Listed:
  • Balbus, Łukasz
  • Reffett, Kevin
  • Woźny, Łukasz

Abstract

We study a class of infinite horizon, discounted stochastic games with strategic complementarities. In our class of games, we prove the existence of a stationary Markov Nash equilibrium, as well as provide methods for constructing this least and greatest equilibrium via a simple successive approximation schemes. We also provide results on computable equilibrium comparative statics relative to ordered perturbations of the space of games. Under stronger assumptions, we prove the stationary Markov Nash equilibrium values form a complete lattice, with least and greatest equilibrium value functions being the uniform limit of approximations starting from pointwise lower and upper bounds.

Suggested Citation

  • Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2014. "A constructive study of Markov equilibria in stochastic games with strategic complementarities," Journal of Economic Theory, Elsevier, vol. 150(C), pages 815-840.
  • Handle: RePEc:eee:jetheo:v:150:y:2014:i:c:p:815-840
    DOI: 10.1016/j.jet.2013.09.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0022053113001506
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ariel Pakes & Michael Ostrovsky & Steven Berry, 2007. "Simple estimators for the parameters of discrete dynamic games (with entry/exit examples)," RAND Journal of Economics, RAND Corporation, vol. 38(2), pages 373-399, June.
    2. Mark Huggett, 2003. "When Are Comparative Dynamics Monotone?," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 6(1), pages 1-11, January.
    3. Kamihigashi, Takashi & Stachurski, John, 2014. "Stochastic stability in monotone economies," Theoretical Economics, Econometric Society, vol. 9(2), May.
    4. Chakrabarti, Subir K., 1999. "Markov Equilibria in Discounted Stochastic Games," Journal of Economic Theory, Elsevier, vol. 85(2), pages 294-327, April.
    5. repec:spr:compst:v:66:y:2007:i:3:p:513-530 is not listed on IDEAS
    6. Herings, P. Jean-Jacques & Peeters, Ronald J. A. P., 2004. "Stationary equilibria in stochastic games: structure, selection, and computation," Journal of Economic Theory, Elsevier, vol. 118(1), pages 32-60, September.
    7. Echenique, Federico, 2004. "Extensive-form games and strategic complementarities," Games and Economic Behavior, Elsevier, vol. 46(2), pages 348-364, February.
    8. John Duggan, 2012. "Noisy Stochastic Games," Econometrica, Econometric Society, vol. 80(5), pages 2017-2045, September.
    9. Lagunoff, Roger, 2009. "Dynamic stability and reform of political institutions," Games and Economic Behavior, Elsevier, vol. 67(2), pages 569-583, November.
    10. Duggan, John & Kalandrakis, Tasos, 2012. "Dynamic legislative policy making," Journal of Economic Theory, Elsevier, vol. 147(5), pages 1653-1688.
    11. Yehuda (John) Levy, 2012. "A Discounted Stochastic Game with No Stationary Equilibria: The Case of Absolutely Continuous Transitions," Discussion Paper Series dp612, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    12. Vives, Xavier, 1990. "Nash equilibrium with strategic complementarities," Journal of Mathematical Economics, Elsevier, vol. 19(3), pages 305-321.
    13. Atkeson, Andrew, 1991. "International Lending with Moral Hazard and Risk of Repudiation," Econometrica, Econometric Society, vol. 59(4), pages 1069-1089, July.
    14. Harris, Christopher & Laibson, David, 2001. "Dynamic Choices of Hyperbolic Consumers," Econometrica, Econometric Society, vol. 69(4), pages 935-957, July.
    15. Abreu, Dilip & Pearce, David & Stacchetti, Ennio, 1990. "Toward a Theory of Discounted Repeated Games with Imperfect Monitoring," Econometrica, Econometric Society, vol. 58(5), pages 1041-1063, September.
    16. Amir, Rabah, 1996. "Sensitivity analysis of multisector optimal economic dynamics," Journal of Mathematical Economics, Elsevier, vol. 25(1), pages 123-141.
    17. Amir, Rabah, 1996. "Continuous Stochastic Games of Capital Accumulation with Convex Transitions," Games and Economic Behavior, Elsevier, vol. 15(2), pages 111-131, August.
    18. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2012. "Stationary Markovian equilibrium in altruistic stochastic OLG models with limited commitment," Journal of Mathematical Economics, Elsevier, vol. 48(2), pages 115-132.
    19. Stokey, Nancy L., 1991. "Credible public policy," Journal of Economic Dynamics and Control, Elsevier, vol. 15(4), pages 627-656, October.
    20. Milgrom, Paul & Roberts, John, 1990. "Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities," Econometrica, Econometric Society, vol. 58(6), pages 1255-1277, November.
    21. Milgrom, Paul & Roberts, John, 1994. "Comparing Equilibria," American Economic Review, American Economic Association, vol. 84(3), pages 441-459, June.
    22. Cabral, Luis M B & Riordan, Michael H, 1994. "The Learning Curve, Market Dominance, and Predatory Pricing," Econometrica, Econometric Society, vol. 62(5), pages 1115-1140, September.
    23. Victor Aguirregabiria & Pedro Mira, 2007. "Sequential Estimation of Dynamic Discrete Games," Econometrica, Econometric Society, vol. 75(1), pages 1-53, January.
    24. Curtat, Laurent O., 1996. "Markov Equilibria of Stochastic Games with Complementarities," Games and Economic Behavior, Elsevier, vol. 17(2), pages 177-199, December.
    25. John Duggan, 2012. "Noisy Stochastic Games," RCER Working Papers 570, University of Rochester - Center for Economic Research (RCER).
    26. Christopher Phelan & Ennio Stacchetti, 2001. "Sequential Equilibria in a Ramsey Tax Model," Econometrica, Econometric Society, vol. 69(6), pages 1491-1518, November.
    27. Martin Pesendorfer & Philipp Schmidt-Dengler, 2008. "Asymptotic Least Squares Estimators for Dynamic Games -super-1," Review of Economic Studies, Oxford University Press, vol. 75(3), pages 901-928.
    28. repec:spr:compst:v:60:y:2004:i:2:p:267-277 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maria Arvaniti & Chandra K. Krishnamurthy & Anne-Sophie Crépin, 2019. "Time-consistent resource management with regime shifts," CER-ETH Economics working paper series 19/329, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    2. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2018. "On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty," Journal of Economic Theory, Elsevier, vol. 176(C), pages 293-310.
    3. Takashi Kamihigashi & Kevin Reffett & Masayuki Yao, 2014. "An Application of Kleene's Fixed Point Theorem to Dynamic Programming: A Note," Working Papers 2014-398, Department of Research, Ipag Business School.
    4. Christopher Sleet & Şevin Yeltekin, 2016. "On the Computation of Value Correspondences for Dynamic Games," Dynamic Games and Applications, Springer, vol. 6(2), pages 174-186, June.
    5. Anne-Christine Barthel & Tarun Sabarwal, 2018. "Directional monotone comparative statics," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(3), pages 557-591, October.
    6. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2015. "Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(1), pages 83-112, February.
    7. Kimmo Berg, 2016. "Elementary Subpaths in Discounted Stochastic Games," Dynamic Games and Applications, Springer, vol. 6(3), pages 304-323, September.
    8. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    9. Łukasz Balbus & Łukasz Woźny, 2016. "A Strategic Dynamic Programming Method for Studying Short-Memory Equilibria of Stochastic Games with Uncountable Number of States," Dynamic Games and Applications, Springer, vol. 6(2), pages 187-208, June.
    10. repec:kan:wpaper:201502 is not listed on IDEAS
    11. Yue Feng & Tarun Sabarwal, 2018. "Strategic Complements in Two Stage, 2 × 2 Games," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201801, University of Kansas, Department of Economics.
    12. Feng, Yue & Sabarwal, Tarun, 2016. "Strategic complements in two stage, 2x2 games," MPRA Paper 99483, University Library of Munich, Germany, revised 05 Apr 2020.
    13. Dianetti, Jodi & Ferrari, Giorgio, 2019. "Nonzero-Sum Submodular Monotone-Follower Games. Existence and Approximation of Nash Equilibria," Center for Mathematical Economics Working Papers 605, Center for Mathematical Economics, Bielefeld University.
    14. Pawel Dziewulski & John Quah, 2016. "Supermodular value functions and supermodular correspondences," Economics Series Working Papers 795, University of Oxford, Department of Economics.
    15. Piotr Więcek, 2017. "Total Reward Semi-Markov Mean-Field Games with Complementarity Properties," Dynamic Games and Applications, Springer, vol. 7(3), pages 507-529, September.
    16. Yue Feng & Tarun Sabarwal, 2020. "Dynamic strategic complements in two stage, 2x2 games," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202006, University of Kansas, Department of Economics.
    17. Pawel Dziewulski & John K. H. Quah, 2019. "Supermodular correspondences and comparison of multi-prior beliefs," Working Paper Series 0619, Department of Economics, University of Sussex Business School.
    18. Shadmehr, Mehdi & Bernhardt, Dan, 2017. "Monotone and bounded interval equilibria in a coordination game with information aggregation," Mathematical Social Sciences, Elsevier, vol. 89(C), pages 61-69.
    19. Bar Light, 2019. "Stochastic Comparative Statics in Markov Decision Processes," Papers 1904.05481, arXiv.org, revised Jan 2020.

    More about this item

    Keywords

    Markov equilibria; Stochastic games; Constructive methods;

    JEL classification:

    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jetheo:v:150:y:2014:i:c:p:815-840. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Haili He). General contact details of provider: http://www.elsevier.com/locate/inca/622869 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.