IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/118865.html
   My bibliography  Save this paper

Discounted stochastic games, the 3M property and stationary Markov perfect equilibria

Author

Listed:
  • Fu, Jing
  • Page, Frank

Abstract

We show that all discounted stochastic games DSGs satisfying the usual assumptions have Nash payoff selection correspondences having fixed points. Our fixed point result is surprising because it is well known that Nash payoff selection correspondences are badly behaved, being in general neither convex valued nor closed valued in the appropriate topologies (in this case the weak star topologies). Here we show that because all DSGs satisfying the usual assumptions have upper Caratheodory (uC) Nash (equilibrium) correspondences containing uC Nash sub-correspondences having the 3M property (defined here), these uC Nash sub-correspondences are continuum valued and therefore induce interval-valued uC player payoff sub-correspondences - and therefore, Caratheodory approximable uC player payoff sub-correspondences. Finally, because these uC player payoff sub-correspondences are Caratheodory approximable, their induced Nash payoff selection sub-correspondences have fixed points - implying that the DSGs to which they belong have stationary Markov perfect equilibria.

Suggested Citation

  • Fu, Jing & Page, Frank, 2022. "Discounted stochastic games, the 3M property and stationary Markov perfect equilibria," LSE Research Online Documents on Economics 118865, London School of Economics and Political Science, LSE Library.
    • Handle: RePEc:ehl:lserod:118865
    as

    Download full text from publisher

    File URL: http://eprints.lse.ac.uk/118865/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Anna Jaśkiewicz & Andrzej S. Nowak, 2016. "Stationary Almost Markov Perfect Equilibria in Discounted Stochastic Games," Mathematics of Operations Research, INFORMS, vol. 41(2), pages 430-441, May.
    2. He, Wei & Sun, Yeneng, 2017. "Stationary Markov perfect equilibria in discounted stochastic games," Journal of Economic Theory, Elsevier, vol. 169(C), pages 35-61.
    3. C. J. Himmelberg & T. Parthasarathy & F. S. VanVleck, 1976. "Optimal Plans for Dynamic Programming Problems," Mathematics of Operations Research, INFORMS, vol. 1(4), pages 390-394, November.
    4. Wei He & Yeneng Sun, 2013. "Stationary Markov Perfect Equilibria in Discounted Stochastic Games," Papers 1311.1562, arXiv.org, revised Jan 2017.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Subir K. Chakrabarti, 2021. "Stationary equilibrium in stochastic dynamic models: Semi-Markov strategies," Economic Theory Bulletin, Springer;Society for the Advancement of Economic Theory (SAET), vol. 9(2), pages 177-194, October.
    2. Jing Fu & Frank Page & Jean-Pierre Zigrand, 2023. "Correction to: Layered Networks, Equilibrium Dynamics, and Stable Coalitions," Dynamic Games and Applications, Springer, vol. 13(2), pages 669-704, June.
    3. Jing Fu & Frank Page & Jean-Pierre Zigrand, 2023. "Layered Networks, Equilibrium Dynamics, and Stable Coalitions," Dynamic Games and Applications, Springer, vol. 13(2), pages 636-668, June.
    4. Fu, Jing & Page, Frank & Zigrand, Jean-Pierre, 2022. "Layered networks, equilibrium dynamics, and stable coalitions," LSE Research Online Documents on Economics 118874, London School of Economics and Political Science, LSE Library.
    5. Light, Bar & Weintraub, Gabriel, 2018. "Mean Field Equilibrium: Uniqueness, Existence, and Comparative Statics," Research Papers 3731, Stanford University, Graduate School of Business.
    6. Damián Pierri, 2023. "Simulations in Models with Heterogeneous Agents, Incomplete Markets and Aggregate Uncertainty," Working Papers 259, Red Nacional de Investigadores en Economía (RedNIE).
    7. Hülya Eraslan & Kirill S. Evdokimov & Jan Zápal, 2022. "Dynamic Legislative Bargaining," Springer Books, in: Emin Karagözoğlu & Kyle B. Hyndman (ed.), Bargaining, chapter 0, pages 151-175, Springer.
    8. Jie Ning, 2021. "Reducible Markov Decision Processes and Stochastic Games," Production and Operations Management, Production and Operations Management Society, vol. 30(8), pages 2726-2751, August.
    9. Chuangyin Dang & P. Jean-Jacques Herings & Peixuan Li, 2022. "An Interior-Point Differentiable Path-Following Method to Compute Stationary Equilibria in Stochastic Games," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1403-1418, May.
    10. Jenkins, Mark & Liu, Paul & Matzkin, Rosa L. & McFadden, Daniel L., 2021. "The browser war — Analysis of Markov Perfect Equilibrium in markets with dynamic demand effects," Journal of Econometrics, Elsevier, vol. 222(1), pages 244-260.
    11. Wei He & Yeneng Sun, 2018. "Conditional expectation of correspondences and economic applications," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 66(2), pages 265-299, August.
    12. Cao, Dan, 2020. "Recursive equilibrium in Krusell and Smith (1998)," Journal of Economic Theory, Elsevier, vol. 186(C).
    13. Dang, Chuangyin & Herings, P. Jean-Jacques & Li, Peixuan, 2020. "An Interior-Point Path-Following Method to Compute Stationary Equilibria in Stochastic Games," Research Memorandum 001, Maastricht University, Graduate School of Business and Economics (GSBE).
    14. He, Wei & Sun, Yeneng, 2020. "Dynamic games with (almost) perfect information," Theoretical Economics, Econometric Society, vol. 15(2), May.
    15. David González-Sánchez & Fernando Luque-Vásquez & J. Adolfo Minjárez-Sosa, 2019. "Zero-Sum Markov Games with Random State-Actions-Dependent Discount Factors: Existence of Optimal Strategies," Dynamic Games and Applications, Springer, vol. 9(1), pages 103-121, March.
    16. Anna Jaśkiewicz & Andrzej S. Nowak, 2021. "Markov decision processes with quasi-hyperbolic discounting," Finance and Stochastics, Springer, vol. 25(2), pages 189-229, April.
    17. Wei He, 2022. "Discontinuous stochastic games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(4), pages 827-858, June.
    18. Frank H. Page & Myrna H. Wooders, 2009. "Endogenous Network Dynamics," Working Papers 2009.28, Fondazione Eni Enrico Mattei.
    19. Page, Frank Jr. & Monteiro, Paulo K., 2003. "Three principles of competitive nonlinear pricing," Journal of Mathematical Economics, Elsevier, vol. 39(1-2), pages 63-109, February.
    20. Levy, Yehuda, 2012. "Stochastic games with information lag," Games and Economic Behavior, Elsevier, vol. 74(1), pages 243-256.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:118865. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.