IDEAS home Printed from https://ideas.repec.org/p/pri/metric/wp005.pdf.html
   My bibliography  Save this paper

Recursive Methods in Discounted Stochastic Games: An Algorithm for ! ! 1 and a Folk Theorem

Author

Listed:
  • Johannes Horner

    (Yale University)

  • Takuo Sugaya

    (Princeton University)

  • Satoru Takahashi

    (Princeton University)

  • Nicolas Vieille

    (HEC Paris)

Abstract

We present an algorithm to compute the set of perfect public equilibrium payoffs as the discount factor tends to one for stochastic games with observable states and public (but not necessarily perfect) monitoring when the limiting set of (long-run players?) equilibrium payoffs is independent of the initial state. This is the case, for instance, if the Markov chain induced by any Markov strategy profile is irreducible. We then provide conditions under which a folk theorem obtains: if in each state the joint distribution over the public signal and next period?s state satisfies some rank condition, every feasible payoff vector above the minmax payoff is sustained by a perfect public equilibrium with low discounting.

Suggested Citation

  • Johannes Horner & Takuo Sugaya & Satoru Takahashi & Nicolas Vieille, 2010. "Recursive Methods in Discounted Stochastic Games: An Algorithm for ! ! 1 and a Folk Theorem," Working Papers 1264, Princeton University, Department of Economics, Econometric Research Program..
    • Handle: RePEc:pri:metric:wp005.pdf
    as

    Download full text from publisher

    File URL: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.221.4313&rep=rep1&type=pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mertens, J.-F. & Parthasarathy, T., 1987. "Equilibria for discounted stochastic games," LIDAM Discussion Papers CORE 1987050, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    2. Green, Edward J & Porter, Robert H, 1984. "Noncooperative Collusion under Imperfect Price Information," Econometrica, Econometric Society, vol. 52(1), pages 87-100, January.
    3. Drew Fudenberg & David K. Levine, 2008. "Efficiency and Observability with Long-Run and Short-Run Players," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 13, pages 275-307, World Scientific Publishing Co. Pte. Ltd..
    4. Drew Fudenberg & David Levine & Eric Maskin, 2008. "The Folk Theorem With Imperfect Public Information," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 12, pages 231-273, World Scientific Publishing Co. Pte. Ltd..
    5. Drew Fudenberg & Eric Maskin, 2008. "The Folk Theorem In Repeated Games With Discounting Or With Incomplete Information," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 11, pages 209-230, World Scientific Publishing Co. Pte. Ltd..
    6. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," Review of Economic Studies, Oxford University Press, vol. 62(1), pages 53-82.
    7. Dutta Prajit K., 1995. "A Folk Theorem for Stochastic Games," Journal of Economic Theory, Elsevier, vol. 66(1), pages 1-32, June.
    8. Yoon, Kiho, 2001. "A Folk Theorem for Asynchronously Repeated Games," Econometrica, Econometric Society, vol. 69(1), pages 191-200, January.
    9. Christopher Phelan & Ennio Stacchetti, 2001. "Sequential Equilibria in a Ramsey Tax Model," Econometrica, Econometric Society, vol. 69(6), pages 1491-1518, November.
    10. Rotemberg, Julio J & Saloner, Garth, 1986. "A Supergame-Theoretic Model of Price Wars during Booms," American Economic Review, American Economic Association, vol. 76(3), pages 390-407, June.
    11. Roy Radner & Roger Myerson & Eric Maskin, 1986. "An Example of a Repeated Partnership Game with Discounting and with Uniformly Inefficient Equilibria," Review of Economic Studies, Oxford University Press, vol. 53(1), pages 59-69.
    12. Phelan, Christopher, 2006. "Public trust and government betrayal," Journal of Economic Theory, Elsevier, vol. 130(1), pages 27-43, September.
    13. Mertens, J.-F. & Parthasarathy, T., 1991. "Nonzero-sum stochastic games," LIDAM Reprints CORE 912, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    14. Mailath, George J. & Samuelson, Larry, 2006. "Repeated Games and Reputations: Long-Run Relationships," OUP Catalogue, Oxford University Press, number 9780195300796, Decembrie.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Barlo, Mehmet & Urgun, Can, 2011. "Stochastic discounting in repeated games: Awaiting the almost inevitable," MPRA Paper 28537, University Library of Munich, Germany.
    2. Escobar, Juan F. & Llanes, Gastón, 2018. "Cooperation dynamics in repeated games of adverse selection," Journal of Economic Theory, Elsevier, vol. 176(C), pages 408-443.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Johannes Horner & Takuo Sugaya & Satoru Takahashi & Nicolas Vieille, 2009. "Recursive Methods in Discounted Stochastic Games: An Algorithm for delta Approaching 1 and a Folk Theorem," Cowles Foundation Discussion Papers 1742, Cowles Foundation for Research in Economics, Yale University, revised Aug 2010.
    2. Escobar, Juan F. & Llanes, Gastón, 2018. "Cooperation dynamics in repeated games of adverse selection," Journal of Economic Theory, Elsevier, vol. 176(C), pages 408-443.
    3. Osório-Costa, António M., 2009. "Efficiency Gains in Repeated Games at Random Moments in Time," MPRA Paper 13105, University Library of Munich, Germany.
    4. Laclau, Marie & Tomala, Tristan, 2017. "Repeated games with public deterministic monitoring," Journal of Economic Theory, Elsevier, vol. 169(C), pages 400-424.
    5. Abito, Jose Miguel & Chen, Cuicui, 2023. "A partial identification framework for dynamic games," International Journal of Industrial Organization, Elsevier, vol. 87(C).
    6. Miyagawa, Eiichi & Miyahara, Yasuyuki & Sekiguchi, Tadashi, 2008. "The folk theorem for repeated games with observation costs," Journal of Economic Theory, Elsevier, vol. 139(1), pages 192-221, March.
    7. Marie Laclau & Tristan Tomala, 2016. "Repeated games with public information revisited," PSE Working Papers hal-01285326, HAL.
    8. Wilson, Alistair J. & Wu, Hong, 2017. "At-will relationships: How an option to walk away affects cooperation and efficiency," Games and Economic Behavior, Elsevier, vol. 102(C), pages 487-507.
    9. Laclau, M., 2014. "Communication in repeated network games with imperfect monitoring," Games and Economic Behavior, Elsevier, vol. 87(C), pages 136-160.
    10. Sugaya, Takuo & Wolitzky, Alexander, 2017. "Bounding equilibrium payoffs in repeated games with private monitoring," Theoretical Economics, Econometric Society, vol. 12(2), May.
    11. Alistair Wilson & Hong Wu, 2014. "Dissolution of Partnerships in Infinitely Repeated Games," Working Paper 532, Department of Economics, University of Pittsburgh, revised Aug 2014.
    12. Kaplow, Louis & Shapiro, Carl, 2007. "Antitrust," Handbook of Law and Economics, in: A. Mitchell Polinsky & Steven Shavell (ed.), Handbook of Law and Economics, edition 1, volume 2, chapter 15, pages 1073-1225, Elsevier.
    13. , H. & ,, 2016. "Approximate efficiency in repeated games with side-payments and correlated signals," Theoretical Economics, Econometric Society, vol. 11(1), January.
    14. Contou-Carrère, Pauline & Tomala, Tristan, 2011. "Finitely repeated games with semi-standard monitoring," Journal of Mathematical Economics, Elsevier, vol. 47(1), pages 14-21, January.
    15. Fudenberg, Drew & Yamamoto, Yuichi, 2011. "Learning from private information in noisy repeated games," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1733-1769, September.
    16. Yutaka Kayaba & Hitoshi Matsushima & Tomohisa Toyama, 2017. "Accuracy and Retaliation in Repeated Games with Imperfect Private Monitoring: Experiments and Theory (Revised version of F-381)," CARF F-Series CARF-F-414, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    17. Chaim Fershtman & Ariel Pakes, 2000. "A Dynamic Oligopoly with Collusion and Price Wars," RAND Journal of Economics, The RAND Corporation, vol. 31(2), pages 207-236, Summer.
    18. Yamamoto, Yuichi, 2009. "A limit characterization of belief-free equilibrium payoffs in repeated games," Journal of Economic Theory, Elsevier, vol. 144(2), pages 802-824, March.
    19. Kimmo Berg, 2016. "Elementary Subpaths in Discounted Stochastic Games," Dynamic Games and Applications, Springer, vol. 6(3), pages 304-323, September.
    20. Spagnolo, Giancarlo, 2002. "Globalization and Cooperative Relations," CEPR Discussion Papers 3522, C.E.P.R. Discussion Papers.

    More about this item

    Keywords

    stochastic games;

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pri:metric:wp005.pdf. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bobray Bordelon (email available below). General contact details of provider: https://edirc.repec.org/data/exprius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.