IDEAS home Printed from https://ideas.repec.org/p/pen/papers/13-038.html
   My bibliography  Save this paper

Individual Learning and Cooperation in Noisy Repeated Games

Author

Listed:
  • Yuichi Yamamoto

    (Department of Economics, University of Pennsylvania)

Abstract

We investigate whether two players in a long-run relationship can maintain cooperation when the details of the underlying game are unknown. Specifically, we consider a new class of repeated games with private monitoring, where an unobservable state of the world influences the payoff functions and/or the monitoring structure. Each player privately learns the state over time but cannot observe what the opponent learned. We show that there are robust equilibria in which players eventually obtain payoffs as if the true state were common knowledge and players played a “belief-free†equilibrium. We also provide explicit equilibrium constructions in various economic examples

Suggested Citation

  • Yuichi Yamamoto, 2013. "Individual Learning and Cooperation in Noisy Repeated Games," PIER Working Paper Archive 13-038, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  • Handle: RePEc:pen:papers:13-038
    as

    Download full text from publisher

    File URL: https://economics.sas.upenn.edu/sites/default/files/filevault/13-038.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Johannes Hörner & Stefano Lovo, 2009. "Belief-Free Equilibria in Games With Incomplete Information," Econometrica, Econometric Society, vol. 77(2), pages 453-487, March.
    2. Yamamoto, Yuichi, 2009. "A limit characterization of belief-free equilibrium payoffs in repeated games," Journal of Economic Theory, Elsevier, vol. 144(2), pages 802-824, March.
    3. Drew Fudenberg & David K. Levine & Satoru Takahashi, 2008. "Perfect public equilibrium when players are patient," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 16, pages 345-367, World Scientific Publishing Co. Pte. Ltd..
    4. Joseph E. Harrington & Andrzej Skrzypacz, 2011. "Private Monitoring and Communication in Cartels: Explaining Recent Collusive Practices," American Economic Review, American Economic Association, vol. 101(6), pages 2425-2449, October.
    5. Drew Fudenberg & David Levine & Eric Maskin, 2008. "The Folk Theorem With Imperfect Public Information," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 12, pages 231-273, World Scientific Publishing Co. Pte. Ltd..
    6. Johannes Hörner & Wojciech Olszewski, 2009. "How Robust is the Folk Theorem?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(4), pages 1773-1814.
    7. Johannes Hörner & Wojciech Olszewski, 2006. "The Folk Theorem for Games with Private Almost-Perfect Monitoring," Econometrica, Econometric Society, vol. 74(6), pages 1499-1544, November.
    8. Sylvain Chassang, 2010. "Building Routines: Learning, Cooperation, and the Dynamics of Incomplete Relational Contracts," American Economic Review, American Economic Association, vol. 100(1), pages 448-465, March.
    9. Sekiguchi, Tadashi, 1997. "Efficiency in Repeated Prisoner's Dilemma with Private Monitoring," Journal of Economic Theory, Elsevier, vol. 76(2), pages 345-361, October.
    10. , J. & ,, 2006. "Coordination failure in repeated games with almost-public monitoring," Theoretical Economics, Econometric Society, vol. 1(3), pages 311-340, September.
    11. Jeffrey C. Ely & Johannes Hörner & Wojciech Olszewski, 2005. "Belief-Free Equilibria in Repeated Games," Econometrica, Econometric Society, vol. 73(2), pages 377-415, March.
    12. SORIN, Sylvain, 1984. "'Big match' with lack of information on one side (part 1)," LIDAM Reprints CORE 601, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    13. Michihiro Kandori & Ichiro Obara, 2006. "Efficiency in Repeated Games Revisited: The Role of Private Strategies," Econometrica, Econometric Society, vol. 74(2), pages 499-519, March.
    14. Mailath, George J. & Morris, Stephen, 2002. "Repeated Games with Almost-Public Monitoring," Journal of Economic Theory, Elsevier, vol. 102(1), pages 189-228, January.
    15. Mailath, George J. & Olszewski, Wojciech, 2011. "Folk theorems with bounded recall under (almost) perfect monitoring," Games and Economic Behavior, Elsevier, vol. 71(1), pages 174-192, January.
    16. Rotemberg, Julio J & Saloner, Garth, 1986. "A Supergame-Theoretic Model of Price Wars during Booms," American Economic Review, American Economic Association, vol. 76(3), pages 390-407, June.
    17. Kandori, Michihiro, 2002. "Introduction to Repeated Games with Private Monitoring," Journal of Economic Theory, Elsevier, vol. 102(1), pages 1-15, January.
    18. Gossner, Olivier & Vieille, Nicolas, 2003. "Strategic learning in games with symmetric information," Games and Economic Behavior, Elsevier, vol. 42(1), pages 25-47, January.
    19. Dekel, Eddie & Fudenberg, Drew & Levine, David K., 2004. "Learning to play Bayesian games," Games and Economic Behavior, Elsevier, vol. 46(2), pages 282-303, February.
    20. Hörner, Johannes & Lovo, Stefano & Tomala, Tristan, 2011. "Belief-free equilibria in games with incomplete information: Characterization and existence," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1770-1795, September.
    21. repec:ebl:ecbull:v:3:y:2007:i:58:p:1-16 is not listed on IDEAS
    22. ,, 2012. "A partial folk theorem for games with private learning," Theoretical Economics, Econometric Society, vol. 7(2), May.
    23. Hitoshi Matsushima, 2004. "Repeated Games with Private Monitoring: Two Players," Econometrica, Econometric Society, vol. 72(3), pages 823-852, May.
    24. Takahashi, Satoru, 2010. "Community enforcement when players observe partners' past play," Journal of Economic Theory, Elsevier, vol. 145(1), pages 42-62, January.
    25. Shalev Jonathan, 1994. "Nonzero-Sum Two-Person Repeated Games with Incomplete Information and Known-Own Payoffs," Games and Economic Behavior, Elsevier, vol. 7(2), pages 246-259, September.
    26. David A. Miller, 2012. "Robust Collusion with Private Information," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(2), pages 778-811.
    27. William Fuchs, 2007. "Contracting with Repeated Moral Hazard and Private Evaluations," American Economic Review, American Economic Association, vol. 97(4), pages 1432-1448, September.
    28. Bhaskar, V. & Obara, Ichiro, 2002. "Belief-Based Equilibria in the Repeated Prisoners' Dilemma with Private Monitoring," Journal of Economic Theory, Elsevier, vol. 102(1), pages 40-69, January.
    29. repec:dau:papers:123456789/6379 is not listed on IDEAS
    30. Drew Fudenberg & Yuichi Yamamoto, 2010. "Repeated Games Where the Payoffs and Monitoring Structure Are Unknown," Econometrica, Econometric Society, vol. 78(5), pages 1673-1710, September.
    31. Yamamoto, Yuichi, 2007. "Efficiency results in N player games with imperfect private monitoring," Journal of Economic Theory, Elsevier, vol. 135(1), pages 382-413, July.
    32. Robert J. Aumann, 1995. "Repeated Games with Incomplete Information," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262011476, December.
    33. Ely, Jeffrey C. & Valimaki, Juuso, 2002. "A Robust Folk Theorem for the Prisoner's Dilemma," Journal of Economic Theory, Elsevier, vol. 102(1), pages 84-105, January.
    34. Sergiu Hart, 1985. "Nonzero-Sum Two-Person Repeated Games with Incomplete Information," Mathematics of Operations Research, INFORMS, vol. 10(1), pages 117-153, February.
    35. Wojciech Olszewski, 2007. "A Simple Exposition of Belief-Free Equilibria in Repeated Games," Economics Bulletin, AccessEcon, vol. 3(58), pages 1-16.
    36. repec:dau:papers:123456789/9834 is not listed on IDEAS
    37. repec:cor:louvrp:-636 is not listed on IDEAS
    38. Jee-Hyeong Park, 2011. "Enforcing International Trade Agreements with Imperfect Private Monitoring," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(3), pages 1102-1134.
    39. Yuichi Yamamoto, 2012. "Characterizing Belief-Free Review-Strategy Equilibrium Payoffs under ConditionalIndependence," PIER Working Paper Archive 12-005, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    40. Piccione, Michele, 2002. "The Repeated Prisoner's Dilemma with Imperfect Private Monitoring," Journal of Economic Theory, Elsevier, vol. 102(1), pages 70-83, January.
    41. Lehrer, E, 1990. "Nash Equilibria of n-Player Repeated Games with Semi-standard Information," International Journal of Game Theory, Springer;Game Theory Society, vol. 19(2), pages 191-217.
    42. Yamamoto, Yuichi, 2012. "Characterizing belief-free review-strategy equilibrium payoffs under conditional independence," Journal of Economic Theory, Elsevier, vol. 147(5), pages 1998-2027.
    43. Mailath, George J. & Samuelson, Larry, 2006. "Repeated Games and Reputations: Long-Run Relationships," OUP Catalogue, Oxford University Press, number 9780195300796.
    44. Michihiro Kandori & Hitoshi Matsushima, 1998. "Private Observation, Communication and Collusion," Econometrica, Econometric Society, vol. 66(3), pages 627-652, May.
    45. Chen, Bo, 2010. "A belief-based approach to the repeated prisoners' dilemma with asymmetric private monitoring," Journal of Economic Theory, Elsevier, vol. 145(1), pages 402-420, January.
    46. Thomas Wiseman, 2005. "A Partial Folk Theorem for Games with Unknown Payoff Distributions," Econometrica, Econometric Society, vol. 73(2), pages 629-645, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Heller, Yuval, 2015. "Instability of Equilibria with Imperfect Private Monitoring," MPRA Paper 64468, University Library of Munich, Germany.
    2. repec:pra:mprapa:64485 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuichi Yamamoto, 2012. "Individual Learning and Cooperation in Noisy Repeated Games," PIER Working Paper Archive 12-044, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    2. Sugaya, Takuo & Yamamoto, Yuichi, 2020. "Common learning and cooperation in repeated games," Theoretical Economics, Econometric Society, vol. 15(3), July.
    3. Takuo Sugaya & Yuichi Yamamoto, 2019. "Common Learning and Cooperation in Repeated Games," PIER Working Paper Archive 19-008, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    4. Heller, Yuval, 2017. "Instability of belief-free equilibria," Journal of Economic Theory, Elsevier, vol. 168(C), pages 261-286.
    5. Heller, Yuval, 2015. "Instability of Equilibria with Imperfect Private Monitoring," MPRA Paper 64468, University Library of Munich, Germany.
    6. repec:pra:mprapa:64485 is not listed on IDEAS
    7. Yamamoto, Yuichi, 2012. "Characterizing belief-free review-strategy equilibrium payoffs under conditional independence," Journal of Economic Theory, Elsevier, vol. 147(5), pages 1998-2027.
    8. Chen, Bo, 2010. "A belief-based approach to the repeated prisoners' dilemma with asymmetric private monitoring," Journal of Economic Theory, Elsevier, vol. 145(1), pages 402-420, January.
    9. Fudenberg, Drew & Yamamoto, Yuichi, 2011. "Learning from private information in noisy repeated games," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1733-1769, September.
    10. Yamamoto, Yuichi, 2009. "A limit characterization of belief-free equilibrium payoffs in repeated games," Journal of Economic Theory, Elsevier, vol. 144(2), pages 802-824, March.
    11. , H. & ,, 2016. "Approximate efficiency in repeated games with side-payments and correlated signals," Theoretical Economics, Econometric Society, vol. 11(1), January.
    12. McLean, Richard & Obara, Ichiro & Postlewaite, Andrew, 2014. "Robustness of public equilibria in repeated games with private monitoring," Journal of Economic Theory, Elsevier, vol. 153(C), pages 191-212.
    13. Tristan Tomala, 2013. "Belief-Free Communication Equilibria in Repeated Games," Mathematics of Operations Research, INFORMS, vol. 38(4), pages 617-637, November.
    14. Hino, Yoshifumi, 2018. "A folk theorem in infinitely repeated prisoner's dilemma with small observation cost," MPRA Paper 90381, University Library of Munich, Germany.
    15. , J. & ,, 2006. "Coordination failure in repeated games with almost-public monitoring," Theoretical Economics, Econometric Society, vol. 1(3), pages 311-340, September.
    16. Sugaya, Takuo & Takahashi, Satoru, 2013. "Coordination failure in repeated games with private monitoring," Journal of Economic Theory, Elsevier, vol. 148(5), pages 1891-1928.
    17. Mailath, George J. & Olszewski, Wojciech, 2011. "Folk theorems with bounded recall under (almost) perfect monitoring," Games and Economic Behavior, Elsevier, vol. 71(1), pages 174-192, January.
    18. Jehiel, Philippe & Samuelson, Larry, 2023. "The analogical foundations of cooperation," Journal of Economic Theory, Elsevier, vol. 208(C).
    19. Yuichi Yamamoto, 2012. "Characterizing Belief-Free Review-Strategy Equilibrium Payoffs under ConditionalIndependence," PIER Working Paper Archive 12-005, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    20. Michihiro Kandori, 2011. "Weakly Belief‐Free Equilibria in Repeated Games With Private Monitoring," Econometrica, Econometric Society, vol. 79(3), pages 877-892, May.
    21. Hino, Yoshifumi, 2018. "A folk theorem in infinitely repeated prisoner's dilemma with small observation cost," MPRA Paper 96010, University Library of Munich, Germany, revised 13 Sep 2019.

    More about this item

    Keywords

    repeated game; private monitoring; incomplete information; belief-free equilibrium; ex-post equilibrium; individual learning;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pen:papers:13-038. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Administrator (email available below). General contact details of provider: https://edirc.repec.org/data/deupaus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.