IDEAS home Printed from https://ideas.repec.org/p/mib/wpaper/46.html
   My bibliography  Save this paper

Rational Learning in Imperfect Monitoring Games

Author

Listed:
  • Mario Gilli

    (Department of Economics, University of Milan-Bicocca)

Abstract

This paper provides a genera1 framework to analyze rational learning in strategic situations where the players have private information and update their private priors collecting data through optimal experimentation. The theory of statistica1 inference for stochastic processes and of Markovian dynamic programming is applied to study players asymptotic behavior in the context of repeated and recurring games, proving convergence towards Conjectural equilibria, an oyporturie generalization of Nash equilibria for this kind of strategic situations. Since the main bulk of the literature on rational learning regards convergence towards equilibria of repeated games, the main contribution of this paper is to argue for rational learning in recurring games, providing dynamic foundations for equilibria of the one-shot game. The analysis focuses on the problem of non stationary environment and on the problem of the correct specification of the stochastic law which regulates players' observations. In this way the paper shows both the limitations and the possibilities of rational learning models in game theory, in particular explaining when and why consistency rather than merging is the correct notion of learning in games.

Suggested Citation

  • Mario Gilli, 2002. "Rational Learning in Imperfect Monitoring Games," Working Papers 46, University of Milano-Bicocca, Department of Economics, revised Mar 2002.
  • Handle: RePEc:mib:wpaper:46
    as

    Download full text from publisher

    File URL: http://repec.dems.unimib.it/repec/pdf/mibwpaper46.pdf
    File Function: First version, 2002
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philippe Aghion & Patrick Bolton & Christopher Harris & Bruno Jullien, 1991. "Optimal Learning by Experimentation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(4), pages 621-654.
    2. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    3. Gilli, Mario, 1999. "On Non-Nash Equilibria," Games and Economic Behavior, Elsevier, vol. 27(2), pages 184-203, May.
    4. Jordan, J. S., 1991. "Bayesian learning in normal form games," Games and Economic Behavior, Elsevier, vol. 3(1), pages 60-81, February.
    5. Kalai, Ehud & Lehrer, Ehud, 1994. "Weak and strong merging of opinions," Journal of Mathematical Economics, Elsevier, vol. 23(1), pages 73-86, January.
    6. Fudenberg, Drew & Levine, David K, 1993. "Self-Confirming Equilibrium," Econometrica, Econometric Society, vol. 61(3), pages 523-545, May.
    7. Koutsougeras, Leonidas C & Yannelis, Nicholas C, 1994. "Convergence and Approximation Results for Non-cooperative Bayesian Games: Learning Theorems," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 4(6), pages 843-857, October.
    8. Kalai, Ehud & Lehrer, Ehud, 1993. "Rational Learning Leads to Nash Equilibrium," Econometrica, Econometric Society, vol. 61(5), pages 1019-1045, September.
    9. Kandori, Michihiro, 2002. "Introduction to Repeated Games with Private Monitoring," Journal of Economic Theory, Elsevier, vol. 102(1), pages 1-15, January.
    10. Mario Gilli, 1999. "Adaptive Learning in Imperfect Monitoring Games," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 2(2), pages 472-485, April.
    11. Dekel, Eddie & Fudenberg, Drew & Levine, David K., 2004. "Learning to play Bayesian games," Games and Economic Behavior, Elsevier, vol. 46(2), pages 282-303, February.
    12. Drew Fudenberg & David Levine, 2008. "Limit Games and Limit Equilibria," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 2, pages 21-39, World Scientific Publishing Co. Pte. Ltd..
    13. Fudenberg, Drew & Levine, David K, 1993. "Steady State Learning and Nash Equilibrium," Econometrica, Econometric Society, vol. 61(3), pages 547-573, May.
    14. Jackson, Matthew O. & Kalai, Ehud, 1997. "Social Learning in Recurring Games," Games and Economic Behavior, Elsevier, vol. 21(1-2), pages 102-134, October.
    15. Nyarko, Yaw, 1991. "The Convergence of Bayesian Belief Hierarchies," Working Papers 91-50, C.V. Starr Center for Applied Economics, New York University.
    16. Fudenberg, Drew & Kreps, David M., 1995. "Learning in extensive-form games I. Self-confirming equilibria," Games and Economic Behavior, Elsevier, vol. 8(1), pages 20-55.
    17. Kalai, Ehud & Lehrer, Ehud, 1993. "Subjective Equilibrium in Repeated Games," Econometrica, Econometric Society, vol. 61(5), pages 1231-1240, September.
    18. Alvaro Sandroni & Rann Smorodinsky, 1999. "The speed of rational learning," International Journal of Game Theory, Springer;Game Theory Society, vol. 28(2), pages 199-210.
    19. Matthew O. Jackson & Ehud Kalai & Rann Smorodinsky, 1999. "Bayesian Representation of Stochastic Processes under Learning: de Finetti Revisited," Econometrica, Econometric Society, vol. 67(4), pages 875-894, July.
    20. Miller, Ronald I. & Sanchirico, Chris William, 1999. "The Role of Absolute Continuity in "Merging of Opinions" and "Rational Learning"," Games and Economic Behavior, Elsevier, vol. 29(1-2), pages 170-190, October.
    21. Nyarko, Yaw, 1994. "Bayesian Learning Leads to Correlated Equilibria in Normal Form Games," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 4(6), pages 821-841, October.
    22. Jordan J. S., 1995. "Bayesian Learning in Repeated Games," Games and Economic Behavior, Elsevier, vol. 9(1), pages 8-20, April.
    23. Jackson, Matthew O. & Kalai, Ehud, 1999. "Reputation versus Social Learning," Journal of Economic Theory, Elsevier, vol. 88(1), pages 40-59, September.
    24. Yaw Nyarko, 1998. "Bayesian learning and convergence to Nash equilibria without common priors," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 11(3), pages 643-655.
    25. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    26. Nyarko, Y., 1998. "The Truth is in the Eye of the Beholder: or Equilibrium in Beliefs and Rational Learning in Games," Working Papers 98-12, C.V. Starr Center for Applied Economics, New York University.
    27. Nyarko, Y., 1992. "Bayesian Learning without Common Priors and Convergence to Nash Equilibria," Working Papers 92-25, C.V. Starr Center for Applied Economics, New York University.
    28. Pearce, David G, 1984. "Rationalizable Strategic Behavior and the Problem of Perfection," Econometrica, Econometric Society, vol. 52(4), pages 1029-1050, July.
    29. Gilli, Mario, 2001. "A General Approach to Rational Learning in Games," Bulletin of Economic Research, Wiley Blackwell, vol. 53(4), pages 275-303, October.
    30. Eichberger Jurgen, 1995. "Bayesian Learning in Repeated Normal Form Games," Games and Economic Behavior, Elsevier, vol. 11(2), pages 254-278, November.
    31. Battigalli, Pierpaolo, 2003. "Rationalizability in infinite, dynamic games with incomplete information," Research in Economics, Elsevier, vol. 57(1), pages 1-38, March.
    32. Chakrabarti, Subir K, 1992. "Equilibrium in Behavior Strategies in Infinite Extensive Form Games with Imperfect Information," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 2(4), pages 481-494, October.
    33. Sandroni, Alvaro, 1998. "Does Rational Learning Lead to Nash Equilibrium in Finitely Repeated Games?," Journal of Economic Theory, Elsevier, vol. 78(1), pages 195-218, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yoo, Seung Han, 2014. "Learning a population distribution," Journal of Economic Dynamics and Control, Elsevier, vol. 48(C), pages 188-201.
    2. Schipper, Burkhard C., 2021. "Discovery and equilibrium in games with unawareness," Journal of Economic Theory, Elsevier, vol. 198(C).
    3. John H. Nachbar, 2005. "Beliefs in Repeated Games," Econometrica, Econometric Society, vol. 73(2), pages 459-480, March.
    4. Yaron Azrieli, 2009. "On pure conjectural equilibrium with non-manipulable information," International Journal of Game Theory, Springer;Game Theory Society, vol. 38(2), pages 209-219, June.
    5. Conlon, John R., 2003. "Hope springs eternal: learning and the stability of cooperation in short horizon repeated games," Journal of Economic Theory, Elsevier, vol. 112(1), pages 35-65, September.
    6. Germano, Fabrizio & Lugosi, Gabor, 2007. "Global Nash convergence of Foster and Young's regret testing," Games and Economic Behavior, Elsevier, vol. 60(1), pages 135-154, July.
    7. Christoph March, 2011. "Adaptive social learning," Working Papers halshs-00572528, HAL.
    8. Jackson, Matthew O. & Kalai, Ehud, 1999. "Reputation versus Social Learning," Journal of Economic Theory, Elsevier, vol. 88(1), pages 40-59, September.
    9. Ignacio Esponda & Demian Pouzo, 2014. "Berk-Nash Equilibrium: A Framework for Modeling Agents with Misspecified Models," Papers 1411.1152, arXiv.org, revised Nov 2019.
    10. Dekel, Eddie & Fudenberg, Drew & Levine, David K., 2004. "Learning to play Bayesian games," Games and Economic Behavior, Elsevier, vol. 46(2), pages 282-303, February.
    11. Sobel, Joel, 2000. "Economists' Models of Learning," Journal of Economic Theory, Elsevier, vol. 94(2), pages 241-261, October.
    12. Drew Fudenberg & David K Levine, 2005. "Learning and Belief Based Trading," Levine's Working Paper Archive 618897000000000975, David K. Levine.
    13. Lupia, Arthur & Levine, Adam Seth & Zharinova, Natasha, 2010. "When Should Political Scientists Use the Self-Confirming Equilibrium Concept? Benefits, Costs, and an Application to Jury Theorems," Political Analysis, Cambridge University Press, vol. 18(1), pages 103-123, January.
    14. Kalai, Ehud & Lehrer, Ehud, 1993. "Rational Learning Leads to Nash Equilibrium," Econometrica, Econometric Society, vol. 61(5), pages 1019-1045, September.
    15. Kalai, Ehud & Lehrer, Ehud, 1995. "Subjective games and equilibria," Games and Economic Behavior, Elsevier, vol. 8(1), pages 123-163.
    16. Matthew O. Jackson & Ehud Kalai, 1997. "False Reputation in a Society of Players," Discussion Papers 1184R, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    17. Levy, Yehuda John, 2015. "Limits to rational learning," Journal of Economic Theory, Elsevier, vol. 160(C), pages 1-23.
    18. Francesco Squintani, 1999. "Games with Small Forgetfulness," Discussion Papers 1273, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    19. Fudenberg, Drew & Levine, David K., 2009. "Self-confirming equilibrium and the Lucas critique," Journal of Economic Theory, Elsevier, vol. 144(6), pages 2354-2371, November.
    20. Macault, Emilien & Scarsini, Marco & Tomala, Tristan, 2022. "Social learning in nonatomic routing games," Games and Economic Behavior, Elsevier, vol. 132(C), pages 221-233.

    More about this item

    Keywords

    rational learning; active and passive learning; stationarity; consistency; merging;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mib:wpaper:46. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Matteo Pelagatti (email available below). General contact details of provider: https://edirc.repec.org/data/dpmibit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.