IDEAS home Printed from https://ideas.repec.org/p/hrv/faseco/27755310.html
   My bibliography  Save this paper

Heterogeneous beliefs and local information in stochastic fictitious play

Author

Listed:
  • Takahashi, Satoru
  • Fudenberg, Drew

Abstract

Stochastic fictitious play (SFP) assumes that agents do not try to influence the future play of their current opponents, an assumption that is justified by appeal to a setting with a large population of players who are randomly matched to play the game. However, the dynamics of SFP have only been analyzed in models where all agents in a player role have the same beliefs. We analyze the dynamics of SFP in settings where there is a population of agents who observe only outcomes in their own matches and thus have heterogeneous beliefs. We provide conditions that ensure that the system converges to a state with homogeneous beliefs, and that its asymptotic behavior is the same as with a single representative agent in each player role.

Suggested Citation

  • Takahashi, Satoru & Fudenberg, Drew, 2011. "Heterogeneous beliefs and local information in stochastic fictitious play," Scholarly Articles 27755310, Harvard University Department of Economics.
    • Handle: RePEc:hrv:faseco:27755310
    as

    Download full text from publisher

    File URL: http://dash.harvard.edu/bitstream/handle/1/27755310/Heterogeneous_Beliefs.pdf
    Download Restriction: no
    File URL: http://dash.harvard.edu/bitstream/handle/1/27755310/Heterogeneous_Beliefs.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ellison, Glenn & Fudenberg, Drew & Imhof, Lorens A., 2009. "Random matching in adaptive dynamics," Games and Economic Behavior, Elsevier, vol. 66(1), pages 98-114, May.
    2. Venkatesh Bala & Sanjeev Goyal, 1998. "Learning from Neighbours," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 595-621.
    3. Fudenberg, Drew & Levine, David K., 1995. "Consistency and cautious fictitious play," Journal of Economic Dynamics and Control, Elsevier, vol. 19(5-7), pages 1065-1089.
    4. Fudenberg, Drew & Levine, David K, 1993. "Self-Confirming Equilibrium," Econometrica, Econometric Society, vol. 61(3), pages 523-545, May.
    5. Michel BenaÔm & J–rgen W. Weibull, 2003. "Deterministic Approximation of Stochastic Evolution in Games," Econometrica, Econometric Society, vol. 71(3), pages 873-903, May.
    6. Sergiu Hart & Andreu Mas-Colell, 2013. "A General Class Of Adaptive Strategies," World Scientific Book Chapters, in: Simple Adaptive Strategies From Regret-Matching to Uncoupled Dynamics, chapter 3, pages 47-76, World Scientific Publishing Co. Pte. Ltd..
    7. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.
    8. Hopkins, Ed, 1999. "A Note on Best Response Dynamics," Games and Economic Behavior, Elsevier, vol. 29(1-2), pages 138-150, October.
    9. Fudenberg, Drew & Levine, David K, 1993. "Steady State Learning and Nash Equilibrium," Econometrica, Econometric Society, vol. 61(3), pages 547-573, May.
    10. Benaïm, Michel & Hofbauer, Josef & Hopkins, Ed, 2009. "Learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1694-1709, July.
    11. Hofbauer, Josef & Sandholm, William H., 2007. "Evolution in games with randomly disturbed payoffs," Journal of Economic Theory, Elsevier, vol. 132(1), pages 47-69, January.
    12. Ellison, Glenn & Fudenberg, Drew, 2000. "Learning Purified Mixed Equilibria," Journal of Economic Theory, Elsevier, vol. 90(1), pages 84-115, January.
    13. Drew Fudenberg & David K. Levine, 1997. "Measuring Players' Losses in Experimental Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 507-536.
    14. Sergiu Hart & Andreu Mas-Colell, 2013. "A Simple Adaptive Procedure Leading To Correlated Equilibrium," World Scientific Book Chapters, in: Simple Adaptive Strategies From Regret-Matching to Uncoupled Dynamics, chapter 2, pages 17-46, World Scientific Publishing Co. Pte. Ltd..
    15. Hofbauer, Josef & Hopkins, Ed, 2005. "Learning in perturbed asymmetric games," Games and Economic Behavior, Elsevier, vol. 52(1), pages 133-152, July.
    16. Fudenberg Drew & Kreps David M., 1993. "Learning Mixed Equilibria," Games and Economic Behavior, Elsevier, vol. 5(3), pages 320-367, July.
    17. Martin W. Cripps & Jeffrey C. Ely & George J. Mailath & Larry Samuelson, 2008. "Common Learning," Econometrica, Econometric Society, vol. 76(4), pages 909-933, July.
    18. Hopkins, Ed, 1999. "Learning, Matching, and Aggregation," Games and Economic Behavior, Elsevier, vol. 26(1), pages 79-110, January.
    19. Peter M. DeMarzo & Dimitri Vayanos & Jeffrey Zwiebel, 2003. "Persuasion Bias, Social Influence, and Unidimensional Opinions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 909-968.
    20. Jackson, Matthew O. & Golub, Benjamin, 2007. "Naive Learning in Social Networks: Convergence, Influence and Wisdom of Crowds," Coalition Theory Network Working Papers 9101, Fondazione Eni Enrico Mattei (FEEM).
    21. Sandholm, William H., 2007. "Evolution in Bayesian games II: Stability of purified equilibria," Journal of Economic Theory, Elsevier, vol. 136(1), pages 641-667, September.
    22. Ellison, Glenn & Fudenberg, Drew, 1993. "Rules of Thumb for Social Learning," Journal of Political Economy, University of Chicago Press, vol. 101(4), pages 612-643, August.
    23. Hopkins, Ed & Posch, Martin, 2005. "Attainability of boundary points under reinforcement learning," Games and Economic Behavior, Elsevier, vol. 53(1), pages 110-125, October.
    24. Jordan J. S., 1993. "Three Problems in Learning Mixed-Strategy Nash Equilibria," Games and Economic Behavior, Elsevier, vol. 5(3), pages 368-386, July.
    25. Young, H Peyton, 1993. "The Evolution of Conventions," Econometrica, Econometric Society, vol. 61(1), pages 57-84, January.
    26. Ellison, Glenn, 1997. "Learning from Personal Experience: One Rational Guy and the Justification of Myopia," Games and Economic Behavior, Elsevier, vol. 19(2), pages 180-210, May.
    27. Daron Acemoglu & Victor Chernozhukov & Muhamet Yildiz, 2006. "Learning and Disagreement in an Uncertain World," NBER Working Papers 12648, National Bureau of Economic Research, Inc.
    28. Ely, Jeffrey C. & Sandholm, William H., 2005. "Evolution in Bayesian games I: Theory," Games and Economic Behavior, Elsevier, vol. 53(1), pages 83-109, October.
    29. Nathaniel T Wilcox, 2006. "Theories of Learning in Games and Heterogeneity Bias," Econometrica, Econometric Society, vol. 74(5), pages 1271-1292, September.
    30. Ellison, Glenn, 1993. "Learning, Local Interaction, and Coordination," Econometrica, Econometric Society, vol. 61(5), pages 1047-1071, September.
    31. Josef Hofbauer & William H. Sandholm, 2002. "On the Global Convergence of Stochastic Fictitious Play," Econometrica, Econometric Society, vol. 70(6), pages 2265-2294, November.
    32. Benaim, Michel & Hirsch, Morris W., 1999. "Mixed Equilibria and Dynamical Systems Arising from Fictitious Play in Perturbed Games," Games and Economic Behavior, Elsevier, vol. 29(1-2), pages 36-72, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Block, Juan I. & Fudenberg, Drew & Levine, David K., 2019. "Learning dynamics with social comparisons and limited memory," Theoretical Economics, Econometric Society, vol. 14(1), January.
    2. Lahkar, Ratul & Seymour, Robert M., 2014. "The dynamics of generalized reinforcement learning," Journal of Economic Theory, Elsevier, vol. 151(C), pages 584-595.
    3. Armenter Roc, 2016. "Sustainable monetary policy and inflation expectations," The B.E. Journal of Macroeconomics, De Gruyter, vol. 16(2), pages 301-334, June.
    4. Ignacio Esponda & Demian Pouzo, 2014. "Berk-Nash Equilibrium: A Framework for Modeling Agents with Misspecified Models," Papers 1411.1152, arXiv.org, revised Nov 2019.
    5. , & ,, 2015. "Rationalizable partition-confirmed equilibrium," Theoretical Economics, Econometric Society, vol. 10(3), September.
    6. Ratul, Lahkar, 2011. "The dynamic instability of dispersed price equilibria," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1796-1827, September.
    7. Dridi, Slimane & Lehmann, Laurent, 2014. "On learning dynamics underlying the evolution of learning rules," Theoretical Population Biology, Elsevier, vol. 91(C), pages 20-36.
    8. Kai A. Konrad & Florian Morath, 2020. "Escalation in conflict games: on beliefs and selection," Experimental Economics, Springer;Economic Science Association, vol. 23(3), pages 750-787, September.
    9. Naoki Funai, 2019. "Convergence results on stochastic adaptive learning," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 68(4), pages 907-934, November.
    10. Mohlin, Erik, 2012. "Evolution of theories of mind," Games and Economic Behavior, Elsevier, vol. 75(1), pages 299-318.
    11. Ellison, Glenn & Fudenberg, Drew & Imhof, Lorens A., 2016. "Fast convergence in evolutionary models: A Lyapunov approach," Journal of Economic Theory, Elsevier, vol. 161(C), pages 1-36.
    12. Sandholm, William H., 2015. "Population Games and Deterministic Evolutionary Dynamics," Handbook of Game Theory with Economic Applications,, Elsevier.
    13. Lahkar, Ratul & Seymour, Robert M., 2013. "Reinforcement learning in population games," Games and Economic Behavior, Elsevier, vol. 80(C), pages 10-38.
    14. Takako Fujiwara-Greve & Carsten Krabbe Nielsen, 2021. "Algorithms may not learn to play a unique Nash equilibrium," Journal of Computational Social Science, Springer, vol. 4(2), pages 839-850, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sandholm, William H., 2015. "Population Games and Deterministic Evolutionary Dynamics," Handbook of Game Theory with Economic Applications,, Elsevier.
    2. Andriy Zapechelnyuk, 2009. "Limit Behavior of No-regret Dynamics," Discussion Papers 21, Kyiv School of Economics.
    3. Benaïm, Michel & Hofbauer, Josef & Hopkins, Ed, 2009. "Learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1694-1709, July.
    4. Ellison, Glenn & Fudenberg, Drew & Imhof, Lorens A., 2016. "Fast convergence in evolutionary models: A Lyapunov approach," Journal of Economic Theory, Elsevier, vol. 161(C), pages 1-36.
    5. Williams, Noah, 2022. "Learning and equilibrium transitions: Stochastic stability in discounted stochastic fictitious play," Journal of Economic Dynamics and Control, Elsevier, vol. 145(C).
    6. Cason, Timothy N. & Friedman, Daniel & Hopkins, Ed, 2010. "Testing the TASP: An experimental investigation of learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 145(6), pages 2309-2331, November.
    7. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.
    8. Block, Juan I. & Fudenberg, Drew & Levine, David K., 2019. "Learning dynamics with social comparisons and limited memory," Theoretical Economics, Econometric Society, vol. 14(1), January.
    9. Naoki Funai, 2019. "Convergence results on stochastic adaptive learning," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 68(4), pages 907-934, November.
    10. , & , H. & ,, 2015. "Sampling best response dynamics and deterministic equilibrium selection," Theoretical Economics, Econometric Society, vol. 10(1), January.
    11. Juan I Block & Drew Fudenberg & David K Levine, 2017. "Learning Dynamics Based on Social Comparisons," Levine's Working Paper Archive 786969000000001375, David K. Levine.
    12. N. Williams, 2002. "Stability and Long Run Equilibrium in Stochastic Fictitious Play," Princeton Economic Theory Working Papers cbeeeb49cc8afc83f125df5a8, David K. Levine.
    13. Kets, W., 2008. "Networks and learning in game theory," Other publications TiSEM 7713fce1-3131-498c-8c6f-3, Tilburg University, School of Economics and Management.
    14. Ratul, Lahkar, 2011. "The dynamic instability of dispersed price equilibria," Journal of Economic Theory, Elsevier, vol. 146(5), pages 1796-1827, September.
    15. Sandholm,W.H., 2003. "Excess payoff dynamics, potential dynamics, and stable games," Working papers 5, Wisconsin Madison - Social Systems.
    16. Daron Acemoglu & Asuman Ozdaglar, 2011. "Opinion Dynamics and Learning in Social Networks," Dynamic Games and Applications, Springer, vol. 1(1), pages 3-49, March.
    17. Mertikopoulos, Panayotis & Sandholm, William H., 2018. "Riemannian game dynamics," Journal of Economic Theory, Elsevier, vol. 177(C), pages 315-364.
    18. Mengel, Friederike, 2012. "Learning across games," Games and Economic Behavior, Elsevier, vol. 74(2), pages 601-619.
    19. Hofbauer,J. & Sandholm,W.H., 2001. "Evolution and learning in games with randomly disturbed payoffs," Working papers 5, Wisconsin Madison - Social Systems.
    20. Jakub Bielawski & Thiparat Chotibut & Fryderyk Falniowski & Michal Misiurewicz & Georgios Piliouras, 2022. "Unpredictable dynamics in congestion games: memory loss can prevent chaos," Papers 2201.10992, arXiv.org, revised Jan 2022.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hrv:faseco:27755310. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Office for Scholarly Communication (email available below). General contact details of provider: https://edirc.repec.org/data/deharus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.