IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this article

Learning in games with unstable equilibria

  • Benaïm, Michel
  • Hofbauer, Josef
  • Hopkins, Ed

We propose a new concept for the analysis of games, the TASP, which gives a precise prediction about non-equilibrium play in games whose Nash equilibria are mixed and are unstable under fictitious play-like learning. We show that, when players learn using weighted stochastic fictitious play and so place greater weight on recent experience, the time average of play often converges in these "unstable" games, even while mixed strategies and beliefs continue to cycle. This time average, the TASP, is related to the cycle identified by Shapley [L.S. Shapley, Some topics in two person games, in: M. Dresher, et al. (Eds.), Advances in Game Theory, Princeton University Press, Princeton, 1964]. The TASP can be close to or quite distinct from Nash equilibrium.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.sciencedirect.com/science/article/pii/S0022-0531(08)00132-4
Download Restriction: Full text for ScienceDirect subscribers only

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Article provided by Elsevier in its journal Journal of Economic Theory.

Volume (Year): 144 (2009)
Issue (Month): 4 (July)
Pages: 1694-1709

as
in new window

Handle: RePEc:eee:jetheo:v:144:y:2009:i:4:p:1694-1709
Contact details of provider: Web page: http://www.elsevier.com/locate/inca/622869

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Foster, Dean P. & Young, H. Peyton, 2003. "Learning, hypothesis testing, and Nash equilibrium," Games and Economic Behavior, Elsevier, vol. 45(1), pages 73-96, October.
  2. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
  3. Gilboa, Itzhak & Matsui, Akihiko, 1991. "Social Stability and Equilibrium," Econometrica, Econometric Society, vol. 59(3), pages 859-67, May.
  4. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945.
  5. Fudenberg, D. & Kreps, D.M., 1992. "Learning Mixed Equilibria," Working papers 92-13, Massachusetts Institute of Technology (MIT), Department of Economics.
  6. Yannick Viossat, 2007. "The replicator dynamics does not lead to correlated equilibria," Post-Print hal-00664293, HAL.
  7. Brown-Kruse, Jamie, et al, 1994. "Bertrand-Edgeworth Competition in Experimental Markets," Econometrica, Econometric Society, vol. 62(2), pages 343-72, March.
  8. Battalio, Raymond & Samuelson, Larry & Van Huyck, John, 2001. "Optimization Incentives and Coordination Failure in Laboratory Stag Hunt Games," Econometrica, Econometric Society, vol. 69(3), pages 749-64, May.
  9. Yannick Viossat, 2005. "Replicator Dynamics and Correlated Equilibrium: Elimination of All Strategies in the Support of Correlated Equilibria," Working Papers hal-00242977, HAL.
  10. Glenn Ellison & Drew Fudenberg, 1998. "Learning Purified Mixed Equilibria," Harvard Institute of Economic Research Working Papers 1817, Harvard - Institute of Economic Research.
  11. Hopkins, E., 1995. "Learning, Matching and Aggregation," G.R.E.Q.A.M. 95a20, Universite Aix-Marseille III.
  12. Cheung, Yin-Wong & Friedman, Daniel, 1997. "Individual Learning in Normal Form Games: Some Laboratory Results," Games and Economic Behavior, Elsevier, vol. 19(1), pages 46-76, April.
  13. Anderson, Christopher M. & Plott, Charles R. & Shimomura, K.-I.Ken-Ichi & Granat, Sander, 2004. "Global instability in experimental general equilibrium: the Scarf example," Journal of Economic Theory, Elsevier, vol. 115(2), pages 209-249, April.
  14. R. McKelvey & T. Palfrey, 2010. "Quantal Response Equilibria for Normal Form Games," Levine's Working Paper Archive 510, David K. Levine.
  15. Brown, James N & Rosenthal, Robert W, 1990. "Testing the Minimax Hypothesis: A Re-examination of O'Neill's Game Experiment," Econometrica, Econometric Society, vol. 58(5), pages 1065-81, September.
  16. Michel Benaïm & Josef Hofbauer & Sylvain Sorin, 2003. "Stochastic Approximations and Differential Inclusions," Working Papers hal-00242990, HAL.
  17. Ed Hopkins, 2002. "Two Competing Models of How People Learn in Games," Econometrica, Econometric Society, vol. 70(6), pages 2141-2166, November.
  18. C. Monica Capra & Jacob K. Goeree & Rosario Gomez & Charles A. Holt, 2000. "Learning and Noisy Equilibrium Behavior in an Experimental Study of Imperfect Price Competition," Virginia Economics Online Papers 336, University of Virginia, Department of Economics.
  19. Ed Hopkins & Roberty M. Seymour, 2002. "The Stability of Price Dispersion under Seller and Consumer Learning," Game Theory and Information 0203002, EconWPA.
  20. Yannick Viossat, 2004. "Replicator Dynamics and Correlated Equilibrium," Working Papers hal-00242953, HAL.
  21. Tang, Fang-Fang, 2001. "Anticipatory learning in two-person games: some experimental results," Journal of Economic Behavior & Organization, Elsevier, vol. 44(2), pages 221-232, February.
  22. Jim Engle-Warnick & Ed Hopkins, 2006. "A Simple Test of Learning Theory," CIRANO Working Papers 2006s-30, CIRANO.
  23. Simon P. Anderson & Jacob K. Goeree & Charles A. Holt, 2002. "The Logit Equilibrium: A Perspective on Intuitive Behavioral Anomalies," Southern Economic Journal, Southern Economic Association, vol. 69(1), pages 21-47, July.
  24. Hofbauer, Josef & Hopkins, Ed, 2005. "Learning in perturbed asymmetric games," Games and Economic Behavior, Elsevier, vol. 52(1), pages 133-152, July.
  25. Ed Hopkins, 1997. "A Note on Best Response Dynamics," ESE Discussion Papers 3, Edinburgh School of Economics, University of Edinburgh.
  26. Sergiu Hart & Andreu Mas-Colell, 1997. "A Simple Adaptive Procedure Leading to Correlated Equilibrium," Game Theory and Information 9703006, EconWPA, revised 24 Mar 1997.
  27. Monderer, Dov & Shapley, Lloyd S., 1996. "Fictitious Play Property for Games with Identical Interests," Journal of Economic Theory, Elsevier, vol. 68(1), pages 258-265, January.
  28. Varian, Hal R, 1980. "A Model of Sales," American Economic Review, American Economic Association, vol. 70(4), pages 651-59, September.
  29. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
  30. Josef Hofbauer & William H. Sandholm, 2002. "On the Global Convergence of Stochastic Fictitious Play," Econometrica, Econometric Society, vol. 70(6), pages 2265-2294, November.
  31. Burdett, Kenneth & Judd, Kenneth L, 1983. "Equilibrium Price Dispersion," Econometrica, Econometric Society, vol. 51(4), pages 955-69, July.
  32. Cason, Timothy N. & Friedman, Daniel & Wagener, Florian, 2005. "The dynamics of price dispersion, or Edgeworth variations," Journal of Economic Dynamics and Control, Elsevier, vol. 29(4), pages 801-822, April.
  33. Gaunersdorfer Andrea & Hofbauer Josef, 1995. "Fictitious Play, Shapley Polygons, and the Replicator Equation," Games and Economic Behavior, Elsevier, vol. 11(2), pages 279-303, November.
  34. Young, H. Peyton, 2004. "Strategic Learning and its Limits," OUP Catalogue, Oxford University Press, number 9780199269181, June.
  35. Timothy N. Cason & Daniel Friedman, 2000. "Buyer Search and Price Dispersion: A Laboratory Study," Econometric Society World Congress 2000 Contributed Papers 1549, Econometric Society.
  36. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-81, September.
  37. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
  38. Michel BenaÔm & J–rgen W. Weibull, 2003. "Deterministic Approximation of Stochastic Evolution in Games," Econometrica, Econometric Society, vol. 71(3), pages 873-903, 05.
  39. Michel Benaim & Josef Hofbauer & Sylvain Sorin, 2005. "Stochastic Approximations and Differential Inclusions II: Applications," Levine's Bibliography 784828000000000098, UCLA Department of Economics.
  40. Morgan, John & Orzen, Henrik & Sefton, Martin, 2006. "An experimental study of price dispersion," Games and Economic Behavior, Elsevier, vol. 54(1), pages 134-158, January.
  41. Benaim, Michel & Hirsch, Morris W., 1999. "Mixed Equilibria and Dynamical Systems Arising from Fictitious Play in Perturbed Games," Games and Economic Behavior, Elsevier, vol. 29(1-2), pages 36-72, October.
  42. repec:dau:papers:123456789/1061 is not listed on IDEAS
  43. Michel Benaïm & Josef Hofbauer & Sylvain Sorin, 2005. "Stochastic Approximations and Differential Inclusions; Part II: Applications," Working Papers hal-00242974, HAL.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:eee:jetheo:v:144:y:2009:i:4:p:1694-1709. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.