Advanced Search
MyIDEAS: Login

Learning Across Games

Contents:

Author Info

  • Friederike Mengel

    ()
    (Universidad de Alicante)

Abstract

In this paper (reinforcement) learning of decision makers that face many different games is studied. As learning separately for all games can be too costly (require too much reasoning resources) agents are assumed to partition the set of all games into analogy classes. Partitions of higher cardinality are more costly. A process of simultaneous learning of actions and partitions is presented and equilibrium partitions and action choices characterized. The model is able to explain deviations from subgame perfection that are sometimes observed in experiments even for vanishingly small reasoning costs. Furthermore it is shown that learning across games can stabilize mixed equilibria in 2×2 Coordination and Anti-Coordination games and destabilize strict Nash equilibria under certain conditions.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.ivie.es/downloads/docs/wpasad/wpasad-2007-05.pdf
File Function: Fisrt version / Primera version, 2007
Download Restriction: no

Bibliographic Info

Paper provided by Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie) in its series Working Papers. Serie AD with number 2007-05.

as in new window
Length: 35 pages
Date of creation: Apr 2007
Date of revision:
Publication status: Published by Ivie
Handle: RePEc:ivi:wpasad:2007-05

Contact details of provider:
Postal: C/ Guardia Civil, 22, Esc 2a, 1o, E-46020 VALENCIA
Phone: +34 96 319 00 50
Fax: +34 96 319 00 55
Email:
Web page: http://www.ivie.es/
More information through EDIRC

Related research

Keywords: Game Theory; Bounded Rationality; Reinforcement Learning; Analogies.;

Other versions of this item:

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Eliaz, K., 2001. "Nash Equilibrium When Players Account for the Complexity of their Forecasts," Papers 2001-6, Tel Aviv.
  2. Gilboa, Itzhak & Schmeidler, David, 1996. "Case-Based Optimization," Games and Economic Behavior, Elsevier, vol. 15(1), pages 1-26, July.
  3. LiCalzi Marco, 1995. "Fictitious Play by Cases," Games and Economic Behavior, Elsevier, vol. 11(1), pages 64-89, October.
  4. Philippe Jeniel, 2001. "Analogy-Based Expectation Equilibrium," Economics Working Papers 0003, Institute for Advanced Study, School of Social Science.
  5. Philip A. Haile & Ali Hortacsu & Grigory Kosenok, 2003. "On the Empirical Content of Quantal Response Equilibrium," Cowles Foundation Discussion Papers 1432, Cowles Foundation for Research in Economics, Yale University.
  6. Van Damme, E. & Selten, R. & Winter, E., 1989. "Alternating Bid Bargaining With A Smallest Money Unit," Papers 8932, Tilburg - Center for Economic Research.
  7. Borgers, Tilman & Sarin, Rajiv, 2000. "Naive Reinforcement Learning with Endogenous Aspirations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 921-50, November.
  8. Rubinstein, Ariel, 1988. "Similarity and decision-making under risk (is there a utility theory resolution to the Allais paradox?)," Journal of Economic Theory, Elsevier, vol. 46(1), pages 145-153, October.
  9. Philippe Jehiel & Dov Samet, 2010. "Learning to play games in extensive form by valuation," Levine's Working Paper Archive 391749000000000040, David K. Levine.
  10. Jakub Steiner & Colin Stewart, 2006. "Contagion through Learning," ESE Discussion Papers 151, Edinburgh School of Economics, University of Edinburgh, revised 10 Aug 2007.
  11. Jacob K. Goeree & Charles A. Holt, 2000. "Ten Little Treasures of Game Theory and Ten Intuitive Contradictions," Virginia Economics Online Papers 333, University of Virginia, Department of Economics.
  12. Itzhak Gilboa & David Schmeidler, 1992. "Case-Based Decision Theory," Discussion Papers 994, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
  13. Ed Hopkins, 2004. "Adaptive Learning Models of Consumer Behaviour," ESE Discussion Papers 121, Edinburgh School of Economics, University of Edinburgh.
  14. Fabrizio Germano, 2007. "Stochastic Evolution of Rules for Playing Finite Normal Form Games," Theory and Decision, Springer, vol. 62(4), pages 311-333, May.
  15. Jorgen W. Weibull, 1997. "Evolutionary Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262731215, January.
  16. Martin J Osborne & Ariel Rubinstein, 2009. "A Course in Game Theory," Levine's Bibliography 814577000000000225, UCLA Department of Economics.
  17. Debraj Ray & Dilip Mookherjee & Fernando Vega Redondo & Rajeeva L. Karandikar, 1996. "Evolving aspirations and cooperation," Working Papers. Serie AD 1996-06, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
  18. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 0203, Economics Division, School of Social Sciences, University of Southampton.
  19. Glenn Ellison & Drew Fudenberg, 1998. "Learning Purified Mixed Equilibria," Harvard Institute of Economic Research Working Papers 1817, Harvard - Institute of Economic Research.
  20. Fudenberg, Drew & Levine, David K, 1993. "Self-Confirming Equilibrium," Econometrica, Econometric Society, vol. 61(3), pages 523-45, May.
  21. Benaim, Michel & Weibull, Jörgen W., 2000. "Deterministic Approximation of Stochastic Evolution in Games," Working Paper Series 534, Research Institute of Industrial Economics, revised 30 Oct 2001.
  22. Spiegler, Ran, 2004. "Simplicity of beliefs and delay tactics in a concession game," Games and Economic Behavior, Elsevier, vol. 47(1), pages 200-220, April.
  23. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
  24. Ed Hopkins, 2001. "Two Competing Models of How People Learn in Games," NajEcon Working Paper Reviews 625018000000000226, www.najecon.org.
  25. J.-F. Laslier & R. Topol & B. Walliser, 1999. "A behavioral learning process in games," THEMA Working Papers 99-03, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
  26. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-81, September.
  27. Tilman B�rgers & Rajiv Sarin, . "Learning Through Reinforcement and Replicator Dynamics," ELSE working papers 051, ESRC Centre on Economics Learning and Social Evolution.
  28. Martin Posch, 1997. "Cycling in a stochastic learning algorithm for normal form games," Journal of Evolutionary Economics, Springer, vol. 7(2), pages 193-207.
  29. Hofbauer, Josef & Hopkins, Ed, 2005. "Learning in perturbed asymmetric games," Games and Economic Behavior, Elsevier, vol. 52(1), pages 133-152, July.
  30. Binmore, Ken & McCarthy, John & Ponti, Giovanni & Samuelson, Larry & Shaked, Avner, 2002. "A Backward Induction Experiment," Journal of Economic Theory, Elsevier, vol. 104(1), pages 48-88, May.
  31. Benaim, Michel & Hirsch, Morris W., 1999. "Mixed Equilibria and Dynamical Systems Arising from Fictitious Play in Perturbed Games," Games and Economic Behavior, Elsevier, vol. 29(1-2), pages 36-72, October.
  32. Abreu, Dilip & Rubinstein, Ariel, 1988. "The Structure of Nash Equilibrium in Repeated Games with Finite Automata," Econometrica, Econometric Society, vol. 56(6), pages 1259-81, November.
  33. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Grimm, Veronika & Mengel, Friederike, 2012. "An experiment on learning in a multiple games environment," Journal of Economic Theory, Elsevier, vol. 147(6), pages 2220-2259.
  2. Edward W. Piotrowski & Jan Sladkowski & Anna Szczypinska, . "Reinforcement Learning in Market Games," Departmental Working Papers 30, University of Bialtystok, Department of Theoretical Physics.
  3. Mohlin, Erik, 2012. "Evolution of theories of mind," Games and Economic Behavior, Elsevier, vol. 75(1), pages 299-318.
  4. Arina Nikandrova, 2013. "Repeated Play of Families of Games by Resource-Constrained Players," Games, MDPI, Open Access Journal, vol. 4(3), pages 339-346, July.
  5. Grimm, Veronika & Mengel, Friederike, 2009. "An Experiment on Learning in a Multiple Games Environment," Research Memorandum 007, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
  6. Heller, Yuval & Winter, Eyal, 2013. "Rule Rationality," MPRA Paper 48746, University Library of Munich, Germany.
  7. K.J.M. De Jaegher & B. Hoyer, 2012. "Cooperation and the common enemy effect," Working Papers 12-24, Utrecht School of Economics.
  8. Jakub Steiner & Colin Stewart, 2006. "Contagion through Learning," ESE Discussion Papers 151, Edinburgh School of Economics, University of Edinburgh, revised 10 Aug 2007.
  9. Mengel Friederike & Sciubba Emanuela, 2010. "Extrapolation in Games of Coordination and Dominance Solvable Games," Research Memorandum 034, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
  10. Christoph March, 2011. "Adaptive social learning," PSE Working Papers halshs-00572528, HAL.
  11. Gabor Lugosi & Omiros Papaspiliopoulos & Gilles Stoltz, 2009. "Online Multi-task Learning with Hard Constraints," Working Papers hal-00362643, HAL.
  12. Mohlin, Erik, 2009. "Optimal Categorization," Working Paper Series in Economics and Finance 721, Stockholm School of Economics, revised 08 Jul 2009.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:ivi:wpasad:2007-05. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Departamento de Edición).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.