Learning to play games in extensive form by valuation
Abstract
A valuation for a board game is an assignment of numeric values to different states of the board. The valuation reflects the desirability of the states for the player. It can be used by a player to decide on her next move during the play. We assume a myopic player, who chooses a move with the highest valuation. Valuations can also be revised, and hopefully improved, after each play of the game. Here, a very simple valuation revision is considered, in which the states of the board visited in a play are assigned the payoff obtained in the play. We show that by adopting such a learning process a player who has a winning strategy in a win-lose game can almost surely guarantee a win in a repeated game. When a player has more than two payoffs, a more elaborate learning procedure is required. We consider one that associates with each state the average payoff in the rounds in which this node was reached. When all players adopt this learning procedure, with some perturbations, then, with probability 1, strategies that are close to subgame perfect equilibrium are played after some time. A single player who adopts this procedure can guarantee only her individually rational payoff.(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract wa
(This abstract was borrowed from another version of this item.)
Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by David K. Levine in its series Levine's Working Paper Archive with number 391749000000000040.Length:
Date of creation: 09 Dec 2010
Date of revision:
Handle: RePEc:cla:levarc:391749000000000040
Contact details of provider:
Web page: http://www.dklevine.com/
Related research
Keywords:Other versions of this item:
- Jehiel, Philippe & Samet, Dov, 2005. "Learning to play games in extensive form by valuation," Journal of Economic Theory, Elsevier, vol. 124(2), pages 129-148, October.
- Philippe Jehiel & Dov Samet, 2001. "Learning To Play Games In Extensive Form By Valuation," NajEcon Working Paper Reviews 391749000000000010, www.najecon.org.
- Philippe Jehiel & Dov Samet, 2001. "Learning to play games in extensive form by valuation," Game Theory and Information 0012001, EconWPA.
- Philippe Jehiel & Dov Samet, 2010. "Learning To Play Games In Extensive Form By Valuation," Levine's Working Paper Archive 391749000000000034, David K. Levine.
- Philippe Jehiel & Dov Samet, 2001. "Learning To Play Games In Extensive Form By Valuation," Levine's Working Paper Archive 391749000000000010, David K. Levine.
- C7 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory
- D8 - Microeconomics - - Information, Knowledge, and Uncertainty
This paper has been announced in the following NEP Reports:
- NEP-ALL-2010-12-18 (All new papers)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- T. Borgers & R. Sarin, 2010.
"Learning Through Reinforcement and Replicator Dynamics,"
Levine's Working Paper Archive
380, David K. Levine.
- Borgers, Tilman & Sarin, Rajiv, 1997. "Learning Through Reinforcement and Replicator Dynamics," Journal of Economic Theory, Elsevier, vol. 77(1), pages 1-14, November.
- Tilman B�rgers & Rajiv Sarin, . "Learning Through Reinforcement and Replicator Dynamics," ELSE working papers 051, ESRC Centre on Economics Learning and Social Evolution.
- Fudenberg, Drew & Levine, David, 1995.
"Consistency and Cautious Fictitious Play,"
Scholarly Articles
3198694, Harvard University Department of Economics.
- Fudenberg, Drew & Levine, David K., 1995. "Consistency and cautious fictitious play," Journal of Economic Dynamics and Control, Elsevier, vol. 19(5-7), pages 1065-1089.
- Drew Fudenberg & David K. Levine, 1996. "Consistency and Cautious Fictitious Play," Levine's Working Paper Archive 470, David K. Levine.
- Debraj Ray & Dilip Mookherjee & Fernando Vega Redondo & Rajeeva L. Karandikar, 1996.
"Evolving aspirations and cooperation,"
Working Papers. Serie AD
1996-06, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
- Karandikar, Rajeeva & Mookherjee, Dilip & Ray, Debraj & Vega-Redondo, Fernando, 1998. "Evolving Aspirations and Cooperation," Journal of Economic Theory, Elsevier, vol. 80(2), pages 292-331, June.
- Drew Fudenberg & David K. Levine, 1998.
"Learning in Games,"
Levine's Working Paper Archive
2222, David K. Levine.
- Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
- Ross Cressman, 2003. "Evolutionary Dynamics and Extensive Form Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262033054.
- Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-81, September.
- Itzhak Gilboa & David Schmeidler, 1992.
"Case-Based Decision Theory,"
Discussion Papers
994, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Gilboa, Itzhak & Schmeidler, David, 1995. "Case-Based Decision Theory," The Quarterly Journal of Economics, MIT Press, vol. 110(3), pages 605-39, August.
- G. Noldeke & L. Samuelson, 2010.
"An Evolutionary Analysis of Backward and Forward Induction,"
Levine's Working Paper Archive
538, David K. Levine.
- Noldeke Georg & Samuelson Larry, 1993. "An Evolutionary Analysis of Backward and Forward Induction," Games and Economic Behavior, Elsevier, vol. 5(3), pages 425-454, July.
- Noeldecke,Georg & Samuelson,Larry, . "An evolutionary analysis of backward and forward induction," Discussion Paper Serie B 228, University of Bonn, Germany.
- Hart, Sergiu, 2002.
"Evolutionary dynamics and backward induction,"
Games and Economic Behavior,
Elsevier, vol. 41(2), pages 227-264, November.
- Sergiu Hart, 1999. "Evolutionary Dynamics and Backward Induction," Game Theory and Information 9905002, EconWPA, revised 23 Mar 2000.
- Philippe Jehiel & Dov Samet, 2006.
"Valuation Equilibria,"
Levine's Bibliography
784828000000000111, UCLA Department of Economics.
- Jehiel, Philippe & Samet, Dov, 2007. "Valuation equilibrium," Theoretical Economics, Econometric Society, vol. 2(2), June.
- Philippe Jehiel & Dov Samet, 2003. "Valuation Equilibria," Levine's Bibliography 666156000000000046, UCLA Department of Economics.
- Philippe Jehiel & Dov Samet, 2003. "Valuation Equilibria," Game Theory and Information 0310003, EconWPA.
- Hendon, Ebbe & Jacobsen, Hans Jorgen & Sloth, Birgitte, 1996.
"Fictitious Play in Extensive Form Games,"
Games and Economic Behavior,
Elsevier, vol. 15(2), pages 177-202, August.
- Ebbe Hendon & Hans Jørgen Jacobsen & Birgitte Sloth, . "Fictitious Play in Extensive Form Games," Discussion Papers 94-06, University of Copenhagen. Department of Economics.
- Sergiu Hart & Andreu Mas-Colell, 2000.
"A Simple Adaptive Procedure Leading to Correlated Equilibrium,"
Econometrica,
Econometric Society, vol. 68(5), pages 1127-1150, September.
- Sergiu Hart & Andreu Mas-Colell, 1997. "A Simple Adaptive Procedure Leading to Correlated Equilibrium," Game Theory and Information 9703006, EconWPA, revised 24 Mar 1997.
- S. Hart & A. Mas-Collel, 2010. "A Simple Adaptive Procedure Leading to Correlated Equilibrium," Levine's Working Paper Archive 572, David K. Levine.
- Sergiu Hart & Andreu Mas-Colell, 1996. "A simple adaptive procedure leading to correlated equilibrium," Economics Working Papers 200, Department of Economics and Business, Universitat Pompeu Fabra, revised Dec 1996.
- Fudenberg, D. & Levine, D.K., 1991.
"Self-Confirming Equilibrium ,"
Working papers
581, Massachusetts Institute of Technology (MIT), Department of Economics.
- Fudenberg, Drew & Levine, David K, 1993. "Self-Confirming Equilibrium," Econometrica, Econometric Society, vol. 61(3), pages 523-45, May.
- Drew Fudenberg & David K. Levine, 1993. "Self-Confirming Equilibrium," Levine's Working Paper Archive 2147, David K. Levine.
- Drew Fudenberg & David K. Levine, 1998.
"The Theory of Learning in Games,"
MIT Press Books,
The MIT Press,
edition 1, volume 1, number 0262061945.
- Drew Fudenberg & David K. Levine, 1996. "The Theory of Learning in Games," Levine's Working Paper Archive 624, David K. Levine.
- Sarin, Rajiv & Vahid, Farshid, 1999. "Payoff Assessments without Probabilities: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 28(2), pages 294-309, August.
- Cho, In-Koo & Matsui, Akihiko, 2005. "Learning aspiration in repeated games," Journal of Economic Theory, Elsevier, vol. 124(2), pages 171-201, October.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Wichardt, Philipp C., 2010. "Modelling equilibrium play as governed by analogy and limited foresight," Games and Economic Behavior, Elsevier, vol. 70(2), pages 472-487, November.
- Philippe Jehiel & Dov Samet, 2006.
"Valuation Equilibria,"
Levine's Bibliography
784828000000000111, UCLA Department of Economics.
- Jehiel, Philippe & Samet, Dov, 2007. "Valuation equilibrium," Theoretical Economics, Econometric Society, vol. 2(2), June.
- Philippe Jehiel & Dov Samet, 2003. "Valuation Equilibria," Levine's Bibliography 666156000000000046, UCLA Department of Economics.
- Philippe Jehiel & Dov Samet, 2003. "Valuation Equilibria," Game Theory and Information 0310003, EconWPA.
- Levine, David & Fudenberg, Drew, 2006.
"Superstition and Rational Learning,"
Scholarly Articles
3196330, Harvard University Department of Economics.
- Drew Fudenberg & David K. Levine, 2006. "Superstition and Rational Learning," American Economic Review, American Economic Association, vol. 96(3), pages 630-651, June.
- Drew Fudenberg & David K Levine, 2005. "Superstition and Rational Learning," Levine's Working Paper Archive 618897000000000731, David K. Levine.
- Drew Fudenberg & David K. Levine, 2006. "Superstition and Rational Learning," Harvard Institute of Economic Research Working Papers 2114, Harvard - Institute of Economic Research.
- Yoav Shoham & Rob Powers & Trond Grenager, 2006. "If multi-agent learning is the answer, what is the question?," Levine's Working Paper Archive 122247000000001156, David K. Levine.
- Drew Fudenberg & David K Levine, 2006.
"An Economists Perspective on Multi-Agent Learning,"
Levine's Working Paper Archive
784828000000000683, David K. Levine.
- Fudenberg, Drew & Levine, David, 2007. "An Economist's Perspective on Multi-Agent Learning," Scholarly Articles 3200613, Harvard University Department of Economics.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:cla:levarc:391749000000000040For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (David K. Levine).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

