This file is part of IDEAS , which uses RePEc data
[ Papers |
Articles |
Software |
Books |
Chapters |
Authors |
Institutions |
JEL Classification |
NEP reports |
Search |
New papers by email |
Author registration |
Rankings |
Volunteers |
FAQ |
Blog |
Help! ]
Two Competing Models of How People Learn in Games Author info | Abstract | Publisher info | Download info | Related research | Statistics Ed Hopkins () (University of Edinburgh)
Additional information is available for the following
registered author(s):
Reinforcement learning and stochastic fictitious play are apparent rivals as models of human learning. They embody quite different assumptions about the processing of information and optimization. This paper compares their properties and finds that they are far more similar than were thought. In particular, the expected motion of stochastic fictitious play and reinforcement learning with experimentation can both be written as a perturbed form of the evolutionary replicator dynamics. Therefore they will in many cases have the same asymptotic behavior. In particular, local stability of mixed equilibria under stochastic fictitious play implies local stability under perturbed reinforcement learning. The main identifiable difference between the two models is speed: stochastic fictitious play gives rise to faster learning. Copyright The Econometric Society 2002.
To download:
If you experience problems downloading a file, check if you have the
proper application to
view it first. Information about this may be contained
in the File-Format links below. In case of further problems read
the IDEAS help
page . Note that these files are not on the IDEAS
site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Article provided by Econometric Society in its journal Econometrica .
Volume (Year): 70 (2002)
Issue (Month): 6 (November)
Pages: 2141-2166
Download reference. The following formats are available: HTML
(with abstract ),
plain text
(with abstract ),
BibTeX ,
RIS (EndNote, RefMan, ProCite),
ReDIF
Handle: RePEc:ecm:emetrp:v:70:y:2002:i:6:p:2141-2166Contact details of provider: Phone: 1 212 998 3820 Fax: 1 212 995 4487 Email: Web page: http://www.econometricsociety.org/ More information through EDIRC
Order Information: Email: Web: http://www.blackwellpublishing.com/memb.asp?ref=0012-9682
For technical questions regarding this item, or to correct its listing, contact: (Christopher F. Baum).
Keywords: Other versions of this item:
References listed on IDEAS Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile , click on "citations" and make appropriate adjustments.: Fudenberg, Drew & Levine, David, 1998.
"Learning in games ,"
European Economic Review ,
Elsevier, vol. 42(3-5), pages 631-639, May.
[Downloadable!] (restricted)
Blume, A. & DeJong, D.V. & Neumann, G.R., 2000.
"Learning and communication in sender-receiver games : an econometric investigation ,"
Discussion Paper
9, Tilburg University, Center for Economic Research.
[Downloadable!]
Benaim, Michel & Hirsch, Morris W., 1999.
"Mixed Equilibria and Dynamical Systems Arising from Fictitious Play in Perturbed Games ,"
Games and Economic Behavior ,
Elsevier, vol. 29(1-2), pages 36-72, October.
[Downloadable!] (restricted)
George R. Neumann & Nathan E. Savin, 2000.
"Learning and Communication in Sender-Receiver Games: An Econometric Investigation ,"
Econometric Society World Congress 2000 Contributed Papers
1852, Econometric Society.
[Downloadable!]
Duffy, John & Hopkins, Ed, 2005.
"Learning, information, and sorting in market entry games: theory and evidence ,"
Games and Economic Behavior ,
Elsevier, vol. 51(1), pages 31-62, April.
[Downloadable!] (restricted)
Other versions: repec:att:wimass:199325 is not listed on IDEAS
Binmore, Ken & Samuelson, Larry, 1999.
"Evolutionary Drift and Equilibrium Selection ,"
Review of Economic Studies ,
Blackwell Publishing, vol. 66(2), pages 363-93, April.
[Downloadable!] (restricted)
Erev, Ido & Roth, Alvin E, 1998.
"Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria ,"
American Economic Review ,
American Economic Association, vol. 88(4), pages 848-81, September.
[Downloadable!] (restricted)
Eddie Dekel & Drew Fudenberg & David K. Levine, 1999.
"Payoff Information and Self-Confirming Equilibrium ,"
Levine's Working Paper Archive
172, David K. Levine.
[Downloadable!]
Other versions:
Eddie Dekel & Drew Fudenberg & David K. Levine, .
"Payoff Information and Self-Confirming Equilibrium ,"
ELSE working papers
032, ESRC Centre on Economics Learning and Social Evolution.
Dekel, E. & Fudenberg, D. & Levine, D.K., 1999.
"Payoff information and Self-Confirming Equilibrium ,"
Papers
9-99, Tel Aviv.
Eddie Dekel & Drew Fudenberg & David K. Levine, 1996.
"Payoff Information and Self-Confirming Equilibrium ,"
Harvard Institute of Economic Research Working Papers
1774, Harvard - Institute of Economic Research.
Eddie Dekel & Drew Fudenberg & David K. Levine, .
"Payoff Information and Self-Confirming Equilibrium ,"
ELSE working papers
040, ESRC Centre on Economics Learning and Social Evolution.
[Downloadable!] Dekel, Eddie & Fudenberg, Drew & Levine, David K., 1999.
"Payoff Information and Self-Confirming Equilibrium ,"
Journal of Economic Theory ,
Elsevier, vol. 89(2), pages 165-185, December.
[Downloadable!] (restricted) Jorgen W. Weibull, 1997.
"Evolutionary Game Theory ,"
MIT Press Books ,
The MIT Press,
edition 1, volume 1, number 0262731215.
Timothy C. Salmon, 2001.
"An Evaluation of Econometric Models of Adaptive Learning ,"
Econometrica ,
Econometric Society, vol. 69(6), pages 1597-1628, November.
[Downloadable!] (restricted)
Arthur, W Brian, 1993.
"On Designing Economic Agents That Behave Like Human Agents ,"
Journal of Evolutionary Economics ,
Springer, vol. 3(1), pages 1-22, February.
Van Huyck, John B & Battalio, Raymond C & Rankin, Frederick W, 1997.
"On the Origin of Convention: Evidence from Coordination Games ,"
Economic Journal ,
Royal Economic Society, vol. 107(442), pages 576-96, May.
[Downloadable!] (restricted)
McKelvey Richard D. & Palfrey Thomas R., 1995.
"Quantal Response Equilibria for Normal Form Games ,"
Games and Economic Behavior ,
Elsevier, vol. 10(1), pages 6-38, July.
[Downloadable!] (restricted)
Nick Feltovich & John Duffy, 1999.
"Does observation of others affect learning in strategic environments? An experimental study ,"
International Journal of Game Theory ,
Springer, vol. 28(1), pages 131-152.
[Downloadable!] (restricted)
Other versions: David J. Cooper & Susan Garvin & John H. Kagel, 1997.
"Signalling and Adaptive Learning in an Entry Limit Pricing Game ,"
RAND Journal of Economics ,
The RAND Corporation, vol. 28(4), pages 662-683, Winter.
[Downloadable!] (restricted)
Martin Posch, 1997.
"Cycling in a stochastic learning algorithm for normal form games ,"
Journal of Evolutionary Economics ,
Springer, vol. 7(2), pages 193-207.
[Downloadable!] (restricted)
Hopkins, Ed, 1999.
"Learning, Matching, and Aggregation ,"
Games and Economic Behavior ,
Elsevier, vol. 26(1), pages 79-110, January.
[Downloadable!] (restricted)
Other versions:
Ed Hopkins, .
"Learning, Matching and Aggregation ,"
Department of Economics
1996 : II, Edinburgh School of Economics, University of Edinburgh.
[Downloadable!] Ed Hopkins, 1995.
"Learning, Matching and Aggregation ,"
Game Theory and Information
9512001, EconWPA.
[Downloadable!] Ed Hopkins, .
"Learning, Matching and Aggregation ,"
ESE Discussion Papers
2, Edinburgh School of Economics, University of Edinburgh.
Ed Hopkins, .
"Learning, Matching and Aggregation ,"
ELSE working papers
033, ESRC Centre on Economics Learning and Social Evolution.
[Downloadable!] Ed Hopkins, .
"Learning, Matching and Aggregation ,"
Discussion Papers
1996-2, Edinburgh School of Economics, University of Edinburgh.
Hopkins, E., 1995.
"Learning, Matching and Aggregation ,"
G.R.E.Q.A.M.
95a20, Universite Aix-Marseille III.
Cheung, Yin-Wong & Friedman, Daniel, 1997.
"Individual Learning in Normal Form Games: Some Laboratory Results ,"
Games and Economic Behavior ,
Elsevier, vol. 19(1), pages 46-76, April.
[Downloadable!] (restricted)
Fudenberg Drew & Kreps David M., 1993.
"Learning Mixed Equilibria ,"
Games and Economic Behavior ,
Elsevier, vol. 5(3), pages 320-367, July.
[Downloadable!] (restricted)
Other versions: Nick Feltovich, 2000.
"Reinforcement-Based vs. Belief-Based Learning Models in Experimental Asymmetric-Information ,"
Econometrica ,
Econometric Society, vol. 68(3), pages 605-642, May.
Colin Camerer & Teck-Hua Ho, 1999.
"Experience-weighted Attraction Learning in Normal Form Games ,"
Econometrica ,
Econometric Society, vol. 67(4), pages 827-874, July.
J.-F. Laslier & R. Topol & B. Walliser, 1999.
"A behavioral learning process in games ,"
THEMA Working Papers
99-03, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
Other versions:
Laslier, J.-F. & Topol, R. & Walliser, B., 1999.
"A Behavioral Learning Process in Games ,"
Papers
99-03, Paris X - Nanterre, U.F.R. de Sc. Ec. Gest. Maths Infor..
Laslier, Jean-Francois & Topol, Richard & Walliser, Bernard, 2001.
"A Behavioral Learning Process in Games ,"
Games and Economic Behavior ,
Elsevier, vol. 37(2), pages 340-366, November.
[Downloadable!] (restricted) Huck, Steffen & Normann, Hans-Theo & Oechssler, Jorg, 1999.
"Learning in Cournot Oligopoly--An Experiment ,"
Economic Journal ,
Royal Economic Society, vol. 109(454), pages C80-95, March.
[Downloadable!] (restricted)
Other versions: Josef Hofbauer & Ed Hopkins, 2004.
"Learning in Perturbed Asymmetric Games ,"
ESE Discussion Papers
53, Edinburgh School of Economics, University of Edinburgh.
[Downloadable!]
Other versions: Borgers, Tilman & Sarin, Rajiv, 1997.
"Learning Through Reinforcement and Replicator Dynamics ,"
Journal of Economic Theory ,
Elsevier, vol. 77(1), pages 1-14, November.
[Downloadable!] (restricted)
Other versions: repec:att:wimass:199529 is not listed on IDEAS
Vriend, Nicolaas J., 1997.
"Will reasoning improve learning? ,"
Economics Letters ,
Elsevier, vol. 55(1), pages 9-18, August.
[Downloadable!] (restricted)
Ellison, Glenn & Fudenberg, Drew, 2000.
"Learning Purified Mixed Equilibria ,"
Journal of Economic Theory ,
Elsevier, vol. 90(1), pages 84-115, January.
[Downloadable!] (restricted)
Other versions: Gaunersdorfer Andrea & Hofbauer Josef, 1995.
"Fictitious Play, Shapley Polygons, and the Replicator Equation ,"
Games and Economic Behavior ,
Elsevier, vol. 11(2), pages 279-303, November.
[Downloadable!] (restricted)
Hopkins, Ed, 1999.
"A Note on Best Response Dynamics ,"
Games and Economic Behavior ,
Elsevier, vol. 29(1-2), pages 138-150, October.
[Downloadable!] (restricted)
Other versions:
Full
references Cited by : (explanations , Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile , click on "citations" and make appropriate adjustments.)
Dana Heller, 2000.
"Parametric Adaptive Learning ,"
Econometric Society World Congress 2000 Contributed Papers
1496, Econometric Society.
[Downloadable!]
Duncan Whitehead, 2008.
"The El Farol Bar Problem Revisited: Reinforcement Learning in a Potential Game ,"
ESE Discussion Papers
186, Edinburgh School of Economics, University of Edinburgh.
[Downloadable!]
Jim Engle-Warnick & Ed Hopkins, 2006.
"A Simple Test of Learning Theory? ,"
ESE Discussion Papers
153, Edinburgh School of Economics, University of Edinburgh.
[Downloadable!]
Other versions: Andriy Zapechelnyuk, 2009.
"Limit Behavior of No-regret Dynamics ,"
Discussion Papers
21, Kyiv School of Economics.
[Downloadable!]
Ed Hopkins & Josef Hofbauer & Michel Benaim, 2005.
"Learning in Games with Unstable Equilibria ,"
ESE Discussion Papers
135, Edinburgh School of Economics, University of Edinburgh.
[Downloadable!]
Other versions: Grimm, Veronika & Mengel, Friederike, 2009.
"An Experiment on Learning in a Multiple Games Environment ,"
Research Memoranda
007, Maastricht : METEOR, Maastricht Research School of Economics of Technology and Organization.
[Downloadable!]
Friederike Mengel, 2007.
"Learning Across Games ,"
Working Papers. Serie AD
2007-05, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
[Downloadable!]
Wolf Ze'ev Ehrblatt & Kyle Hyndman & Erkut Y. ÄOzbay & Andrew Schotter, 2006.
"Convergence: An Experimental Study ,"
Levine's Working Paper Archive
122247000000001148, David K. Levine.
[Downloadable!]
Camerer, Colin F. & Ho, Teck H. & Chong, Juin-Kuan., 2000.
"Sophisticated EWA Learning and Strategic Teaching in Repeated Games ,"
Working Papers
1087, California Institute of Technology, Division of the Humanities and Social Sciences.
[Downloadable!]
Timothy N. Cason & Daniel Friedman & Ed Hopkins, 2009.
"Testing the TASP: An Experimental Investigation of Learning in Games with Unstable Equilibria ,"
ESE Discussion Papers
188, Edinburgh School of Economics, University of Edinburgh.
[Downloadable!]
Sudip Gupta, 2004.
"Endogenous Asymmetry and Entry in Sequential Multi-Unit Auctions: Identification and Estimation ,"
Econometric Society 2004 North American Summer Meetings
566, Econometric Society.
[Downloadable!]
Fabrizio Germano, 2007.
"Stochastic Evolution of Rules for Playing Finite Normal Form Games ,"
Theory and Decision ,
Springer, vol. 62(4), pages 311-333, May.
[Downloadable!] (restricted)
Theodore L. Turocy, 2002.
"A Dynamic Homotopy Interpretation of Quantal Response Equilibrium Correspondences ,"
Game Theory and Information
0212001, EconWPA, revised 16 Oct 2003.
[Downloadable!]
Josef Hofbauer & Ed Hopkins, 2004.
"Learning in Perturbed Asymmetric Games ,"
ESE Discussion Papers
53, Edinburgh School of Economics, University of Edinburgh.
[Downloadable!]
Other versions: Antonella Ianni, 2007.
"Learning Strict Nash Equilibria through Reinforcement ,"
Economics Working Papers
ECO2007/21, European University Institute.
[Downloadable!]
Ed Hopkins, 2004.
"Adaptative Learning Models of Consumer Behaviour (first version) ,"
ESE Discussion Papers
80, Edinburgh School of Economics, University of Edinburgh.
Kets, W. & Voorneveld, M., 2007.
"Congestion, Equilibrium and Learning: The Minority Game ,"
Discussion Paper
2007-61, Tilburg University, Center for Economic Research.
[Downloadable!]
Ed Hopkins, 2003.
"Adaptive Learning Models of Consumer Behaviour ,"
Levine's Bibliography
506439000000000346, UCLA Department of Economics.
[Downloadable!]
Other versions: Ed Hopkins & Martin Posch, 2003.
"Attainability of Boundary Points under Reinforcement Learning ,"
Levine's Bibliography
506439000000000350, UCLA Department of Economics.
[Downloadable!]
Other versions:
Ed Hopkins & Martin Posch, 2004.
"Attainability of Boundary Points under Reinforcement Learning ,"
ESE Discussion Papers
79, Edinburgh School of Economics, University of Edinburgh.
[Downloadable!] Hopkins, Ed & Posch, Martin, 2005.
"Attainability of boundary points under reinforcement learning ,"
Games and Economic Behavior ,
Elsevier, vol. 53(1), pages 110-125, October.
[Downloadable!] (restricted) repec:att:wimass:1919982 is not listed on IDEAS
Reinoud Joosten & Berend Roorda, 2008.
"Generalized projection dynamics in evolutionary game theory ,"
Papers on Economics and Evolution
2008-11, Max Planck Institute of Economics, Evolutionary Economics Group.
[Downloadable!]
Access and
download statistics Did you know? IDEAS uses the data collected within the RePEc project , the largest online bibliographic database in Economics.
This page was last updated on 2009-11-12.
This information is provided to you by IDEAS at the Department of Economics , College of Liberal Arts and Sciences , University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics .