Learning Through Reinforcement and Replicator Dynamics
Abstract
This paper considers a version of Bush and Mosteller's stochastic learning theory in the context of games. We compare this model of learning to a model of biological evolution. The purpose is to investigate analogies between learning and evolution. We and that in the continuous time limit the biological model coincides with the deterministic, continuous time replicator process. We give conditions under which the same is true for the learning model. For the case that these conditions do not hold, we show that the replicator process continues to play an important role in characterising the continuous time limit of the learning model, but that a di�erent e�ect (\Probability Matching") enters as well.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by ESRC Centre on Economics Learning and Social Evolution in its series ELSE working papers with number 051.Length:
Date of creation:
Date of revision:
Handle: RePEc:els:esrcls:051
Contact details of provider:
Postal: Gower Street, London WC1E 6BT
Email:
Web page: http://else.econ.ucl.ac.uk/
More information through EDIRC
Related research
Keywords: Games; Learning; Evolution;Other versions of this item:
- Borgers, Tilman & Sarin, Rajiv, 1997. "Learning Through Reinforcement and Replicator Dynamics," Journal of Economic Theory, Elsevier, vol. 77(1), pages 1-14, November.
- T. Borgers & R. Sarin, 2010. "Learning Through Reinforcement and Replicator Dynamics," Levine's Working Paper Archive 380, David K. Levine.
- C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
- D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Samuelson, L. & Zhang, J., 1991.
"Evolutionary Stability in Asymmetric Games,"
Papers
9132, Tilburg - Center for Economic Research.
- Samuelson, L. & Zhang, J., 1990. "Evolutionary Stability In Symmetric Games," Working papers 90-24, Wisconsin Madison - Social Systems.
- Samuelson, L., 1989. "Evolutionnary Stability In Asymmetric Games," Papers 11-8-2, Pennsylvania State - Department of Economics.
- Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
- Boylan Richard T., 1995. "Continuous Approximation of Dynamical Systems with Randomly Matched Individuals," Journal of Economic Theory, Elsevier, vol. 66(2), pages 615-625, August.
- repec:att:wimass:9410 is not listed on IDEAS
- Binmore, K. & samuelson, L., 1996.
"Muddling Through : Noisy Equilibrium Section,"
Working papers
9410r, Wisconsin Madison - Social Systems.
- Ken Binmore & Larry Samuelson, 1994. "Muddling Through:Noisy Equilibrium Selection," Game Theory and Information 9403005, EconWPA, revised 29 Mar 1994.
- Ken Binmore & Larry Samuelson, 1994. "Muddling Through: Noisy Equilibrium Selection," Game Theory and Information 9410002, EconWPA.
- Binmore, Ken & Larry Samuelson, 1994. "Muddling Through: Noisy Equilibrium Selection," Discussion Paper Serie B 275, University of Bonn, Germany.
- Cabrales, Antonio, .
"Stochastic Replicator Dynamics,"
Open Access publications from Universidad Carlos III de Madrid
info:hdl:10016/3514, Universidad Carlos III de Madrid.
- Cabrales, Antonio, 2000. "Stochastic Replicator Dynamics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(2), pages 451-81, May.
- Cabrales, Antonio, . "Stochastic Replicator Dynamics," Open Access publications from Universidad Carlos III de Madrid info:hdl:10016/3684, Universidad Carlos III de Madrid.
- A. Cabrales, 2010. "Stochastic Replicator Dynamics," Levine's Working Paper Archive 489, David K. Levine.
- Antonio Cabrales, 1993. "Stochastic replicator dynamics," Economics Working Papers 54, Department of Economics and Business, Universitat Pompeu Fabra.
- Mookherjee Dilip & Sopher Barry, 1994. "Learning Behavior in an Experimental Matching Pennies Game," Games and Economic Behavior, Elsevier, vol. 7(1), pages 62-91, July.
- Cabrales, Antonio & Sobel, Joel, .
"On the Limit Points of Discrete Selection Dynamics,"
Open Access publications from Universidad Carlos III de Madrid
info:hdl:10016/4186, Universidad Carlos III de Madrid.
- Cabrales, Antonio & Sobel, Joel, 1992. "On the limit points of discrete selection dynamics," Journal of Economic Theory, Elsevier, vol. 57(2), pages 407-419, August.
- Antonio Cabrales & Joel Sobel, 2010. "On the Limit Points of Discrete Selection Dynamics," Levine's Working Paper Archive 432, David K. Levine.
- Cabrales, Antonio & Sobel, Joel, . "On the Limit Points of Discrete Selection Dynamics," Open Access publications from Universidad Carlos III de Madrid info:hdl:10016/3515, Universidad Carlos III de Madrid.
- L. Samuelson & J. Zhang, 2010. "Evolutionary Stability in Asymmetric Games," Levine's Working Paper Archive 453, David K. Levine.
- Gilboa, Itzhak & Matsui, Akihiko, 1992.
"A model of random matching,"
Journal of Mathematical Economics,
Elsevier, vol. 21(2), pages 185-197.
- Itzhak Gilboa & Akihiko Matsui, 1990. "A Model of Random Matching," Discussion Papers 887, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- E. Dekel & S. Scotchmer, 2010.
"On the Evolution of Optimizing Behavior,"
Levine's Working Paper Archive
434, David K. Levine.
- Dekel, Eddie & Scotchmer, Suzanne, 1992. "On the evolution of optimizing behavior," Journal of Economic Theory, Elsevier, vol. 57(2), pages 392-406, August.
- Samuelson, Larry & Zhang, Jianbo, 1992. "Evolutionary stability in asymmetric games," Journal of Economic Theory, Elsevier, vol. 57(2), pages 363-391, August.
- E. Akin & V. Losert, 2010. "Evolutionary Dynamics of zero-sum games," Levine's Working Paper Archive 424, David K. Levine.
- Cross, John G, 1973. "A Stochastic Learning Model of Economic Behavior," The Quarterly Journal of Economics, MIT Press, vol. 87(2), pages 239-66, May.
- Ritzberger, Klaus & Weibull, Jorgen W, 1995.
"Evolutionary Selection in Normal-Form Games,"
Econometrica,
Econometric Society, vol. 63(6), pages 1371-99, November.
- K. Ritzberger & J. Weibull, 2010. "Evolutionary Selection in Normal-Form Games," Levine's Working Paper Archive 452, David K. Levine.
- Boylan, Richard T., 1992. "Laws of large numbers for dynamical systems with randomly matched individuals," Journal of Economic Theory, Elsevier, vol. 57(2), pages 473-504, August.
- Schmalensee, Richard, 1975. "Alternative models of bandit selection," Journal of Economic Theory, Elsevier, vol. 10(3), pages 333-342, June.
- P. Taylor & L. Jonker, 2010. "Evolutionarily Stable Strategies and Game Dynamics," Levine's Working Paper Archive 457, David K. Levine.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:els:esrcls:051For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (s. malkani).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

