Naïve Reinforcement Learning With Endogenous Aspirations
AbstractThis article considers a simple model of reinforcement learning. All behavior change derives from the reinforcing or deterring effect of instantaneous payoff experiences. Payoff experiences are reinforcing or deterring depending on whether the paxoff exceeds an aspiration level or falls short of it. Over time, the aspiration level is adjusted toward the actually experienced payoffs. This article shows that aspiration level adjustments may improve the decision maker's long-run performance by preventing him or her from feeling dissatisfied with even the best available strategies. However, such movements also lead to persistent deviations from expected payoff maximization by creating "probability matching" effects. Copyright 2000 by Economics Department of the University of Pennsylvania and the Osaka University Institute of Social and Economic Research Association.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by David K. Levine in its series Levine's Working Paper Archive with number 381.
Date of creation: 08 Dec 2010
Date of revision:
Contact details of provider:
Web page: http://www.dklevine.com/
Other versions of this item:
- Borgers, Tilman & Sarin, Rajiv, 2000. "Naive Reinforcement Learning with Endogenous Aspirations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 921-50, November.
- Tilman B�rgers & Rajiv Sarin, . "Naive Reinforcement Learning With Endogenous Aspiration," ELSE working papers 037, ESRC Centre on Economics Learning and Social Evolution.
- C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
- D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Debraj Ray & Dilip Mookherjee & Fernando Vega Redondo & Rajeeva L. Karandikar, 1996.
"Evolving aspirations and cooperation,"
Working Papers. Serie AD
1996-06, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
- Cross, John G, 1973. "A Stochastic Learning Model of Economic Behavior," The Quarterly Journal of Economics, MIT Press, vol. 87(2), pages 239-66, May.
- Gilboa, Itzhak & Schmeidler, David, 1996.
Games and Economic Behavior,
Elsevier, vol. 15(1), pages 1-26, July.
- Bendor, J. & Mookherjee, D. & Ray, D., 1994.
"Aspirations, Adaptive Learning and Cooperation in Reapeted Games,"
27, Boston University - Department of Economics.
- Bendor, J. & Mookherjee, D. & Ray, D., 1994. "Aspirations, adaptive learning and cooperation in repeated games," Discussion Paper 1994-42, Tilburg University, Center for Economic Research.
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page. reading list or among the top items on IDEAS.Access and download statisticsgeneral information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (David K. Levine).
If references are entirely missing, you can add them using this form.