Naïve Reinforcement Learning With Endogenous Aspirations
AbstractThis risk.paper considers a simple learning process for decision problems under All behaviour change derives from the reinforcing or deterring effect of instantaneous payoff experiences. Payoff experiences are reinforcing or deterring depending on whether the payoff exceeds an aspiration level or falls short of it. The aspiration level is endogenous. Over time it is adjusted into the direction of the actually experienced payoff. This paper shows that realistic aspiration level adjustments may improve the decision maker's long run per-formance, because they may prevent him from feeling dissatisfied with even the best of the available strategies. On the other hand, the paper also shows that in a large class of decision problems endogenous aspiration levels lead to persistent deviations from expected payoff maximisation because they create "probability matching" effects.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by David K. Levine in its series Levine's Working Paper Archive with number 381.
Date of creation: 08 Dec 2010
Date of revision:
Contact details of provider:
Web page: http://www.dklevine.com/
Other versions of this item:
- Borgers, Tilman & Sarin, Rajiv, 2000. "Naive Reinforcement Learning with Endogenous Aspirations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 921-50, November.
- Tilman Bï¿½rgers & Rajiv Sarin, . "Naive Reinforcement Learning With Endogenous Aspiration," ELSE working papers 037, ESRC Centre on Economics Learning and Social Evolution.
- C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
- D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Itzhak Gilboa & David Schmeidler, 1993.
Discussion Papers, Northwestern University, Center for Mathematical Studies in Economics and Management Science
1039, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Bendor, J. & Mookherjee, D. & Ray, D., 1994.
"Aspirations, adaptive learning and cooperation in repeated games,"
Discussion Paper, Tilburg University, Center for Economic Research
1994-42, Tilburg University, Center for Economic Research.
- Bendor, J. & Mookherjee, D. & Ray, D., 1994. "Aspirations, Adaptive Learning and Cooperation in Reapeted Games," Papers, Boston University - Department of Economics 27, Boston University - Department of Economics.
- Karandikar, Rajeeva & Mookherjee, Dilip & Ray, Debraj & Vega-Redondo, Fernando, 1998.
"Evolving Aspirations and Cooperation,"
Journal of Economic Theory,
Elsevier, vol. 80(2), pages 292-331, June.
- Cross, John G, 1973. "A Stochastic Learning Model of Economic Behavior," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 87(2), pages 239-66, May.
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page. reading list or among the top items on IDEAS.Access and download statisticsgeneral information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (David K. Levine).
If references are entirely missing, you can add them using this form.