Naive Reinforcement Learning With Endogenous Aspiration
This risk.paper considers a simple learning process for decision problems under All behaviour change derives from the reinforcing or deterring effect of instantaneous payoff experiences. Payoff experiences are reinforcing or deterring depending on whether the payoff exceeds an aspiration level or falls short of it. The aspiration level is endogenous. Over time it is adjusted into the direction of the actually experienced payoff. This paper shows that realistic aspiration level adjustments may improve the decision maker's long run per-formance, because they may prevent him from feeling dissatisfied with even the best of the available strategies. On the other hand, the paper also shows that in a large class of decision problems endogenous aspiration levels lead to persistent deviations from expected payoff maximisation because they create "probability matching" effects.
|Date of creation:|
|Date of revision:|
|Contact details of provider:|| Web page: http://else.econ.ucl.ac.uk/|
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Itzhak Gilboa & David Schmeidler, 1996.
- Bendor, J. & Mookherjee, D. & Ray, D., 1994.
"Aspirations, Adaptive Learning and Cooperation in Reapeted Games,"
27, Boston University - Department of Economics.
- Bendor, J. & Mookherjee, D. & Ray, D., 1994. "Aspirations, adaptive learning and cooperation in repeated games," Discussion Paper 1994-42, Tilburg University, Center for Economic Research.
- Debraj Ray & Dilip Mookherjee & Fernando Vega Redondo & Rajeeva L. Karandikar, 1996.
"Evolving aspirations and cooperation,"
Working Papers. Serie AD
1996-06, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
- John G. Cross, 1973. "A Stochastic Learning Model of Economic Behavior," The Quarterly Journal of Economics, Oxford University Press, vol. 87(2), pages 239-266.
When requesting a correction, please mention this item's handle: RePEc:els:esrcls:037. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (s. malkani)The email address of this maintainer does not seem to be valid anymore. Please ask s. malkani to update the entry or send us the correct email address
If references are entirely missing, you can add them using this form.