Naïve Reinforcement Learning With Endogenous Aspirations
This article considers a simple model of reinforcement learning. All behavior change derives from the reinforcing or deterring effect of instantaneous payoff experiences. Payoff experiences are reinforcing or deterring depending on whether the paxoff exceeds an aspiration level or falls short of it. Over time, the aspiration level is adjusted toward the actually experienced payoffs. This article shows that aspiration level adjustments may improve the decision maker's long-run performance by preventing him or her from feeling dissatisfied with even the best available strategies. However, such movements also lead to persistent deviations from expected payoff maximization by creating "probability matching" effects. Copyright 2000 by Economics Department of the University of Pennsylvania and the Osaka University Institute of Social and Economic Research Association.
(This abstract was borrowed from another version of this item.)
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Karandikar, Rajeeva & Mookherjee, Dilip & Ray, Debraj & Vega-Redondo, Fernando, 1998.
"Evolving Aspirations and Cooperation,"
Journal of Economic Theory,
Elsevier, vol. 80(2), pages 292-331, June.
- Debraj Ray & Dilip Mookherjee & Fernando Vega Redondo & Rajeeva L. Karandikar, 1996. "Evolving aspirations and cooperation," Working Papers. Serie AD 1996-06, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
- Gilboa, Itzhak & Schmeidler, David, 1996. "Case-Based Optimization," Games and Economic Behavior, Elsevier, vol. 15(1), pages 1-26, July.
- Itzhak Gilboa & David Schmeidler, 1993. "Case-Based Optimization," Discussion Papers 1039, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Itzhak Gilboa & David Schmeidler, 1996. "Case-Based Optimization," Post-Print hal-00753138, HAL.
- Bendor, J. & Mookherjee, D. & Ray, D., 1994. "Aspirations, adaptive learning and cooperation in repeated games," Discussion Paper 1994-42, Tilburg University, Center for Economic Research.
- Bendor, J. & Mookherjee, D. & Ray, D., 1994. "Aspirations, Adaptive Learning and Cooperation in Reapeted Games," Papers 27, Boston University - Department of Economics.
- John G. Cross, 1973. "A Stochastic Learning Model of Economic Behavior," The Quarterly Journal of Economics, Oxford University Press, vol. 87(2), pages 239-266. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:cla:levarc:381. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (David K. Levine)
If references are entirely missing, you can add them using this form.