Learning in hidden Markov models with bounded memory
This paper explores the role of memory in decision making in dynamic environments. We examine the inference problem faced by an agent with bounded memory who receives a sequence of signals from a hidden Markov model. We show that the optimal symmetric memory rule may be deterministic. This result contrasts sharply with Hellman and Cover (1970) and Wilson (2004) and solves, for the context of a hidden Markov model, an open question posed by Kalai and Solan (2003).
|Date of creation:||23 Jun 2010|
|Date of revision:||23 Jun 2010|
|Contact details of provider:|| Postal: |
Web page: http://mpra.ub.uni-muenchen.de
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Kalai, Ehud & Solan, Eilon, 2003. "Randomization and simplification in dynamic decision-making," Journal of Economic Theory, Elsevier, vol. 111(2), pages 251-264, August.
- Harold L. Cole & Narayana R. Kocherlakota, 2000.
"Finite memory and imperfect monitoring,"
604, Federal Reserve Bank of Minneapolis.
- Marco Battaglini, 2003.
"Long-Term Contracting with Markovian Consumers,"
Theory workshop papers
505798000000000048, UCLA Department of Economics.
- Andrew Postlewaite & Olivier Compte, 2009.
"Plausible Cooperation, Second Version,"
PIER Working Paper Archive
10-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 16 Dec 2010.
- Olivier Compte & Andrew Postlewaite, 2007. "Effecting Cooperation," PIER Working Paper Archive 09-019, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 29 May 2009.
- Olivier Compte & Andrew Postlewaite, 2010. "Plausible Cooperation,Third Version," PIER Working Paper Archive 13-008, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Dec 2012.
- Barton L. Lipman, 1993.
"Information Processing and Bounded Rationality: A Survey,"
872, Queen's University, Department of Economics.
- Barton L. Lipman, 1995. "Information Processing and Bounded Rationality: A Survey," Canadian Journal of Economics, Canadian Economics Association, vol. 28(1), pages 42-67, February.
- Monte, Daniel, 2014. "Learning with bounded memory in games," Games and Economic Behavior, Elsevier, vol. 87(C), pages 204-223.
When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:23854. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ekkehart Schlicht)
If references are entirely missing, you can add them using this form.