Learning in hidden Markov models with bounded memory
This paper explores the role of memory in decision making in dynamic environments. We examine the inference problem faced by an agent with bounded memory who receives a sequence of signals from a hidden Markov model. We show that the optimal symmetric memory rule may be deterministic. This result contrasts sharply with Hellman and Cover (1970) and Wilson (2004) and solves, for the context of a hidden Markov model, an open question posed by Kalai and Solan (2003).
|Date of creation:||23 Jun 2010|
|Date of revision:||23 Jun 2010|
|Contact details of provider:|| Postal: |
Web page: http://mpra.ub.uni-muenchen.de
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Marco Battaglini, 2005.
"Long-Term Contracting with Markovian Consumers,"
American Economic Review,
American Economic Association, vol. 95(3), pages 637-658, June.
- Olivier Compte & Andrew Postlewaite, 2007.
PIER Working Paper Archive
09-019, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 29 May 2009.
- Andrew Postlewaite & Olivier Compte, 2009. "Plausible Cooperation, Second Version," PIER Working Paper Archive 10-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 16 Dec 2010.
- Olivier Compte & Andrew Postlewaite, 2010. "Plausible Cooperation,Third Version," PIER Working Paper Archive 13-008, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Dec 2012.
- Harold L. Cole & Narayana R. Kocherlakota, 2001.
"Finite memory and imperfect monitoring,"
287, Federal Reserve Bank of Minneapolis.
- Barton L. Lipman, 1993.
"Information Processing and Bounded Rationality: A Survey,"
872, Queen's University, Department of Economics.
- Barton L. Lipman, 1995. "Information Processing and Bounded Rationality: A Survey," Canadian Journal of Economics, Canadian Economics Association, vol. 28(1), pages 42-67, February.
- Kalai, Ehud & Solan, Eilon, 2003. "Randomization and simplification in dynamic decision-making," Journal of Economic Theory, Elsevier, vol. 111(2), pages 251-264, August.
When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:23854. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ekkehart Schlicht)
If references are entirely missing, you can add them using this form.