Learning in hidden Markov models with bounded memory
AbstractThis paper explores the role of memory in decision making in dynamic environments. We examine the inference problem faced by an agent with bounded memory who receives a sequence of signals from a hidden Markov model. We show that the optimal symmetric memory rule may be deterministic. This result contrasts sharply with Hellman and Cover (1970) and Wilson (2004) and solves, for the context of a hidden Markov model, an open question posed by Kalai and Solan (2003).
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University Library of Munich, Germany in its series MPRA Paper with number 23854.
Date of creation: 23 Jun 2010
Date of revision: 23 Jun 2010
Bounded Memory; Hidden Markov Model; Randomization.;
Find related papers by JEL classification:
- D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
- D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
- C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
- C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Andrew Postlewaite & Olivier Compte, 2009.
"Plausible Cooperation, Second Version,"
PIER Working Paper Archive
10-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 16 Dec 2010.
- Olivier Compte & Andrew Postlewaite, 2010. "Plausible Cooperation,Third Version," PIER Working Paper Archive 13-008, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Dec 2012.
- Olivier Compte & Andrew Postlewaite, 2007. "Effecting Cooperation," PIER Working Paper Archive 09-019, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 29 May 2009.
- Harold L. Cole & Narayana R. Kocherlakota, 2001.
"Finite memory and imperfect monitoring,"
287, Federal Reserve Bank of Minneapolis.
- Marco Battaglini, 2005.
"Long-Term Contracting with Markovian Consumers,"
American Economic Review,
American Economic Association, vol. 95(3), pages 637-658, June.
- Kalai, Ehud & Solan, Eilon, 2003. "Randomization and simplification in dynamic decision-making," Journal of Economic Theory, Elsevier, vol. 111(2), pages 251-264, August.
- Barton L. Lipman, 1995.
"Information Processing and Bounded Rationality: A Survey,"
Canadian Journal of Economics,
Canadian Economics Association, vol. 28(1), pages 42-67, February.
- Barton L. Lipman, 1993. "Information Processing and Bounded Rationality: A Survey," Working Papers 872, Queen's University, Department of Economics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ekkehart Schlicht).
If references are entirely missing, you can add them using this form.