Advanced Search
MyIDEAS: Login to save this paper or follow this series

The Neuroeconomics of Learning and Information Processing; Applying Markov Decision Process

Contents:

Author Info

  • Chatterjee, Sidharta

Abstract

This paper deals with cognitive theories behind agent-based modeling of learning and information processing methodologies. Herein, I undertake a descriptive analysis of how human agents learn to select action and maximize their value function under reinforcement learning model. In doing so, I have considered the spatio-temporal environment under bounded rationality using Markov Decision process modeling to generalize patterns of agent behavior by analyzing the determinants of value functions, and of factors that modify policy- action-induced cognitive abilities. Since detecting patterns are central to the human cognitive skills, this paper aspires at uncovering the entanglements of complex contextual pattern identification by linking contexts with optimal decisions that agents undertake under hypercompetitive market pressure through learning which have however, implicative applications in a wide array of social and macroeconomic domains.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://mpra.ub.uni-muenchen.de/28883/
File Function: original version
Download Restriction: no

File URL: http://mpra.ub.uni-muenchen.de/28983/
File Function: revised version
Download Restriction: no

File URL: http://mpra.ub.uni-muenchen.de/28993/
File Function: revised version
Download Restriction: no

Bibliographic Info

Paper provided by University Library of Munich, Germany in its series MPRA Paper with number 28883.

as in new window
Length:
Date of creation: 14 Feb 2011
Date of revision:
Handle: RePEc:pra:mprapa:28883

Contact details of provider:
Postal: Schackstr. 4, D-80539 Munich, Germany
Phone: +49-(0)89-2180-2219
Fax: +49-(0)89-2180-3900
Web page: http://mpra.ub.uni-muenchen.de
More information through EDIRC

Related research

Keywords: Cognitive theory; Reinforcement Learning; Markov Decision Process; Glia; Action potential; policy pattern; Neuroeconomics;

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Daniel Houser & Michael Keane & Kevin McCabe, 2002. "Behavior in a dynamic decision problem: An analysis of experimental evidence using a bayesian type classification algorithm," Experimental 0211001, EconWPA.
  2. Kahneman, Daniel & Tversky, Amos, 1979. "Prospect Theory: An Analysis of Decision under Risk," Econometrica, Econometric Society, vol. 47(2), pages 263-91, March.
  3. Leigh Tesfatsion, 2002. "Agent-Based Computational Economics," Computational Economics 0203001, EconWPA, revised 15 Aug 2002.
  4. Luigi Marengo & Giovanni Dosi & Paolo Legrenzi & Corrado Pasquali, 1999. "The structure of problem-solving knowledge and the structure of organisations," LEM Papers Series 1999/09, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
  5. Anat Bracha & Donald J. Brown, 2010. "Affective decision making: a theory of optimism bias," Working Papers 10-16, Federal Reserve Bank of Boston.
  6. Simon, Herbert A., 1978. "Rational Decision-Making in Business Organizations," Nobel Prize in Economics documents 1978-1, Nobel Prize Committee.
  7. Herbert A. Simon, 1999. "The many shapes of knowledge," Revue d'Économie Industrielle, Programme National Persée, vol. 88(1), pages 23-39.
  8. Paul A. David, 1997. "Path Dependence and the Quest for Historical Economics: One More chorus of Ballad of QWERTY," Oxford University Economic and Social History Series _020, Economics Group, Nuffield College, University of Oxford.
  9. Salvatore Rizzello, 2004. "Knowledge as a Path-Dependence Process," Journal of Bioeconomics, Springer, vol. 6(3), pages 255-274, 09.
  10. Mongin, P & d'Aspremont, C, 1996. "Utility Theory and Ethics," Papers 9632, Paris X - Nanterre, U.F.R. de Sc. Ec. Gest. Maths Infor..
  11. Egidi Massimo & Rizzello Salvatore, 2003. "Cognitive economics: Foundations and historical evolution," CESMEP Working Papers 200304, University of Turin.
  12. Anat Bracha & Donald Brown, 2010. "Affective Decision-Making: A Theory of Optimism-Bias," Levine's Working Paper Archive 661465000000000123, David K. Levine.
  13. Giovanni Dosi & Marco Faillo & Luigi Marengo & Daniele Moschella, 2011. "Toward Formal Representations of Search Processes and Routines in Organizational Problem Solving. An Assessment of the State of the Art," LEM Papers Series 2011/04, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
  14. Tesfatsion, Leigh & Judd, Kenneth L., 2006. "Handbook of Computational Economics, Vol. 2: Agent-Based Computational Economics," Staff General Research Papers 10368, Iowa State University, Department of Economics.
  15. Ralph-C. Bayer & Ludovic Renou, 2011. "Cognitive abilities and behavior in strategic-form games.," Discussion Papers in Economics 11/16, Department of Economics, University of Leicester.
  16. Novarese, Marco & Lanteri, Alessandro, 2007. "Individual learning: theory formation, and feedback in a complex task," MPRA Paper 3049, University Library of Munich, Germany.
  17. Herbert Simon, 2000. "Bounded rationality in social science: Today and tomorrow," Mind and Society: Cognitive Studies in Economics and Social Sciences, Fondazione Rosselli, vol. 1(1), pages 25-39, March.
  18. Anat Bracha & Donald J. Brown, 2010. "Affective Decision-Making: A Theory of Optimism-Bias," Cowles Foundation Discussion Papers 1759, Cowles Foundation for Research in Economics, Yale University.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Chatterjee, Sidharta, 2014. "Equilibrium Models of Macroeconomic Science: What to Look For in (DSGE) Models?," MPRA Paper 53893, University Library of Munich, Germany.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:28883. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ekkehart Schlicht).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.