The Neuroeconomics of Learning and Information Processing; Applying Markov Decision Process
AbstractThis paper deals with cognitive theories behind agent-based modeling of learning and information processing methodologies. Herein, I undertake a descriptive analysis of how human agents learn to select action and maximize their value function under reinforcement learning model. In doing so, I have considered the spatio-temporal environment under bounded rationality using Markov Decision process modeling to generalize patterns of agent behavior by analyzing the determinants of value functions, and of factors that modify policy- action-induced cognitive abilities. Since detecting patterns are central to the human cognitive skills, this paper aspires at uncovering the entanglements of complex contextual pattern identification by linking contexts with optimal decisions that agents undertake under hypercompetitive market pressure through learning which have however, implicative applications in a wide array of social and macroeconomic domains.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University Library of Munich, Germany in its series MPRA Paper with number 28883.
Date of creation: 14 Feb 2011
Date of revision:
Cognitive theory; Reinforcement Learning; Markov Decision Process; Glia; Action potential; policy pattern; Neuroeconomics;
Find related papers by JEL classification:
- D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
- C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
- D87 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Neuroeconomics
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-02-26 (All new papers)
- NEP-CBE-2011-02-26 (Cognitive & Behavioural Economics)
- NEP-EVO-2011-02-26 (Evolutionary Economics)
- NEP-NEU-2011-02-26 (Neuroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Herbert A. Simon, 1999. "The many shapes of knowledge," Revue d'Économie Industrielle, Programme National Persée, vol. 88(1), pages 23-39.
- Leigh Tesfatsion, 2002. "Agent-Based Computational Economics," Computational Economics 0203001, EconWPA, revised 15 Aug 2002.
- Ralph-C. Bayer & Ludovic Renou, 2011. "Cognitive abilities and behavior in strategic-form games.," Discussion Papers in Economics 11/16, Department of Economics, University of Leicester.
- Daniel Houser & Michael Keane & Kevin McCabe, 2002.
"Behavior in a dynamic decision problem: An analysis of experimental evidence using a bayesian type classification algorithm,"
- Daniel Houser & Michael Keane & Kevin McCabe, 2004. "Behavior in a Dynamic Decision Problem: An Analysis of Experimental Evidence Using a Bayesian Type Classification Algorithm," Econometrica, Econometric Society, vol. 72(3), pages 781-822, 05.
- Luigi Marengo & Giovanni Dosi & Paolo Legrenzi & Corrado Pasquali, 1999.
"The structure of problem-solving knowledge and the structure of organisations,"
LEM Papers Series
1999/09, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Marengo, Luigi, et al, 2000. "The Structure of Problem-Solving Knowledge and the Structure of Organizations," Industrial and Corporate Change, Oxford University Press, vol. 9(4), pages 757-88, December.
- Egidi Massimo & Rizzello Salvatore, 2003. "Cognitive economics: Foundations and historical evolution," CESMEP Working Papers 200304, University of Turin.
- P. Mongin & C. d'Aspremont, 1996.
"Utility theory and ethics,"
THEMA Working Papers
96-32, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
- Mongin, P & d'Aspremont, C, 1996. "Utility Theory and Ethics," Papers 9632, Paris X - Nanterre, U.F.R. de Sc. Ec. Gest. Maths Infor..
- MONGIN, Philippe & d ASPREMONT, Claude, 1996. "Utility theory and ethics," CORE Discussion Papers 1996063, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- MONGIN, Philippe & d'ASPREMONT, Claude, . "Utility theory and ethics," CORE Discussion Papers RP -1423, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Anat Bracha & Donald J. Brown, 2010. "Affective decision making: a theory of optimism bias," Working Papers 10-16, Federal Reserve Bank of Boston.
- Amos Tversky & Daniel Kahneman, 1979.
"Prospect Theory: An Analysis of Decision under Risk,"
Levine's Working Paper Archive
7656, David K. Levine.
- Kahneman, Daniel & Tversky, Amos, 1979. "Prospect Theory: An Analysis of Decision under Risk," Econometrica, Econometric Society, vol. 47(2), pages 263-91, March.
- Novarese, Marco & Lanteri, Alessandro, 2007. "Individual learning: theory formation, and feedback in a complex task," MPRA Paper 3049, University Library of Munich, Germany.
- Tesfatsion, Leigh & Judd, Kenneth L., 2006. "Handbook of Computational Economics, Vol. 2: Agent-Based Computational Economics," Staff General Research Papers 10368, Iowa State University, Department of Economics.
- Anat Bracha & Donald Brown, 2010. "Affective Decision-Making: A Theory of Optimism-Bias," Levine's Working Paper Archive 661465000000000123, David K. Levine.
- Simon, Herbert A, 1979.
"Rational Decision Making in Business Organizations,"
American Economic Review,
American Economic Association, vol. 69(4), pages 493-513, September.
- Simon, Herbert A., 1978. "Rational Decision-Making in Business Organizations," Nobel Prize in Economics documents 1978-1, Nobel Prize Committee.
- Herbert Simon, 2000. "Bounded rationality in social science: Today and tomorrow," Mind and Society: Cognitive Studies in Economics and Social Sciences, Fondazione Rosselli, vol. 1(1), pages 25-39, March.
- Paul A. David, 1997.
"Path Dependence and the Quest for Historical Economics: One More chorus of Ballad of QWERTY,"
Oxford University Economic and Social History Series
_020, Economics Group, Nuffield College, University of Oxford.
- Paul David, 1997. "Path Dependence and the Quest for Historical Economics: One More chorus of Ballad of QWERTY," Economics Series Working Papers 1997-W20, University of Oxford, Department of Economics.
- Giovanni Dosi & Marco Faillo & Luigi Marengo & Daniele Moschella, 2011. "Toward Formal Representations of Search Processes and Routines in Organizational Problem Solving. An Assessment of the State of the Art," LEM Papers Series 2011/04, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Salvatore Rizzello, 2004. "Knowledge as a Path-Dependence Process," Journal of Bioeconomics, Springer, vol. 6(3), pages 255-274, 09.
- Anat Bracha & Donald J. Brown, 2010. "Affective Decision-Making: A Theory of Optimism-Bias," Cowles Foundation Discussion Papers 1759, Cowles Foundation for Research in Economics, Yale University.
- Chatterjee, Sidharta, 2014. "Equilibrium Models of Macroeconomic Science: What to Look For in (DSGE) Models?," MPRA Paper 53893, University Library of Munich, Germany.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ekkehart Schlicht).
If references are entirely missing, you can add them using this form.