An artificial economy based on reinforcement learning and agent based modeling
AbstractIn this paper we employ techniques from artificial intelligence such as reinforcement learning and agent based modeling as building blocks of a computational model for an economy based on convention. First we model the interaction among firms in the private sector. These firms behave in an information environment based on conventions meaning that a firm is likely to behave as it neighbors if it observes that their actions lead to a good pay-off. On the other hand, we propose the use of reinforcement learning as a computational model for the role of goverment in the economy, as the agent that determines the fiscal policy, and whose objective is to maximize economy growth. We present the implementation of a simulator of the proposed model based on SWARM, that employs the SARSA algotithm combined wiht a multilayer perceptron as the function approximation for the action value function
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by UNIVERSIDAD DEL ROSARIO in its series DOCUMENTOS DE TRABAJO with number 003907.
Date of creation: 30 Apr 2007
Date of revision:
Contact details of provider:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-81, September.
- Hopkins, E., 1995.
"Learning, Matching and Aggregation,"
95a20, Universite Aix-Marseille III.
- Ed Hopkins, . "Learning, Matching and Aggregation," ESE Discussion Papers 2, Edinburgh School of Economics, University of Edinburgh.
- Ed Hopkins, . "Learning, Matching and Aggregation," ELSE working papers 033, ESRC Centre on Economics Learning and Social Evolution.
- Ed Hopkins, . "Learning, Matching and Aggregation," Department of Economics 1996 : II, Edinburgh School of Economics, University of Edinburgh.
- Ed Hopkins, 1995. "Learning, Matching and Aggregation," Game Theory and Information 9512001, EconWPA.
- Ed Hopkins, . "Learning, Matching and Aggregation," Discussion Papers 1996-2, Edinburgh School of Economics, University of Edinburgh.
- Brenner, Thomas, 2006.
"Agent Learning Representation: Advice on Modelling Economic Learning,"
Handbook of Computational Economics,
in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 18, pages 895-947
- Thomas Brenner, 2004. "Agent Learning Representation - Advice in Modelling Economic Learning," Papers on Economics and Evolution 2004-16, Max Planck Institute of Economics, Evolutionary Economics Group.
- Duffy, John, 2006.
"Agent-Based Models and Human Subject Experiments,"
Handbook of Computational Economics,
in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011
- Thomas J. Sargent & Francois R. Velde, 1998. "Optimal Fiscal Policy in a Linear Stochastic Economy," QM&RBC Codes 130, Quantitative Macroeconomics & Real Business Cycles.
- Tilman B�rgers & Rajiv Sarin, .
"Learning Through Reinforcement and Replicator Dynamics,"
ELSE working papers
051, ESRC Centre on Economics Learning and Social Evolution.
- Borgers, Tilman & Sarin, Rajiv, 1997. "Learning Through Reinforcement and Replicator Dynamics," Journal of Economic Theory, Elsevier, vol. 77(1), pages 1-14, November.
- T. Borgers & R. Sarin, 2010. "Learning Through Reinforcement and Replicator Dynamics," Levine's Working Paper Archive 380, David K. Levine.
- Feltovich, Nick, 1999. "Equilibrium and reinforcement learning in private-information games: An experimental study1," Journal of Economic Dynamics and Control, Elsevier, vol. 23(9-10), pages 1605-1632, September.
- Erev, Ido & Bereby-Meyer, Yoella & Roth, Alvin E., 1999. "The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models," Journal of Economic Behavior & Organization, Elsevier, vol. 39(1), pages 111-128, May.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Publicaciones Economía).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.