An artificial economy based on reinforcement learning and agent based modeling
In this paper we employ techniques from artificial intelligence such as reinforcement learning and agent based modeling as building blocks of a computational model for an economy based on convention. First we model the interaction among firms in the private sector. These firms behave in an information environment based on conventions meaning that a firm is likely to behave as it neighbors if it observes that their actions lead to a good pay-off. On the other hand, we propose the use of reinforcement learning as a computational model for the role of goverment in the economy, as the agent that determines the fiscal policy, and whose objective is to maximize economy growth. We present the implementation of a simulator of the proposed model based on SWARM, that employs the SARSA algotithm combined wiht a multilayer perceptron as the function approximation for the action value function
|Date of creation:||30 Apr 2007|
|Date of revision:|
|Contact details of provider:|| |
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Ed Hopkins, 1995.
"Learning, Matching and Aggregation,"
Game Theory and Information
- Hopkins, E., 1995. "Learning, Matching and Aggregation," G.R.E.Q.A.M. 95a20, Universite Aix-Marseille III.
- Ed Hopkins, . "Learning, Matching and Aggregation," Discussion Papers 1996-2, Edinburgh School of Economics, University of Edinburgh.
- Ed Hopkins, 1995. "Learning, Matching and Aggregation," ESE Discussion Papers 2, Edinburgh School of Economics, University of Edinburgh.
- Ed Hopkins, . "Learning, Matching and Aggregation," ELSE working papers 033, ESRC Centre on Economics Learning and Social Evolution.
- Ed Hopkins, . "Learning, Matching and Aggregation," Department of Economics 1996 : II, Edinburgh School of Economics, University of Edinburgh.
- Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-81, September.
- Brenner, Thomas, 2006.
"Agent Learning Representation: Advice on Modelling Economic Learning,"
Handbook of Computational Economics,
in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 18, pages 895-947
- Thomas Brenner, 2004. "Agent Learning Representation - Advice in Modelling Economic Learning," Papers on Economics and Evolution 2004-16, Philipps University Marburg, Department of Geography.
- John Duffy, 2004.
"Agent-Based Models and Human Subject Experiments,"
- T. Borgers & R. Sarin, 2010.
"Learning Through Reinforcement and Replicator Dynamics,"
Levine's Working Paper Archive
380, David K. Levine.
- Borgers, Tilman & Sarin, Rajiv, 1997. "Learning Through Reinforcement and Replicator Dynamics," Journal of Economic Theory, Elsevier, vol. 77(1), pages 1-14, November.
- Tilman Börgers & Rajiv Sarin, . "Learning Through Reinforcement and Replicator Dynamics," ELSE working papers 051, ESRC Centre on Economics Learning and Social Evolution.
- Cooper,Russell, 1999. "Coordination Games," Cambridge Books, Cambridge University Press, number 9780521570176, November.
- Cooper,Russell, 1999. "Coordination Games," Cambridge Books, Cambridge University Press, number 9780521578967, November.
- Thomas J. Sargent & Francois R. Velde, 1998. "Optimal Fiscal Policy in a Linear Stochastic Economy," QM&RBC Codes 130, Quantitative Macroeconomics & Real Business Cycles.
- Feltovich, Nick, 1999. "Equilibrium and reinforcement learning in private-information games: An experimental study," Journal of Economic Dynamics and Control, Elsevier, vol. 23(9-10), pages 1605-1632, September.
- Erev, Ido & Bereby-Meyer, Yoella & Roth, Alvin E., 1999. "The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models," Journal of Economic Behavior & Organization, Elsevier, vol. 39(1), pages 111-128, May.
When requesting a correction, please mention this item's handle: RePEc:col:000092:003907. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Facultad de Economía)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.