Learning And Adaptive Artificial Agents: An Analysis Of Evolutionary Economic Models
AbstractThe last years have been seen an extraordinary flourishing of works studying learning and adaptive behaviour in diverse fields. Following the fashion of computer innovation, there has been a growing interest in application to economic models of learning procedure developed in evolutionary computation tools such as genetic algorithms. Accordingly then, the use of computer simulation based on the related genetic algorithms (GAs) has largely taken by many researchers, for example, Axelord (1987), Marimon, McGrattan and Sargent (1990), Arifovic (1994, 1995a, 1995b), Arifovic and Eaton (1995), Dawid (1996a, 1996b), Birchenhall (1995), Birchenhall et al (1997), Bullard and Duffy (1997), Riechmann (1998, 1999), and Vriend (1998).We study a simple overlapping generation economy as an adaptive learning system. There are two populations co-existing in each period of time. A significant departure to representative agent in economic modelling is a release of hypothesis of perfect foresight or rational expectation. As a result, individual agents in the economy have heterogeneous beliefs concerning realisation of possible outcomes. With the existence of heterogeneity in the economy, actual outcome may or may not identical to any particular individual agent' expectation ex-ante. When the actual outcome feeds back to individual agents' beliefs, individual agents learn to correctly update their own beliefs. The learning is via a so-called genetic algorithm process.The framework proposed here is identical to the one considered in Bullard and Duffy (1998). Two prime questions raised are firstly the explanation of appearance of convergence to the Pareto superior equilibrium, and secondly how robust its convergence is to the changes in parameter value of the model, in particular, there are distinctions in two respects: within one learning scheme and between learning schemes. Moreover, we will look at what Vriend (1998) addressed a so-called "spite-effect"; in an economic setting, the effect of the economic forces might lead to significantly different results when applied computational tools between individual and social learning.We investigate performances of Holland's standard GA (SGA), Arifovic's augmented GA (AGA), and Birchenhall's selective transfer GA (STGA). Compared to modern artificial adaptive techniques, Maynard Smith's replicator model in its simple formulation highlighting the role of selection has been successfully applied in economics. In this study, the results from the replicator dynamics are compared to results of the related GAs above. In addition, we modify these learning algorithms. The results are compared to the results of their originals. Our work suggests that the stability of the Pareto superior equilibrium of the model is robust i.e. independent of the precise algorithm used. Finally, a further work for the study is necessary, even if it is a little speculative. While the learning schemes are not derived from an explicit behavioural model, one learning algorithm can be only described as a specific form of learning process. In other words, we ask which learning scheme agent will use population-wide when agent has many learning schemes available.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Society for Computational Economics in its series Computing in Economics and Finance 2000 with number 327.
Date of creation: 05 Jul 2000
Date of revision:
Contact details of provider:
Postal: CEF 2000, Departament d'Economia i Empresa, Universitat Pompeu Fabra, Ramon Trias Fargas, 25,27, 08005, Barcelona, Spain
Fax: +34 93 542 17 46
Web page: http://enginy.upf.es/SCE/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- James Bullard & John Duffy, 2010.
"Using genetic algorithms to model the evolution of heterogenous beliefs,"
Levine's Working Paper Archive
550, David K. Levine.
- Bullard, James & Duffy, John, 1999. "Using Genetic Algorithms to Model the Evolution of Heterogeneous Beliefs," Computational Economics, Society for Computational Economics, vol. 13(1), pages 41-60, February.
- James Bullard & John Duffy, 1994. "Using genetic algorithms to model the evolution of heterogeneous beliefs," Working Papers 1994-028, Federal Reserve Bank of St. Louis.
- Selten, Reinhard, 1991.
"Evolution, learning, and economic behavior,"
Games and Economic Behavior,
Elsevier, vol. 3(1), pages 3-24, February.
- Riechmann, Thomas, 1998.
"Genetic Algorithms and Economic Evolution,"
Diskussionspapiere der Wirtschaftswissenschaftlichen FakultÃ¤t der Leibniz UniversitÃ¤t Hannover
dp-219, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
- Sent,Esther-Mirjam, 1998.
"The Evolving Rationality of Rational Expectations,"
Cambridge University Press, number 9780521571647, November.
- Marimon, R. & Mcgrattan, E. & Sargent, T.J., 1989.
"Money As A Medium Of Exchange In An Economy With Artificially Intelligent Agents,"
e-89-28, Hoover Institution, Stanford University.
- Marimon, Ramon & McGrattan, Ellen & Sargent, Thomas J., 1990. "Money as a medium of exchange in an economy with artificially intelligent agents," Journal of Economic Dynamics and Control, Elsevier, vol. 14(2), pages 329-373, May.
- John C. Harsanyi & Reinhard Selten, 1988. "A General Theory of Equilibrium Selection in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262582384, June.
- Arifovic, Jasmina & Eaton, Curtis, 1995.
"Coordination via Genetic Learning,"
Society for Computational Economics, vol. 8(3), pages 181-203, August.
- Arifovic, Jasmina, 1994. "Genetic algorithm learning and the cobweb model," Journal of Economic Dynamics and Control, Elsevier, vol. 18(1), pages 3-28, January.
- Arifovic, Jasmina, 1995. "Genetic algorithms and inflationary economies," Journal of Monetary Economics, Elsevier, vol. 36(1), pages 219-243, August.
- Arifovic, Jasmina, 1996. "The Behavior of the Exchange Rate in the Genetic Algorithm and Experimental Economies," Journal of Political Economy, University of Chicago Press, vol. 104(3), pages 510-41, June.
- Herbert Dawid, 1996. "Learning of cycles and sunspot equilibria by Genetic Algorithms (*)," Journal of Evolutionary Economics, Springer, vol. 6(4), pages 361-373.
- Vriend, Nicolaas J., 2000. "An illustration of the essential difference between individual and social learning, and its consequences for computational analyses," Journal of Economic Dynamics and Control, Elsevier, vol. 24(1), pages 1-19, January.
- Blume, Lawrence E. & Easley, David, 1982. "Learning to be rational," Journal of Economic Theory, Elsevier, vol. 26(2), pages 340-351, April.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F. Baum).
If references are entirely missing, you can add them using this form.