IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Learning And Adaptive Artificial Agents: An Analysis Of Evolutionary Economic Models

  • Jie-Shin Lin

    (University of Manchester)

  • Chris Birchenhall
Registered author(s):

    The last years have been seen an extraordinary flourishing of works studying learning and adaptive behaviour in diverse fields. Following the fashion of computer innovation, there has been a growing interest in application to economic models of learning procedure developed in evolutionary computation tools such as genetic algorithms. Accordingly then, the use of computer simulation based on the related genetic algorithms (GAs) has largely taken by many researchers, for example, Axelord (1987), Marimon, McGrattan and Sargent (1990), Arifovic (1994, 1995a, 1995b), Arifovic and Eaton (1995), Dawid (1996a, 1996b), Birchenhall (1995), Birchenhall et al (1997), Bullard and Duffy (1997), Riechmann (1998, 1999), and Vriend (1998).We study a simple overlapping generation economy as an adaptive learning system. There are two populations co-existing in each period of time. A significant departure to representative agent in economic modelling is a release of hypothesis of perfect foresight or rational expectation. As a result, individual agents in the economy have heterogeneous beliefs concerning realisation of possible outcomes. With the existence of heterogeneity in the economy, actual outcome may or may not identical to any particular individual agent' expectation ex-ante. When the actual outcome feeds back to individual agents' beliefs, individual agents learn to correctly update their own beliefs. The learning is via a so-called genetic algorithm process.The framework proposed here is identical to the one considered in Bullard and Duffy (1998). Two prime questions raised are firstly the explanation of appearance of convergence to the Pareto superior equilibrium, and secondly how robust its convergence is to the changes in parameter value of the model, in particular, there are distinctions in two respects: within one learning scheme and between learning schemes. Moreover, we will look at what Vriend (1998) addressed a so-called "spite-effect"; in an economic setting, the effect of the economic forces might lead to significantly different results when applied computational tools between individual and social learning.We investigate performances of Holland's standard GA (SGA), Arifovic's augmented GA (AGA), and Birchenhall's selective transfer GA (STGA). Compared to modern artificial adaptive techniques, Maynard Smith's replicator model in its simple formulation highlighting the role of selection has been successfully applied in economics. In this study, the results from the replicator dynamics are compared to results of the related GAs above. In addition, we modify these learning algorithms. The results are compared to the results of their originals. Our work suggests that the stability of the Pareto superior equilibrium of the model is robust i.e. independent of the precise algorithm used. Finally, a further work for the study is necessary, even if it is a little speculative. While the learning schemes are not derived from an explicit behavioural model, one learning algorithm can be only described as a specific form of learning process. In other words, we ask which learning scheme agent will use population-wide when agent has many learning schemes available.

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL: http://fmwww.bc.edu/cef00/papers/paper327.pdf
    Download Restriction: no

    Paper provided by Society for Computational Economics in its series Computing in Economics and Finance 2000 with number 327.

    as
    in new window

    Length:
    Date of creation: 05 Jul 2000
    Date of revision:
    Handle: RePEc:sce:scecf0:327
    Contact details of provider: Postal: CEF 2000, Departament d'Economia i Empresa, Universitat Pompeu Fabra, Ramon Trias Fargas, 25,27, 08005, Barcelona, Spain
    Fax: +34 93 542 17 46
    Web page: http://enginy.upf.es/SCE/
    Email:


    More information through EDIRC

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as in new window
    1. Selten,Reinhard, . "Evolution,learning and economic behaviour," Discussion Paper Serie B 132, University of Bonn, Germany.
    2. repec:cup:cbooks:9780521571647 is not listed on IDEAS
    3. John C. Harsanyi & Reinhard Selten, 1988. "A General Theory of Equilibrium Selection in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262582384, June.
    4. Marimon, Ramon & McGrattan, Ellen & Sargent, Thomas J., 1990. "Money as a medium of exchange in an economy with artificially intelligent agents," Journal of Economic Dynamics and Control, Elsevier, vol. 14(2), pages 329-373, May.
    5. Arifovic, Jasmina, 1995. "Genetic algorithms and inflationary economies," Journal of Monetary Economics, Elsevier, vol. 36(1), pages 219-243, August.
    6. James Bullard & John Duffy, 1994. "Using genetic algorithms to model the evolution of heterogeneous beliefs," Working Papers 1994-028, Federal Reserve Bank of St. Louis.
    7. Arifovic, Jasmina, 1996. "The Behavior of the Exchange Rate in the Genetic Algorithm and Experimental Economies," Journal of Political Economy, University of Chicago Press, vol. 104(3), pages 510-41, June.
    8. Thomas Riechmann, 1999. "Genetic Algorithms and Economic Evolution," Computing in Economics and Finance 1999 1011, Society for Computational Economics.
    9. Sacco, Pier Luigi, 1994. "Can People Learn Rational Expectations? An 'Ecological' Approach," Journal of Evolutionary Economics, Springer, vol. 4(1), pages 35-43, March.
    10. Blume, Lawrence E. & Easley, David, 1982. "Learning to be rational," Journal of Economic Theory, Elsevier, vol. 26(2), pages 340-351, April.
    11. Herbert Dawid, 1996. "Learning of cycles and sunspot equilibria by Genetic Algorithms (*)," Journal of Evolutionary Economics, Springer, vol. 6(4), pages 361-373.
    12. Arifovic, J. & Eaton, C., 1994. "Coordination via Genetic Learning," Discussion Papers dp94-11, Department of Economics, Simon Fraser University.
    13. Vriend, Nicolaas J., 2000. "An illustration of the essential difference between individual and social learning, and its consequences for computational analyses," Journal of Economic Dynamics and Control, Elsevier, vol. 24(1), pages 1-19, January.
    14. Arifovic, Jasmina, 1994. "Genetic algorithm learning and the cobweb model," Journal of Economic Dynamics and Control, Elsevier, vol. 18(1), pages 3-28, January.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:sce:scecf0:327. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F. Baum)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.