IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2008-10-2.html
   My bibliography  Save this article

Errors and Artefacts in Agent-Based Modelling

Author

Abstract

The objectives of this paper are to define and classify different types of errors and artefacts that can appear in the process of developing an agent-based model, and to propose activities aimed at avoiding them during the model construction and testing phases. To do this in a structured way, we review the main concepts of the process of developing such a model – establishing a general framework that summarises the process of designing, implementing, and using agent-based models. Within this framework we identify the various stages where different types of errors and artefacts may appear. Finally we propose activities that could be used to detect (and hence eliminate) each type of error or artefact.

Suggested Citation

  • José Manuel Galán & Luis R. Izquierdo & Segismundo S. Izquierdo & José Ignacio Santos & Ricardo del Olmo & Adolfo López-Paredes & Bruce Edmonds, 2009. "Errors and Artefacts in Agent-Based Modelling," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-1.
  • Handle: RePEc:jas:jasssj:2008-10-2
    as

    Download full text from publisher

    File URL: http://jasss.soc.surrey.ac.uk/12/1/1/1.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. Klemm, Konstantin & Eguiluz, Victor M. & Toral, Raul & Miguel, Maxi San, 2005. "Globalization, polarization and cultural drift," Journal of Economic Dynamics and Control, Elsevier, vol. 29(1-2), pages 321-334, January.
    2. Hare, M & Deadman, P, 2004. "Further towards a taxonomy of agent-based simulation models in environmental management," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 64(1), pages 25-40.
    3. Keiki Takadama & Yutaka L. Suematsu & Norikazu Sugimoto & Norberto E. Nawa & Katsunori Shimohara, 2003. "Cross-Element Validation in Multiagent-Based Simulation: Switching Learning Mechanisms in Agents," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-6.
    4. Margaret Edwards & Sylvie Huet & François Goreaud & Guillaume Deffuant, 2003. "Comparing an Individual-Based Model of Behaviour Diffusion with Its Mean Field Aggregate Approximation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-9.
    5. Norman Ehrentreich, 2002. "The Santa Fe Artificial Stock Market Re-Examined - Suggested Corrections," Computational Economics 0209001, University Library of Munich, Germany.
    6. Kleijnen, Jack P. C., 1995. "Verification and validation of simulation models," European Journal of Operational Research, Elsevier, vol. 82(1), pages 145-162, April.
    7. Andreas Flache & Rainer Hegselmann, 2001. "Do Irregular Grids Make a Difference? Relaxing the Spatial Regularity Assumption in Cellular Models of Social Dynamics," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 4(4), pages 1-6.
    8. Ehrentreich, Norman, 2006. "Technical trading in the Santa Fe Institute Artificial Stock Market revisited," Journal of Economic Behavior & Organization, Elsevier, vol. 61(4), pages 599-616, December.
    9. Matteo Richiardi & Roberto Leombruni & Nicole J. Saam & Michele Sonnessa, 2006. "A Common Protocol for Agent-Based Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(1), pages 1-15.
    10. Leombruni, Roberto & Richiardi, Matteo, 2005. "Why are economists sceptical about agent-based simulations?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 355(1), pages 103-109.
    11. J. Gareth Polhill & Luis R. Izquierdo & Nicholas M. Gotts, 2004. "The Ghost in the Model (and Other Effects of Floating Point Arithmetic)," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(1), pages 1-5.
    12. Caron-Lormier, Geoffrey & Humphry, Roger W. & Bohan, David A. & Hawes, Cathy & Thorbek, Pernille, 2008. "Asynchronous and synchronous updating in individual-based models," Ecological Modelling, Elsevier, vol. 212(3), pages 522-527.
    13. Axelrod, Robert, 1986. "An Evolutionary Approach to Norms," American Political Science Review, Cambridge University Press, vol. 80(4), pages 1095-1111, December.
    14. Segismundo S. Izquierdo & Luis R. Izquierdo & Nicholas M. Gotts, 2008. "Reinforcement Learning Dynamics in Social Dilemmas," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-1.
    15. Nigel Gilbert & Pietro Terna, 2000. "How to build and use agent-based models in social science," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 1(1), pages 57-72, March.
    16. LeBaron, Blake & Arthur, W. Brian & Palmer, Richard, 1999. "Time series properties of an artificial stock market," Journal of Economic Dynamics and Control, Elsevier, vol. 23(9-10), pages 1487-1516, September.
    17. Uri Wilensky & William Rand, 2007. "Making Models Match: Replicating an Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(4), pages 1-2.
    18. Sylvie Huet & Margaret Edwards & Guillaume Deffuant, 2007. "Taking into Account the Variations of Neighbourhood Sizes in the Mean-Field Approximation of the Threshold Model on a Random Network," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(1), pages 1-10.
    19. J. Gareth Polhill & Luis R. Izquierdo, 2005. "Lessons Learned from Converting the Artificial Stock Market to Interval Arithmetic," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(2), pages 1-2.
    20. José Manuel Galán & Luis R. Izquierdo, 2005. "Appearances Can Be Deceiving: Lessons Learned Re-Implementing Axelrod's 'Evolutionary Approach to Norms'," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(3), pages 1-2.
    21. Andreas Flache & Michael W. Macy, 2002. "Stochastic Collusion and the Power Law of Learning," Journal of Conflict Resolution, Peace Science Society (International), vol. 46(5), pages 629-653, October.
    22. Bruce Edmonds & David Hales, 2003. "Replication, Replication and Replication: Some Hard Lessons from Model Alignmen," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-11.
    23. Jürgen Klüver & Christina Klüver, 2003. "Simulations of Group Dynamics with Different Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-8.
    24. Luis R. Izquierdo & Segismundo S. Izquierdo & José Manuel Galán & José Ignacio Santos, 2009. "Techniques to Understand Computer Simulations: Markov Chain Analysis," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-6.
    25. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Gotts, Nicholas M. & Polhill, J. Gary, 2007. "Transient and asymptotic dynamics of reinforcement learning in games," Games and Economic Behavior, Elsevier, vol. 61(2), pages 259-276, November.
    26. George B. Kleindorfer & Liam O'Neill & Ram Ganeshan, 1998. "Validation in Simulation: Various Positions in the Philosophy of Science," Management Science, INFORMS, vol. 44(8), pages 1087-1099, August.
    27. Luis R. Izquierdo & J. Gareth Polhill, 2006. "Is Your Model Susceptible to Floating-Point Errors?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(4), pages 1-4.
    28. J. Gareth Polhill & Edoardo Pignotti & Nicholas M. Gotts & Pete Edwards & Alun Preece, 2007. "A Semantic Grid Service for Experimentation with an Agent-Based Model of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-2.
    29. Joshua M. Epstein & Robert L. Axtell, 1996. "Growing Artificial Societies: Social Science from the Bottom Up," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262550253, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. J. Gareth Polhill, 2015. "Extracting OWL Ontologies from Agent-Based Models: A Netlogo Extension," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(2), pages 1-15.
    2. Jacopo Baggio & Elissaios Papyrakis, 2014. "Agent-Based Simulations of Subjective Well-Being," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 115(2), pages 623-635, January.
    3. Paola Tubaro, 2011. "Computational Economics," Chapters, in: John B. Davis & D. Wade Hands (ed.), The Elgar Companion to Recent Economic Methodology, chapter 10, Edward Elgar Publishing.
    4. Rixen, Martin & Weigand, Jürgen, 2014. "Agent-based simulation of policy induced diffusion of smart meters," Technological Forecasting and Social Change, Elsevier, vol. 85(C), pages 153-167.
    5. Juan Manuel Larrosa, 2016. "Agentes computacionales y análisis económico," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 18(34), pages 87-113, January-J.
    6. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    7. Nancy Quinceno Cárdenas, 2014. "Modelación basada en agentes en el sistema pensional colombiano. Una aproximación desde el mercado laboral y la dinámica poblacional," Revista CIFE, Universidad Santo Tomás, September.
    8. Barroso, Ricardo Vieira & Lima, Joaquim Ignacio Alves Vasconcellos & Lucchetti, Alexandre Henrique & Cajueiro, Daniel Oliveira, 2016. "Interbank network and regulation policies: an analysis through agent-based simulations with adaptive learning," MPRA Paper 73308, University Library of Munich, Germany.
    9. Kolkman, Daan, 2020. "The usefulness of algorithmic models in policy making," SocArXiv hpma8, Center for Open Science.
    10. Sara Lumbreras & Sonja Wogrin & Guillermo Navarro & Ilaria Bertazzi & Maria Pereda, 2019. "A Decentralized Solution for Transmission Expansion Planning: Getting Inspiration from Nature," Energies, MDPI, Open Access Journal, vol. 12(23), pages 1-17, November.
    11. Georg Holtz & Christian Schnülle & Malcolm Yadack & Jonas Friege & Thorben Jensen & Pablo Thier & Peter Viebahn & Émile J. L. Chappin, 2020. "Using Agent-Based Models to Generate Transformation Knowledge for the German Energiewende—Potentials and Challenges Derived from Four Case Studies," Energies, MDPI, Open Access Journal, vol. 13(22), pages 1-26, November.
    12. Sung-youn Kim, 2011. "A Model of Political Judgment: An Agent-Based Simulation of Candidate Evaluation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 14(2), pages 1-3.
    13. Bernardo Alves Furtado, 2018. "Modeling tax distribution in metropolitan regions with PolicySpace," Papers 1901.02391, arXiv.org.
    14. José M Galán & Maciej M Łatek & Seyed M Mussavi Rizi, 2011. "Axelrod's Metanorm Games on Networks," PLOS ONE, Public Library of Science, vol. 6(5), pages 1-11, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Uri Wilensky & William Rand, 2007. "Making Models Match: Replicating an Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(4), pages 1-2.
    2. Luis R. Izquierdo & Segismundo S. Izquierdo & José Manuel Galán & José Ignacio Santos, 2009. "Techniques to Understand Computer Simulations: Markov Chain Analysis," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-6.
    3. J. Gareth Polhill & Dawn C. Parker & Daniel Brown & Volker Grimm, 2008. "Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-3.
    4. Segismundo S. Izquierdo & Luis R. Izquierdo & Nicholas M. Gotts, 2008. "Reinforcement Learning Dynamics in Social Dilemmas," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-1.
    5. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    6. Luis R. Izquierdo & J. Gareth Polhill, 2006. "Is Your Model Susceptible to Floating-Point Errors?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 9(4), pages 1-4.
    7. Chueh-Yung Tsao & Ya-Chi Huang, 2018. "Revisiting the issue of survivability and market efficiency with the Santa Fe Artificial Stock Market," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 13(3), pages 537-560, October.
    8. Matthew Oremland & Reinhard Laubenbacher, 2014. "Using difference equations to find optimal tax structures on the SugarScape," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 9(2), pages 233-253, October.
    9. J. Gareth Polhill & Bruce Edmonds, 2007. "Open Access for Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(3), pages 1-10.
    10. Mario Paolucci & Francisco Grimaldo, 2014. "Mechanism change in a simulation of peer review: from junk support to elitism," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 663-688, June.
    11. Schuster, Stephan, 2012. "Applications in Agent-Based Computational Economics," MPRA Paper 47201, University Library of Munich, Germany.
    12. Dirk Helbing & Anders Johansson, 2010. "Cooperation, Norms, and Revolutions: A Unified Game-Theoretical Approach," PLOS ONE, Public Library of Science, vol. 5(10), pages 1-15, October.
    13. Friederike Wall, 2016. "Agent-based modeling in managerial science: an illustrative survey and study," Review of Managerial Science, Springer, vol. 10(1), pages 135-193, January.
    14. Ya-Chi Huang & Chueh-Yung Tsao, 2018. "Evolutionary Frequency and Forecasting Accuracy: Simulations Based on an Agent-Based Artificial Stock Market," Computational Economics, Springer;Society for Computational Economics, vol. 52(1), pages 79-104, June.
    15. Matus Halas, 2018. "Balancing Against Threats In Interactions Determined By Distance And Overall Gains," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 21(05), pages 1-22, August.
    16. José M Galán & Maciej M Łatek & Seyed M Mussavi Rizi, 2011. "Axelrod's Metanorm Games on Networks," PLOS ONE, Public Library of Science, vol. 6(5), pages 1-11, May.
    17. Friederike Wall, 2016. "Agent-based modeling in managerial science: an illustrative survey and study," Review of Managerial Science, Springer, vol. 10(1), pages 135-193, January.
    18. Riccardo Boero & Flaminio Squazzoni, 2005. "Does Empirical Embeddedness Matter? Methodological Issues on Agent-Based Models for Analytical Social Science," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(4), pages 1-6.
    19. Peter Revay & Claudio Cioffi-Revilla, 2018. "Survey of evolutionary computation methods in social agent-based modeling studies," Journal of Computational Social Science, Springer, vol. 1(1), pages 115-146, January.
    20. Christopher J Lynch & Saikou Y Diallo & Hamdi Kavak & Jose J Padilla, 2020. "A content analysis-based approach to explore simulation verification and identify its current challenges," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-33, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2008-10-2. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Flaminio Squazzoni). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.