IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2003-32-1.html
   My bibliography  Save this article

Replication, Replication and Replication: Some Hard Lessons from Model Alignmen

Author

Abstract

A published simulation model (Riolo et al. 2001) was replicated in two independent implementations so that the results as well as the conceptual design align. This double replication allowed the original to be analysed and critiqued with confidence. In this case, the replication revealed some weaknesses in the original model, which otherwise might not have come to light. This shows that unreplicated simulation models and their results can not be trusted – as with other kinds of experiment, simulations need to be independently replicated.

Suggested Citation

  • Bruce Edmonds & David Hales, 2003. "Replication, Replication and Replication: Some Hard Lessons from Model Alignmen," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-11.
  • Handle: RePEc:jas:jasssj:2003-32-1
    as

    Download full text from publisher

    File URL: http://jasss.soc.surrey.ac.uk/6/4/11.html
    Download Restriction: no

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Uri Wilensky & William Rand, 2007. "Making Models Match: Replicating an Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(4), pages 1-2.
    2. Happe, Kathrin & Kellermann, Konrad, 2007. "DIESE MODELLE SIND ZU KOMPLEX!-ODER DOCH NICHT?: EXPERIMENTELLES DESIGN UND METAMODELLIERUNG ALS MOGLICHER WEG, DAS KOMMUNIKATIONSPROBLEM AGENTENBASIERTER MODELLE IN DER POLITIKANALYSE ZU LOSEN (Germa," 47th Annual Conference, Weihenstephan, Germany, September 26-28, 2007 7613, German Association of Agricultural Economists (GEWISOLA).
    3. José Manuel Galán & Luis R. Izquierdo & Segismundo S. Izquierdo & José Ignacio Santos & Ricardo del Olmo & Adolfo López-Paredes & Bruce Edmonds, 2009. "Errors and Artefacts in Agent-Based Modelling," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-1.
    4. Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
    5. Radax, Wolfgang & Rengs, Bernhard, 2009. "Replication of the Demographic Prisoner’s Dilemma," MPRA Paper 14419, University Library of Munich, Germany.
    6. J. Gary Polhill & Dawn C. Parker & Daniel Brown & Volker Grimm, 2008. "Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-3.
    7. repec:spr:scient:v:99:y:2014:i:3:d:10.1007_s11192-014-1239-1 is not listed on IDEAS
    8. Janssen, Marco A., 2007. "Coordination in irrigation systems: An analysis of the Lansing-Kremer model of Bali," Agricultural Systems, Elsevier, vol. 93(1-3), pages 170-190, March.
    9. J. Gary Polhill & Bruce Edmonds, 2007. "Open Access for Social Simulation," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(3), pages 1-10.
    10. Sylvie Geisendorf, 2016. "The impact of personal beliefs on climate change: the “battle of perspectives” revisited," Journal of Evolutionary Economics, Springer, vol. 26(3), pages 551-580, July.
    11. Marco A. Janssen, 2009. "Understanding Artificial Anasazi," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(4), pages 1-13.
    12. Juliette Rouchier & Claudio Cioffi-Revilla & J. Gary Polhill & Keiki Takadama, 2008. "Progress in Model-To-Model Analysis," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-8.
    13. Ugo Merlone & Michele Sonnessa & Pietro Terna, 2008. "Horizontal and Vertical Multiple Implementations in a Model of Industrial Districts," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-5.
    14. Heinrich, Torsten, 2016. "The Narrow and the Broad Approach to Evolutionary Modeling in Economics," MPRA Paper 75797, University Library of Munich, Germany.
    15. Riccardo Boero & Flaminio Squazzoni, 2005. "Does Empirical Embeddedness Matter? Methodological Issues on Agent-Based Models for Analytical Social Science," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(4), pages 1-6.

    More about this item

    Keywords

    [No keywords];

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2003-32-1. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Flaminio Squazzoni). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.