IDEAS home Printed from https://ideas.repec.org/a/eee/ecomod/v501y2025ics0304380024003557.html
   My bibliography  Save this article

Using the ODD protocol and NetLogo to replicate agent-based models

Author

Listed:
  • Grimm, Volker
  • Berger, Uta
  • Calabrese, Justin M.
  • Cortés-Avizanda, Ainara
  • Ferrer, Jordi
  • Franz, Mathias
  • Groeneveld, Jürgen
  • Hartig, Florian
  • Jakoby, Oliver
  • Jovani, Roger
  • Kramer-Schadt, Stephanie
  • Münkemüller, Tamara
  • Piou, Cyril
  • Premo, L.S.
  • Pütz, Sandro
  • Quintaine, Thomas
  • Rademacher, Christine
  • Rüger, Nadja
  • Schmolke, Amelie
  • Thiele, Jan C.
  • Touza, Julia
  • Railsback, Steven F.

Abstract

Replicating existing models and their key results not only adds credibility to the original work, it also allows modellers to start model development from an existing approach rather than from scratch. New theory can then be developed by changing the assumptions or scenarios tested, or by carrying out more in-depth analysis of the model. However, model replication can be challenging if the original model description is incomplete or ambiguous. Here we show that the use of standards can facilitate and speed up replication: the ODD protocol for describing models, and NetLogo, an easy-to-learn but powerful software platform and language for implementing agent-based models. To demonstrate the benefits of this approach, we conducted a replication experiment on 18 agent-based models from different disciplines. The researchers doing the replications had no or little previous experience using ODD and NetLogo. Their task was to rewrite the original model description using ODD, implement the model in NetLogo and try to replicate at least one exemplary main result. They were also asked to produce, if time allowed, some initial new results with the replicated model, and to record the total time spent on the replication exercise. Replication was successful for 15 out of 18 models. The time taken varied between 2 and 12 days, with an average of 5 days. ODD helped to systematically scan the original model description, while NetLogo proved easy and quick to learn, but difficult to debug when implementation problems arose. Although most of the models replicated were relatively simple, we conclude that even for more complex models it can be useful to use ODD and NetLogo for replication, at least for developing a prototype to help decide how to proceed with the replicated model. Overall, the use of both, standard approaches such as ODD and easy to learn but powerful software such as NetLogo, can promote coherence and efficiency within and between different models and modelling communities. Imagine if all modellers spoke ODD and NetLogo as a common language or lingua franca.

Suggested Citation

  • Grimm, Volker & Berger, Uta & Calabrese, Justin M. & Cortés-Avizanda, Ainara & Ferrer, Jordi & Franz, Mathias & Groeneveld, Jürgen & Hartig, Florian & Jakoby, Oliver & Jovani, Roger & Kramer-Schadt, S, 2025. "Using the ODD protocol and NetLogo to replicate agent-based models," Ecological Modelling, Elsevier, vol. 501(C).
  • Handle: RePEc:eee:ecomod:v:501:y:2025:i:c:s0304380024003557
    DOI: 10.1016/j.ecolmodel.2024.110967
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304380024003557
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ecolmodel.2024.110967?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. David Hales & Juliette Rouchier & Bruce Edmonds, 2003. "Model-To-Model Analysis," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-5.
    2. Volker Grimm & Alice S. A. Johnston & H.-H. Thulke & V. E. Forbes & P. Thorbek, 2020. "Three questions to ask before using model outputs for decision support," Nature Communications, Nature, vol. 11(1), pages 1-3, December.
    3. Grimm, Volker & Augusiak, Jacqueline & Focks, Andreas & Frank, Béatrice M. & Gabsi, Faten & Johnston, Alice S.A. & Liu, Chun & Martin, Benjamin T. & Meli, Mattia & Radchuk, Viktoriia & Thorbek, Pernil, 2014. "Towards better modelling and decision support: Documenting model development, testing, and analysis using TRACE," Ecological Modelling, Elsevier, vol. 280(C), pages 129-139.
    4. Guillaume Deffuant & Frederic Amblard & Gérard Weisbuch, 2002. "How Can Extremism Prevail? a Study Based on the Relative Agreement Interaction Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 5(4), pages 1-1.
    5. Ginovart, M & López, D & Valls, J & Silbert, M, 2002. "Individual based simulations of bacterial growth on agar plates," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 305(3), pages 604-618.
    6. Volker Grimm & Steven F. Railsback & Christian E. Vincenot & Uta Berger & Cara Gallagher & Donald L. DeAngelis & Bruce Edmonds & Jiaqi Ge & Jarl Giske & Jürgen Groeneveld & Alice S.A. Johnston & Alex, 2020. "The ODD Protocol for Describing Agent-Based and Other Simulation Models: A Second Update to Improve Clarity, Replication, and Structural Realism," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 23(2), pages 1-7.
    7. Jonas Hauke & Sebastian Achter & Matthias Meyer, 2020. "Theory Development Via Replicated Simulations and the Added Value of Standards," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 23(1), pages 1-12.
    8. Grimm, Volker & Berger, Uta, 2016. "Robustness analysis: Deconstructing computational models for ecological theory and applications," Ecological Modelling, Elsevier, vol. 326(C), pages 162-167.
    9. Benjamin Kerr & Margaret A. Riley & Marcus W. Feldman & Brendan J. M. Bohannan, 2002. "Local dispersal promotes biodiversity in a real-life game of rock–paper–scissors," Nature, Nature, vol. 418(6894), pages 171-174, July.
    10. Christoph Hauert & Michael Doebeli, 2004. "Spatial structure often inhibits the evolution of cooperation in the snowdrift game," Nature, Nature, vol. 428(6983), pages 643-646, April.
    11. J. Gareth Polhill & Dawn C. Parker & Daniel Brown & Volker Grimm, 2008. "Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(2), pages 1-3.
    12. Bruce Edmonds & David Hales, 2003. "Replication, Replication and Replication: Some Hard Lessons from Model Alignmen," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 6(4), pages 1-11.
    13. Grimm, Volker & Berger, Uta & DeAngelis, Donald L. & Polhill, J. Gary & Giske, Jarl & Railsback, Steven F., 2010. "The ODD protocol: A review and first update," Ecological Modelling, Elsevier, vol. 221(23), pages 2760-2768.
    14. Steven F. Railsback & Daniel Ayllón & Uta Berger & Volker Grimm & Steven Lytinen & Colin Sheppard & Jan Thiele, 2017. "Improving Execution Speed of Models Implemented in NetLogo," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 20(1), pages 1-3.
    15. Ayllón, Daniel & Railsback, Steven F. & Vincenzi, Simone & Groeneveld, Jürgen & Almodóvar, Ana & Grimm, Volker, 2016. "InSTREAM-Gen: Modelling eco-evolutionary dynamics of trout populations under anthropogenic environmental change," Ecological Modelling, Elsevier, vol. 326(C), pages 36-53.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. An, Li & Grimm, Volker & Sullivan, Abigail & Turner II, B.L. & Malleson, Nicolas & Heppenstall, Alison & Vincenot, Christian & Robinson, Derek & Ye, Xinyue & Liu, Jianguo & Lindkvist, Emilie & Tang, W, 2021. "Challenges, tasks, and opportunities in modeling agent-based complex systems," Ecological Modelling, Elsevier, vol. 457(C).
    2. Planque, Benjamin & Aarflot, Johanna M. & Buttay, Lucie & Carroll, JoLynn & Fransner, Filippa & Hansen, Cecilie & Husson, Bérengère & Langangen, Øystein & Lindstrøm, Ulf & Pedersen, Torstein & Primice, 2022. "A standard protocol for describing the evaluation of ecological models," Ecological Modelling, Elsevier, vol. 471(C).
    3. Chudzinska, Magda & Nabe-Nielsen, Jacob & Smout, Sophie & Aarts, Geert & Brasseur, Sophie & Graham, Isla & Thompson, Paul & McConnell, Bernie, 2021. "AgentSeal: Agent-based model describing movement of marine central-place foragers," Ecological Modelling, Elsevier, vol. 440(C).
    4. Drechsler, Martin & Wätzold, Frank & Grimm, Volker, 2022. "The hitchhiker's guide to generic ecological-economic modelling of land-use-based biodiversity conservation policies," Ecological Modelling, Elsevier, vol. 465(C).
    5. Bialozyt, Ronald B. & Roß-Nickoll, Martina & Ottermanns, Richard & Jetzkowitz, Jens, 2025. "The different ways to operationalise the social in applied models and simulations of sustainability science: A contribution for the enhancement of good modelling practices," Ecological Modelling, Elsevier, vol. 500(C).
    6. Lorscheid, Iris & Meyer, Matthias, 2016. "Divide and conquer: Configuring submodels for valid and efficient analyses of complex simulation models," Ecological Modelling, Elsevier, vol. 326(C), pages 152-161.
    7. Watson, Joseph W & Boyd, Robin & Dutta, Ritabrata & Vasdekis, Georgios & Walker, Nicola D. & Roy, Shovonlal & Everitt, Richard & Hyder, Kieran & Sibly, Richard M, 2022. "Incorporating environmental variability in a spatially-explicit individual-based model of European sea bass✰," Ecological Modelling, Elsevier, vol. 466(C).
    8. Grimm, Volker & Berger, Uta, 2016. "Structural realism, emergence, and predictions in next-generation ecological modelling: Synthesis from a special issue," Ecological Modelling, Elsevier, vol. 326(C), pages 177-187.
    9. Crouse, Kristin N. & Desai, Nisarg P. & Cassidy, Kira A. & Stahler, Erin E. & Lehman, Clarence L. & Wilson, Michael L., 2022. "Larger territories reduce mortality risk for chimpanzees, wolves, and agents: Multiple lines of evidence in a model validation framework," Ecological Modelling, Elsevier, vol. 471(C).
    10. Troost, Christian & Huber, Robert & Bell, Andrew R. & van Delden, Hedwig & Filatova, Tatiana & Le, Quang Bao & Lippe, Melvin & Niamir, Leila & Polhill, J. Gareth & Sun, Zhanli & Berger, Thomas, 2023. "How to keep it adequate: A protocol for ensuring validity in agent-based simulation," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 159, pages 1-21.
    11. Micheletti, Tatiane & Wimmler, Marie-Christin & Berger, Uta & Grimm, Volker & McIntire, Eliot J., 2024. "Beyond guides, protocols and acronyms: Adoption of good modelling practices depends on challenging academia's status quo in ecology," Ecological Modelling, Elsevier, vol. 496(C).
    12. Lapp, Maya & Long, Colby, 2022. "A new approach to agent-based models of Community Resource Management based on the analysis of cheating, monitoring, and sanctioning," Ecological Modelling, Elsevier, vol. 468(C).
    13. Zanette, Eduardo M. & Bialozyt, Ronald B. & Santos, Mayara M. & de Almeida e Silva, Anne Sophie & Bufalo, Felipe & Kaisin, Olivier & Messaoudi, Yness & Alcolea, Mirela & Heymann, Eckhard W. & Culot, L, 2025. "Predicting frugivore generated seed rain in different environmental contexts: a modelling approach applied to a forest specialist," Ecological Modelling, Elsevier, vol. 505(C).
    14. Meier, Laura & Grimm, Volker & Frank, Karin, 2025. "Model perpetuation by designing and documenting models and workflows so that they can be reused and further developed by others: The case of multiple stressors in ecology," Ecological Modelling, Elsevier, vol. 501(C).
    15. Bruce Edmonds, 2010. "Bootstrapping Knowledge About Social Phenomena Using Simulation Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 13(1), pages 1-8.
    16. Dick, D.D.C. & Ayllón, D., 2017. "FloMan-MF: Floodplain Management for the Moor Frog − a simulation model for amphibian conservation in dynamic wetlands," Ecological Modelling, Elsevier, vol. 348(C), pages 110-124.
    17. Tardy, Olivia & Lenglos, Christophe & Lai, Sandra & Berteaux, Dominique & Leighton, Patrick A., 2023. "Rabies transmission in the Arctic: An agent-based model reveals the effects of broad-scale movement strategies on contact risk between Arctic foxes," Ecological Modelling, Elsevier, vol. 476(C).
    18. Jascha-Alexander Koch & Jens Lausen & Moritz Kohlhase, 2021. "Internalizing the externalities of overfunding: an agent-based model approach for analyzing the market dynamics on crowdfunding platforms," Journal of Business Economics, Springer, vol. 91(9), pages 1387-1430, November.
    19. Crevier, Lucas Phillip & Salkeld, Joseph H & Marley, Jessa & Parrott, Lael, 2021. "Making the best possible choice: Using agent-based modelling to inform wildlife management in small communities," Ecological Modelling, Elsevier, vol. 446(C).
    20. Dur, Gaël & Won, Eun-Ji & Han, Jeonghoon & Lee, Jae-Seong & Souissi, Sami, 2021. "An individual-based model for evaluating post-exposure effects of UV-B radiation on zooplankton reproduction," Ecological Modelling, Elsevier, vol. 441(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecomod:v:501:y:2025:i:c:s0304380024003557. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/ecological-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.