IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2019-147-2.html
   My bibliography  Save this article

The ODD Protocol for Describing Agent-Based and Other Simulation Models: A Second Update to Improve Clarity, Replication, and Structural Realism

Author

Abstract

The Overview, Design concepts and Details (ODD) protocol for describing Individual- and Agent-Based Models (ABMs) is now widely accepted and used to document such models in journal articles. As a standardized document for providing a consistent, logical and readable account of the structure and dynamics of ABMs, some research groups also find it useful as a workflow for model design. Even so, there are still limitations to ODD that obstruct its more widespread adoption. Such limitations are discussed and addressed in this paper: the limited availability of guidance on how to use ODD; the length of ODD documents; limitations of ODD for highly complex models; lack of sufficient details of many ODDs to enable reimplementation without access to the model code; and the lack of provision for sections in the document structure covering model design rationale, the model’s underlying narrative, and the means by which the model’s fitness for purpose is evaluated. We document the steps we have taken to provide better guidance on: structuring complex ODDs and an ODD summary for inclusion in a journal article (with full details in supplementary material; Table 1); using ODD to point readers to relevant sections of the model code; update the document structure to include sections on model rationale and evaluation. We also further advocate the need for standard descriptions of simulation experiments and argue that ODD can in principle be used for any type of simulation model. Thereby ODD would provide a lingua franca for simulation modelling.

Suggested Citation

  • Volker Grimm & Steven F. Railsback & Christian E. Vincenot & Uta Berger & Cara Gallagher & Donald L. DeAngelis & Bruce Edmonds & Jiaqi Ge & Jarl Giske & Jürgen Groeneveld & Alice S.A. Johnston & Alex, 2020. "The ODD Protocol for Describing Agent-Based and Other Simulation Models: A Second Update to Improve Clarity, Replication, and Structural Realism," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 23(2), pages 1-7.
  • Handle: RePEc:jas:jasssj:2019-147-2
    as

    Download full text from publisher

    File URL: https://www.jasss.org/23/2/7/7.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. J. Gareth Polhill, 2015. "Extracting OWL Ontologies from Agent-Based Models: A Netlogo Extension," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(2), pages 1-15.
    2. Weller, Florian & Sherley, Richard B. & Waller, Lauren J. & Ludynia, Katrin & Geldenhuys, Deon & Shannon, Lynne J. & Jarre, Astrid, 2016. "System dynamics modelling of the Endangered African penguin populations on Dyer and Robben islands, South Africa," Ecological Modelling, Elsevier, vol. 327(C), pages 44-56.
    3. Grimm, Volker & Berger, Uta & DeAngelis, Donald L. & Polhill, J. Gary & Giske, Jarl & Railsback, Steven F., 2010. "The ODD protocol: A review and first update," Ecological Modelling, Elsevier, vol. 221(23), pages 2760-2768.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tardy, Olivia & Lenglos, Christophe & Lai, Sandra & Berteaux, Dominique & Leighton, Patrick A., 2023. "Rabies transmission in the Arctic: An agent-based model reveals the effects of broad-scale movement strategies on contact risk between Arctic foxes," Ecological Modelling, Elsevier, vol. 476(C).
    2. Vimercati, Giovanni & Hui, Cang & Davies, Sarah J. & Measey, G. John, 2017. "Integrating age structured and landscape resistance models to disentangle invasion dynamics of a pond-breeding anuran," Ecological Modelling, Elsevier, vol. 356(C), pages 104-116.
    3. Hinker, Jonas & Hemkendreis, Christian & Drewing, Emily & März, Steven & Hidalgo Rodríguez, Diego I. & Myrzik, Johanna M.A., 2017. "A novel conceptual model facilitating the derivation of agent-based models for analyzing socio-technical optimality gaps in the energy domain," Energy, Elsevier, vol. 137(C), pages 1219-1230.
    4. Tianran Ding & Wouter Achten, 2023. "Coupling agent-based modeling with territorial LCA to support agricultural land-use planning," ULB Institutional Repository 2013/359527, ULB -- Universite Libre de Bruxelles.
    5. Crevier, Lucas Phillip & Salkeld, Joseph H & Marley, Jessa & Parrott, Lael, 2021. "Making the best possible choice: Using agent-based modelling to inform wildlife management in small communities," Ecological Modelling, Elsevier, vol. 446(C).
    6. Meli, Mattia & Auclerc, Apolline & Palmqvist, Annemette & Forbes, Valery E. & Grimm, Volker, 2013. "Population-level consequences of spatially heterogeneous exposure to heavy metals in soil: An individual-based model of springtails," Ecological Modelling, Elsevier, vol. 250(C), pages 338-351.
    7. Claudia Dislich & Elisabeth Hettig & Jan Salecker & Johannes Heinonen & Jann Lay & Katrin M Meyer & Kerstin Wiegand & Suria Tarigan, 2018. "Land-use change in oil palm dominated tropical landscapes—An agent-based model to explore ecological and socio-economic trade-offs," PLOS ONE, Public Library of Science, vol. 13(1), pages 1-20, January.
    8. Dur, Gaël & Won, Eun-Ji & Han, Jeonghoon & Lee, Jae-Seong & Souissi, Sami, 2021. "An individual-based model for evaluating post-exposure effects of UV-B radiation on zooplankton reproduction," Ecological Modelling, Elsevier, vol. 441(C).
    9. Bauduin, Sarah & Grente, Oksana & Santostasi, Nina Luisa & Ciucci, Paolo & Duchamp, Christophe & Gimenez, Olivier, 2020. "An individual-based model to explore the impacts of lesser-known social dynamics on wolf populations," Ecological Modelling, Elsevier, vol. 433(C).
    10. Zhai, Xueting & Zhong, Dixi & Luo, Qiuju, 2019. "Turn it around in crisis communication: An ABM approach," Annals of Tourism Research, Elsevier, vol. 79(C).
    11. Graciá, Eva & Rodríguez-Caro, Roberto C. & Sanz-Aguilar, Ana & Anadón, José D. & Botella, Francisco & García-García, Angel Luis & Wiegand, Thorsten & Giménez, Andrés, 2020. "Assessment of the key evolutionary traits that prevent extinctions in human-altered habitats using a spatially explicit individual-based model," Ecological Modelling, Elsevier, vol. 415(C).
    12. Ahmed Laatabi & Nicolas Marilleau & Tri Nguyen-Huu & Hassan Hbid & Mohamed Ait Babram, 2018. "ODD+2D: An ODD Based Protocol for Mapping Data to Empirical ABMs," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 21(2), pages 1-9.
    13. Ahmadreza Asgharpourmasouleh & Atiye Sadeghi & Ali Yousofi, 2017. "A Grounded Agent-Based Model of Common Good Production in a Residential Complex: Applying Artificial Experiments," SAGE Open, , vol. 7(4), pages 21582440177, October.
    14. Medeiros-Sousa, Antônio Ralph & Lange, Martin & Mucci, Luis Filipe & Marrelli, Mauro Toledo & Grimm, Volker, 2024. "Modelling the transmission and spread of yellow fever in forest landscapes with different spatial configurations," Ecological Modelling, Elsevier, vol. 489(C).
    15. Student, Jillian & Kramer, Mark R. & Steinmann, Patrick, 2020. "Simulating emerging coastal tourism vulnerabilities: an agent-based modelling approach," Annals of Tourism Research, Elsevier, vol. 85(C).
    16. Ascensão, Fernando & Clevenger, Anthony & Santos-Reis, Margarida & Urbano, Paulo & Jackson, Nathan, 2013. "Wildlife–vehicle collision mitigation: Is partial fencing the answer? An agent-based model approach," Ecological Modelling, Elsevier, vol. 257(C), pages 36-43.
    17. Anshuka Anshuka & Floris F. Ogtrop & David Sanderson & Simone Z. Leao, 2022. "A systematic review of agent-based model for flood risk management and assessment using the ODD protocol," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 112(3), pages 2739-2771, July.
    18. Brito, Izabella de Andrade & López-Barrera, Ellie Anne & Araújo, Sabrina Borges Lino & Ribeiro, Ciro Alberto de Oliveira, 2017. "Modeling the exposure risk of the silver catfish Rhamdia quelen (Teleostei, Heptapteridae) to wastewater," Ecological Modelling, Elsevier, vol. 347(C), pages 40-49.
    19. Jiapeng Qu & Zelin Liu & Zhenggang Guo & Yikang Li & Huakun Zhou, 2021. "A System Dynamics Model for Assessing the Efficacy of Lethal Control for Sustainable Management of Ochotona curzoniae on Tibetan Plateau," Sustainability, MDPI, vol. 13(2), pages 1-11, January.
    20. Myong-Hun Chang & Troy Tassier, 2023. "Spatial Disparities in Vaccination and the Risk of Infection in a Multi-Region Agent-Based Model of Epidemic Dynamics," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 26(3), pages 1-3.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2019-147-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.