IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2019-127-3.html
   My bibliography  Save this article

Leveraging Modularity During Replication of High-Fidelity Models: Lessons from Replicating an Agent-Based Model for HIV Prevention

Author

Listed:

Abstract

High-fidelity models are increasingly used to predict, and guide decision making. Prior work has emphasized the importance of replication in ensuring reliable modeling, and has yielded important replication strategies. However, this work is based on relatively simple theory generating models, and its lessons might not translate to high-fidelity models used for decision support. Using NetLogo we replicate a recently published high-fidelity model examining the effects of a HIV biomedical intervention. We use a modular approach to build our model from the ground up, and provide examples of the replication process investigating the replication of two sub-modules as well as the overall simulation experiment. For the first module, we achieved numerical identity during replication, whereas we obtained distributional equivalence in replicating the second module. We achieved relational equivalence among the overall model behaviors, with a 0.98 correlation across the two implementations for our outcome measure even without strictly following the original model in the formation of the sexual network. Our results show that replication of high-fidelity models is feasible when following a set of systematic strategies that leverage the modularity, and highlight the role of replication standards, modular testing, and functional code in facilitating such strategies.

Suggested Citation

  • Wouter Vermeer & Arthur Hjorth & Samuel M. Jenness & C Hendrick Brown & Uri Wilensky, 2020. "Leveraging Modularity During Replication of High-Fidelity Models: Lessons from Replicating an Agent-Based Model for HIV Prevention," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 23(4), pages 1-7.
    • Handle: RePEc:jas:jasssj:2019-127-3
    as

    Download full text from publisher

    File URL: https://www.jasss.org/23/4/7/7.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Steven M Goodreau & Nicole B Carnegie & Eric Vittinghoff & Javier R Lama & Jonathan D Fuchs & Jorge Sanchez & Susan P Buchbinder, 2014. "Can Male Circumcision Have an Impact on the HIV Epidemic in Men Who Have Sex with Men?," PLOS ONE, Public Library of Science, vol. 9(7), pages 1-9, July.
    2. Joshua M. Epstein, 2009. "Modelling to contain pandemics," Nature, Nature, vol. 460(7256), pages 687-687, August.
    3. Grimm, Volker & Augusiak, Jacqueline & Focks, Andreas & Frank, Béatrice M. & Gabsi, Faten & Johnston, Alice S.A. & Liu, Chun & Martin, Benjamin T. & Meli, Mattia & Radchuk, Viktoriia & Thorbek, Pernil, 2014. "Towards better modelling and decision support: Documenting model development, testing, and analysis using TRACE," Ecological Modelling, Elsevier, vol. 280(C), pages 129-139.
    4. Grimm, Volker & Berger, Uta & DeAngelis, Donald L. & Polhill, J. Gary & Giske, Jarl & Railsback, Steven F., 2010. "The ODD protocol: A review and first update," Ecological Modelling, Elsevier, vol. 221(23), pages 2760-2768.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lorscheid, Iris & Meyer, Matthias, 2016. "Divide and conquer: Configuring submodels for valid and efficient analyses of complex simulation models," Ecological Modelling, Elsevier, vol. 326(C), pages 152-161.
    2. Watson, Joseph W & Boyd, Robin & Dutta, Ritabrata & Vasdekis, Georgios & Walker, Nicola D. & Roy, Shovonlal & Everitt, Richard & Hyder, Kieran & Sibly, Richard M, 2022. "Incorporating environmental variability in a spatially-explicit individual-based model of European sea bass✰," Ecological Modelling, Elsevier, vol. 466(C).
    3. Boult, Victoria L. & Quaife, Tristan & Fishlock, Vicki & Moss, Cynthia J. & Lee, Phyllis C. & Sibly, Richard M., 2018. "Individual-based modelling of elephant population dynamics using remote sensing to estimate food availability," Ecological Modelling, Elsevier, vol. 387(C), pages 187-195.
    4. Walker, Nicola D. & Boyd, Robin & Watson, Joseph & Kotz, Max & Radford, Zachary & Readdy, Lisa & Sibly, Richard & Roy, Shovonlal & Hyder, Kieran, 2020. "A spatially explicit individual-based model to support management of commercial and recreational fisheries for European sea bass Dicentrarchus labrax," Ecological Modelling, Elsevier, vol. 431(C).
    5. Jette Reeg & Simon Heine & Christine Mihan & Sean McGee & Thomas G Preuss & Florian Jeltsch, 2020. "Herbicide risk assessments of non-target terrestrial plant communities: A graphical user interface for the plant community model IBC-grass," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-18, March.
    6. Ayllón, Daniel & Railsback, Steven F. & Vincenzi, Simone & Groeneveld, Jürgen & Almodóvar, Ana & Grimm, Volker, 2016. "InSTREAM-Gen: Modelling eco-evolutionary dynamics of trout populations under anthropogenic environmental change," Ecological Modelling, Elsevier, vol. 326(C), pages 36-53.
    7. Fitts, Lucia A. & Fraser, Jacob S. & Miranda, Brian R. & Domke, Grant M. & Russell, Matthew B. & Sturtevant, Brian R., 2023. "An iterative site-scale approach to calibrate and corroborate successional processes within a forest landscape model," Ecological Modelling, Elsevier, vol. 477(C).
    8. Lamonica, Dominique & Herbach, Ulysse & Orias, Frédéric & Clément, Bernard & Charles, Sandrine & Lopes, Christelle, 2016. "Mechanistic modelling of daphnid-algae dynamics within a laboratory microcosm," Ecological Modelling, Elsevier, vol. 320(C), pages 213-230.
    9. Boyd, Robin & Roy, Shovonlal & Sibly, Richard & Thorpe, Robert & Hyder, Kieran, 2018. "A general approach to incorporating spatial and temporal variation in individual-based models of fish populations with application to Atlantic mackerel," Ecological Modelling, Elsevier, vol. 382(C), pages 9-17.
    10. Crouse, Kristin N. & Desai, Nisarg P. & Cassidy, Kira A. & Stahler, Erin E. & Lehman, Clarence L. & Wilson, Michael L., 2022. "Larger territories reduce mortality risk for chimpanzees, wolves, and agents: Multiple lines of evidence in a model validation framework," Ecological Modelling, Elsevier, vol. 471(C).
    11. Troost, Christian & Huber, Robert & Bell, Andrew R. & van Delden, Hedwig & Filatova, Tatiana & Le, Quang Bao & Lippe, Melvin & Niamir, Leila & Polhill, J. Gareth & Sun, Zhanli & Berger, Thomas, 2023. "How to keep it adequate: A protocol for ensuring validity in agent-based simulation," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 159, pages 1-21.
    12. J. Farmer & Cameron Hepburn & Penny Mealy & Alexander Teytelboym, 2015. "A Third Wave in the Economics of Climate Change," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(2), pages 329-357, October.
    13. Chudzinska, Magda & Nabe-Nielsen, Jacob & Smout, Sophie & Aarts, Geert & Brasseur, Sophie & Graham, Isla & Thompson, Paul & McConnell, Bernie, 2021. "AgentSeal: Agent-based model describing movement of marine central-place foragers," Ecological Modelling, Elsevier, vol. 440(C).
    14. An, Li & Grimm, Volker & Sullivan, Abigail & Turner II, B.L. & Malleson, Nicolas & Heppenstall, Alison & Vincenot, Christian & Robinson, Derek & Ye, Xinyue & Liu, Jianguo & Lindkvist, Emilie & Tang, W, 2021. "Challenges, tasks, and opportunities in modeling agent-based complex systems," Ecological Modelling, Elsevier, vol. 457(C).
    15. King, Elizabeth G. & Franz, Trenton E., 2016. "Combining ecohydrologic and transition probability-based modeling to simulate vegetation dynamics in a semi-arid rangeland," Ecological Modelling, Elsevier, vol. 329(C), pages 41-63.
    16. Courbaud, B. & Lafond, V. & Lagarrigues, G. & Vieilledent, G. & Cordonnier, T. & Jabot, F. & de Coligny, F., 2015. "Applying ecological model evaludation: Lessons learned with the forest dynamics model Samsara2," Ecological Modelling, Elsevier, vol. 314(C), pages 1-14.
    17. Keane, Robert E. & McKenzie, Donald & Falk, Donald A. & Smithwick, Erica A.H. & Miller, Carol & Kellogg, Lara-Karena B., 2015. "Representing climate, disturbance, and vegetation interactions in landscape models," Ecological Modelling, Elsevier, vol. 309, pages 33-47.
    18. Lapp, Maya & Long, Colby, 2022. "A new approach to agent-based models of Community Resource Management based on the analysis of cheating, monitoring, and sanctioning," Ecological Modelling, Elsevier, vol. 468(C).
    19. Planque, Benjamin & Aarflot, Johanna M. & Buttay, Lucie & Carroll, JoLynn & Fransner, Filippa & Hansen, Cecilie & Husson, Bérengère & Langangen, Øystein & Lindstrøm, Ulf & Pedersen, Torstein & Primice, 2022. "A standard protocol for describing the evaluation of ecological models," Ecological Modelling, Elsevier, vol. 471(C).
    20. Cartwright, Samantha J. & Bowgen, Katharine M. & Collop, Catherine & Hyder, Kieran & Nabe-Nielsen, Jacob & Stafford, Richard & Stillman, Richard A. & Thorpe, Robert B. & Sibly, Richard M., 2016. "Communicating complex ecological models to non-scientist end users," Ecological Modelling, Elsevier, vol. 338(C), pages 51-59.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2019-127-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.