IDEAS home Printed from https://ideas.repec.org/a/eee/ecomod/v280y2014icp129-139.html
   My bibliography  Save this article

Towards better modelling and decision support: Documenting model development, testing, and analysis using TRACE

Author

Listed:
  • Grimm, Volker
  • Augusiak, Jacqueline
  • Focks, Andreas
  • Frank, Béatrice M.
  • Gabsi, Faten
  • Johnston, Alice S.A.
  • Liu, Chun
  • Martin, Benjamin T.
  • Meli, Mattia
  • Radchuk, Viktoriia
  • Thorbek, Pernille
  • Railsback, Steven F.

Abstract

The potential of ecological models for supporting environmental decision making is increasingly acknowledged. However, it often remains unclear whether a model is realistic and reliable enough. Good practice for developing and testing ecological models has not yet been established. Therefore, TRACE, a general framework for documenting a model's rationale, design, and testing was recently suggested. Originally TRACE was aimed at documenting good modelling practice. However, the word ‘documentation’ does not convey TRACE's urgency. Therefore, we re-define TRACE as a tool for planning, performing, and documenting good modelling practice. TRACE documents should provide convincing evidence that a model was thoughtfully designed, correctly implemented, thoroughly tested, well understood, and appropriately used for its intended purpose. TRACE documents link the science underlying a model to its application, thereby also linking modellers and model users, for example stakeholders, decision makers, and developers of policies. We report on first experiences in producing TRACE documents. We found that the original idea underlying TRACE was valid, but to make its use more coherent and efficient, an update of its structure and more specific guidance for its use are needed. The updated TRACE format follows the recently developed framework of model ‘evaludation’: the entire process of establishing model quality and credibility throughout all stages of model development, analysis, and application. TRACE thus becomes a tool for planning, documenting, and assessing model evaludation, which includes understanding the rationale behind a model and its envisaged use. We introduce the new structure and revised terminology of TRACE and provide examples.

Suggested Citation

  • Grimm, Volker & Augusiak, Jacqueline & Focks, Andreas & Frank, Béatrice M. & Gabsi, Faten & Johnston, Alice S.A. & Liu, Chun & Martin, Benjamin T. & Meli, Mattia & Radchuk, Viktoriia & Thorbek, Pernil, 2014. "Towards better modelling and decision support: Documenting model development, testing, and analysis using TRACE," Ecological Modelling, Elsevier, vol. 280(C), pages 129-139.
  • Handle: RePEc:eee:ecomod:v:280:y:2014:i:c:p:129-139
    DOI: 10.1016/j.ecolmodel.2014.01.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304380014000611
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ecolmodel.2014.01.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Augusiak, Jacqueline & Van den Brink, Paul J. & Grimm, Volker, 2014. "Merging validation and evaluation of ecological models to ‘evaludation’: A review of terminology and a practical approach," Ecological Modelling, Elsevier, vol. 280(C), pages 117-128.
    2. Saul I. Gass, 1983. "Feature Article—Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis," Operations Research, INFORMS, vol. 31(4), pages 603-631, August.
    3. Meli, Mattia & Palmqvist, Annemette & Forbes, Valery E. & Groeneveld, Jürgen & Grimm, Volker, 2014. "Two pairs of eyes are better than one: Combining individual-based and matrix models for ecological risk assessment of chemicals," Ecological Modelling, Elsevier, vol. 280(C), pages 40-52.
    4. Liu, Chun & Sibly, Richard M. & Grimm, Volker & Thorbek, Pernille, 2013. "Linking pesticide exposure and spatial dynamics: An individual-based model of wood mouse (Apodemus sylvaticus) populations in agricultural landscapes," Ecological Modelling, Elsevier, vol. 248(C), pages 92-102.
    5. Focks, Andreas & ter Horst, Mechteld & van den Berg, Erik & Baveco, Hans & van den Brink, Paul J., 2014. "Integrating chemical fate and population-level effect models for pesticides at landscape scale: New options for risk assessment," Ecological Modelling, Elsevier, vol. 280(C), pages 102-116.
    6. Meli, Mattia & Auclerc, Apolline & Palmqvist, Annemette & Forbes, Valery E. & Grimm, Volker, 2013. "Population-level consequences of spatially heterogeneous exposure to heavy metals in soil: An individual-based model of springtails," Ecological Modelling, Elsevier, vol. 250(C), pages 338-351.
    7. Grimm, Volker & Berger, Uta & DeAngelis, Donald L. & Polhill, J. Gary & Giske, Jarl & Railsback, Steven F., 2010. "The ODD protocol: A review and first update," Ecological Modelling, Elsevier, vol. 221(23), pages 2760-2768.
    8. Johnston, A.S.A. & Hodson, M.E. & Thorbek, P. & Alvarez, T. & Sibly, R.M., 2014. "An energy budget agent-based model of earthworm populations and its application to study the effects of pesticides," Ecological Modelling, Elsevier, vol. 280(C), pages 5-17.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Troost, Christian & Huber, Robert & Bell, Andrew R. & van Delden, Hedwig & Filatova, Tatiana & Le, Quang Bao & Lippe, Melvin & Niamir, Leila & Polhill, J. Gareth & Sun, Zhanli & Berger, Thomas, 2023. "How to keep it adequate: A protocol for ensuring validity in agent-based simulation," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 159, pages 1-21.
    2. Cartwright, Samantha J. & Bowgen, Katharine M. & Collop, Catherine & Hyder, Kieran & Nabe-Nielsen, Jacob & Stafford, Richard & Stillman, Richard A. & Thorpe, Robert B. & Sibly, Richard M., 2016. "Communicating complex ecological models to non-scientist end users," Ecological Modelling, Elsevier, vol. 338(C), pages 51-59.
    3. Liukkonen, Lauri & Ayllón, Daniel & Kunnasranta, Mervi & Niemi, Marja & Nabe-Nielsen, Jacob & Grimm, Volker & Nyman, Anna-Maija, 2018. "Modelling movements of Saimaa ringed seals using an individual-based approach," Ecological Modelling, Elsevier, vol. 368(C), pages 321-335.
    4. Lorscheid, Iris & Meyer, Matthias, 2016. "Divide and conquer: Configuring submodels for valid and efficient analyses of complex simulation models," Ecological Modelling, Elsevier, vol. 326(C), pages 152-161.
    5. Ahmed Laatabi & Nicolas Marilleau & Tri Nguyen-Huu & Hassan Hbid & Mohamed Ait Babram, 2018. "ODD+2D: An ODD Based Protocol for Mapping Data to Empirical ABMs," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 21(2), pages 1-9.
    6. Watson, Joseph W & Boyd, Robin & Dutta, Ritabrata & Vasdekis, Georgios & Walker, Nicola D. & Roy, Shovonlal & Everitt, Richard & Hyder, Kieran & Sibly, Richard M, 2022. "Incorporating environmental variability in a spatially-explicit individual-based model of European sea bass✰," Ecological Modelling, Elsevier, vol. 466(C).
    7. Boult, Victoria L. & Quaife, Tristan & Fishlock, Vicki & Moss, Cynthia J. & Lee, Phyllis C. & Sibly, Richard M., 2018. "Individual-based modelling of elephant population dynamics using remote sensing to estimate food availability," Ecological Modelling, Elsevier, vol. 387(C), pages 187-195.
    8. Honkaniemi, Juha & Ojansuu, Risto & Kasanen, Risto & Heliövaara, Kari, 2018. "Interaction of disturbance agents on Norway spruce: A mechanistic model of bark beetle dynamics integrated in simulation framework WINDROT," Ecological Modelling, Elsevier, vol. 388(C), pages 45-60.
    9. Beltran, Roxanne S. & Testa, J. Ward & Burns, Jennifer M., 2017. "An agent-based bioenergetics model for predicting impacts of environmental change on a top marine predator, the Weddell seal," Ecological Modelling, Elsevier, vol. 351(C), pages 36-50.
    10. Ayllón, Daniel & Railsback, Steven F. & Vincenzi, Simone & Groeneveld, Jürgen & Almodóvar, Ana & Grimm, Volker, 2016. "InSTREAM-Gen: Modelling eco-evolutionary dynamics of trout populations under anthropogenic environmental change," Ecological Modelling, Elsevier, vol. 326(C), pages 36-53.
    11. Fitts, Lucia A. & Fraser, Jacob S. & Miranda, Brian R. & Domke, Grant M. & Russell, Matthew B. & Sturtevant, Brian R., 2023. "An iterative site-scale approach to calibrate and corroborate successional processes within a forest landscape model," Ecological Modelling, Elsevier, vol. 477(C).
    12. Boyd, Robin & Roy, Shovonlal & Sibly, Richard & Thorpe, Robert & Hyder, Kieran, 2018. "A general approach to incorporating spatial and temporal variation in individual-based models of fish populations with application to Atlantic mackerel," Ecological Modelling, Elsevier, vol. 382(C), pages 9-17.
    13. Crouse, Kristin N. & Desai, Nisarg P. & Cassidy, Kira A. & Stahler, Erin E. & Lehman, Clarence L. & Wilson, Michael L., 2022. "Larger territories reduce mortality risk for chimpanzees, wolves, and agents: Multiple lines of evidence in a model validation framework," Ecological Modelling, Elsevier, vol. 471(C).
    14. Kevin E Jablonski & Randall B Boone & Paul J Meiman, 2018. "An agent-based model of cattle grazing toxic Geyer's larkspur," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-22, March.
    15. Liu, Chun & Bednarska, Agnieszka J. & Sibly, Richard M. & Murfitt, Roger C. & Edwards, Peter & Thorbek, Pernille, 2014. "Incorporating toxicokinetics into an individual-based model for more realistic pesticide exposure estimates: A case study of the wood mouse," Ecological Modelling, Elsevier, vol. 280(C), pages 30-39.
    16. McLane, Adam J. & Semeniuk, Christina & McDermid, Gregory J. & Tomback, Diana F. & Lorenz, Teresa & Marceau, Danielle, 2017. "Energetic behavioural-strategy prioritization of Clark’s nutcrackers in whitebark pine communities: An agent-based modeling approach," Ecological Modelling, Elsevier, vol. 354(C), pages 123-139.
    17. An, Li & Grimm, Volker & Sullivan, Abigail & Turner II, B.L. & Malleson, Nicolas & Heppenstall, Alison & Vincenot, Christian & Robinson, Derek & Ye, Xinyue & Liu, Jianguo & Lindkvist, Emilie & Tang, W, 2021. "Challenges, tasks, and opportunities in modeling agent-based complex systems," Ecological Modelling, Elsevier, vol. 457(C).
    18. Wallentin, Gudrun, 2017. "Spatial simulation: A spatial perspective on individual-based ecology—a review," Ecological Modelling, Elsevier, vol. 350(C), pages 30-41.
    19. King, Elizabeth G. & Franz, Trenton E., 2016. "Combining ecohydrologic and transition probability-based modeling to simulate vegetation dynamics in a semi-arid rangeland," Ecological Modelling, Elsevier, vol. 329(C), pages 41-63.
    20. Courbaud, B. & Lafond, V. & Lagarrigues, G. & Vieilledent, G. & Cordonnier, T. & Jabot, F. & de Coligny, F., 2015. "Applying ecological model evaludation: Lessons learned with the forest dynamics model Samsara2," Ecological Modelling, Elsevier, vol. 314(C), pages 1-14.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecomod:v:280:y:2014:i:c:p:129-139. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/ecological-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.