IDEAS home Printed from https://ideas.repec.org/a/eee/ecomod/v501y2025ics0304380024003788.html
   My bibliography  Save this article

A protocol for implementing parameter sensitivity analyses in complex ecosystem models

Author

Listed:
  • Luján, Criscely
  • Shin, Yunne-Jai
  • Barrier, Nicolas
  • Leadley, Paul
  • Oliveros-Ramos, Ricardo

Abstract

Systematic analysis of uncertainty is critical for consolidating ecosystem model projections. Sensitivity analysis is an essential step in understanding model uncertainty, but there are many challenges when dealing with complex models. One of these is related to the quantification of uncertainty in model input parameters, which is especially problematic when limited data leads to the use of arbitrary fixed ranges of variation to define parameter uncertainty. We show the drawbacks of this practice and propose an alternative approach based on the parameter reliability criterion. This criterion helps to classify the model parameters according to the source of information used to estimate their values and calculate the ranges of variability for each parameter used in a sensitivity analysis. Our proposed approach presented in this protocol is illustrated by implementing a sensitivity analysis of the OSMOSE marine ecosystem modelling platform applied to the northern Peru Current ecosystem. We compare the results from the sensitivity analysis based on the parameter reliability criterion with those obtained using fixed ranges of variation. We find that using arbitrary uncertainty ranges can produce different conclusions compared to alternative approaches, such as the one based on the reliability of the parameters. The parameter reliability criterion can be helpful in situations where direct quantification of uncertainty in model inputs is not available.

Suggested Citation

  • Luján, Criscely & Shin, Yunne-Jai & Barrier, Nicolas & Leadley, Paul & Oliveros-Ramos, Ricardo, 2025. "A protocol for implementing parameter sensitivity analyses in complex ecosystem models," Ecological Modelling, Elsevier, vol. 501(C).
  • Handle: RePEc:eee:ecomod:v:501:y:2025:i:c:s0304380024003788
    DOI: 10.1016/j.ecolmodel.2024.110990
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304380024003788
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ecolmodel.2024.110990?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pannell, David J., 1997. "Sensitivity analysis of normative economic models: theoretical framework and practical strategies," Agricultural Economics, Blackwell, vol. 16(2), pages 139-152, May.
    2. Song, Xiaodong & Bryan, Brett A. & Almeida, Auro C. & Paul, Keryn I. & Zhao, Gang & Ren, Yin, 2013. "Time-dependent sensitivity of a process-based ecological model," Ecological Modelling, Elsevier, vol. 265(C), pages 114-123.
    3. Bracis, Chloe & Lehuta, Sigrid & Savina-Rolland, Marie & Travers-Trolet, Morgane & Girardin, Raphaël, 2020. "Improving confidence in complex ecosystem models: The sensitivity analysis of an Atlantis ecosystem model," Ecological Modelling, Elsevier, vol. 431(C).
    4. Morris, David J. & Speirs, Douglas C. & Cameron, Angus I. & Heath, Michael R., 2014. "Global sensitivity analysis of an end-to-end marine ecosystem model of the North Sea: Factors affecting the biomass of fish and benthos," Ecological Modelling, Elsevier, vol. 273(C), pages 251-263.
    5. Cariboni, J. & Gatelli, D. & Liska, R. & Saltelli, A., 2007. "The role of sensitivity analysis in ecological modelling," Ecological Modelling, Elsevier, vol. 203(1), pages 167-182.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lopez de Gamiz-Zearra, A. & Hansen, C. & Corrales, X. & Andonegi, E., 2024. "Increasing the reliability of the Bay of Biscay Atlantis model: A sensitivity analysis to parameters perturbations using a Morris screening approach," Ecological Modelling, Elsevier, vol. 488(C).
    2. Francisco A. Buendia-Hernandez & Maria J. Ortiz Bevia & Francisco J. Alvarez-Garcia & Antonio Ruizde Elvira, 2022. "Sensitivity of a Dynamic Model of Air Traffic Emissions to Technological and Environmental Factors," IJERPH, MDPI, vol. 19(22), pages 1-17, November.
    3. Yi, Xuan & Zou, Rui & Guo, Huaicheng, 2016. "Global sensitivity analysis of a three-dimensional nutrients-algae dynamic model for a large shallow lake," Ecological Modelling, Elsevier, vol. 327(C), pages 74-84.
    4. Bracis, Chloe & Lehuta, Sigrid & Savina-Rolland, Marie & Travers-Trolet, Morgane & Girardin, Raphaël, 2020. "Improving confidence in complex ecosystem models: The sensitivity analysis of an Atlantis ecosystem model," Ecological Modelling, Elsevier, vol. 431(C).
    5. Myrgiotis, Vasileios & Rees, Robert M. & Topp, Cairistiona F.E. & Williams, Mathew, 2018. "A systematic approach to identifying key parameters and processes in agroecosystem models," Ecological Modelling, Elsevier, vol. 368(C), pages 344-356.
    6. Imron, Muhammad Ali & Gergs, Andre & Berger, Uta, 2012. "Structure and sensitivity analysis of individual-based predator–prey models," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 71-81.
    7. Pelletier, Dominique & Mahevas, Stéphanie & Drouineau, Hilaire & Vermard, Youen & Thebaud, Olivier & Guyader, Olivier & Poussin, Benjamin, 2009. "Evaluation of the bioeconomic sustainability of multi-species multi-fleet fisheries under a wide range of policy options using ISIS-Fish," Ecological Modelling, Elsevier, vol. 220(7), pages 1013-1033.
    8. Frank H. Koch & Denys Yemshanov & Daniel W. McKenney & William D. Smith, 2009. "Evaluating Critical Uncertainty Thresholds in a Spatial Model of Forest Pest Invasion Risk," Risk Analysis, John Wiley & Sons, vol. 29(9), pages 1227-1241, September.
    9. Kopke, Emma & Kingwell, Ross S. & Young, John, 2005. "A farm-level economic assessment of the Australian Merino, Dohne Merino, and South African Meat Merino sheep breeds in southern Australia," 2005 Conference (49th), February 9-11, 2005, Coff's Harbour, Australia 137934, Australian Agricultural and Resource Economics Society.
    10. Guthrie, R. & Purse, Kevin & Lurie, P., 2006. "Workers' Compensation Western Australia; a Case Study 1993 - 2004," Australian Bulletin of Labour, National Institute of Labour Studies, vol. 32(1), pages 62-73.
    11. Emile Noël, 1996. "Quelques réflexions sur les perspectives politico-institutionnelles de l'intégration européenne en 2000 et au-delà," EUI-RSCAS Working Papers 39, European University Institute (EUI), Robert Schuman Centre of Advanced Studies (RSCAS).
    12. Karin Fierke & Antje Wiener, 1999. "Constructing Institutional Interests: EU and NATO Enlargement," EUI-RSCAS Working Papers 14, European University Institute (EUI), Robert Schuman Centre of Advanced Studies (RSCAS).
    13. Leslie Holmes, 1997. "The Democratic State or State Democracy? Problems of Post-Communist Transition," EUI-RSCAS Working Papers 48, European University Institute (EUI), Robert Schuman Centre of Advanced Studies (RSCAS).
    14. Lorscheid, Iris & Meyer, Matthias, 2016. "Divide and conquer: Configuring submodels for valid and efficient analyses of complex simulation models," Ecological Modelling, Elsevier, vol. 326(C), pages 152-161.
    15. Mustajoki, Jyri & Hamalainen, Raimo P. & Lindstedt, Mats R.K., 2006. "Using intervals for global sensitivity and worst-case analyses in multiattribute value trees," European Journal of Operational Research, Elsevier, vol. 174(1), pages 278-292, October.
    16. Jackson, T.M. & Hanjra, Munir A. & Khan, S. & Hafeez, M.M., 2011. "Building a climate resilient farm: A risk based approach for understanding water, energy and emissions in irrigated agriculture," Agricultural Systems, Elsevier, vol. 104(9), pages 729-745.
    17. Kanapaux, William & Kiker, Gregory A., 2013. "Development and testing of an object-oriented model for adaptively managing human disturbance of least tern (Sternula antillarum) nesting habitat," Ecological Modelling, Elsevier, vol. 268(C), pages 64-77.
    18. Chu-Agor, M.L. & Muñoz-Carpena, R. & Kiker, G.A. & Aiello-Lammens, M.E. & Akçakaya, H.R. & Convertino, M. & Linkov, I., 2012. "Simulating the fate of Florida Snowy Plovers with sea-level rise: Exploring research and management priorities with a global uncertainty and sensitivity analysis perspective," Ecological Modelling, Elsevier, vol. 224(1), pages 33-47.
    19. Janssen, Sander & van Ittersum, Martin K., 2007. "Assessing farm innovations and responses to policies: A review of bio-economic farm models," Agricultural Systems, Elsevier, vol. 94(3), pages 622-636, June.
    20. Rodriguez Iglesias, 1996. "Le pouvoir judiciaire de la Communauté européenne au stade actuel de l'évolution de l'Union," EUI-RSCAS Working Papers 41, European University Institute (EUI), Robert Schuman Centre of Advanced Studies (RSCAS).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecomod:v:501:y:2025:i:c:s0304380024003788. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/ecological-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.