IDEAS home Printed from https://ideas.repec.org/a/eee/ecomod/v309-310y2015ip48-59.html
   My bibliography  Save this article

Performance metrics and variance partitioning reveal sources of uncertainty in species distribution models

Author

Listed:
  • Watling, James I.
  • Brandt, Laura A.
  • Bucklin, David N.
  • Fujisaki, Ikuko
  • Mazzotti, Frank J.
  • Romañach, Stephanie S.
  • Speroterra, Carolina

Abstract

Species distribution models (SDMs) are widely used in basic and applied ecology, making it important to understand sources and magnitudes of uncertainty in SDM performance and predictions. We analyzed SDM performance and partitioned variance among prediction maps for 15 rare vertebrate species in the southeastern USA using all possible combinations of seven potential sources of uncertainty in SDMs: algorithms, climate datasets, model domain, species presences, variable collinearity, CO2 emissions scenarios, and general circulation models. The choice of modeling algorithm was the greatest source of uncertainty in SDM performance and prediction maps, with some additional variation in performance associated with the comprehensiveness of the species presences used for modeling. Other sources of uncertainty that have received attention in the SDM literature such as variable collinearity and model domain contributed little to differences in SDM performance or predictions in this study. Predictions from different algorithms tended to be more variable at northern range margins for species with more northern distributions, which may complicate conservation planning at the leading edge of species’ geographic ranges. The clear message emerging from this work is that researchers should use multiple algorithms for modeling rather than relying on predictions from a single algorithm, invest resources in compiling a comprehensive set of species presences, and explicitly evaluate uncertainty in SDM predictions at leading range margins.

Suggested Citation

  • Watling, James I. & Brandt, Laura A. & Bucklin, David N. & Fujisaki, Ikuko & Mazzotti, Frank J. & Romañach, Stephanie S. & Speroterra, Carolina, 2015. "Performance metrics and variance partitioning reveal sources of uncertainty in species distribution models," Ecological Modelling, Elsevier, vol. 309, pages 48-59.
  • Handle: RePEc:eee:ecomod:v:309-310:y:2015:i::p:48-59
    DOI: 10.1016/j.ecolmodel.2015.03.017
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304380015001283
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ecolmodel.2015.03.017?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. R. J. Nicholls & S. Hanson & Celine Herweijer & Nicola Patmore & Stéphane Hallegatte & Jan Corfee-Morlot & Jean Château & Robert Muir-Wood, 2008. "Ranking Port Cities with High Exposure and Vulnerability to Climate Extremes: Exposure Estimates," OECD Environment Working Papers 1, OECD Publishing.
    2. Watling, James I. & Romañach, Stephanie S. & Bucklin, David N. & Speroterra, Carolina & Brandt, Laura A. & Pearlstine, Leonard G. & Mazzotti, Frank J., 2012. "Do bioclimate variables improve performance of climate envelope models?," Ecological Modelling, Elsevier, vol. 246(C), pages 79-85.
    3. Anja Jaeschke & Torsten Bittner & Anke Jentsch & Björn Reineking & Helmut Schlumprecht & Carl Beierkuhnlein, 2012. "Biotic Interactions in the Face of Climate Change: A Comparison of Three Modelling Approaches," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-10, December.
    4. Barve, Narayani & Barve, Vijay & Jiménez-Valverde, Alberto & Lira-Noriega, Andrés & Maher, Sean P. & Peterson, A. Townsend & Soberón, Jorge & Villalobos, Fabricio, 2011. "The crucial role of the accessible area in ecological niche modeling and species distribution modeling," Ecological Modelling, Elsevier, vol. 222(11), pages 1810-1819.
    5. VanDerWal, Jeremy & Shoo, Luke P. & Graham, Catherine & Williams, Stephen E., 2009. "Selecting pseudo-absence data for presence-only distribution modeling: How far should you stray from what you know?," Ecological Modelling, Elsevier, vol. 220(4), pages 589-594.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Khalatbari Limaki, Mahdieh & Es-hagh Nimvari, Majid & Alavi, Seyed Jalil & Mataji, Asadollah & Kazemnezhad, Farid, 2021. "Potential elevation shift of oriental beech (Fagus orientalis L.) in Hyrcanian mixed forest ecoregion under future global warming," Ecological Modelling, Elsevier, vol. 455(C).
    2. Beaumont, Linda J. & Graham, Erin & Duursma, Daisy Englert & Wilson, Peter D. & Cabrelli, Abigail & Baumgartner, John B. & Hallgren, Willow & Esperón-Rodríguez, Manuel & Nipperess, David A. & Warren, , 2016. "Which species distribution models are more (or less) likely to project broad-scale, climate-induced shifts in species ranges?," Ecological Modelling, Elsevier, vol. 342(C), pages 135-146.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alsamadisi, Adam G. & Tran, Liem T. & Papeş, Monica, 2020. "Employing inferences across scales: Integrating spatial data with different resolutions to enhance Maxent models," Ecological Modelling, Elsevier, vol. 415(C).
    2. Amaro, George & Fidelis, Elisangela Gomes & da Silva, Ricardo Siqueira & Marchioro, Cesar Augusto, 2023. "Effect of study area extent on the potential distribution of Species: A case study with models for Raoiella indica Hirst (Acari: Tenuipalpidae)," Ecological Modelling, Elsevier, vol. 483(C).
    3. Zeng, Yiwen & Low, Bi Wei & Yeo, Darren C.J., 2016. "Novel methods to select environmental variables in MaxEnt: A case study using invasive crayfish," Ecological Modelling, Elsevier, vol. 341(C), pages 5-13.
    4. Saupe, E.E. & Barve, V. & Myers, C.E. & Soberón, J. & Barve, N. & Hensz, C.M. & Peterson, A.T. & Owens, H.L. & Lira-Noriega, A., 2012. "Variation in niche and distribution model performance: The need for a priori assessment of key causal factors," Ecological Modelling, Elsevier, vol. 237, pages 11-22.
    5. Sillero, Neftalí & Arenas-Castro, Salvador & Enriquez‐Urzelai, Urtzi & Vale, Cândida Gomes & Sousa-Guedes, Diana & Martínez-Freiría, Fernando & Real, Raimundo & Barbosa, A.Márcia, 2021. "Want to model a species niche? A step-by-step guideline on correlative ecological niche modelling," Ecological Modelling, Elsevier, vol. 456(C).
    6. Jiménez, Laura & Soberón, Jorge & Christen, J. Andrés & Soto, Desireé, 2019. "On the problem of modeling a fundamental niche from occurrence data," Ecological Modelling, Elsevier, vol. 397(C), pages 74-83.
    7. Herkt, K. Matthias B. & Barnikel, Günter & Skidmore, Andrew K. & Fahr, Jakob, 2016. "A high-resolution model of bat diversity and endemism for continental Africa," Ecological Modelling, Elsevier, vol. 320(C), pages 9-28.
    8. Azuaje-Rodríguez, Roxiris A. & Silva, Sofia Marques & Carlos, Caio J., 2022. "Not going with the flow: Ecological niche of a migratory seabird, the South American Tern Sterna hirundinacea," Ecological Modelling, Elsevier, vol. 463(C).
    9. Pelayo Acevedo & Alberto Jiménez-Valverde & Jorge M. Lobo & Raimundo Real, 2017. "Predictor weighting and geographical background delimitation: two synergetic sources of uncertainty when assessing species sensitivity to climate change," Climatic Change, Springer, vol. 145(1), pages 131-143, November.
    10. Jarnevich, Catherine S. & Talbert, Marian & Morisette, Jeffery & Aldridge, Cameron & Brown, Cynthia S. & Kumar, Sunil & Manier, Daniel & Talbert, Colin & Holcombe, Tracy, 2017. "Minimizing effects of methodological decisions on interpretation and prediction in species distribution studies: An example with background selection," Ecological Modelling, Elsevier, vol. 363(C), pages 48-56.
    11. Martin Godefroid & Astrid Cruaud & Jean-Pierre Rossi & Jean-Yves Rasplus, 2015. "Assessing the Risk of Invasion by Tephritid Fruit Flies: Intraspecific Divergence Matters," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-19, August.
    12. Boria, Robert A. & Blois, Jessica L., 2018. "The effect of large sample sizes on ecological niche models: Analysis using a North American rodent, Peromyscus maniculatus," Ecological Modelling, Elsevier, vol. 386(C), pages 83-88.
    13. Omran Frihy & Mahmoud El-Sayed, 2013. "Vulnerability risk assessment and adaptation to climate change induced sea level rise along the Mediterranean coast of Egypt," Mitigation and Adaptation Strategies for Global Change, Springer, vol. 18(8), pages 1215-1237, December.
    14. Wolke Tobón-Niedfeldt & Alicia Mastretta-Yanes & Tania Urquiza-Haas & Bárbara Goettsch & Angela P. Cuervo-Robayo & Esmeralda Urquiza-Haas & M. Andrea Orjuela-R & Francisca Acevedo Gasman & Oswaldo Oli, 2022. "Incorporating evolutionary and threat processes into crop wild relatives conservation," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    15. Kwasi Appeaning Addo, 2015. "Monitoring sea level rise-induced hazards along the coast of Accra in Ghana," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 78(2), pages 1293-1307, September.
    16. Antje Otto & Kristine Kern & Wolfgang Haupt & Peter Eckersley & Annegret H. Thieken, 2021. "Ranking local climate policy: assessing the mitigation and adaptation activities of 104 German cities," Climatic Change, Springer, vol. 167(1), pages 1-23, July.
    17. Brandt, Laura A. & Benscoter, Allison M. & Harvey, Rebecca & Speroterra, Carolina & Bucklin, David & Romañach, Stephanie S. & Watling, James I. & Mazzotti, Frank J., 2017. "Comparison of climate envelope models developed using expert-selected variables versus statistical selection," Ecological Modelling, Elsevier, vol. 345(C), pages 10-20.
    18. S. A. Mashi & A. I. Inkani & Oghenejeabor Obaro & A. S. Asanarimam, 2020. "Community perception, response and adaptation strategies towards flood risk in a traditional African city," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 103(2), pages 1727-1759, September.
    19. P. Ward & M. Marfai & F. Yulianto & D. Hizbaron & J. Aerts, 2011. "Coastal inundation and damage exposure estimation: a case study for Jakarta," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 56(3), pages 899-916, March.
    20. Liang, Wanwan & Papeş, Monica & Tran, Liem & Grant, Jerome & Washington-Allen, Robert & Stewart, Scott & Wiggins, Gregory, 2018. "The effect of pseudo-absence selection method on transferability of species distribution models in the context of non-adaptive niche shift," Ecological Modelling, Elsevier, vol. 388(C), pages 1-9.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecomod:v:309-310:y:2015:i::p:48-59. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/ecological-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.