IDEAS home Printed from https://ideas.repec.org/a/eee/ecomod/v220y2009i24p3512-3520.html
   My bibliography  Save this article

The performance of state-of-the-art modelling techniques depends on geographical distribution of species

Author

Listed:
  • Marmion, Mathieu
  • Luoto, Miska
  • Heikkinen, Risto K.
  • Thuiller, Wilfried

Abstract

We explored the effects of prevalence, latitudinal range and clumping (spatial autocorrelation) of species distribution patterns on the predictive accuracy of eight state-of-the-art modelling techniques: Generalized Linear Models (GLMs), Generalized Boosting Method (GBM), Generalized Additive Models (GAMs), Classification Tree Analysis (CTA), Artificial Neural Network (ANN), Multivariate Adaptive Regression Splines (MARS), Mixture Discriminant Analysis (MDA) and Random Forest (RF). One hundred species of Lepidoptera, selected from the Distribution Atlas of European Butterflies, and three climate variables were used to determine the bioclimatic envelope for each butterfly species. The data set consisting of 2620 grid squares 30′×60′ in size all over Europe was randomly split into the calibration and the evaluation data sets. The performance of different models was assessed using the area under the curve (AUC) of a receiver operating characteristic (ROC) plot. Observed differences in modelling accuracy among species were then related to the geographical attributes of the species using GAM. The modelling performance was negatively related to the latitudinal range and prevalence, whereas the effect of spatial autocorrelation on prediction accuracy depended on the modelling technique. These three geographical attributes accounted for 19–61% of the variation in the modelling accuracy. Predictive accuracy of GAM, GLM and MDA was highly influenced by the three geographical attributes, whereas RF, ANN and GBM were moderately, and MARS and CTA only slightly affected. The contrasting effects of geographical distribution of species on predictive performance of different modelling techniques represent one source of uncertainty in species spatial distribution models. This should be taken into account in biogeographical modelling studies and assessments of climate change impacts.

Suggested Citation

  • Marmion, Mathieu & Luoto, Miska & Heikkinen, Risto K. & Thuiller, Wilfried, 2009. "The performance of state-of-the-art modelling techniques depends on geographical distribution of species," Ecological Modelling, Elsevier, vol. 220(24), pages 3512-3520.
  • Handle: RePEc:eee:ecomod:v:220:y:2009:i:24:p:3512-3520
    DOI: 10.1016/j.ecolmodel.2008.10.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304380008004948
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ecolmodel.2008.10.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wilfried Thuiller & Miguel B. Araújo & Richard G. Pearson & Robert J. Whittaker & Lluís Brotons & Sandra Lavorel, 2004. "Uncertainty in predictions of extinction risk," Nature, Nature, vol. 430(6995), pages 34-34, July.
    2. Dormann, Carsten F., 2007. "Assessing the validity of autologistic regression," Ecological Modelling, Elsevier, vol. 207(2), pages 234-242.
    3. de Frutos, Ángel & Olea, Pedro P. & Vera, Rubén, 2007. "Analyzing and modelling spatial distribution of summering lesser kestrel: The role of spatial autocorrelation," Ecological Modelling, Elsevier, vol. 200(1), pages 33-44.
    4. Bashir, Shaheena & Carter, E. M., 2005. "High breakdown mixture discriminant analysis," Journal of Multivariate Analysis, Elsevier, vol. 93(1), pages 102-111, March.
    5. Austin, Mike, 2007. "Species distribution models and ecological theory: A critical assessment and some possible new approaches," Ecological Modelling, Elsevier, vol. 200(1), pages 1-19.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guo, Chuanbo & Lek, Sovan & Ye, Shaowen & Li, Wei & Liu, Jiashou & Li, Zhongjie, 2015. "Uncertainty in ensemble modelling of large-scale species distribution: Effects from species characteristics and model techniques," Ecological Modelling, Elsevier, vol. 306(C), pages 67-75.
    2. Jin Li & Maggie Tran & Justy Siwabessy, 2016. "Selecting Optimal Random Forest Predictive Models: A Case Study on Predicting the Spatial Distribution of Seabed Hardness," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-29, February.
    3. Kyungeun Lee & Daeguen Kim & Jaegyu Cha & Seungbum Hong, 2023. "Fine-Scale Species Distribution Modeling of Abies koreana across a Subalpine Zone in South Korea for In Situ Species Conservation," Sustainability, MDPI, vol. 15(11), pages 1-15, June.
    4. Junhee Lee & Youngjae Yoo & Raeik Jang & Seongwoo Jeon, 2023. "Mapping the Species Richness of Woody Plants in Republic of Korea," Sustainability, MDPI, vol. 15(7), pages 1-14, March.
    5. Hallstan, Simon & Johnson, Richard K. & Willén, Eva & Grandin, Ulf, 2012. "Comparison of classification-then-modelling and species-by-species modelling for predicting lake phytoplankton assemblages," Ecological Modelling, Elsevier, vol. 231(C), pages 11-19.
    6. Alexandra M. Thorn & Jonathan R. Thompson & Joshua S. Plisinski, 2016. "Patterns and Predictors of Recent Forest Conversion in New England," Land, MDPI, vol. 5(3), pages 1-17, September.
    7. Alessandro Balestrieri & Giuseppe Bogliani & Giovanni Boano & Aritz Ruiz-González & Nicola Saino & Stefano Costa & Pietro Milanesi, 2016. "Modelling the Distribution of Forest-Dependent Species in Human-Dominated Landscapes: Patterns for the Pine Marten in Intensively Cultivated Lowlands," PLOS ONE, Public Library of Science, vol. 11(7), pages 1-14, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Platts, Philip J. & McClean, Colin J. & Lovett, Jon C. & Marchant, Rob, 2008. "Predicting tree distributions in an East African biodiversity hotspot: model selection, data bias and envelope uncertainty," Ecological Modelling, Elsevier, vol. 218(1), pages 121-134.
    2. Wesley R. Brooks & Stephen C. Newbold, 2013. "Ecosystem damages in integrated assessment models of climate change," NCEE Working Paper Series 201302, National Center for Environmental Economics, U.S. Environmental Protection Agency, revised Mar 2013.
    3. Václavík, Tomáš & Meentemeyer, Ross K., 2009. "Invasive species distribution modeling (iSDM): Are absence data and dispersal constraints needed to predict actual distributions?," Ecological Modelling, Elsevier, vol. 220(23), pages 3248-3258.
    4. Muñoz-Mas, Rafael & Vezza, Paolo & Alcaraz-Hernández, Juan Diego & Martínez-Capel, Francisco, 2016. "Risk of invasion predicted with support vector machines: A case study on northern pike (Esox Lucius, L.) and bleak (Alburnus alburnus, L.)," Ecological Modelling, Elsevier, vol. 342(C), pages 123-134.
    5. Meineri, Eric & Dahlberg, C. Johan & Hylander, Kristoffer, 2015. "Using Gaussian Bayesian Networks to disentangle direct and indirect associations between landscape physiography, environmental variables and species distribution," Ecological Modelling, Elsevier, vol. 313(C), pages 127-136.
    6. Kaiping Wang & Weiqi Wang & Niyi Zha & Yue Feng & Chenlan Qiu & Yunlu Zhang & Jia Ma & Rui Zhang, 2022. "Spatially Heterogeneity Response of Critical Ecosystem Service Capacity to Address Regional Development Risks to Rapid Urbanization: The Case of Beijing-Tianjin-Hebei Urban Agglomeration in China," Sustainability, MDPI, vol. 14(12), pages 1-21, June.
    7. Sellami, Mohamed Habib & Sifaoui, Mohamed Salah, 2008. "Modelling of heat and mass transfer inside a traditional oasis: Experimental validation," Ecological Modelling, Elsevier, vol. 210(1), pages 144-154.
    8. Di Traglia, Mario & Attorre, Fabio & Francesconi, Fabio & Valenti, Roberto & Vitale, Marcello, 2011. "Is cellular automata algorithm able to predict the future dynamical shifts of tree species in Italy under climate change scenarios? A methodological approach," Ecological Modelling, Elsevier, vol. 222(4), pages 925-934.
    9. Mouton, Ans M. & De Baets, Bernard & Goethals, Peter L.M., 2010. "Ecological relevance of performance criteria for species distribution models," Ecological Modelling, Elsevier, vol. 221(16), pages 1995-2002.
    10. Aertsen, Wim & Kint, Vincent & van Orshoven, Jos & Özkan, Kürşad & Muys, Bart, 2010. "Comparison and ranking of different modelling techniques for prediction of site index in Mediterranean mountain forests," Ecological Modelling, Elsevier, vol. 221(8), pages 1119-1130.
    11. Lyndsie S Wszola & Victoria L Simonsen & Erica F Stuber & Caitlyn R Gillespie & Lindsey N Messinger & Karie L Decker & Jeffrey J Lusk & Christopher F Jorgensen & Andrew A Bishop & Joseph J Fontaine, 2017. "Translating statistical species-habitat models to interactive decision support tools," PLOS ONE, Public Library of Science, vol. 12(12), pages 1-13, December.
    12. Basille, Mathieu & Calenge, Clément & Marboutin, Éric & Andersen, Reidar & Gaillard, Jean-Michel, 2008. "Assessing habitat selection using multivariate statistics: Some refinements of the ecological-niche factor analysis," Ecological Modelling, Elsevier, vol. 211(1), pages 233-240.
    13. Rufino, Marta M. & Albouy, Camille & Brind'Amour, Anik, 2021. "Which spatial interpolators I should use? A case study applying to marine species," Ecological Modelling, Elsevier, vol. 449(C).
    14. Mouton, Ans M. & De Baets, Bernard & Van Broekhoven, Ester & Goethals, Peter L.M., 2009. "Prevalence-adjusted optimisation of fuzzy models for species distribution," Ecological Modelling, Elsevier, vol. 220(15), pages 1776-1786.
    15. Stoklosa, Jakub & Huang, Yih-Huei & Furlan, Elise & Hwang, Wen-Han, 2016. "On quadratic logistic regression models when predictor variables are subject to measurement error," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 109-121.
    16. Troxler, David & Zabel, Astrid & Grêt-Regamey, Adrienne, 2023. "Identifying drivers of forest clearances in Switzerland," Forest Policy and Economics, Elsevier, vol. 150(C).
    17. Suárez-Seoane, Susana & García de la Morena, Eladio L. & Morales Prieto, Manuel B. & Osborne, Patrick E. & de Juana, Eduardo, 2008. "Maximum entropy niche-based modelling of seasonal changes in little bustard (Tetrax tetrax) distribution," Ecological Modelling, Elsevier, vol. 219(1), pages 17-29.
    18. Hopkins, Robert L. & Burr, Brooks M., 2009. "Modeling freshwater fish distributions using multiscale landscape data: A case study of six narrow range endemics," Ecological Modelling, Elsevier, vol. 220(17), pages 2024-2034.
    19. Solaiman Afroughi & Soghrat Faghihzadeh & Majid Jafari Khaledi & Mehdi Ghandehari Motlagh & Ebrahim Hajizadeh, 2011. "Analysis of clustered spatially correlated binary data using autologistic model and Bayesian method with an application to dental caries of 3--5-year-old children," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(12), pages 2763-2774, February.
    20. Pie, Marcio R. & Meyer, Andreas L.S. & Firkowski, Carina R. & Ribeiro, Luiz F. & Bornschein, Marcos R., 2013. "Understanding the mechanisms underlying the distribution of microendemic montane frogs (Brachycephalus spp., Terrarana: Brachycephalidae) in the Brazilian Atlantic Rainforest," Ecological Modelling, Elsevier, vol. 250(C), pages 165-176.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecomod:v:220:y:2009:i:24:p:3512-3520. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/ecological-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.