Generalizability of songbird habitat models in boreal mixedwood forests of Alberta

Statistical models relating habitat characteristics to species occurrences are increasingly used to evaluate the consequences of forest management activities and conservation plans over large spatial and temporal scales. In practice, such models do not always generalize to other locations, hence, they should be validated using independent data. In this paper, we assess the predictive ability of 16 songbird habitat models developed in the Calling Lake region of the boreal mixedwood forest of Alberta using both internal and external validation approaches. Internal validation relied on the same dataset used to develop the models while external validation utilised independent data collected within four validation landscapes in the same ecological region. Two aspects of predictive accuracy were evaluated: the agreement between observations and predicted values (calibration) and the models’ ability to classify locations into those in which species are present or absent (discrimination). Calibration was assessed using the Hosmer–Lemeshow (H–L) statistic and plots showing predicted versus observed probabilities of occurrence. Discrimination was assessed using receiver operating characteristic (ROC) curves and the associated area under the ROC curve.