Author
Listed:
- Antonio Palazón-Bru
- David Manuel Folgado-de la Rosa
- Ernesto Cortés-Castell
- María Teresa López-Cascales
- Vicente Francisco Gil-Guillén
Abstract
Background: A sample size containing at least 100 events and 100 non-events has been suggested to validate a predictive model, regardless of the model being validated and that certain factors can influence calibration of the predictive model (discrimination, parameterization and incidence). Scoring systems based on binary logistic regression models are a specific type of predictive model. Objective: The aim of this study was to develop an algorithm to determine the sample size for validating a scoring system based on a binary logistic regression model and to apply it to a case study. Methods: The algorithm was based on bootstrap samples in which the area under the ROC curve, the observed event probabilities through smooth curves, and a measure to determine the lack of calibration (estimated calibration index) were calculated. To illustrate its use for interested researchers, the algorithm was applied to a scoring system, based on a binary logistic regression model, to determine mortality in intensive care units. Results: In the case study provided, the algorithm obtained a sample size with 69 events, which is lower than the value suggested in the literature. Conclusion: An algorithm is provided for finding the appropriate sample size to validate scoring systems based on binary logistic regression models. This could be applied to determine the sample size in other similar cases.
Suggested Citation
Antonio Palazón-Bru & David Manuel Folgado-de la Rosa & Ernesto Cortés-Castell & María Teresa López-Cascales & Vicente Francisco Gil-Guillén, 2017.
"Sample size calculation to externally validate scoring systems based on logistic regression models,"
PLOS ONE, Public Library of Science, vol. 12(5), pages 1-11, May.
Handle:
RePEc:plo:pone00:0176726
DOI: 10.1371/journal.pone.0176726
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0176726. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.