MLOGITROC: Stata module to calculate multiclass ROC Curves and AUC from Multinomial Logistic Regression
Abstractmlogitroc generates multiclass ROC curves for classification accuracy based on multinomial logistic regression using mlogit. The algorithm begins by running mlogit B=100 times using bootstrapped records for each run while the original class labels are intact. Class prediction is then performed for records not sampled during bootstrapping, and accuracy for the left out records is determined as the fraction of correct class membership predictions. This results in B=100 realizations of the accuracy for the alternative distribution. Next, B=100 mlogit runs are made again, but this time after shuffling class labels of all records prior to modeling, which results in B=100 realizations of null accuracy. Smoothed probability distributions are obtained for the B=100 alternative and null accuracy values using kernel density estimation (KDE, Gaussian kernel) to obtain 100 smoothed realizations for alternative and null accuracy. The false positive rate (FPR), true positive rate (TPR), and area under the curve (AUC) are determined from the smooth pdfs derived from KDE. Twoway scatter plots of the smoothed pdfs are constructed, followed by plotting the ROC curve.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoSoftware component provided by Boston College Department of Economics in its series Statistical Software Components with number S457181.
Programming language: Stata
Requires: Stata version 11
Date of creation: 30 Sep 2010
Date of revision:
Note: This module should be installed from within Stata by typing "ssc install mlogitroc". Windows users should not attempt to download these files with a web browser.
Contact details of provider:
Postal: Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA
Web page: http://fmwww.bc.edu/EC/
More information through EDIRC
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F Baum).
If references are entirely missing, you can add them using this form.