IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this software component

MLOGITROC: Stata module to calculate multiclass ROC Curves and AUC from Multinomial Logistic Regression

Listed author(s):
  • Leif E. Peterson


    (Methodist Hospital Research Institute)

Registered author(s):

    mlogitroc generates multiclass ROC curves for classification accuracy based on multinomial logistic regression using mlogit. The algorithm begins by running mlogit B=100 times using bootstrapped records for each run while the original class labels are intact. Class prediction is then performed for records not sampled during bootstrapping, and accuracy for the left out records is determined as the fraction of correct class membership predictions. This results in B=100 realizations of the accuracy for the alternative distribution. Next, B=100 mlogit runs are made again, but this time after shuffling class labels of all records prior to modeling, which results in B=100 realizations of null accuracy. Smoothed probability distributions are obtained for the B=100 alternative and null accuracy values using kernel density estimation (KDE, Gaussian kernel) to obtain 100 smoothed realizations for alternative and null accuracy. The false positive rate (FPR), true positive rate (TPR), and area under the curve (AUC) are determined from the smooth pdfs derived from KDE. Twoway scatter plots of the smoothed pdfs are constructed, followed by plotting the ROC curve.

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL:
    File Function: program code
    Download Restriction: no

    File URL:
    File Function: help file
    Download Restriction: no

    File URL:
    File Function: sample graph
    Download Restriction: no

    Software component provided by Boston College Department of Economics in its series Statistical Software Components with number S457181.

    in new window

    Programming language: Stata
    Requires: Stata version 11
    Date of creation: 30 Sep 2010
    Handle: RePEc:boc:bocode:s457181
    Note: This module should be installed from within Stata by typing "ssc install mlogitroc". Windows users should not attempt to download these files with a web browser.
    Contact details of provider: Postal:
    Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA

    Phone: 617-552-3670
    Fax: +1-617-552-2308
    Web page:

    More information through EDIRC

    Order Information: Web:

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:boc:bocode:s457181. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F Baum)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.