Advanced Search
MyIDEAS: Login

MLOGITROC: Stata module to calculate multiclass ROC Curves and AUC from Multinomial Logistic Regression

Contents:

Author Info

  • Leif E. Peterson

    ()
    (Methodist Hospital Research Institute)

Registered author(s):

    Abstract

    mlogitroc generates multiclass ROC curves for classification accuracy based on multinomial logistic regression using mlogit. The algorithm begins by running mlogit B=100 times using bootstrapped records for each run while the original class labels are intact. Class prediction is then performed for records not sampled during bootstrapping, and accuracy for the left out records is determined as the fraction of correct class membership predictions. This results in B=100 realizations of the accuracy for the alternative distribution. Next, B=100 mlogit runs are made again, but this time after shuffling class labels of all records prior to modeling, which results in B=100 realizations of null accuracy. Smoothed probability distributions are obtained for the B=100 alternative and null accuracy values using kernel density estimation (KDE, Gaussian kernel) to obtain 100 smoothed realizations for alternative and null accuracy. The false positive rate (FPR), true positive rate (TPR), and area under the curve (AUC) are determined from the smooth pdfs derived from KDE. Twoway scatter plots of the smoothed pdfs are constructed, followed by plotting the ROC curve.

    Download Info

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
    File URL: http://fmwww.bc.edu/repec/bocode/m/mlogitroc.ado
    File Function: program code
    Download Restriction: no

    File URL: http://fmwww.bc.edu/repec/bocode/m/mlogitroc.sthlp
    File Function: help file
    Download Restriction: no

    File URL: http://fmwww.bc.edu/repec/bocode/m/mlogitroc.png
    File Function: sample graph
    Download Restriction: no

    Bibliographic Info

    Software component provided by Boston College Department of Economics in its series Statistical Software Components with number S457181.

    as in new window
    Size:
    Programming language: Stata
    Requires: Stata version 11
    Date of creation: 30 Sep 2010
    Date of revision:
    Handle: RePEc:boc:bocode:s457181

    Note: This module should be installed from within Stata by typing "ssc install mlogitroc". Windows users should not attempt to download these files with a web browser.
    Contact details of provider:
    Postal: Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA
    Phone: 617-552-3670
    Fax: +1-617-552-2308
    Email:
    Web page: http://fmwww.bc.edu/EC/
    More information through EDIRC

    Order Information:
    Web: http://repec.org/docs/ssc.php

    Related research

    Keywords: Multinomial logistic regression; ROC curve; multiclass; kernel density estimation; bootstrap;

    Lists

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    Statistics

    Access and download statistics

    Corrections

    When requesting a correction, please mention this item's handle: RePEc:boc:bocode:s457181. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F Baum).

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.