IDEAS home Printed from https://ideas.repec.org/p/ems/eureri/19678.html
   My bibliography  Save this paper

AUK: a simple alternative to the AUC

Author

Listed:
  • Kaymak, U.
  • Ben-David, A.
  • Potharst, R.

Abstract

The area under Receiver Operating Characteristic (ROC) curve, also known as the AUC-index, is commonly used for ranking the performance of data mining models. The AUC has many merits, such as objectivity and ease of interpretation. However, since it is class indifferent, its usefulness while dealing with highly skewed data sets is questionable, to say the least. In this paper, we propose a simple alternative scalar measure to the AUCindex, the Area Under an Kappa curve (AUK). The proposed AUK-index compensates for the above basic flaw of the AUC by being sensitive to the class distribution. Therefore it is particularly suitable for measuring classifiers’ performance on skewed data sets. After introducing the AUK we explore its mathematical relationship with the AUC and show that there is a nonlinear relation between them.

Suggested Citation

  • Kaymak, U. & Ben-David, A. & Potharst, R., 2010. "AUK: a simple alternative to the AUC," ERIM Report Series Research in Management ERS-2010-024-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    • Handle: RePEc:ems:eureri:19678
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/19678/ERS-2010-024-LIS.pdf
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    AUC; AUK; H-measure; Kappa index; ROC curve; area under ROC curve; model ranking; model selection;
    All these keywords.

    JEL classification:

    • L23 - Industrial Organization - - Firm Objectives, Organization, and Behavior - - - Organization of Production
    • M - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics
    • M11 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - Production Management
    • R4 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Transportation Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureri:19678. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/erimanl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.