IDEAS home Printed from https://ideas.repec.org/a/tsj/stataj/v20y2020i1p131-148.html
   My bibliography  Save this article

When to consult precision-recall curves

Author

Listed:
  • Jonathan Cook

    (Public Company Accounting Oversight Board)

  • Vikram Ramadas

    (Public Company Accounting Oversight Board)

Abstract

Receiver operating characteristic (ROC) curves are commonly used to evaluate predictions of binary outcomes. When there is a small percentage of items of interest (as would be the case with fraud detection, for example), ROC curves can provide an inflated view of performance. This can cause challenges in determining which set of predictions is better. In this article, we discuss the condi- tions under which precision-recall curves may be preferable to ROC curves. As an illustrative example, we compare two commonly used fraud predictors (Beneish’s [1999, Financial Analysts Journal 55: 24–36] M score and Dechow et al.’s [2011, Contemporary Accounting Research 28: 17–82] F score) using both ROC and precision-recall curves. To aid the reader with using precision-recall curves, we also introduce the command prcurve to plot them.

Suggested Citation

  • Jonathan Cook & Vikram Ramadas, 2020. "When to consult precision-recall curves," Stata Journal, StataCorp LP, vol. 20(1), pages 131-148, March.
    • Handle: RePEc:tsj:stataj:v:20:y:2020:i:1:p:131-148
    DOI: 10.1177/1536867X20909693
    Note: to access software from within Stata, net describe http://www.stata-journal.com/software/sj20-1/st0591/
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1177/1536867X20909693
    Download Restriction: no
    File URL: https://libkey.io/10.1177/1536867X20909693?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Codruț-Georgian Artene & Ciprian Oprișa & Cristian Nicolae Buțincu & Florin Leon, 2023. "Finding Patient Zero and Tracking Narrative Changes in the Context of Online Disinformation Using Semantic Similarity Analysis," Mathematics, MDPI, vol. 11(9), pages 1-26, April.
    2. Esmeli, Ramazan & Bader-El-Den, Mohamed & Abdullahi, Hassana, 2022. "An analyses of the effect of using contextual and loyalty features on early purchase prediction of shoppers in e-commerce domain," Journal of Business Research, Elsevier, vol. 147(C), pages 420-434.
    3. Kajal Lahiri & Cheng Yang, 2023. "ROC and PRC Approaches to Evaluate Recession Forecasts," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 19(2), pages 119-148, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tsj:stataj:v:20:y:2020:i:1:p:131-148. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum or Lisa Gilmore (email available below). General contact details of provider: http://www.stata-journal.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.