IDEAS home Printed from https://ideas.repec.org/a/spr/stmapp/v30y2021i3d10.1007_s10260-021-00573-7.html
   My bibliography  Save this article

robROSE: A robust approach for dealing with imbalanced data in fraud detection

Author

Listed:
  • Bart Baesens

    (KU Leuven)

  • Sebastiaan Höppner

    (KU Leuven)

  • Irene Ortner

    (Applied Statistics GmbH)

  • Tim Verdonck

    (University of Antwerp)

Abstract

A major challenge when trying to detect fraud is that the fraudulent activities form a minority class which make up a very small proportion of the data set. In most data sets, fraud occurs in typically less than $$0.5\%$$ 0.5 % of the cases. Detecting fraud in such a highly imbalanced data set typically leads to predictions that favor the majority group, causing fraud to remain undetected. We discuss some popular oversampling techniques that solve the problem of imbalanced data by creating synthetic samples that mimic the minority class. A frequent problem when analyzing real data is the presence of anomalies or outliers. When such atypical observations are present in the data, most oversampling techniques are prone to create synthetic samples that distort the detection algorithm and spoil the resulting analysis. A useful tool for anomaly detection is robust statistics, which aims to find the outliers by first fitting the majority of the data and then flagging data observations that deviate from it. In this paper, we present a robust version of ROSE, called robROSE, which combines several promising approaches to cope simultaneously with the problem of imbalanced data and the presence of outliers. The proposed method achieves to enhance the presence of the fraud cases while ignoring anomalies. The good performance of our new sampling technique is illustrated on simulated and real data sets and it is shown that robROSE can provide better insight in the structure of the data. The source code of the robROSE algorithm is made freely available.

Suggested Citation

  • Bart Baesens & Sebastiaan Höppner & Irene Ortner & Tim Verdonck, 2021. "robROSE: A robust approach for dealing with imbalanced data in fraud detection," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(3), pages 841-861, September.
  • Handle: RePEc:spr:stmapp:v:30:y:2021:i:3:d:10.1007_s10260-021-00573-7
    DOI: 10.1007/s10260-021-00573-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10260-021-00573-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10260-021-00573-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. D J Hand & C Whitrow & N M Adams & P Juszczak & D Weston, 2008. "Performance criteria for plastic card fraud detection tools," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(7), pages 956-962, July.
    2. Andrea Cerioli & Domenico Perrotta, 2014. "Robust clustering around regression lines with high density regions," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 8(1), pages 5-26, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lisa Crosato & Caterina Liberati & Marco Repetto, 2021. "Look Who's Talking: Interpretable Machine Learning for Assessing Italian SMEs Credit Default," Papers 2108.13914, arXiv.org, revised Sep 2021.
    2. Lucio Barabesi & Andrea Cerioli & Domenico Perrotta, 2021. "Forum on Benford’s law and statistical methods for the detection of frauds," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(3), pages 767-778, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Domenico Perrotta & Francesca Torti, 2018. "Discussion of “The power of monitoring: how to make the most of a contaminated multivariate sample”," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(4), pages 641-649, December.
    2. Riani, Marco & Perrotta, Domenico & Cerioli, Andrea, 2015. "The Forward Search for Very Large Datasets," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(c01).
    3. Lucio Barabesi & Andrea Cerioli & Domenico Perrotta, 2021. "Forum on Benford’s law and statistical methods for the detection of frauds," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(3), pages 767-778, September.
    4. Höppner, Sebastiaan & Baesens, Bart & Verbeke, Wouter & Verdonck, Tim, 2022. "Instance-dependent cost-sensitive learning for detecting transfer fraud," European Journal of Operational Research, Elsevier, vol. 297(1), pages 291-300.
    5. Marco Riani & Andrea Cerioli & Domenico Perrotta & Francesca Torti, 2015. "Simulating mixtures of multivariate data with fixed cluster overlap in FSDA library," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 9(4), pages 461-481, December.
    6. Finlay, Steven, 2010. "Credit scoring for profitability objectives," European Journal of Operational Research, Elsevier, vol. 202(2), pages 528-537, April.
    7. Christoforos Anagnostopoulos & Dimitris Tasoulis & Niall Adams & David Hand, 2009. "Temporally adaptive estimation of logistic classifiers on data streams," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 3(3), pages 243-261, December.
    8. Francesca Torti & Marco Riani & Gianluca Morelli, 2021. "Semiautomatic robust regression clustering of international trade data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(3), pages 863-894, September.
    9. Francesca Torti & Domenico Perrotta & Marco Riani & Andrea Cerioli, 2019. "Assessing trimming methodologies for clustering linear regression data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(1), pages 227-257, March.
    10. Silvia Salini & Andrea Cerioli & Fabrizio Laurini & Marco Riani, 2016. "Reliable Robust Regression Diagnostics," International Statistical Review, International Statistical Institute, vol. 84(1), pages 99-127, April.
    11. Lessmann, Stefan & Voß, Stefan, 2009. "A reference model for customer-centric data mining with support vector machines," European Journal of Operational Research, Elsevier, vol. 199(2), pages 520-530, December.
    12. Hand, David J. & Crowder, Martin J., 2012. "Overcoming selectivity bias in evaluating new fraud detection systems for revolving credit operations," International Journal of Forecasting, Elsevier, vol. 28(1), pages 216-223.
    13. Sanjeev Jha & J. Christopher Westland, 2013. "A Descriptive Study of Credit Card Fraud Pattern," Global Business Review, International Management Institute, vol. 14(3), pages 373-384, September.
    14. Yang, Yi & Guo, Yuxuan & Chang, Xiangyu, 2021. "Angle-based cost-sensitive multicategory classification," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stmapp:v:30:y:2021:i:3:d:10.1007_s10260-021-00573-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.