IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i3p692-d1050757.html
   My bibliography  Save this article

AdvSCOD: Bayesian-Based Out-Of-Distribution Detection via Curvature Sketching and Adversarial Sample Enrichment

Author

Listed:
  • Jiacheng Qiao

    (Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou 510006, China)

  • Chengzhi Zhong

    (Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou 510006, China)

  • Peican Zhu

    (School of Artificial Intelligence, Optics, and Electronics (iOPEN), Northwestern Polytechnical University, Xi’an 710072, China)

  • Keke Tang

    (Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou 510006, China
    Department of New Networks, Peng Cheng Laboratory, Shenzhen 518066, China)

Abstract

Detecting out-of-distribution (OOD) samples is critical for the deployment of deep neural networks (DNN) in real-world scenarios. An appealing direction in which to conduct OOD detection is to measure the epistemic uncertainty in DNNs using the Bayesian model, since it is much more explainable. SCOD sketches the curvature of DNN classifiers based on Bayesian posterior estimation and decomposes the OOD measurement into the uncertainty of the model parameters and the influence of input samples on the DNN models. However, since lots of approximation is applied, and the influence of the input samples on DNN models can be hardly measured stably, as demonstrated in adversarial attacks, the detection is not robust. In this paper, we propose a novel AdvSCOD framework that enriches the input sample with a small set of its neighborhoods generated by applying adversarial perturbation, which we believe can better reflect the influence on model predictions, and then we average their uncertainties, measured by SCOD. Extensive experiments with different settings of in-distribution and OOD datasets validate the effectiveness of AdvSCOD in OOD detection and its superiority to state-of-the-art Bayesian-based methods. We also evaluate the influence of different types of perturbation.

Suggested Citation

  • Jiacheng Qiao & Chengzhi Zhong & Peican Zhu & Keke Tang, 2023. "AdvSCOD: Bayesian-Based Out-Of-Distribution Detection via Curvature Sketching and Adversarial Sample Enrichment," Mathematics, MDPI, vol. 11(3), pages 1-15, January.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:3:p:692-:d:1050757
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/3/692/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/3/692/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:3:p:692-:d:1050757. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.