IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i16p3578-d1220115.html
   My bibliography  Save this article

Variational Disentangle Zero-Shot Learning

Author

Listed:
  • Jie Su

    (School of Computing, Newcastle University, Newcastle upon Tyne NE4 5TG, UK)

  • Jinhao Wan

    (ISPNU Lab, Zhejiang University of Technology, Hangzhou 310023, China)

  • Taotao Li

    (ISPNU Lab, Zhejiang University of Technology, Hangzhou 310023, China)

  • Xiong Li

    (ISPNU Lab, Zhejiang University of Technology, Hangzhou 310023, China)

  • Yuheng Ye

    (ISPNU Lab, Zhejiang University of Technology, Hangzhou 310023, China)

Abstract

Existing zero-shot learning (ZSL) methods typically focus on mapping from the feature space (e.g., visual space) to class-level attributes, often leading to a non-injective projection. Such a mapping may cause a significant loss of instance-level information. While an ideal projection to instance-level attributes would be desirable, it can also be prohibitively expensive and thus impractical in many scenarios. In this work, we propose a variational disentangle zero-shot learning (VDZSL) framework that addresses this problem by constructing variational instance-specific attributes from a class-specific semantic latent distribution. Specifically, our approach disentangles each instance into class-specific attributes and the corresponding variant features. Unlike transductive ZSL, which assumes that unseen classes’ attributions are known beforehand, our VDZSL method does not rely on this strong assumption, making it more applicable in real-world scenarios. Extensive experiments conducted on three popular ZSL benchmark datasets (i.e., AwA2, CUB, and FLO) validate the effectiveness of our approach. In the conventional ZSL setting, our method demonstrates an improvement of 12∼15% relative to the advanced approaches and achieves a classification accuracy of 70% on the AwA2 dataset. Furthermore, under the more challenging generalized ZSL setting, our approach can gain an improvement of 5∼15% compared with the advanced methods.

Suggested Citation

  • Jie Su & Jinhao Wan & Taotao Li & Xiong Li & Yuheng Ye, 2023. "Variational Disentangle Zero-Shot Learning," Mathematics, MDPI, vol. 11(16), pages 1-13, August.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:16:p:3578-:d:1220115
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/16/3578/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/16/3578/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:16:p:3578-:d:1220115. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.