IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i20p4401-d1265576.html
   My bibliography  Save this article

BaMSGAN: Self-Attention Generative Adversarial Network with Blur and Memory for Anime Face Generation

Author

Listed:
  • Xu Li

    (Department of Computer, Central South University, Changsha 410083, China)

  • Bowei Li

    (School of Telecommunication Engineering, Xidian University, Xi’an 710126, China)

  • Minghao Fang

    (Zhejiang University-University of Illinois at Urbana-Champaign Institute, Zhejiang University, Haining 314400, China)

  • Rui Huang

    (School of Earth Sciences, Zhejiang University, Hangzhou 310000, China)

  • Xiaoran Huang

    (School of Software Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China)

Abstract

In this paper, we propose a novel network, self-attention generative adversarial network with blur and memory (BaMSGAN), for generating anime faces with improved clarity and faster convergence while retaining the capacity for continuous learning. Traditional self-attention generative adversarial networks (SAGANs) produce anime faces of higher quality compared to deep convolutional generative adversarial networks (DCGANs); however, some edges remain blurry and distorted, and the generation speed is sluggish. Additionally, common issues hinder the model’s ability to learn continuously. To address these challenges, we introduce a blurring preprocessing step on a portion of the training dataset, which is then fed to the discriminator as fake data to encourage the model to avoid blurry edges. Furthermore, we incorporate regulation into the optimizer to mitigate mode collapse. Additionally, memory data stored in the memory repository is presented to the model every epoch to alleviate catastrophic forgetting, thereby enhancing performance throughout the training process. Experimental results demonstrate that BaMSGAN outperforms prior work in anime face generation, significantly reducing distortion rates and accelerating shape convergence.

Suggested Citation

  • Xu Li & Bowei Li & Minghao Fang & Rui Huang & Xiaoran Huang, 2023. "BaMSGAN: Self-Attention Generative Adversarial Network with Blur and Memory for Anime Face Generation," Mathematics, MDPI, vol. 11(20), pages 1-13, October.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:20:p:4401-:d:1265576
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/20/4401/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/20/4401/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:20:p:4401-:d:1265576. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.