IDEAS home Printed from https://ideas.repec.org/a/hin/jnlmpe/4973535.html
   My bibliography  Save this article

Self-Attention-Based Edge Computing Model for Synthesis Image to Text through Next-Generation AI Mechanism

Author

Listed:
  • Hamdan Ali Alshehri
  • N. Junath
  • Poonam Panwar
  • Kirti Shukla
  • Saima Ahmed Rahin
  • R. John Martin
  • Vijay Kumar

Abstract

Image synthesis based on natural language description has become a research hotspot in edge computing in artificial intelligence. With the help of generative adversarial edge computing networks, the field has made great strides in high-resolution image synthesis. However, there are still some defects in the authenticity of synthetic single-target images. For example, there will be abnormal situations such as “multiple heads†and “multiple mouths†when synthesizing bird graphics. Aiming at such problems, a text generation single-target model SA-AttnGAN based on a self-attention mechanism is proposed. SA-AttnGAN (Attentional Generative Adversarial Network) refines text features into word features and sentence features to improve the semantic alignment of text and images; in the initialization stage of AttnGAN, the self-attention mechanism is used to improve the stability of the text-generated image model; the multistage GAN network is used to superimpose, finally synthesizing high-resolution images. Experimental data show that SA-AttnGAN outperforms other comparable models in terms of Inception Score and Frechet Inception Distance; synthetic image analysis shows that this model can learn background and colour information and correctly capture bird heads and mouths. The structural information of other components is improved, and the AttnGAN model generates incorrect images such as “multiple heads†and “multiple mouths.†Furthermore, SA-AttnGAN is successfully applied to description-based clothing image synthesis with good generalization ability.

Suggested Citation

  • Hamdan Ali Alshehri & N. Junath & Poonam Panwar & Kirti Shukla & Saima Ahmed Rahin & R. John Martin & Vijay Kumar, 2022. "Self-Attention-Based Edge Computing Model for Synthesis Image to Text through Next-Generation AI Mechanism," Mathematical Problems in Engineering, Hindawi, vol. 2022, pages 1-12, June.
  • Handle: RePEc:hin:jnlmpe:4973535
    DOI: 10.1155/2022/4973535
    as

    Download full text from publisher

    File URL: http://downloads.hindawi.com/journals/mpe/2022/4973535.pdf
    Download Restriction: no

    File URL: http://downloads.hindawi.com/journals/mpe/2022/4973535.xml
    Download Restriction: no

    File URL: https://libkey.io/10.1155/2022/4973535?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hin:jnlmpe:4973535. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mohamed Abdelhakeem (email available below). General contact details of provider: https://www.hindawi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.