IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i6p899-d1359293.html
   My bibliography  Save this article

Boundary-Match U-Shaped Temporal Convolutional Network for Vulgar Action Segmentation

Author

Listed:
  • Zhengwei Shen

    (School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, China)

  • Ran Xu

    (School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, China)

  • Yongquan Zhang

    (School of Data Sciences, Zhejiang University of Finance and Economics, Hangzhou 310018, China)

  • Feiwei Qin

    (School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, China)

  • Ruiquan Ge

    (School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, China)

  • Changmiao Wang

    (Medical Big Data Lab, Shenzhen Research Institute of Big Data, Shenzhen 518172, China)

  • Masahiro Toyoura

    (Department of Computer Science and Engineering, University of Yamanashi, Kofu 400-8511, Japan)

Abstract

The advent of deep learning has provided solutions to many challenges posed by the Internet. However, efficient localization and recognition of vulgar segments within videos remain formidable tasks. This difficulty arises from the blurring of spatial features in vulgar actions, which can render them indistinguishable from general actions. Furthermore, issues of boundary ambiguity and over-segmentation complicate the segmentation of vulgar actions. To address these issues, we present the B oundary- M atch U -shaped T emporal C onvolutional N etwork (BMUTCN), a novel approach for the segmentation of vulgar actions. The BMUTCN employs a U-shaped architecture within an encoder–decoder temporal convolutional network to bolster feature recognition by leveraging the context of the video. Additionally, we introduce a boundary-match map that fuses action boundary inform ation with greater precision for frames that exhibit ambiguous boundaries. Moreover, we propose an adaptive internal block suppression technique, which substantially mitigates over-segmentation errors while preserving accuracy. Our methodology, tested across several public datasets as well as a bespoke vulgar dataset, has demonstrated state-of-the-art performance on the latter.

Suggested Citation

  • Zhengwei Shen & Ran Xu & Yongquan Zhang & Feiwei Qin & Ruiquan Ge & Changmiao Wang & Masahiro Toyoura, 2024. "Boundary-Match U-Shaped Temporal Convolutional Network for Vulgar Action Segmentation," Mathematics, MDPI, vol. 12(6), pages 1-18, March.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:6:p:899-:d:1359293
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/6/899/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/6/899/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:6:p:899-:d:1359293. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.