IDEAS home Printed from https://ideas.repec.org/a/igg/jswis0/v20y2024i1p1-23.html
   My bibliography  Save this article

Semantic Web-Driven Targeted Adversarial Attack on Black Box Automatic Speech Recognition Systems

Author

Listed:
  • Jing Li

    (The School of Data Science and Technology, North University of China, Taiyuan, China)

  • Yanru Feng

    (The School of Data Science and Technology, North University of China, Taiyuan, China & The School of Information Engineering, Institute of Disaster Prevention, Sanhe, China)

  • Mengli Wang

    (The School of Data Science and Technology, North University of China, Taiyuan, China)

Abstract

The susceptibility of Deep Neural Networks (DNNs) to adversarial attacks in Automatic Speech Recognition (ASR) systems has drawn significant attention. Most work focuses on white-box methods, but the assumption of full transparency of model architecture and parameters is unrealistic in real-world scenarios. Although several targeted black-box attack methods have been proposed in recent years, due to the complexity of ASR systems, they primarily rely on query-based approaches with limited search capabilities, leading to low success rates and noticeable noise. To address this, we propose DE-gradient, a new black-box approach using differential evolution (DE), a population-based search algorithm. Inspired by Semantic Web ideas, we introduce modulation noise to preserve semantic coherence while enhancing imperceptibility. In experiments on two public datasets, DE-gradient improved attack success rates by 19% and increased the signal-to-noise ratio (SNR) of silent parts from 27 dB to 54 dB, establishing a strong baseline for evaluating black-box adversarial attacks in ASR systems.

Suggested Citation

  • Jing Li & Yanru Feng & Mengli Wang, 2024. "Semantic Web-Driven Targeted Adversarial Attack on Black Box Automatic Speech Recognition Systems," International Journal on Semantic Web and Information Systems (IJSWIS), IGI Global, vol. 20(1), pages 1-23, January.
  • Handle: RePEc:igg:jswis0:v:20:y:2024:i:1:p:1-23
    as

    Download full text from publisher

    File URL: https://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJSWIS.360651
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mehmet Balcilar & Elie Bouri & Rangan Gupta & Clement Kweku Kyei, 2021. "High-Frequency Predictability of Housing Market Movements of the United States: The Role of Economic Sentiment," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 22(4), pages 490-498, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rangan Gupta & Damien Moodley, 2023. "Housing Search Activity and Quantiles-Based Predictability of Housing Price Movements in the United States," Working Papers 202335, University of Pretoria, Department of Economics.
    2. Bouri, Elie & Gupta, Rangan & Kyei, Clement Kweku & Shivambu, Rinsuna, 2021. "Uncertainty and daily predictability of housing returns and volatility of the United States: Evidence from a higher-order nonparametric causality-in-quantiles test," The Quarterly Review of Economics and Finance, Elsevier, vol. 82(C), pages 200-206.
    3. Hakan Yıldırım & Festus Victor Bekun, 2023. "Predicting volatility of bitcoin returns with ARCH, GARCH and EGARCH models," Future Business Journal, Springer, vol. 9(1), pages 1-8, December.
    4. Oguzhan Cepni & Rangan Gupta & Christian Pierdzioch, 2024. "Forecasting Growth-at-Risk of the United States: Housing Price versus Housing Sentiment or Attention," Working Papers 202401, University of Pretoria, Department of Economics.
    5. Riza Demirer & Rangan Gupta & Jacobus Nel & Christian Pierdzioch, 2020. "Effect of Rare Disaster Risks on Crude Oil: Evidence from El Nino from Over 140 Years of Data," Working Papers 2020104, University of Pretoria, Department of Economics.
    6. Gupta, Rangan & Sheng, Xin & van Eyden, Reneé & Wohar, Mark E., 2021. "The impact of disaggregated oil shocks on state-level real housing returns of the United States: The role of oil dependence," Finance Research Letters, Elsevier, vol. 43(C).
    7. Biktimirov, Ernest N. & Sokolyk, Tatyana & Ayanso, Anteneh, 2024. "Unpacking the relation between media sentiment and house prices: A topic modeling approach," Journal of Housing Economics, Elsevier, vol. 66(C).
    8. Elie Bouri & Rangan Gupta & Hardik A. Marfatia & Jacobus Nel, 2022. "Do Climate Risks Predict US Housing Returns and Volatility? Evidence from a Quantiles-Based Approach," Working Papers 202240, University of Pretoria, Department of Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:igg:jswis0:v:20:y:2024:i:1:p:1-23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Journal Editor (email available below). General contact details of provider: https://www.igi-global.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.