IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1012376.html
   My bibliography  Save this article

Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention

Author

Listed:
  • Keyvan Mahjoory
  • Andreas Bahmer
  • Molly J Henry

Abstract

Human listeners have the ability to direct their attention to a single speaker in a multi-talker environment. The neural correlates of selective attention can be decoded from a single trial of electroencephalography (EEG) data. In this study, leveraging the source-reconstructed and anatomically-resolved EEG data as inputs, we sought to employ CNN as an interpretable model to uncover task-specific interactions between brain regions, rather than simply to utilize it as a black box decoder. To this end, our CNN model was specifically designed to learn pairwise interaction representations for 10 cortical regions from five-second inputs. By exclusively utilizing these features for decoding, our model was able to attain a median accuracy of 77.56% for within-participant and 65.14% for cross-participant classification. Through ablation analysis together with dissecting the features of the models and applying cluster analysis, we were able to discern the presence of alpha-band-dominated inter-hemisphere interactions, as well as alpha- and beta-band dominant interactions that were either hemisphere-specific or were characterized by a contrasting pattern between the right and left hemispheres. These interactions were more pronounced in parietal and central regions for within-participant decoding, but in parietal, central, and partly frontal regions for cross-participant decoding. These findings demonstrate that our CNN model can effectively utilize features known to be important in auditory attention tasks and suggest that the application of domain knowledge inspired CNNs on source-reconstructed EEG data can offer a novel computational framework for studying task-relevant brain interactions.Author summary: In our study, we explored how the brain manages to focus on one speaker among many, a common challenge in noisy environments. Using advanced brainwave (EEG) data analysis, we developed a new method to understand how different parts of the brain communicate during this task. Our technique involves a type of artificial intelligence known as a convolutional neural network (CNN). However, instead of using it as a black box, we designed it to specifically reveal how ten brain areas work together in pairs during selective listening. Remarkably, our approach achieved a high level of accuracy in recognizing where someone’s attention was directed, based on EEG data alone. We discovered that certain patterns of brain activity, especially in regions known for processing sound and spatial awareness, are crucial for focusing attention. This study not only advances our understanding of the brain’s attention mechanisms but also introduces a promising tool for examining complex brain functions, offering insights that could help develop new tools for improving listening in challenging environments.

Suggested Citation

  • Keyvan Mahjoory & Andreas Bahmer & Molly J Henry, 2024. "Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention," PLOS Computational Biology, Public Library of Science, vol. 20(8), pages 1-22, August.
  • Handle: RePEc:plo:pcbi00:1012376
    DOI: 10.1371/journal.pcbi.1012376
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1012376
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1012376&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1012376?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1012376. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.