IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1002079.html
   My bibliography  Save this article

Generative Embedding for Model-Based Classification of fMRI Data

Author

Listed:
  • Kay H Brodersen
  • Thomas M Schofield
  • Alexander P Leff
  • Cheng Soon Ong
  • Ekaterina I Lomakina
  • Joachim M Buhmann
  • Klaas E Stephan

Abstract

Decoding models, such as those underlying multivariate classification algorithms, have been increasingly used to infer cognitive or clinical brain states from measures of brain activity obtained by functional magnetic resonance imaging (fMRI). The practicality of current classifiers, however, is restricted by two major challenges. First, due to the high data dimensionality and low sample size, algorithms struggle to separate informative from uninformative features, resulting in poor generalization performance. Second, popular discriminative methods such as support vector machines (SVMs) rarely afford mechanistic interpretability. In this paper, we address these issues by proposing a novel generative-embedding approach that incorporates neurobiologically interpretable generative models into discriminative classifiers. Our approach extends previous work on trial-by-trial classification for electrophysiological recordings to subject-by-subject classification for fMRI and offers two key advantages over conventional methods: it may provide more accurate predictions by exploiting discriminative information encoded in ‘hidden’ physiological quantities such as synaptic connection strengths; and it affords mechanistic interpretability of clinical classifications. Here, we introduce generative embedding for fMRI using a combination of dynamic causal models (DCMs) and SVMs. We propose a general procedure of DCM-based generative embedding for subject-wise classification, provide a concrete implementation, and suggest good-practice guidelines for unbiased application of generative embedding in the context of fMRI. We illustrate the utility of our approach by a clinical example in which we classify moderately aphasic patients and healthy controls using a DCM of thalamo-temporal regions during speech processing. Generative embedding achieves a near-perfect balanced classification accuracy of 98% and significantly outperforms conventional activation-based and correlation-based methods. This example demonstrates how disease states can be detected with very high accuracy and, at the same time, be interpreted mechanistically in terms of abnormalities in connectivity. We envisage that future applications of generative embedding may provide crucial advances in dissecting spectrum disorders into physiologically more well-defined subgroups. Author Summary: Neurological and psychiatric spectrum disorders are typically defined in terms of particular symptom sets, despite increasing evidence that the same symptom may be caused by very different pathologies. Pathophysiological classification and effective treatment of such disorders will increasingly require a mechanistic understanding of inter-individual differences and clinical tools for making accurate diagnostic inference in individual patients. Previous classification studies have shown that functional magnetic resonance imaging (fMRI) can be used to differentiate between healthy controls and neurological or psychiatric patients. However, these studies are typically based on descriptive patterns and indirect measures of neural activity, and they rarely afford mechanistic insights into the underlying condition. In this paper, we address this challenge by proposing a classification approach that rests on a model of brain function and exploits the rich discriminative information encoded in directed interregional connection strengths. Based on an fMRI dataset acquired from moderately aphasic patients and healthy controls, we illustrate that our approach enables more accurate classification and deeper mechanistic insights about disease processes than conventional classification methods.

Suggested Citation

  • Kay H Brodersen & Thomas M Schofield & Alexander P Leff & Cheng Soon Ong & Ekaterina I Lomakina & Joachim M Buhmann & Klaas E Stephan, 2011. "Generative Embedding for Model-Based Classification of fMRI Data," PLOS Computational Biology, Public Library of Science, vol. 7(6), pages 1-19, June.
  • Handle: RePEc:plo:pcbi00:1002079
    DOI: 10.1371/journal.pcbi.1002079
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1002079
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1002079&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1002079?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stephenie A. Harrison & Frank Tong, 2009. "Decoding reveals the contents of visual working memory in early visual areas," Nature, Nature, vol. 458(7238), pages 632-635, April.
    2. Asa Ben-Hur & Cheng Soon Ong & Sören Sonnenburg & Bernhard Schölkopf & Gunnar Rätsch, 2008. "Support Vector Machines and Kernels for Computational Biology," PLOS Computational Biology, Public Library of Science, vol. 4(10), pages 1-10, October.
    3. Kendrick N. Kay & Thomas Naselaris & Ryan J. Prenger & Jack L. Gallant, 2008. "Identifying natural images from human brain activity," Nature, Nature, vol. 452(7185), pages 352-355, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Timothy N Rubin & Oluwasanmi Koyejo & Krzysztof J Gorgolewski & Michael N Jones & Russell A Poldrack & Tal Yarkoni, 2017. "Decoding brain activity using a large-scale probabilistic functional-anatomical atlas of human cognition," PLOS Computational Biology, Public Library of Science, vol. 13(10), pages 1-24, October.
    2. Eduardo A Aponte & Dario Schöbi & Klaas E Stephan & Jakob Heinzle, 2017. "The Stochastic Early Reaction, Inhibition, and late Action (SERIA) model for antisaccades," PLOS Computational Biology, Public Library of Science, vol. 13(8), pages 1-36, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nadine Dijkstra & Stephen M. Fleming, 2023. "Subjective signal strength distinguishes reality from imagination," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    2. Umut Güçlü & Marcel A J van Gerven, 2014. "Unsupervised Feature Learning Improves Prediction of Human Brain Activity in Response to Natural Images," PLOS Computational Biology, Public Library of Science, vol. 10(8), pages 1-12, August.
    3. Guillermo A Cecchi & Lejian Huang & Javeria Ali Hashmi & Marwan Baliki & María V Centeno & Irina Rish & A Vania Apkarian, 2012. "Predictive Dynamics of Human Pain Perception," PLOS Computational Biology, Public Library of Science, vol. 8(10), pages 1-12, October.
    4. Zvi N. Roth & Kendrick Kay & Elisha P. Merriam, 2022. "Natural scene sampling reveals reliable coarse-scale orientation tuning in human V1," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    5. Hamed Nili & Cai Wingfield & Alexander Walther & Li Su & William Marslen-Wilson & Nikolaus Kriegeskorte, 2014. "A Toolbox for Representational Similarity Analysis," PLOS Computational Biology, Public Library of Science, vol. 10(4), pages 1-11, April.
    6. Duncan Edward Astle & Anna Christina Nobre & Gaia Scerif, 2009. "Applying an Attentional Set to Perceived and Remembered Features," PLOS ONE, Public Library of Science, vol. 4(10), pages 1-12, October.
    7. Hamed Nili & Alexander Walther & Arjen Alink & Nikolaus Kriegeskorte, 2020. "Inferring exemplar discriminability in brain representations," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-28, June.
    8. Alaa Tharwat & Aboul Ella Hassanien, 2019. "Quantum-Behaved Particle Swarm Optimization for Parameter Optimization of Support Vector Machine," Journal of Classification, Springer;The Classification Society, vol. 36(3), pages 576-598, October.
    9. Emily S W Wong & Margaret C Hardy & David Wood & Timothy Bailey & Glenn F King, 2013. "SVM-Based Prediction of Propeptide Cleavage Sites in Spider Toxins Identifies Toxin Innovation in an Australian Tarantula," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-11, July.
    10. Jacob M. Paul & Martijn Ackooij & Tuomas C. Cate & Ben M. Harvey, 2022. "Numerosity tuning in human association cortices and local image contrast representations in early visual cortex," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    11. Lior Shamir & John D Delaney & Nikita Orlov & D Mark Eckley & Ilya G Goldberg, 2010. "Pattern Recognition Software and Techniques for Biological Image Analysis," PLOS Computational Biology, Public Library of Science, vol. 6(11), pages 1-10, November.
    12. Agustin Lage-Castellanos & Giancarlo Valente & Elia Formisano & Federico De Martino, 2019. "Methods for computing the maximum performance of computational models of fMRI responses," PLOS Computational Biology, Public Library of Science, vol. 15(3), pages 1-25, March.
    13. Shweta Bhandare & Debra S Goldberg & Robin Dowell, 2017. "Discriminating between HuR and TTP binding sites using the k-spectrum kernel method," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-14, March.
    14. Shinsuke Koyama & Uri Eden & Emery Brown & Robert Kass, 2010. "Bayesian decoding of neural spike trains," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 62(1), pages 37-59, February.
    15. Kiyohito Iigaya & Sanghyun Yi & Iman A. Wahle & Sandy Tanwisuth & Logan Cross & John P. O’Doherty, 2023. "Neural mechanisms underlying the hierarchical construction of perceived aesthetic value," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    16. Ming Bo Cai & Nicolas W Schuck & Jonathan W Pillow & Yael Niv, 2019. "Representational structure or task structure? Bias in neural representational similarity analysis and a Bayesian method for reducing bias," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-30, May.
    17. Ghislain St-Yves & Emily J. Allen & Yihan Wu & Kendrick Kay & Thomas Naselaris, 2023. "Brain-optimized deep neural network models of human visual areas learn non-hierarchical representations," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    18. Hanzhong Liu & Bin Yu, 2017. "Comments on: High-dimensional simultaneous inference with the bootstrap," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(4), pages 740-750, December.
    19. Wei Shui & Yiyi Zhang & Xinggui Wang & Yuanmeng Liu & Qianfeng Wang & Fei Duan & Chaowei Wu & Wanyu Shui, 2022. "Does Tibetan Household Livelihood Capital Enhance Tourism Participation Sustainability? Evidence from China’s Jiaju Tibetan Village," IJERPH, MDPI, vol. 19(15), pages 1-15, July.
    20. Marina M -C Vidovic & Nico Görnitz & Klaus-Robert Müller & Gunnar Rätsch & Marius Kloft, 2015. "SVM2Motif—Reconstructing Overlapping DNA Sequence Motifs by Mimicking an SVM Predictor," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-23, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1002079. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.