IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1006243.html
   My bibliography  Save this article

Human Pavlovian fear conditioning conforms to probabilistic learning

Author

Listed:
  • Athina Tzovara
  • Christoph W Korn
  • Dominik R Bach

Abstract

Learning to predict threat from environmental cues is a fundamental skill in changing environments. This aversive learning process is exemplified by Pavlovian threat conditioning. Despite a plethora of studies on the neural mechanisms supporting the formation of associations between neutral and aversive events, our computational understanding of this process is fragmented. Importantly, different computational models give rise to different and partly opposing predictions for the trial-by-trial dynamics of learning, for example expressed in the activity of the autonomic nervous system (ANS). Here, we investigate human ANS responses to conditioned stimuli during Pavlovian fear conditioning. To obtain precise, trial-by-trial, single-subject estimates of ANS responses, we build on a statistical framework for psychophysiological modelling. We then consider previously proposed non-probabilistic models, a simple probabilistic model, and non-learning models, as well as different observation functions to link learning models with ANS activity. Across three experiments, and both for skin conductance (SCR) and pupil size responses (PSR), a probabilistic learning model best explains ANS responses. Notably, SCR and PSR reflect different quantities of the same model: SCR track a mixture of expected outcome and uncertainty, while PSR track expected outcome alone. In summary, by combining psychophysiological modelling with computational learning theory, we provide systematic evidence that the formation and maintenance of Pavlovian threat predictions in humans may rely on probabilistic inference and includes estimation of uncertainty. This could inform theories of neural implementation of aversive learning.Author summary: Using environmental cues to predict threat is a crucial skill, encountered in many species. A laboratory model to study associating predictive cues with aversive events is Pavlovian fear conditioning. A computational understanding of this process at a systems-level is lacking. Here, we investigate which computational learning model best predicts activity of the human autonomic nervous system during fear conditioning. We show, across three data sets and two autonomic readouts, that a probabilistic learning model explains the data decisively better than previously proposed models. We suggest that humans learn to predict threat by maintaining and constantly updating a probabilistic model of the environment through Bayes’ rule.

Suggested Citation

  • Athina Tzovara & Christoph W Korn & Dominik R Bach, 2018. "Human Pavlovian fear conditioning conforms to probabilistic learning," PLOS Computational Biology, Public Library of Science, vol. 14(8), pages 1-21, August.
  • Handle: RePEc:plo:pcbi00:1006243
    DOI: 10.1371/journal.pcbi.1006243
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1006243
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1006243&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1006243?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stephane Ciocchi & Cyril Herry & François Grenier & Steffen B. E. Wolff & Johannes J. Letzkus & Ioannis Vlachos & Ingrid Ehrlich & Rolf Sprengel & Karl Deisseroth & Michael B. Stadler & Christian Müll, 2010. "Encoding of conditioned fear in central amygdala inhibitory circuits," Nature, Nature, vol. 468(7321), pages 277-282, November.
    2. Johannes J. Letzkus & Steffen B. E. Wolff & Elisabeth M. M. Meyer & Philip Tovote & Julien Courtin & Cyril Herry & Andreas Lüthi, 2011. "A disinhibitory microcircuit for associative fear learning in the auditory cortex," Nature, Nature, vol. 480(7377), pages 331-335, December.
    3. Samuel J Gershman, 2015. "A Unifying Probabilistic View of Associative Learning," PLOS Computational Biology, Public Library of Science, vol. 11(11), pages 1-20, November.
    4. Jeremiah Y. Cohen & Sebastian Haesler & Linh Vong & Bradford B. Lowell & Naoshige Uchida, 2012. "Neuron-type-specific signals for reward and punishment in the ventral tegmental area," Nature, Nature, vol. 482(7383), pages 85-88, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Toby Wise & Jochen Michely & Peter Dayan & Raymond J Dolan, 2019. "A computational account of threat-related attentional bias," PLOS Computational Biology, Public Library of Science, vol. 15(10), pages 1-21, October.
    2. Filip Melinscak & Dominik R Bach, 2020. "Computational optimization of associative learning experiments," PLOS Computational Biology, Public Library of Science, vol. 16(1), pages 1-23, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Allen P. F. Chen & Jeffrey M. Malgady & Lu Chen & Kaiyo W. Shi & Eileen Cheng & Joshua L. Plotkin & Shaoyu Ge & Qiaojie Xiong, 2022. "Nigrostriatal dopamine pathway regulates auditory discrimination behavior," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    2. Matteo Farinella & Daniel T Ruedt & Padraig Gleeson & Frederic Lanore & R Angus Silver, 2014. "Glutamate-Bound NMDARs Arising from In Vivo-like Network Activity Extend Spatio-temporal Integration in a L5 Cortical Pyramidal Cell Model," PLOS Computational Biology, Public Library of Science, vol. 10(4), pages 1-21, April.
    3. Holger Mohr & Katharina Zwosta & Dimitrije Markovic & Sebastian Bitzer & Uta Wolfensteller & Hannes Ruge, 2018. "Deterministic response strategies in a trial-and-error learning task," PLOS Computational Biology, Public Library of Science, vol. 14(11), pages 1-19, November.
    4. Terence C. Burnham & Jay Phelan, 2020. "Ordinaries," Journal of Bioeconomics, Springer, vol. 22(2), pages 63-76, July.
    5. Olschewski, Sebastian & Diao, Linan & Rieskamp, Jörg, 2021. "Reinforcement learning about asset variability and correlation in repeated portfolio decisions," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    6. Danyang Chen & Qianqian Lou & Xiang-Jie Song & Fang Kang & An Liu & Changjian Zheng & Yanhua Li & Di Wang & Sen Qun & Zhi Zhang & Peng Cao & Yan Jin, 2024. "Microglia govern the extinction of acute stress-induced anxiety-like behaviors in male mice," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    7. Qi Wang & Jia-Jie Zhu & Lizhao Wang & Yan-Peng Kan & Yan-Mei Liu & Yan-Jiao Wu & Xue Gu & Xin Yi & Ze-Jie Lin & Qin Wang & Jian-Fei Lu & Qin Jiang & Ying Li & Ming-Gang Liu & Nan-Jie Xu & Michael X. Z, 2022. "Insular cortical circuits as an executive gateway to decipher threat or extinction memory via distinct subcortical pathways," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    8. Laurens Winkelmeier & Carla Filosa & Renée Hartig & Max Scheller & Markus Sack & Jonathan R. Reinwald & Robert Becker & David Wolf & Martin Fungisai Gerchen & Alexander Sartorius & Andreas Meyer-Linde, 2022. "Striatal hub of dynamic and stabilized prediction coding in forebrain networks for olfactory reinforcement learning," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
    9. Huanyuan Zhou & KongFatt Wong-Lin & Da-Hui Wang, 2018. "Parallel Excitatory and Inhibitory Neural Circuit Pathways Underlie Reward-Based Phasic Neural Responses," Complexity, Hindawi, vol. 2018, pages 1-20, April.
    10. Hong Yu & Xinkuan Xiang & Zongming Chen & Xu Wang & Jiaqi Dai & Xinxin Wang & Pengcheng Huang & Zheng-dong Zhao & Wei L. Shen & Haohong Li, 2021. "Periaqueductal gray neurons encode the sequential motor program in hunting behavior of mice," Nature Communications, Nature, vol. 12(1), pages 1-15, December.
    11. Rosalba Morese & Daniela Rabellino & Fabio Sambataro & Felice Perussia & Maria Consuelo Valentini & Bruno G Bara & Francesca M Bosco, 2016. "Group Membership Modulates the Neural Circuitry Underlying Third Party Punishment," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-14, November.
    12. Robert Legenstein & Wolfgang Maass, 2014. "Ensembles of Spiking Neurons with Noise Support Optimal Probabilistic Inference in a Dynamically Changing Environment," PLOS Computational Biology, Public Library of Science, vol. 10(10), pages 1-27, October.
    13. Anna P. Giron & Simon Ciranka & Eric Schulz & Wouter Bos & Azzurra Ruggeri & Björn Meder & Charley M. Wu, 2023. "Developmental changes in exploration resemble stochastic optimization," Nature Human Behaviour, Nature, vol. 7(11), pages 1955-1967, November.
    14. Terence C. Burnham & Jay Phelan, 2021. "Ordinaries," Journal of Bioeconomics, Springer, vol. 23(2), pages 125-149, July.
    15. Jing-Jing Yan & Xiao-Jing Ding & Ting He & Ai-Xiao Chen & Wen Zhang & Zi-Xian Yu & Xin-Yu Cheng & Chuan-Yao Wei & Qiao-Dan Hu & Xiao-Yao Liu & Yan-Li Zhang & Mengge He & Zhi-Yong Xie & Xi Zha & Chun X, 2022. "A circuit from the ventral subiculum to anterior hypothalamic nucleus GABAergic neurons essential for anxiety-like behavioral avoidance," Nature Communications, Nature, vol. 13(1), pages 1-16, December.
    16. Anna J. Bowen & Y. Waterlily Huang & Jane Y. Chen & Jordan L. Pauli & Carlos A. Campos & Richard D. Palmiter, 2023. "Topographic representation of current and future threats in the mouse nociceptive amygdala," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    17. Chloe Hegoburu & Yan Tang & Ruifang Niu & Supriya Ghosh & Rodrigo Triana Del Rio & Isabel de Araujo Salgado & Marios Abatis & David Alexandre Mota Caseiro & Erwin H. Burg & Christophe Grundschober & R, 2024. "Social buffering in rats reduces fear by oxytocin triggering sustained changes in central amygdala neuronal activity," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    18. Lizhu Li & Lihui Lu & Yuqi Ren & Guo Tang & Yu Zhao & Xue Cai & Zhao Shi & He Ding & Changbo Liu & Dali Cheng & Yang Xie & Huachun Wang & Xin Fu & Lan Yin & Minmin Luo & Xing Sheng, 2022. "Colocalized, bidirectional optogenetic modulations in freely behaving mice with a wireless dual-color optoelectronic probe," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    19. Bernard Bloem & Rafiq Huda & Ken-ichi Amemori & Alex S. Abate & Gayathri Krishna & Anna L. Wilson & Cody W. Carter & Mriganka Sur & Ann M. Graybiel, 2022. "Multiplexed action-outcome representation by striatal striosome-matrix compartments detected with a mouse cost-benefit foraging task," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    20. Torben Ott & Anna Marlina Stein & Andreas Nieder, 2023. "Dopamine receptor activation regulates reward expectancy signals during cognitive control in primate prefrontal neurons," Nature Communications, Nature, vol. 14(1), pages 1-14, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1006243. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.