IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-023-44632-x.html
   My bibliography  Save this article

Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases

Author

Listed:
  • Johannes Algermissen

    (Radboud University, Donders Institute for Brain, Cognition and Behaviour)

  • Jennifer C. Swart

    (Radboud University, Donders Institute for Brain, Cognition and Behaviour)

  • René Scheeringa

    (Radboud University, Donders Institute for Brain, Cognition and Behaviour
    University of Duisburg‐Essen)

  • Roshan Cools

    (Radboud University, Donders Institute for Brain, Cognition and Behaviour
    Radboud University Medical Centre)

  • Hanneke E. M. den Ouden

    (Radboud University, Donders Institute for Brain, Cognition and Behaviour)

Abstract

Actions are biased by the outcomes they can produce: Humans are more likely to show action under reward prospect, but hold back under punishment prospect. Such motivational biases derive not only from biased response selection, but also from biased learning: humans tend to attribute rewards to their own actions, but are reluctant to attribute punishments to having held back. The neural origin of these biases is unclear. Specifically, it remains open whether motivational biases arise primarily from the architecture of subcortical regions or also reflect cortical influences, the latter being typically associated with increased behavioral flexibility and control beyond stereotyped behaviors. Simultaneous EEG-fMRI allowed us to track which regions encoded biased prediction errors in which order. Biased prediction errors occurred in cortical regions (dorsal anterior and posterior cingulate cortices) before subcortical regions (striatum). These results highlight that biased learning is not a mere feature of the basal ganglia, but arises through prefrontal cortical contributions, revealing motivational biases to be a potentially flexible, sophisticated mechanism.

Suggested Citation

  • Johannes Algermissen & Jennifer C. Swart & René Scheeringa & Roshan Cools & Hanneke E. M. den Ouden, 2024. "Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-023-44632-x
    DOI: 10.1038/s41467-023-44632-x
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-44632-x
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-44632-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ali Mohebi & Jeffrey R. Pettibone & Arif A. Hamid & Jenny-Marie T. Wong & Leah T. Vinson & Tommaso Patriarchi & Lin Tian & Robert T. Kennedy & Joshua D. Berke, 2019. "Publisher Correction: Dissociable dopamine dynamics for learning and motivation," Nature, Nature, vol. 571(7763), pages 3-3, July.
    2. Payam Piray & Amir Dezfouli & Tom Heskes & Michael J Frank & Nathaniel D Daw, 2019. "Hierarchical Bayesian inference for concurrent model fitting and comparison for group studies," PLOS Computational Biology, Public Library of Science, vol. 15(6), pages 1-34, June.
    3. Nadescha Trudel & Jacqueline Scholl & Miriam C. Klein-Flügge & Elsa Fouragnan & Lev Tankelevitch & Marco K. Wittmann & Matthew F. S. Rushworth, 2021. "Polarity of uncertainty representation during exploration and exploitation in ventromedial prefrontal cortex," Nature Human Behaviour, Nature, vol. 5(1), pages 83-98, January.
    4. Anitha Pasupathy & Earl K. Miller, 2005. "Different time courses of learning-related activity in the prefrontal cortex and striatum," Nature, Nature, vol. 433(7028), pages 873-876, February.
    5. Elsa Fouragnan & Chris Retzler & Karen Mullinger & Marios G. Philiastides, 2015. "Two spatiotemporally distinct value systems shape reward-based learning in the human brain," Nature Communications, Nature, vol. 6(1), pages 1-11, November.
    6. Ali Mohebi & Jeffrey R. Pettibone & Arif A. Hamid & Jenny-Marie T. Wong & Leah T. Vinson & Tommaso Patriarchi & Lin Tian & Robert T. Kennedy & Joshua D. Berke, 2019. "Dissociable dopamine dynamics for learning and motivation," Nature, Nature, vol. 570(7759), pages 65-70, June.
    7. Jeanette A Mumford & Jean-Baptiste Poline & Russell A Poldrack, 2015. "Orthogonalization of Regressors in fMRI Models," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-11, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laurens Winkelmeier & Carla Filosa & Renée Hartig & Max Scheller & Markus Sack & Jonathan R. Reinwald & Robert Becker & David Wolf & Martin Fungisai Gerchen & Alexander Sartorius & Andreas Meyer-Linde, 2022. "Striatal hub of dynamic and stabilized prediction coding in forebrain networks for olfactory reinforcement learning," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
    2. Han Guo & Jian-Bo Jiang & Wei Xu & Mu-Tian Zhang & Hui Chen & Huan-Ying Shi & Lu Wang & Miao He & Michael Lazarus & Shan-Qun Li & Zhi-Li Huang & Wei-Min Qu, 2023. "Parasubthalamic calretinin neurons modulate wakefulness associated with exploration in male mice," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    3. Armando G. Salinas & Jeong Oen Lee & Shana M. Augustin & Shiliang Zhang & Tommaso Patriarchi & Lin Tian & Marisela Morales & Yolanda Mateo & David M. Lovinger, 2023. "Distinct sub-second dopamine signaling in dorsolateral striatum measured by a genetically-encoded fluorescent sensor," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    4. Zengpeng Han & Nengsong Luo & Wenyu Ma & Xiaodong Liu & Yuxiang Cai & Jiaxin Kou & Jie Wang & Lei Li & Siqi Peng & Zihong Xu & Wen Zhang & Yuxiang Qiu & Yang Wu & Chaohui Ye & Kunzhang Lin & Fuqiang X, 2023. "AAV11 enables efficient retrograde targeting of projection neurons and enhances astrocyte-directed transduction," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    5. Allen P. F. Chen & Lu Chen & Kaiyo W. Shi & Eileen Cheng & Shaoyu Ge & Qiaojie Xiong, 2023. "Nigrostriatal dopamine modulates the striatal-amygdala pathway in auditory fear conditioning," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    6. Susanne Prokop & Péter Ábrányi-Balogh & Benjámin Barti & Márton Vámosi & Miklós Zöldi & László Barna & Gabriella M. Urbán & András Dávid Tóth & Barna Dudok & Attila Egyed & Hui Deng & Gian Marco Leggi, 2021. "PharmacoSTORM nanoscale pharmacology reveals cariprazine binding on Islands of Calleja granule cells," Nature Communications, Nature, vol. 12(1), pages 1-19, December.
    7. Xin-Yue Wang & Wen-Bin Jia & Xiang Xu & Rui Chen & Liang-Biao Wang & Xiao-Jing Su & Peng-Fei Xu & Xiao-Qing Liu & Jie Wen & Xiao-Yuan Song & Yuan-Yuan Liu & Zhi Zhang & Xin-Feng Liu & Yan Zhang, 2023. "A glutamatergic DRN–VTA pathway modulates neuropathic pain and comorbid anhedonia-like behavior in mice," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    8. Seetha Krishnan & Chad Heer & Chery Cherian & Mark E. J. Sheffield, 2022. "Reward expectation extinction restructures and degrades CA1 spatial maps through loss of a dopaminergic reward proximity signal," Nature Communications, Nature, vol. 13(1), pages 1-19, December.
    9. Miguel Skirzewski & Oren Princz-Lebel & Liliana German-Castelan & Alycia M. Crooks & Gerard Kyungwook Kim & Sophie Henke Tarnow & Amy Reichelt & Sara Memar & Daniel Palmer & Yulong Li & R. Jane Rylett, 2022. "Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
    10. Ali Ghazizadeh & Okihide Hikosaka, 2022. "Salience memories formed by value, novelty and aversiveness jointly shape object responses in the prefrontal cortex and basal ganglia," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    11. Angela M. Ianni & Daniel P. Eisenberg & Erie D. Boorman & Sara M. Constantino & Catherine E. Hegarty & Michael D. Gregory & Joseph C. Masdeu & Philip D. Kohn & Timothy E. Behrens & Karen F. Berman, 2023. "PET-measured human dopamine synthesis capacity and receptor availability predict trading rewards and time-costs during foraging," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    12. Abigail Kalmbach & Vanessa Winiger & Nuri Jeong & Arun Asok & Charles R. Gallistel & Peter D. Balsam & Eleanor H. Simpson, 2022. "Dopamine encodes real-time reward availability and transitions between reward availability states on different timescales," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    13. Carole Morel & Sarah E. Montgomery & Long Li & Romain Durand-de Cuttoli & Emily M. Teichman & Barbara Juarez & Nikos Tzavaras & Stacy M. Ku & Meghan E. Flanigan & Min Cai & Jessica J. Walsh & Scott J., 2022. "Midbrain projection to the basolateral amygdala encodes anxiety-like but not depression-like behaviors," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    14. Lior Matityahu & Naomi Gilin & Gideon A. Sarpong & Yara Atamna & Lior Tiroshi & Nicolas X. Tritsch & Jeffery R. Wickens & Joshua A. Goldberg, 2023. "Acetylcholine waves and dopamine release in the striatum," Nature Communications, Nature, vol. 14(1), pages 1-23, December.
    15. Allen P. F. Chen & Jeffrey M. Malgady & Lu Chen & Kaiyo W. Shi & Eileen Cheng & Joshua L. Plotkin & Shaoyu Ge & Qiaojie Xiong, 2022. "Nigrostriatal dopamine pathway regulates auditory discrimination behavior," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    16. repec:cup:judgdm:v:16:y:2021:i:6:p:1413-1438 is not listed on IDEAS
    17. Payam Piray & Nathaniel D Daw, 2020. "A simple model for learning in volatile environments," PLOS Computational Biology, Public Library of Science, vol. 16(7), pages 1-26, July.
    18. Freund, Richard & Favara, Marta & Porter, Catherine & Behrman, Jere R., 2022. "Social Protection and Foundational Cognitive Skills during Adolescence: Evidence from a Large Public Works Programme," IZA Discussion Papers 15551, Institute of Labor Economics (IZA).
    19. Jaron T Colas & Wolfgang M Pauli & Tobias Larsen & J Michael Tyszka & John P O’Doherty, 2017. "Distinct prediction errors in mesostriatal circuits of the human brain mediate learning about the values of both states and actions: evidence from high-resolution fMRI," PLOS Computational Biology, Public Library of Science, vol. 13(10), pages 1-32, October.
    20. Makoto Ito & Kenji Doya, 2015. "Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum," PLOS Computational Biology, Public Library of Science, vol. 11(11), pages 1-25, November.
    21. Christopher. A. Kelly & Tali Sharot, 2021. "Individual differences in information-seeking," Nature Communications, Nature, vol. 12(1), pages 1-13, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-023-44632-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.