IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-34465-5.html
   My bibliography  Save this article

Reward expectation extinction restructures and degrades CA1 spatial maps through loss of a dopaminergic reward proximity signal

Author

Listed:
  • Seetha Krishnan

    (University of Chicago)

  • Chad Heer

    (University of Chicago)

  • Chery Cherian

    (University of Chicago)

  • Mark E. J. Sheffield

    (University of Chicago)

Abstract

Hippocampal place cells support reward-related spatial memories by forming a cognitive map that over-represents reward locations. The strength of these memories is modulated by the extent of reward expectation during encoding. However, the circuit mechanisms underlying this modulation are unclear. Here we find that when reward expectation is extinguished in mice, they remain engaged with their environment, yet place cell over-representation of rewards vanishes, place field remapping throughout the environment increases, and place field trial-to-trial reliability decreases. Interestingly, Ventral Tegmental Area (VTA) dopaminergic axons in CA1 exhibit a ramping reward-proximity signal that depends on reward expectation and inhibiting VTA dopaminergic neurons largely replicates the effects of extinguishing reward expectation. We conclude that changing reward expectation restructures CA1 cognitive maps and determines map reliability by modulating the dopaminergic VTA-CA1 reward-proximity signal. Thus, internal states of high reward expectation enhance encoding of spatial memories by reinforcing hippocampal cognitive maps associated with reward.

Suggested Citation

  • Seetha Krishnan & Chad Heer & Chery Cherian & Mark E. J. Sheffield, 2022. "Reward expectation extinction restructures and degrades CA1 spatial maps through loss of a dopaminergic reward proximity signal," Nature Communications, Nature, vol. 13(1), pages 1-19, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-34465-5
    DOI: 10.1038/s41467-022-34465-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-34465-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-34465-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nathaniel R. Kinsky & William Mau & David W. Sullivan & Samuel J. Levy & Evan A. Ruesch & Michael E. Hasselmo, 2020. "Trajectory-modulated hippocampal neurons persist throughout memory-guided navigation," Nature Communications, Nature, vol. 11(1), pages 1-14, December.
    2. Ali Mohebi & Jeffrey R. Pettibone & Arif A. Hamid & Jenny-Marie T. Wong & Leah T. Vinson & Tommaso Patriarchi & Lin Tian & Robert T. Kennedy & Joshua D. Berke, 2019. "Publisher Correction: Dissociable dopamine dynamics for learning and motivation," Nature, Nature, vol. 571(7763), pages 3-3, July.
    3. Mark W. Howe & Patrick L. Tierney & Stefan G. Sandberg & Paul E. M. Phillips & Ann M. Graybiel, 2013. "Prolonged dopamine signalling in striatum signals proximity and value of distant rewards," Nature, Nature, vol. 500(7464), pages 575-579, August.
    4. Can Dong & Antoine D. Madar & Mark E. J. Sheffield, 2021. "Distinct place cell dynamics in CA1 and CA3 encode experience in new environments," Nature Communications, Nature, vol. 12(1), pages 1-13, December.
    5. Ali Mohebi & Jeffrey R. Pettibone & Arif A. Hamid & Jenny-Marie T. Wong & Leah T. Vinson & Tommaso Patriarchi & Lin Tian & Robert T. Kennedy & Joshua D. Berke, 2019. "Dissociable dopamine dynamics for learning and motivation," Nature, Nature, vol. 570(7759), pages 65-70, June.
    6. Mark E. J. Sheffield & Daniel A. Dombeck, 2015. "Calcium transient prevalence across the dendritic arbour predicts place field properties," Nature, Nature, vol. 517(7533), pages 200-204, January.
    7. Thomas Hainmueller & Marlene Bartos, 2018. "Parallel emergence of stable and dynamic memory engrams in the hippocampus," Nature, Nature, vol. 558(7709), pages 292-296, June.
    8. Anthony I. Jang & Matthew R. Nassar & Daniel G. Dillon & Michael J. Frank, 2019. "Positive reward prediction errors during decision-making strengthen memory encoding," Nature Human Behaviour, Nature, vol. 3(7), pages 719-732, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Heather C. Ratigan & Seetha Krishnan & Shai Smith & Mark E. J. Sheffield, 2023. "A thalamic-hippocampal CA1 signal for contextual fear memory suppression, extinction, and discrimination," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    2. Oliver Barnstedt & Petra Mocellin & Stefan Remy, 2024. "A hippocampus-accumbens code guides goal-directed appetitive behavior," Nature Communications, Nature, vol. 15(1), pages 1-20, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laurens Winkelmeier & Carla Filosa & Renée Hartig & Max Scheller & Markus Sack & Jonathan R. Reinwald & Robert Becker & David Wolf & Martin Fungisai Gerchen & Alexander Sartorius & Andreas Meyer-Linde, 2022. "Striatal hub of dynamic and stabilized prediction coding in forebrain networks for olfactory reinforcement learning," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
    2. Armando G. Salinas & Jeong Oen Lee & Shana M. Augustin & Shiliang Zhang & Tommaso Patriarchi & Lin Tian & Marisela Morales & Yolanda Mateo & David M. Lovinger, 2023. "Distinct sub-second dopamine signaling in dorsolateral striatum measured by a genetically-encoded fluorescent sensor," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    3. Abigail Kalmbach & Vanessa Winiger & Nuri Jeong & Arun Asok & Charles R. Gallistel & Peter D. Balsam & Eleanor H. Simpson, 2022. "Dopamine encodes real-time reward availability and transitions between reward availability states on different timescales," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    4. Lior Matityahu & Naomi Gilin & Gideon A. Sarpong & Yara Atamna & Lior Tiroshi & Nicolas X. Tritsch & Jeffery R. Wickens & Joshua A. Goldberg, 2023. "Acetylcholine waves and dopamine release in the striatum," Nature Communications, Nature, vol. 14(1), pages 1-23, December.
    5. Allen P. F. Chen & Jeffrey M. Malgady & Lu Chen & Kaiyo W. Shi & Eileen Cheng & Joshua L. Plotkin & Shaoyu Ge & Qiaojie Xiong, 2022. "Nigrostriatal dopamine pathway regulates auditory discrimination behavior," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    6. Taylor J. Malone & Nai-Wen Tien & Yan Ma & Lian Cui & Shangru Lyu & Garret Wang & Duc Nguyen & Kai Zhang & Maxym V. Myroshnychenko & Jean Tyan & Joshua A. Gordon & David A. Kupferschmidt & Yi Gu, 2024. "A consistent map in the medial entorhinal cortex supports spatial memory," Nature Communications, Nature, vol. 15(1), pages 1-22, December.
    7. Han Guo & Jian-Bo Jiang & Wei Xu & Mu-Tian Zhang & Hui Chen & Huan-Ying Shi & Lu Wang & Miao He & Michael Lazarus & Shan-Qun Li & Zhi-Li Huang & Wei-Min Qu, 2023. "Parasubthalamic calretinin neurons modulate wakefulness associated with exploration in male mice," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    8. Heather C. Ratigan & Seetha Krishnan & Shai Smith & Mark E. J. Sheffield, 2023. "A thalamic-hippocampal CA1 signal for contextual fear memory suppression, extinction, and discrimination," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    9. Zengpeng Han & Nengsong Luo & Wenyu Ma & Xiaodong Liu & Yuxiang Cai & Jiaxin Kou & Jie Wang & Lei Li & Siqi Peng & Zihong Xu & Wen Zhang & Yuxiang Qiu & Yang Wu & Chaohui Ye & Kunzhang Lin & Fuqiang X, 2023. "AAV11 enables efficient retrograde targeting of projection neurons and enhances astrocyte-directed transduction," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    10. Allen P. F. Chen & Lu Chen & Kaiyo W. Shi & Eileen Cheng & Shaoyu Ge & Qiaojie Xiong, 2023. "Nigrostriatal dopamine modulates the striatal-amygdala pathway in auditory fear conditioning," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    11. Susanne Prokop & Péter Ábrányi-Balogh & Benjámin Barti & Márton Vámosi & Miklós Zöldi & László Barna & Gabriella M. Urbán & András Dávid Tóth & Barna Dudok & Attila Egyed & Hui Deng & Gian Marco Leggi, 2021. "PharmacoSTORM nanoscale pharmacology reveals cariprazine binding on Islands of Calleja granule cells," Nature Communications, Nature, vol. 12(1), pages 1-19, December.
    12. Johannes Algermissen & Jennifer C. Swart & René Scheeringa & Roshan Cools & Hanneke E. M. den Ouden, 2024. "Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    13. Xin-Yue Wang & Wen-Bin Jia & Xiang Xu & Rui Chen & Liang-Biao Wang & Xiao-Jing Su & Peng-Fei Xu & Xiao-Qing Liu & Jie Wen & Xiao-Yuan Song & Yuan-Yuan Liu & Zhi Zhang & Xin-Feng Liu & Yan Zhang, 2023. "A glutamatergic DRN–VTA pathway modulates neuropathic pain and comorbid anhedonia-like behavior in mice," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    14. Thomas Hainmueller & Aurore Cazala & Li-Wen Huang & Marlene Bartos, 2024. "Subfield-specific interneuron circuits govern the hippocampal response to novelty in male mice," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    15. Miguel Skirzewski & Oren Princz-Lebel & Liliana German-Castelan & Alycia M. Crooks & Gerard Kyungwook Kim & Sophie Henke Tarnow & Amy Reichelt & Sara Memar & Daniel Palmer & Yulong Li & R. Jane Rylett, 2022. "Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
    16. Thibault Cholvin & Marlene Bartos, 2022. "Hemisphere-specific spatial representation by hippocampal granule cells," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    17. Ali Ghazizadeh & Okihide Hikosaka, 2022. "Salience memories formed by value, novelty and aversiveness jointly shape object responses in the prefrontal cortex and basal ganglia," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    18. Angela M. Ianni & Daniel P. Eisenberg & Erie D. Boorman & Sara M. Constantino & Catherine E. Hegarty & Michael D. Gregory & Joseph C. Masdeu & Philip D. Kohn & Timothy E. Behrens & Karen F. Berman, 2023. "PET-measured human dopamine synthesis capacity and receptor availability predict trading rewards and time-costs during foraging," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    19. Carole Morel & Sarah E. Montgomery & Long Li & Romain Durand-de Cuttoli & Emily M. Teichman & Barbara Juarez & Nikos Tzavaras & Stacy M. Ku & Meghan E. Flanigan & Min Cai & Jessica J. Walsh & Scott J., 2022. "Midbrain projection to the basolateral amygdala encodes anxiety-like but not depression-like behaviors," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    20. Payam Piray & Nathaniel D Daw, 2020. "A simple model for learning in volatile environments," PLOS Computational Biology, Public Library of Science, vol. 16(7), pages 1-26, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-34465-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.