IDEAS home Printed from https://ideas.repec.org/a/plo/pbio00/3001985.html

Neural responses in macaque prefrontal cortex are linked to strategic exploration

Author

Listed:
  • Caroline I Jahn
  • Jan Grohn
  • Steven Cuell
  • Andrew Emberton
  • Sebastien Bouret
  • Mark E Walton
  • Nils Kolling
  • Jérôme Sallet

Abstract

Humans have been shown to strategically explore. They can identify situations in which gathering information about distant and uncertain options is beneficial for the future. Because primates rely on scarce resources when they forage, they are also thought to strategically explore, but whether they use the same strategies as humans and the neural bases of strategic exploration in monkeys are largely unknown. We designed a sequential choice task to investigate whether monkeys mobilize strategic exploration based on whether information can improve subsequent choice, but also to ask the novel question about whether monkeys adjust their exploratory choices based on the contingency between choice and information, by sometimes providing the counterfactual feedback about the unchosen option. We show that monkeys decreased their reliance on expected value when exploration could be beneficial, but this was not mediated by changes in the effect of uncertainty on choices. We found strategic exploratory signals in anterior and mid-cingulate cortex (ACC/MCC) and dorsolateral prefrontal cortex (dlPFC). This network was most active when a low value option was chosen, which suggests a role in counteracting expected value signals, when exploration away from value should to be considered. Such strategic exploration was abolished when the counterfactual feedback was available. Learning from counterfactual outcome was associated with the recruitment of a different circuit centered on the medial orbitofrontal cortex (OFC), where we showed that monkeys represent chosen and unchosen reward prediction errors. Overall, our study shows how ACC/MCC-dlPFC and OFC circuits together could support exploitation of available information to the fullest and drive behavior towards finding more information through exploration when it is beneficial.Humans have been shown to strategically explore; non-human primates are also thought to strategically explore, but do they use the same strategies and neural bases? This study reveals that monkeys strategically explore to improve future outcomes; such strategic exploration is linked to distinct signals in their frontal cortex.

Suggested Citation

  • Caroline I Jahn & Jan Grohn & Steven Cuell & Andrew Emberton & Sebastien Bouret & Mark E Walton & Nils Kolling & Jérôme Sallet, 2023. "Neural responses in macaque prefrontal cortex are linked to strategic exploration," PLOS Biology, Public Library of Science, vol. 21(1), pages 1-29, January.
    • Handle: RePEc:plo:pbio00:3001985
    DOI: 10.1371/journal.pbio.3001985
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001985
    Download Restriction: no
    File URL: https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.3001985&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pbio.3001985?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Christopher M Warren & Robert C Wilson & Nic J van der Wee & Eric J Giltay & Martijn S van Noorden & Jonathan D Cohen & Sander Nieuwenhuis, 2017. "The effect of atomoxetine on random and directed exploration in humans," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-17, April.
    2. Basten, Ulrike & Biele, Guido & Heekeren, Hauke R. & Fiebach, Christian J., 2010. "How the brain integrates costs and benefits during decision making," SFB 649 Discussion Papers 2010-063, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    3. Nathaniel D. Daw & John P. O'Doherty & Peter Dayan & Ben Seymour & Raymond J. Dolan, 2006. "Cortical substrates for exploratory decisions in humans," Nature, Nature, vol. 441(7095), pages 876-879, June.
    4. Bürkner, Paul-Christian, 2017. "brms: An R Package for Bayesian Multilevel Models Using Stan," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 80(i01).
    5. Sophie Bavard & Maël Lebreton & Mehdi Khamassi & Giorgio Coricelli & Stefano Palminteri, 2018. "Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
    6. Sebastien Ballesta & Camillo Padoa-Schioppa, 2019. "Economic Decisions through Circuit Inhibition," Post-Print hal-04607659, HAL.
    7. Frederic M. Stoll & Vincent Fontanier & Emmanuel Procyk, 2016. "Specific frontal neural dynamics contribute to decisions to check," Nature Communications, Nature, vol. 7(1), pages 1-14, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Georgy Antonov & Peter Dayan, 2025. "Exploring replay," Nature Communications, Nature, vol. 16(1), pages 1-20, December.
    2. Maël Lebreton & Karin Bacily & Stefano Palminteri & Jan B Engelmann, 2019. "Contextual influence on confidence judgments in human reinforcement learning," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-27, April.
    3. Lieke L F van Lieshout & Iris J Traast & Floris P de Lange & Roshan Cools, 2021. "Curiosity or savouring? Information seeking is modulated by both uncertainty and valence," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-19, September.
    4. Song Qi & Dylan M Nielson & Daniele Marcotulli & Daniel S Pine & Argyris Stringaris, 2024. "Subjective affective experience under threat is shaped by environmental affordances," PLOS ONE, Public Library of Science, vol. 19(12), pages 1-12, December.
    5. Yongping Bao & Ludwig Danwitz & Fabian Dvorak & Sebastian Fehrler & Lars Hornuf & Hsuan Yu Lin & Bettina von Helversen, 2022. "Similarity and Consistency in Algorithm-Guided Exploration," CESifo Working Paper Series 10188, CESifo.
    6. Shi, Yuwei & Herniman, John, 2023. "The role of expectation in innovation evolution: Exploring hype cycles," Technovation, Elsevier, vol. 119(C).
    7. Sashittal, Hemant C. & Sriramachandramurthy, Rajendran & Hodis, Monica, 2012. "Targeting college students on Facebook? How to stop wasting your money," Business Horizons, Elsevier, vol. 55(5), pages 495-507.
    8. Peter S. Riefer & Bradley C. Love, 2015. "Unfazed by Both the Bull and Bear: Strategic Exploration in Dynamic Environments," Games, MDPI, vol. 6(3), pages 1-11, August.
    9. Makoto Naruse & Eiji Yamamoto & Takashi Nakao & Takuma Akimoto & Hayato Saigo & Kazuya Okamura & Izumi Ojima & Georg Northoff & Hirokazu Hori, 2018. "Why is the environment important for decision making? Local reservoir model for choice-based learning," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-17, October.
    10. Ziang Liu & Zhuangyi Jiang & Li Shi & Fang Fang & Shiming Tang & Yang Zhou, 2025. "Neural correlates of trial outcome monitoring during long-term learning in primate posterior parietal cortex," Nature Communications, Nature, vol. 16(1), pages 1-19, December.
    11. Toni Amadeus Bechtold & Ben Curry & Maria Witek, 2024. "The perceived catchiness of music affects the experience of groove," PLOS ONE, Public Library of Science, vol. 19(5), pages 1-18, May.
    12. Jeremy Gordon & Flavio Chierichetti & Alessandro Panconesi & Giovanni Pezzulo, 2023. "Information foraging with an oracle," PLOS ONE, Public Library of Science, vol. 18(12), pages 1-21, December.
    13. Christina Fang & Daniel Levinthal, 2009. "Near-Term Liability of Exploitation: Exploration and Exploitation in Multistage Problems," Organization Science, INFORMS, vol. 20(3), pages 538-551, June.
    14. repec:osf:socarx:rn9xk_v1 is not listed on IDEAS
    15. Jean Daunizeau & Hanneke E M den Ouden & Matthias Pessiglione & Stefan J Kiebel & Klaas E Stephan & Karl J Friston, 2010. "Observing the Observer (I): Meta-Bayesian Models of Learning and Decision-Making," PLOS ONE, Public Library of Science, vol. 5(12), pages 1-10, December.
    16. Christine Beauchene & Silu Men & Thomas Hinault & Susan M. Courtney & Sridevi V. Sarma, 2022. "Using Neural Networks to Uncover the Relationship between Highly Variable Behavior and EEG during a Working Memory Task with Distractors," Mathematics, MDPI, vol. 10(11), pages 1-17, May.
    17. Shawn A. Rhoads & Lin Gan & Kathryn Berluti & Katherine O’Connell & Jo Cutler & Patricia L. Lockwood & Abigail A. Marsh, 2025. "Neurocomputational basis of learning when choices simultaneously affect both oneself and others," Nature Communications, Nature, vol. 16(1), pages 1-16, December.
    18. Elyse H Norton & Stephen M Fleming & Nathaniel D Daw & Michael S Landy, 2017. "Suboptimal Criterion Learning in Static and Dynamic Environments," PLOS Computational Biology, Public Library of Science, vol. 13(1), pages 1-28, January.
    19. Ayaka Kato & Kenji Morita, 2016. "Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation," PLOS Computational Biology, Public Library of Science, vol. 12(10), pages 1-41, October.
    20. Elise Payzan-LeNestour & Peter Bossaerts, 2011. "Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings," PLOS Computational Biology, Public Library of Science, vol. 7(1), pages 1-14, January.
    21. Pérez-Centeno, Victor, 2018. "Brain-driven entrepreneurship research: Expanded review and research agenda towards entrepreneurial enhancement," Working Papers 02/18, Institut für Mittelstandsforschung (IfM) Bonn.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pbio00:3001985. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosbiology (email available below). General contact details of provider: https://journals.plos.org/plosbiology/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.