IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-41130-y.html
   My bibliography  Save this article

Dopamine regulates decision thresholds in human reinforcement learning in males

Author

Listed:
  • Karima Chakroun

    (University Medical Center Hamburg-Eppendorf)

  • Antonius Wiehler

    (Motivation, Brain and Behavior Lab, Paris Brain Institute (ICM), Pitié-Salpêtrière Hospital)

  • Ben Wagner

    (Technical University Dresden)

  • David Mathar

    (University of Cologne)

  • Florian Ganzer

    (Integrated Psychiatry Winterthur)

  • Thilo Eimeren

    (University Medical Center Cologne)

  • Tobias Sommer

    (University Medical Center Hamburg-Eppendorf)

  • Jan Peters

    (University Medical Center Hamburg-Eppendorf
    University of Cologne)

Abstract

Dopamine fundamentally contributes to reinforcement learning, but recent accounts also suggest a contribution to specific action selection mechanisms and the regulation of response vigour. Here, we examine dopaminergic mechanisms underlying human reinforcement learning and action selection via a combined pharmacological neuroimaging approach in male human volunteers (n = 31, within-subjects; Placebo, 150 mg of the dopamine precursor L-dopa, 2 mg of the D2 receptor antagonist Haloperidol). We found little credible evidence for previously reported beneficial effects of L-dopa vs. Haloperidol on learning from gains and altered neural prediction error signals, which may be partly due to differences experimental design and/or drug dosages. Reinforcement learning drift diffusion models account for learning-related changes in accuracy and response times, and reveal consistent decision threshold reductions under both drugs, in line with the idea that lower dosages of D2 receptor antagonists increase striatal DA release via an autoreceptor-mediated feedback mechanism. These results are in line with the idea that dopamine regulates decision thresholds during reinforcement learning, and may help to bridge action selection and response vigor accounts of dopamine.

Suggested Citation

  • Karima Chakroun & Antonius Wiehler & Ben Wagner & David Mathar & Florian Ganzer & Thilo Eimeren & Tobias Sommer & Jan Peters, 2023. "Dopamine regulates decision thresholds in human reinforcement learning in males," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-41130-y
    DOI: 10.1038/s41467-023-41130-y
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-41130-y
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-41130-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nitzan Shahar & Tobias U Hauser & Michael Moutoussis & Rani Moran & Mehdi Keramati & NSPN consortium & Raymond J Dolan, 2019. "Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling," PLOS Computational Biology, Public Library of Science, vol. 15(2), pages 1-25, February.
    2. Maël Lebreton & Sophie Bavard & Jean Daunizeau & Stefano Palminteri, 2019. "Assessing inter-individual differences with task-related functional neuroimaging," Nature Human Behaviour, Nature, vol. 3(9), pages 897-905, September.
    3. Mathias Pessiglione & Ben Seymour & Guillaume Flandin & Raymond J. Dolan & Chris D. Frith, 2006. "Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans," Nature, Nature, vol. 442(7106), pages 1042-1045, August.
    4. Jan Peters & Mark D’Esposito, 2020. "The drift diffusion model as the choice rule in inter-temporal and risky choice: A case study in medial orbitofrontal cortex lesion patients and controls," PLOS Computational Biology, Public Library of Science, vol. 16(4), pages 1-25, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hanan Shteingart & Tal Neiman & Yonatan Loewenstein, 2012. "The Role of First Impression in Operant Learning," Discussion Paper Series dp626, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    2. Kuhnen, Camelia M. & Miu, Andrei C., 2017. "Socioeconomic status and learning from financial information," Journal of Financial Economics, Elsevier, vol. 124(2), pages 349-372.
    3. Reimann, Martin & Bechara, Antoine, 2010. "The somatic marker framework as a neurological theory of decision-making: Review, conceptual comparisons, and future neuroeconomics research," Journal of Economic Psychology, Elsevier, vol. 31(5), pages 767-776, October.
    4. George I. Christopoulos & Xiao-Xiao Liu & Ying-yi Hong, 2017. "Toward an Understanding of Dynamic Moral Decision Making: Model-Free and Model-Based Learning," Journal of Business Ethics, Springer, vol. 144(4), pages 699-715, September.
    5. Maël Lebreton & Karin Bacily & Stefano Palminteri & Jan B Engelmann, 2019. "Contextual influence on confidence judgments in human reinforcement learning," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-27, April.
    6. Kuhnen, Camelia M. & Knutson, Brian, 2011. "The Influence of Affect on Beliefs, Preferences, and Financial Decisions," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 46(3), pages 605-626, June.
    7. Bruno B Averbeck, 2015. "Theory of Choice in Bandit, Information Sampling and Foraging Tasks," PLOS Computational Biology, Public Library of Science, vol. 11(3), pages 1-28, March.
    8. Stefano Palminteri & Emma J Kilford & Giorgio Coricelli & Sarah-Jayne Blakemore, 2016. "The Computational Development of Reinforcement Learning during Adolescence," PLOS Computational Biology, Public Library of Science, vol. 12(6), pages 1-25, June.
    9. Paul M Bays & Ben A Dowding, 2017. "Fidelity of the representation of value in decision-making," PLOS Computational Biology, Public Library of Science, vol. 13(3), pages 1-16, March.
    10. Chih-Chung Ting & Nahuel Salem-Garcia & Stefano Palminteri & Jan B. Engelmann & Maël Lebreton, 2023. "Neural and computational underpinnings of biased confidence in human reinforcement learning," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    11. Antoine Collomb-Clerc & Maëlle C. M. Gueguen & Lorella Minotti & Philippe Kahane & Vincent Navarro & Fabrice Bartolomei & Romain Carron & Jean Regis & Stephan Chabardès & Stefano Palminteri & Julien B, 2023. "Human thalamic low-frequency oscillations correlate with expected value and outcomes during reinforcement learning," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    12. David Vaquero-Puyuelo & Concepción De-la-Cámara & Beatriz Olaya & Patricia Gracia-García & Antonio Lobo & Raúl López-Antón & Javier Santabárbara, 2021. "Anhedonia as a Potential Risk Factor of Alzheimer’s Disease in a Community-Dwelling Elderly Sample: Results from the ZARADEMP Project," IJERPH, MDPI, vol. 18(4), pages 1-12, February.
    13. Sophie Massin, 2011. "La notion d'addiction en économie : La théorie du choix rationnel à l'épreuve," Revue d'économie politique, Dalloz, vol. 121(5), pages 713-750.
    14. Gifford Jr., Adam, 2009. "Cultural, cognition and human action," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 38(1), pages 13-24, January.
    15. Hachi E. Manzur & Ksenia Vlasov & You-Jhe Jhong & Hung-Yen Chen & Shih-Chieh Lin, 2023. "The behavioral signature of stepwise learning strategy in male rats and its neural correlate in the basal forebrain," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    16. Daniel Serra, 2019. "Neuroeconomics and modern neuroscience," CEE-M Working Papers halshs-02160907, CEE-M, Universtiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
    17. He A Xu & Alireza Modirshanechi & Marco P Lehmann & Wulfram Gerstner & Michael H Herzog, 2021. "Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making," PLOS Computational Biology, Public Library of Science, vol. 17(6), pages 1-32, June.
    18. Necker, Sarah & Ziegelmeyer, Michael, 2016. "Household risk taking after the financial crisis," The Quarterly Review of Economics and Finance, Elsevier, vol. 59(C), pages 141-160.
    19. Tal Neiman & Yonatan Loewenstein, 2011. "Reinforcement learning in professional basketball players," Discussion Paper Series dp593, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    20. Davide Cenci & Manuel Glauco Carbone & Camilla Callegari & Icro Maremmani, 2022. "Psychomotor Symptoms in Chronic Cocaine Users: An Interpretative Model," IJERPH, MDPI, vol. 19(3), pages 1-10, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-41130-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.