IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1012474.html
   My bibliography  Save this article

Roles and interplay of reinforcement-based and error-based processes during reaching and gait in neurotypical adults and individuals with Parkinson’s disease

Author

Listed:
  • Adam M Roth
  • John H Buggeln
  • Joanna E Hoh
  • Jonathan M Wood
  • Seth R Sullivan
  • Truc T Ngo
  • Jan A Calalo
  • Rakshith Lokesh
  • Susanne M Morton
  • Stephen Grill
  • John J Jeka
  • Michael J Carter
  • Joshua G A Cashaback

Abstract

From a game of darts to neurorehabilitation, the ability to explore and fine tune our movements is critical for success. Past work has shown that exploratory motor behaviour in response to reinforcement (reward) feedback is closely linked with the basal ganglia, while movement corrections in response to error feedback is commonly attributed to the cerebellum. While our past work has shown these processes are dissociable during adaptation, it is unknown how they uniquely impact exploratory behaviour. Moreover, converging neuroanatomical evidence shows direct and indirect connections between the basal ganglia and cerebellum, suggesting that there is an interaction between reinforcement-based and error-based neural processes. Here we examine the unique roles and interaction between reinforcement-based and error-based processes on sensorimotor exploration in a neurotypical population. We also recruited individuals with Parkinson’s disease to gain mechanistic insight into the role of the basal ganglia and associated reinforcement pathways in sensorimotor exploration. Across three reaching experiments, participants were given either reinforcement feedback, error feedback, or simultaneously both reinforcement & error feedback during a sensorimotor task that encouraged exploration. Our reaching results, a re-analysis of a previous gait experiment, and our model suggests that in isolation, reinforcement-based and error-based processes respectively boost and suppress exploration. When acting in concert, we found that reinforcement-based and error-based processes interact by mutually opposing one another. Finally, we found that those with Parkinson’s disease had decreased exploration when receiving reinforcement feedback, supporting the notion that compromised reinforcement-based processes reduces the ability to explore new motor actions. Understanding the unique and interacting roles of reinforcement-based and error-based processes may help to inform neurorehabilitation paradigms where it is important to discover new and successful motor actions.Author summary: Reinforcement-based and error-based processes play a pivotal role in regulating our movements. Converging neuroanatomical evidence show interconnected reinforcement-based and error-based neural circuits. Yet is unclear how reinforcement-based and error-based processes interact to influence sensorimotor behavior. In our past work we showed that reinforcement-based and error-based processes are dissociable. Building on this work, here we show that these process can also interact to influence trial-by-trial sensorimotor behaviour.

Suggested Citation

  • Adam M Roth & John H Buggeln & Joanna E Hoh & Jonathan M Wood & Seth R Sullivan & Truc T Ngo & Jan A Calalo & Rakshith Lokesh & Susanne M Morton & Stephen Grill & John J Jeka & Michael J Carter & Josh, 2024. "Roles and interplay of reinforcement-based and error-based processes during reaching and gait in neurotypical adults and individuals with Parkinson’s disease," PLOS Computational Biology, Public Library of Science, vol. 20(10), pages 1-32, October.
  • Handle: RePEc:plo:pcbi00:1012474
    DOI: 10.1371/journal.pcbi.1012474
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1012474
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1012474&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1012474?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jonathan B Dingwell & Joby John & Joseph P Cusumano, 2010. "Do Humans Optimally Exploit Redundancy to Control Step Variability in Walking?," PLOS Computational Biology, Public Library of Science, vol. 6(7), pages 1-15, July.
    2. Dagmar Sternad & Se-Woong Park & Hermann Müller & Neville Hogan, 2010. "Coordinate Dependence of Variability Analysis," PLOS Computational Biology, Public Library of Science, vol. 6(4), pages 1-16, April.
    3. Mathias Pessiglione & Ben Seymour & Guillaume Flandin & Raymond J. Dolan & Chris D. Frith, 2006. "Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans," Nature, Nature, vol. 442(7106), pages 1042-1045, August.
    4. Kurt A. Thoroughman & Reza Shadmehr, 2000. "Learning of action through adaptive combination of motor primitives," Nature, Nature, vol. 407(6805), pages 742-747, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antoine Collomb-Clerc & Maëlle C. M. Gueguen & Lorella Minotti & Philippe Kahane & Vincent Navarro & Fabrice Bartolomei & Romain Carron & Jean Regis & Stephan Chabardès & Stefano Palminteri & Julien B, 2023. "Human thalamic low-frequency oscillations correlate with expected value and outcomes during reinforcement learning," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    2. Manuel Glauco Carbone & Icro Maremmani, 2024. "Chronic Cocaine Use and Parkinson’s Disease: An Interpretative Model," IJERPH, MDPI, vol. 21(8), pages 1-23, August.
    3. David Vaquero-Puyuelo & Concepción De-la-Cámara & Beatriz Olaya & Patricia Gracia-García & Antonio Lobo & Raúl López-Antón & Javier Santabárbara, 2021. "Anhedonia as a Potential Risk Factor of Alzheimer’s Disease in a Community-Dwelling Elderly Sample: Results from the ZARADEMP Project," IJERPH, MDPI, vol. 18(4), pages 1-12, February.
    4. Ian S Howard & David W Franklin, 2015. "Neural Tuning Functions Underlie Both Generalization and Interference," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-21, June.
    5. Stefano Palminteri & Mehdi Khamassi & Mateus Joffily & Giorgio Coricelli, 2015. "Contextual modulation of value signals in reward and punishment learning," Post-Print halshs-01236045, HAL.
    6. repec:plo:pone00:0043016 is not listed on IDEAS
    7. repec:plo:pone00:0037900 is not listed on IDEAS
    8. Julius Verrel & Martin Lövdén & Ulman Lindenberger, 2012. "Older Adults Show Preserved Equilibrium but Impaired Step Length Control in Motor-Equivalent Stabilization of Gait," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-8, December.
    9. Hanan Shteingart & Tal Neiman & Yonatan Loewenstein, 2012. "The Role of First Impression in Operant Learning," Discussion Paper Series dp626, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    10. Sophie Massin, 2011. "La notion d'addiction en économie : La théorie du choix rationnel à l'épreuve," Revue d'économie politique, Dalloz, vol. 121(5), pages 713-750.
    11. Kuhnen, Camelia M. & Miu, Andrei C., 2017. "Socioeconomic status and learning from financial information," Journal of Financial Economics, Elsevier, vol. 124(2), pages 349-372.
    12. Gifford Jr., Adam, 2009. "Cultural, cognition and human action," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 38(1), pages 13-24, January.
    13. Hachi E. Manzur & Ksenia Vlasov & You-Jhe Jhong & Hung-Yen Chen & Shih-Chieh Lin, 2023. "The behavioral signature of stepwise learning strategy in male rats and its neural correlate in the basal forebrain," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    14. Biele, Guido & Rieskamp, Jörg & Krugel, Lea K. & Heekeren, Hauke R., 2011. "The neural basis of following advice," SFB 649 Discussion Papers 2011-038, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    15. Daniel Serra, 2019. "Neuroeconomics and modern neuroscience," CEE-M Working Papers halshs-02160907, CEE-M, Universtiy of Montpellier, CNRS, INRA, Montpellier SupAgro.
    16. He A Xu & Alireza Modirshanechi & Marco P Lehmann & Wulfram Gerstner & Michael H Herzog, 2021. "Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making," PLOS Computational Biology, Public Library of Science, vol. 17(6), pages 1-32, June.
    17. Reimann, Martin & Bechara, Antoine, 2010. "The somatic marker framework as a neurological theory of decision-making: Review, conceptual comparisons, and future neuroeconomics research," Journal of Economic Psychology, Elsevier, vol. 31(5), pages 767-776, October.
    18. George I. Christopoulos & Xiao-Xiao Liu & Ying-yi Hong, 2017. "Toward an Understanding of Dynamic Moral Decision Making: Model-Free and Model-Based Learning," Journal of Business Ethics, Springer, vol. 144(4), pages 699-715, September.
    19. Necker, Sarah & Ziegelmeyer, Michael, 2016. "Household risk taking after the financial crisis," The Quarterly Review of Economics and Finance, Elsevier, vol. 59(C), pages 141-160.
    20. Marietta Kirchner & Patric Schubert & Magnus Liebherr & Christian T Haas, 2014. "Detrended Fluctuation Analysis and Adaptive Fractal Analysis of Stride Time Data in Parkinson's Disease: Stitching Together Short Gait Trials," PLOS ONE, Public Library of Science, vol. 9(1), pages 1-6, January.
    21. Steven H Collins & Arthur D Kuo, 2013. "Two Independent Contributions to Step Variability during Over-Ground Human Walking," PLOS ONE, Public Library of Science, vol. 8(8), pages 1-1, August.
    22. Maël Lebreton & Karin Bacily & Stefano Palminteri & Jan B Engelmann, 2019. "Contextual influence on confidence judgments in human reinforcement learning," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-27, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1012474. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.