IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0270619.html
   My bibliography  Save this article

Differentiating between Bayesian parameter learning and structure learning based on behavioural and pupil measures

Author

Listed:
  • Danaja Rutar
  • Olympia Colizoli
  • Luc Selen
  • Lukas Spieß
  • Johan Kwisthout
  • Sabine Hunnius

Abstract

Within predictive processing two kinds of learning can be distinguished: parameter learning and structure learning. In Bayesian parameter learning, parameters under a specific generative model are continuously being updated in light of new evidence. However, this learning mechanism cannot explain how new parameters are added to a model. Structure learning, unlike parameter learning, makes structural changes to a generative model by altering its causal connections or adding or removing parameters. Whilst these two types of learning have recently been formally differentiated, they have not been empirically distinguished. The aim of this research was to empirically differentiate between parameter learning and structure learning on the basis of how they affect pupil dilation. Participants took part in a within-subject computer-based learning experiment with two phases. In the first phase, participants had to learn the relationship between cues and target stimuli. In the second phase, they had to learn a conditional change in this relationship. Our results show that the learning dynamics were indeed qualitatively different between the two experimental phases, but in the opposite direction as we originally expected. Participants were learning more gradually in the second phase compared to the first phase. This might imply that participants built multiple models from scratch in the first phase (structure learning) before settling on one of these models. In the second phase, participants possibly just needed to update the probability distribution over the model parameters (parameter learning).

Suggested Citation

  • Danaja Rutar & Olympia Colizoli & Luc Selen & Lukas Spieß & Johan Kwisthout & Sabine Hunnius, 2023. "Differentiating between Bayesian parameter learning and structure learning based on behavioural and pupil measures," PLOS ONE, Public Library of Science, vol. 18(2), pages 1-20, February.
  • Handle: RePEc:plo:pone00:0270619
    DOI: 10.1371/journal.pone.0270619
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0270619
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0270619&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0270619?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. James B. Heald & Máté Lengyel & Daniel M. Wolpert, 2021. "Contextual inference underlies the learning of sensorimotor repertoires," Nature, Nature, vol. 600(7889), pages 489-493, December.
    2. P. Read Montague & Steven E. Hyman & Jonathan D. Cohen, 2004. "Computational roles for dopamine in behavioural control," Nature, Nature, vol. 431(7010), pages 760-767, October.
    3. Ezgi Kayhan & Lieke Heil & Johan Kwisthout & Iris van Rooij & Sabine Hunnius & Harold Bekkering, 2019. "Young children integrate current observations, priors and agent information to predict others’ actions," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-16, May.
    4. Keith A May & Joshua A Solomon, 2013. "Four Theorems on the Psychometric Function," PLOS ONE, Public Library of Science, vol. 8(10), pages 1-34, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Minsu Abel Yang & Min Whan Jung & Sang Wan Lee, 2025. "Striatal arbitration between choice strategies guides few-shot adaptation," Nature Communications, Nature, vol. 16(1), pages 1-26, December.
    2. Andreea O Diaconescu & Christoph Mathys & Lilian A E Weber & Jean Daunizeau & Lars Kasper & Ekaterina I Lomakina & Ernst Fehr & Klaas E Stephan, 2014. "Inferring on the Intentions of Others by Hierarchical Bayesian Learning," PLOS Computational Biology, Public Library of Science, vol. 10(9), pages 1-19, September.
    3. Nidhi Seethapathi & Barrett C. Clark & Manoj Srinivasan, 2024. "Exploration-based learning of a stabilizing controller predicts locomotor adaptation," Nature Communications, Nature, vol. 15(1), pages 1-23, December.
    4. Biele, Guido & Rieskamp, Jörg & Krugel, Lea K. & Heekeren, Hauke R., 2011. "The neural basis of following advice," SFB 649 Discussion Papers 2011-038, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    5. Ünsal Özdilek, 2021. "Sensing Happiness in Senseless Information," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 16(5), pages 2059-2084, October.
    6. Burkhard Pleger & Christian C Ruff & Felix Blankenburg & Stefan Klöppel & Jon Driver & Raymond J Dolan, 2009. "Influence of Dopaminergically Mediated Reward on Somatosensory Decision-Making," PLOS Biology, Public Library of Science, vol. 7(7), pages 1-10, July.
    7. Joanna C. Chang & Matthew G. Perich & Lee E. Miller & Juan A. Gallego & Claudia Clopath, 2024. "De novo motor learning creates structure in neural activity that shapes adaptation," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    8. Kyung-Shin Lee & Yoon-Jung Choi & Jin-Woo Cho & Sung-Ji Moon & Youn-Hee Lim & Johanna-Inhyang Kim & Young-Ah Lee & Choong-Ho Shin & Bung-Nyun Kim & Yun-Chul Hong, 2021. "Children’s Greenness Exposure and IQ-Associated DNA Methylation: A Prospective Cohort Study," IJERPH, MDPI, vol. 18(14), pages 1-16, July.
    9. Alex S Baldwin & Daniel H Baker & Robert F Hess, 2016. "What Do Contrast Threshold Equivalent Noise Studies Actually Measure? Noise vs. Nonlinearity in Different Masking Paradigms," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-25, March.
    10. Márton Albert Hajnal & Duy Tran & Michael Einstein & Mauricio Vallejo Martelo & Karen Safaryan & Pierre-Olivier Polack & Peyman Golshani & Gergő Orbán, 2023. "Continuous multiplexed population representations of task context in the mouse primary visual cortex," Nature Communications, Nature, vol. 14(1), pages 1-20, December.
    11. Márton Albert Hajnal & Duy Tran & Zsombor Szabó & Andrea Albert & Karen Safaryan & Michael Einstein & Mauricio Vallejo Martelo & Pierre-Olivier Polack & Peyman Golshani & Gergő Orbán, 2024. "Shifts in attention drive context-dependent subspace encoding in anterior cingulate cortex in mice during decision making," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    12. Kisho Ogasa & Atsushi Yokoi & Gouki Okazawa & Morimichi Nishigaki & Masaya Hirashima & Nobuhiro Hagura, 2024. "Decision uncertainty as a context for motor memory," Nature Human Behaviour, Nature, vol. 8(9), pages 1738-1751, September.
    13. Hanan Shteingart & Yonatan Loewenstein, 2014. "Reinforcement Learning and Human Behavior," Discussion Paper Series dp656, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    14. repec:plo:pbio00:1001089 is not listed on IDEAS
    15. Taisei Sugiyama & Nicolas Schweighofer & Jun Izawa, 2023. "Reinforcement learning establishes a minimal metacognitive process to monitor and control motor learning performance," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    16. Wei-Long Zheng & Zhongxuan Wu & Ali Hummos & Guangyu Robert Yang & Michael M. Halassa, 2024. "Rapid context inference in a thalamocortical model using recurrent neural networks," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    17. Joseph Pemberton & Paul Chadderton & Rui Ponte Costa, 2024. "Cerebellar-driven cortical dynamics can enable task acquisition, switching and consolidation," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    18. Lindkvist, Emilie & Norberg, Jon, 2014. "Modeling experiential learning: The challenges posed by threshold dynamics for sustainable renewable resource management," Ecological Economics, Elsevier, vol. 104(C), pages 107-118.
    19. Litt, Ab & Reich, Taly & Maymin, Senia & Shiv, Baba, 2010. "Pressure and Perverse Flights to Familiarity," Research Papers 2073, Stanford University, Graduate School of Business.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0270619. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.