IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1004558.html
   My bibliography  Save this article

Modeling the Evolution of Beliefs Using an Attentional Focus Mechanism

Author

Listed:
  • Dimitrije Marković
  • Jan Gläscher
  • Peter Bossaerts
  • John O’Doherty
  • Stefan J Kiebel

Abstract

For making decisions in everyday life we often have first to infer the set of environmental features that are relevant for the current task. Here we investigated the computational mechanisms underlying the evolution of beliefs about the relevance of environmental features in a dynamical and noisy environment. For this purpose we designed a probabilistic Wisconsin card sorting task (WCST) with belief solicitation, in which subjects were presented with stimuli composed of multiple visual features. At each moment in time a particular feature was relevant for obtaining reward, and participants had to infer which feature was relevant and report their beliefs accordingly. To test the hypothesis that attentional focus modulates the belief update process, we derived and fitted several probabilistic and non-probabilistic behavioral models, which either incorporate a dynamical model of attentional focus, in the form of a hierarchical winner-take-all neuronal network, or a diffusive model, without attention-like features. We used Bayesian model selection to identify the most likely generative model of subjects’ behavior and found that attention-like features in the behavioral model are essential for explaining subjects’ responses. Furthermore, we demonstrate a method for integrating both connectionist and Bayesian models of decision making within a single framework that allowed us to infer hidden belief processes of human subjects.Author Summary: When making decisions in our everyday life (e.g. where to eat) we first have to identify a set of environmental features that are relevant for the decision (e.g. the distance to the place, current time or the price). Although we are able to make such inferences almost effortlessly, this type of problems is computationally challenging, as we live in a complex environment that constantly changes and contains an immense number of features. Here we investigated the question of how the human brain solves this computational challenge. In particular, we designed a new experimental paradigm and derived novel behavioral models to test the hypothesis that attention modulates the formation of beliefs about the relevance of several environmental features. As each behavioral model accounted for a different hypothesis about the underlying computational mechanism we compared them in their ability to explain the measured behavior of human subjects performing the experimental task. The model comparison indicates that an attentional-focus mechanism is a key feature of behavioral models that accurately replicate subjects’ behavior. These findings suggest that the evolution of beliefs is modulated by a competitive attractor dynamics that forms prior expectation about future outcomes. Hence, the findings provide interesting and novel insights into the computational mechanisms underlying human behavior when making decisions in complex environments.

Suggested Citation

  • Dimitrije Marković & Jan Gläscher & Peter Bossaerts & John O’Doherty & Stefan J Kiebel, 2015. "Modeling the Evolution of Beliefs Using an Attentional Focus Mechanism," PLOS Computational Biology, Public Library of Science, vol. 11(10), pages 1-34, October.
  • Handle: RePEc:plo:pcbi00:1004558
    DOI: 10.1371/journal.pcbi.1004558
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004558
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1004558&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1004558?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Élise PAYZAN LE NESTOUR, 2010. "Bayesian Learning in UnstableSettings: Experimental Evidence Based on the Bandit Problem," Swiss Finance Institute Research Paper Series 10-28, Swiss Finance Institute.
    2. Konrad P Körding & Ulrik Beierholm & Wei Ji Ma & Steven Quartz & Joshua B Tenenbaum & Ladan Shams, 2007. "Causal Inference in Multisensory Perception," PLOS ONE, Public Library of Science, vol. 2(9), pages 1-10, September.
    3. Luigi Acerbi & Sethu Vijayakumar & Daniel M Wolpert, 2014. "On the Origins of Suboptimality in Human Probabilistic Inference," PLOS Computational Biology, Public Library of Science, vol. 10(6), pages 1-23, June.
    4. Will D Penny & Klaas E Stephan & Jean Daunizeau & Maria J Rosa & Karl J Friston & Thomas M Schofield & Alex P Leff, 2010. "Comparing Families of Dynamic Causal Models," PLOS Computational Biology, Public Library of Science, vol. 6(3), pages 1-14, March.
    5. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    6. Andre Palma & Moshe Ben-Akiva & David Brownstone & Charles Holt & Thierry Magnac & Daniel McFadden & Peter Moffatt & Nathalie Picard & Kenneth Train & Peter Wakker & Joan Walker, 2008. "Risk, uncertainty and discrete choice models," Marketing Letters, Springer, vol. 19(3), pages 269-285, December.
      • André de Palma & Moshe Ben-Akiva & David Brownstone & Charles Holt & Thierry Magnac & Daniel McFadden & Peter Moffatt & Nathalie Picard & Kenneth Train & Peter Wakker & Joan Walker, 2008. "Risk, Uncertainty and Discrete Choice Models," THEMA Working Papers 2008-02, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    7. Jean Daunizeau & Hanneke E M den Ouden & Matthias Pessiglione & Stefan J Kiebel & Karl J Friston & Klaas E Stephan, 2010. "Observing the Observer (II): Deciding When to Decide," PLOS ONE, Public Library of Science, vol. 5(12), pages 1-19, December.
    8. Jean Daunizeau & Hanneke E M den Ouden & Matthias Pessiglione & Stefan J Kiebel & Klaas E Stephan & Karl J Friston, 2010. "Observing the Observer (I): Meta-Bayesian Models of Learning and Decision-Making," PLOS ONE, Public Library of Science, vol. 5(12), pages 1-10, December.
    9. Nial Friel & Jason Wyse, 2012. "Estimating the evidence – a review," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 66(3), pages 288-308, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andreea O Diaconescu & Christoph Mathys & Lilian A E Weber & Jean Daunizeau & Lars Kasper & Ekaterina I Lomakina & Ernst Fehr & Klaas E Stephan, 2014. "Inferring on the Intentions of Others by Hierarchical Bayesian Learning," PLOS Computational Biology, Public Library of Science, vol. 10(9), pages 1-19, September.
    2. Fabien Vinckier & Lionel Rigoux & Irma T Kurniawan & Chen Hu & Sacha Bourgeois-Gironde & Jean Daunizeau & Mathias Pessiglione, 2019. "Sour grapes and sweet victories: How actions shape preferences," PLOS Computational Biology, Public Library of Science, vol. 15(1), pages 1-24, January.
    3. Adam N Sanborn & Ulrik R Beierholm, 2016. "Fast and Accurate Learning When Making Discrete Numerical Estimates," PLOS Computational Biology, Public Library of Science, vol. 12(4), pages 1-28, April.
    4. Tim Genewein & Eduard Hez & Zeynab Razzaghpanah & Daniel A Braun, 2015. "Structure Learning in Bayesian Sensorimotor Integration," PLOS Computational Biology, Public Library of Science, vol. 11(8), pages 1-27, August.
    5. Falk Lieder & Klaas E Stephan & Jean Daunizeau & Marta I Garrido & Karl J Friston, 2013. "A Neurocomputational Model of the Mismatch Negativity," PLOS Computational Biology, Public Library of Science, vol. 9(11), pages 1-14, November.
    6. Luigi Acerbi & Kalpana Dokka & Dora E Angelaki & Wei Ji Ma, 2018. "Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception," PLOS Computational Biology, Public Library of Science, vol. 14(7), pages 1-38, July.
    7. Giovanni Leone & Charlotte Postel & Alison Mary & Florence Fraisse & Thomas Vallée & Fausto Viader & Vincent Sayette & Denis Peschanski & Jaques Dayan & Francis Eustache & Pierre Gagnepain, 2022. "Altered predictive control during memory suppression in PTSD," Nature Communications, Nature, vol. 13(1), pages 1-16, December.
    8. Marie Devaine & Jean Daunizeau, 2017. "Learning about and from others' prudence, impatience or laziness: The computational bases of attitude alignment," PLOS Computational Biology, Public Library of Science, vol. 13(3), pages 1-28, March.
    9. Jean Daunizeau & Kerstin Preuschoff & Karl Friston & Klaas Stephan, 2011. "Optimizing Experimental Design for Comparing Models of Brain Function," PLOS Computational Biology, Public Library of Science, vol. 7(11), pages 1-18, November.
    10. Jean Daunizeau & Hanneke E M den Ouden & Matthias Pessiglione & Stefan J Kiebel & Karl J Friston & Klaas E Stephan, 2010. "Observing the Observer (II): Deciding When to Decide," PLOS ONE, Public Library of Science, vol. 5(12), pages 1-19, December.
    11. Jean Daunizeau & Vincent Adam & Lionel Rigoux, 2014. "VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data," PLOS Computational Biology, Public Library of Science, vol. 10(1), pages 1-16, January.
    12. Victor Bystrov, 2018. "Measuring the Natural Rates of Interest in Germany and Italy," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(4), pages 333-353, December.
    13. Yukai Yang & Luc Bauwens, 2018. "State-Space Models on the Stiefel Manifold with a New Approach to Nonlinear Filtering," Econometrics, MDPI, vol. 6(4), pages 1-22, December.
    14. Fernández-Macho, Javier, 2008. "Spectral estimation of a structural thin-plate smoothing model," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 189-195, September.
    15. Drew Creal & Siem Jan Koopman & Eric Zivot, 2008. "The Effect of the Great Moderation on the U.S. Business Cycle in a Time-varying Multivariate Trend-cycle Model," Tinbergen Institute Discussion Papers 08-069/4, Tinbergen Institute.
    16. Avanzi, Benjamin & Taylor, Greg & Vu, Phuong Anh & Wong, Bernard, 2020. "A multivariate evolutionary generalised linear model framework with adaptive estimation for claims reserving," Insurance: Mathematics and Economics, Elsevier, vol. 93(C), pages 50-71.
    17. François R. Velde, 2009. "Chronicle of a Deflation Unforetold," Journal of Political Economy, University of Chicago Press, vol. 117(4), pages 591-634, August.
    18. Chen, Peimin & Wu, Chunchi, 2014. "Default prediction with dynamic sectoral and macroeconomic frailties," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 211-226.
    19. repec:zbw:bofitp:2019_008 is not listed on IDEAS
    20. Yue Zhao & Difang Wan, 2018. "Institutional high frequency trading and price discovery: Evidence from an emerging commodity futures market," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 38(2), pages 243-270, February.
    21. Wen Xu, 2016. "Estimation of Dynamic Panel Data Models with Stochastic Volatility Using Particle Filters," Econometrics, MDPI, vol. 4(4), pages 1-13, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1004558. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.