IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v16y2025i1d10.1038_s41467-025-58797-0.html
   My bibliography  Save this article

Hierarchical motion perception as causal inference

Author

Listed:
  • Sabyasachi Shivkumar

    (University of Rochester
    Columbia University)

  • Gregory C. DeAngelis

    (University of Rochester
    University of Rochester)

  • Ralf M. Haefner

    (University of Rochester
    University of Rochester)

Abstract

Motion can only be defined relative to a reference frame; yet it remains unclear which reference frame guides perception. A century of psychophysical studies has produced conflicting evidence: retinotopic, egocentric, world-centric, or even object-centric. We introduce a hierarchical Bayesian model mapping retinal velocities to perceived velocities. Our model mirrors the structure in the world, in which visual elements move within causally connected reference frames. Friction renders velocities in these reference frames mostly stationary, formalized by an additional delta component (at zero) in the prior. Inverting this model automatically segments visual inputs into groups, groups into supergroups, progressively inferring structured reference frames and “perceives" motion in the appropriate reference frame. Critical model predictions are supported by two experiments, and fitting our model to the data allows us to infer the subjective set of reference frames used by individual observers. Our model provides a quantitative normative justification for key Gestalt principles providing inspiration for building better models of visual processing in general.

Suggested Citation

  • Sabyasachi Shivkumar & Gregory C. DeAngelis & Ralf M. Haefner, 2025. "Hierarchical motion perception as causal inference," Nature Communications, Nature, vol. 16(1), pages 1-14, December.
  • Handle: RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-58797-0
    DOI: 10.1038/s41467-025-58797-0
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-025-58797-0
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-025-58797-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Johannes Bill & Samuel J. Gershman & Jan Drugowitsch, 2022. "Visual motion perception as online hierarchical inference," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    2. David R Wozny & Ulrik R Beierholm & Ladan Shams, 2010. "Probability Matching as a Computational Strategy Used in Perception," PLOS Computational Biology, Public Library of Science, vol. 6(8), pages 1-7, August.
    3. Luigi Acerbi & Kalpana Dokka & Dora E Angelaki & Wei Ji Ma, 2018. "Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception," PLOS Computational Biology, Public Library of Science, vol. 14(7), pages 1-38, July.
    4. Marc O. Ernst & Martin S. Banks, 2002. "Humans integrate visual and haptic information in a statistically optimal fashion," Nature, Nature, vol. 415(6870), pages 429-433, January.
    5. Konrad P. Körding & Daniel M. Wolpert, 2004. "Bayesian integration in sensorimotor learning," Nature, Nature, vol. 427(6971), pages 244-247, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adam N Sanborn & Ulrik R Beierholm, 2016. "Fast and Accurate Learning When Making Discrete Numerical Estimates," PLOS Computational Biology, Public Library of Science, vol. 12(4), pages 1-28, April.
    2. Jannes Jegminat & Maya A Jastrzębowska & Matthew V Pachai & Michael H Herzog & Jean-Pascal Pfister, 2020. "Bayesian regression explains how human participants handle parameter uncertainty," PLOS Computational Biology, Public Library of Science, vol. 16(5), pages 1-23, May.
    3. Loreen Hertäg & Katharina A. Wilmes & Claudia Clopath, 2025. "Uncertainty estimation with prediction-error circuits," Nature Communications, Nature, vol. 16(1), pages 1-15, December.
    4. Jacques Pesnot Lerousseau & Cesare V. Parise & Marc O. Ernst & Virginie Wassenhove, 2022. "Multisensory correlation computations in the human brain identified by a time-resolved encoding model," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    5. Wen-Hao Zhang & Si Wu & Krešimir Josić & Brent Doiron, 2023. "Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    6. Seth W. Egger & Stephen G. Lisberger, 2022. "Neural structure of a sensory decoder for motor control," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    7. Wendy J Adams, 2016. "The Development of Audio-Visual Integration for Temporal Judgements," PLOS Computational Biology, Public Library of Science, vol. 12(4), pages 1-17, April.
    8. Tim Genewein & Eduard Hez & Zeynab Razzaghpanah & Daniel A Braun, 2015. "Structure Learning in Bayesian Sensorimotor Integration," PLOS Computational Biology, Public Library of Science, vol. 11(8), pages 1-27, August.
    9. Brocas, Isabelle & Carrillo, Juan D., 2012. "From perception to action: An economic model of brain processes," Games and Economic Behavior, Elsevier, vol. 75(1), pages 81-103.
    10. Jennifer Laura Lee & Wei Ji Ma, 2021. "Point-estimating observer models for latent cause detection," PLOS Computational Biology, Public Library of Science, vol. 17(10), pages 1-29, October.
    11. Carrillo, Juan & Brocas, Isabelle, 2007. "Reason, Emotion and Information Processing in the Brain," CEPR Discussion Papers 6535, C.E.P.R. Discussion Papers.
    12. Luigi Acerbi & Sethu Vijayakumar & Daniel M Wolpert, 2014. "On the Origins of Suboptimality in Human Probabilistic Inference," PLOS Computational Biology, Public Library of Science, vol. 10(6), pages 1-23, June.
    13. Guido Marco Cicchini & Giovanni D’Errico & David Charles Burr, 2022. "Crowding results from optimal integration of visual targets with contextual information," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    14. Udo A Ernst & Sunita Mandon & Nadja Schinkel–Bielefeld & Simon D Neitzel & Andreas K Kreiter & Klaus R Pawelzik, 2012. "Optimality of Human Contour Integration," PLOS Computational Biology, Public Library of Science, vol. 8(5), pages 1-17, May.
    15. Philipp Schustek & Rubén Moreno-Bote, 2018. "Instance-based generalization for human judgments about uncertainty," PLOS Computational Biology, Public Library of Science, vol. 14(6), pages 1-27, June.
    16. Peter W Battaglia & Daniel Kersten & Paul R Schrater, 2011. "How Haptic Size Sensations Improve Distance Perception," PLOS Computational Biology, Public Library of Science, vol. 7(6), pages 1-13, June.
    17. Luigi Acerbi & Kalpana Dokka & Dora E Angelaki & Wei Ji Ma, 2018. "Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception," PLOS Computational Biology, Public Library of Science, vol. 14(7), pages 1-38, July.
    18. Lukas K. Amann & Virginia Casasnovas & Alexander Gail, 2025. "Visual target and task-critical feedback uncertainty impair different stages of reach planning in motor cortex," Nature Communications, Nature, vol. 16(1), pages 1-15, December.
    19. Elyse H Norton & Luigi Acerbi & Wei Ji Ma & Michael S Landy, 2019. "Human online adaptation to changes in prior probability," PLOS Computational Biology, Public Library of Science, vol. 15(7), pages 1-26, July.
    20. Edward J A Turnham & Daniel A Braun & Daniel M Wolpert, 2011. "Inferring Visuomotor Priors for Sensorimotor Learning," PLOS Computational Biology, Public Library of Science, vol. 7(3), pages 1-13, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-58797-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.