IDEAS home Printed from https://ideas.repec.org/a/abq/fcsi11/v1y2023i1p10-17.html
   My bibliography  Save this article

A Computational Model of Flexible Maze Navigation Through Hippocampal Replay: Bridging Neuroscience and AI

Author

Listed:
  • Amjad Khan

    (Department of Computer Science, Punjab University, Lahore)

Abstract

The hippocampus is widely recognized for its role in spatial memory and navigation, particularly through the phenomenon of neural replay. This study proposes a computational model that simulates hippocampal replay to support flexible navigation in dynamic maze environments. By integrating biologically inspired replay mechanisms with a reinforcement learning framework, the model was tested in three types of mazes—linear, Y-shaped, and open-field. The replay-based model significantly outperformed traditional models like DQN and A3C in success rate, path efficiency, and learning speed. The results underscore the importance of temporal sequence replay in forming goal-directed trajectories and adapting to changing environments. Comparisons with neuroscientific literature confirm the plausibility of the model, aligning with empirical findings on the predictive and retrospective roles of hippocampal replay in animal studies. This work offers a novel computational perspective on cognitive mapping and sets the foundation for developing more adaptive and human-like AI navigation systems.

Suggested Citation

  • Amjad Khan, 2023. "A Computational Model of Flexible Maze Navigation Through Hippocampal Replay: Bridging Neuroscience and AI," Frontiers in Computational Spatial Intelligence, 50sea, vol. 1(1), pages 10-17, July.
    • Handle: RePEc:abq:fcsi11:v:1:y:2023:i:1:p:10-17
    as

    Download full text from publisher

    File URL: https://journal.xdgen.com/index.php/FCSI/article/view/293/360
    Download Restriction: no
    File URL: https://journal.xdgen.com/index.php/FCSI/article/view/293
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yun-Cheng Tsai & Chun-Chieh Wang, 2019. "Deep Reinforcement Learning for Foreign Exchange Trading," Papers 1908.08036, arXiv.org, revised Jun 2020.
    2. Thibaut Th'eate & Damien Ernst, 2020. "An Application of Deep Reinforcement Learning to Algorithmic Trading," Papers 2004.06627, arXiv.org, revised Oct 2020.
    3. Stefano Recanatesi & Matthew Farrell & Guillaume Lajoie & Sophie Deneve & Mattia Rigotti & Eric Shea-Brown, 2021. "Predictive learning as a network mechanism for extracting low-dimensional latent space representations," Nature Communications, Nature, vol. 12(1), pages 1-13, December.
    4. Andrea Banino & Caswell Barry & Benigno Uria & Charles Blundell & Timothy Lillicrap & Piotr Mirowski & Alexander Pritzel & Martin J. Chadwick & Thomas Degris & Joseph Modayil & Greg Wayne & Hubert Soy, 2018. "Vector-based navigation using grid-like representations in artificial agents," Nature, Nature, vol. 557(7705), pages 429-433, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eric Benhamou & David Saltiel & Sandrine Ungari & Abhishek Mukhopadhyay & Jamal Atif, 2020. "AAMDRL: Augmented Asset Management with Deep Reinforcement Learning," Papers 2010.08497, arXiv.org.
    2. Fatima Batool, 2023. "Bridging Neuroscience and AI: A Grid-Cell-Inspired Deep Learning Model for Spatial Navigation," Frontiers in Computational Spatial Intelligence, 50sea, vol. 1(1), pages 1-9, June.
    3. Thibaut Th'eate & S'ebastien Mathieu & Damien Ernst, 2020. "An Artificial Intelligence Solution for Electricity Procurement in Forward Markets," Papers 2006.05784, arXiv.org, revised Dec 2020.
    4. Kumar, S. Senthil & Srinivasan, C. & Balavignesh, S., 2025. "Enhancing grid integration of renewable energy sources for micro grid stability using forecasting and optimal dispatch strategies," Energy, Elsevier, vol. 322(C).
    5. Thibaut Théate & Sébastien Mathieu & Damien Ernst, 2020. "An Artificial Intelligence Solution for Electricity Procurement in Forward Markets," Energies, MDPI, vol. 13(23), pages 1-17, December.
    6. W. Jeffrey Johnston & Stefano Fusi, 2023. "Abstract representations emerge naturally in neural networks trained to perform multiple tasks," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    7. Eric Benhamou & David Saltiel & Sandrine Ungari & Abhishek Mukhopadhyay, 2020. "Bridging the gap between Markowitz planning and deep reinforcement learning," Papers 2010.09108, arXiv.org.
    8. Antonio Briola & Jeremy Turiel & Riccardo Marcaccioli & Alvaro Cauderan & Tomaso Aste, 2021. "Deep Reinforcement Learning for Active High Frequency Trading," Papers 2101.07107, arXiv.org, revised Aug 2023.
    9. Peng Chen & Dongyun Yi & Chengli Zhao, 2020. "Trading Strategy for Market Situation Estimation Based on Hidden Markov Model," Mathematics, MDPI, vol. 8(7), pages 1-13, July.
    10. Tatiana de Macedo Nogueira Lima, 2022. "Documento de Trabalho 03/2022 - Aprendizado de máquina e antitruste," Documentos de Trabalho 2022030, Conselho Administrativo de Defesa Econômica (Cade), Departamento de Estudos Econômicos.
    11. Michał Dominik Stasiak, 2020. "Candlestick—The Main Mistake of Economy Research in High Frequency Markets," IJFS, MDPI, vol. 8(4), pages 1-15, October.
    12. David A. Sabatini & Matthew T. Kaufman, 2024. "Reach-dependent reorientation of rotational dynamics in motor cortex," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    13. Eva Andrés & Manuel Pegalajar Cuéllar & Gabriel Navarro, 2024. "Brain-Inspired Agents for Quantum Reinforcement Learning," Mathematics, MDPI, vol. 12(8), pages 1-26, April.
    14. Nikolay Didenko & Djamilia Skripnuk & Sergey Barykin & Vladimir Yadykin & Oksana Nikiforova & Angela B. Mottaeva & Valentina Kashintseva & Mark Khaikin & Elmira Nazarova & Ivan Moshkin, 2024. "Impact of Carbon Emission Factors on Economic Agents Based on the Decision Modeling in Complex Systems," Sustainability, MDPI, vol. 16(10), pages 1-14, May.
    15. Vemund Sigmundson Schøyen & Kosio Beshkov & Markus Borud Pettersen & Erik Hermansen & Konstantin Holzhausen & Anders Malthe-Sørenssen & Marianne Fyhn & Mikkel Elle Lepperød, 2025. "Hexagons all the way down: grid cells as a conformal isometric map of space," PLOS Computational Biology, Public Library of Science, vol. 21(2), pages 1-26, February.
    16. An, Li & Grimm, Volker & Sullivan, Abigail & Turner II, B.L. & Malleson, Nicolas & Heppenstall, Alison & Vincenot, Christian & Robinson, Derek & Ye, Xinyue & Liu, Jianguo & Lindkvist, Emilie & Tang, W, 2021. "Challenges, tasks, and opportunities in modeling agent-based complex systems," Ecological Modelling, Elsevier, vol. 457(C).
    17. Toon Van de Maele & Bart Dhoedt & Tim Verbelen & Giovanni Pezzulo, 2024. "A hierarchical active inference model of spatial alternation tasks and the hippocampal-prefrontal circuit," Nature Communications, Nature, vol. 15(1), pages 1-16, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:abq:fcsi11:v:1:y:2023:i:1:p:10-17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dr. Shehzad Hassan (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.