IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-36935-w.html
   My bibliography  Save this article

Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement

Author

Listed:
  • Chengpeng Jiang

    (Nankai University
    Shenzhen Research Institute of Nankai University
    Zhejiang Lab)

  • Jiaqi Liu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Yao Ni

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Shangda Qu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Lu Liu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Yue Li

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Lu Yang

    (Nankai University
    Shenzhen Research Institute of Nankai University)

  • Wentao Xu

    (Nankai University
    Shenzhen Research Institute of Nankai University)

Abstract

Perceptual enhancement of neural and behavioral response due to combinations of multisensory stimuli are found in many animal species across different sensory modalities. By mimicking the multisensory integration of ocular-vestibular cues for enhanced spatial perception in macaques, a bioinspired motion-cognition nerve based on a flexible multisensory neuromorphic device is demonstrated. A fast, scalable and solution-processed fabrication strategy is developed to prepare a nanoparticle-doped two-dimensional (2D)-nanoflake thin film, exhibiting superior electrostatic gating capability and charge-carrier mobility. The multi-input neuromorphic device fabricated using this thin film shows history-dependent plasticity, stable linear modulation, and spatiotemporal integration capability. These characteristics ensure parallel, efficient processing of bimodal motion signals encoded as spikes and assigned with different perceptual weights. Motion-cognition function is realized by classifying the motion types using mean firing rates of encoded spikes and postsynaptic current of the device. Demonstrations of recognition of human activity types and drone flight modes reveal that the motion-cognition performance match the bio-plausible principles of perceptual enhancement by multisensory integration. Our system can be potentially applied in sensory robotics and smart wearables.

Suggested Citation

  • Chengpeng Jiang & Jiaqi Liu & Yao Ni & Shangda Qu & Lu Liu & Yue Li & Lu Yang & Wentao Xu, 2023. "Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-36935-w
    DOI: 10.1038/s41467-023-36935-w
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-36935-w
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-023-36935-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zhaoyang Lin & Yuan Liu & Udayabagya Halim & Mengning Ding & Yuanyue Liu & Yiliu Wang & Chuancheng Jia & Peng Chen & Xidong Duan & Chen Wang & Frank Song & Mufan Li & Chengzhang Wan & Yu Huang & Xiang, 2018. "Solution-processable 2D semiconductors for high-performance large-area electronics," Nature, Nature, vol. 562(7726), pages 254-258, October.
    2. Xudong Ji & Bryan D. Paulsen & Gary K. K. Chik & Ruiheng Wu & Yuyang Yin & Paddy K. L. Chan & Jonathan Rivnay, 2021. "Mimicking associative learning using an ion-trapping non-volatile synaptic organic electrochemical transistor," Nature Communications, Nature, vol. 12(1), pages 1-12, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pengzhan Li & Mingzhen Zhang & Qingli Zhou & Qinghua Zhang & Donggang Xie & Ge Li & Zhuohui Liu & Zheng Wang & Erjia Guo & Meng He & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2024. "Reconfigurable optoelectronic transistors for multimodal recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    2. Chengpeng Jiang & Honghuan Xu & Lu Yang & Jiaqi Liu & Yue Li & Kuniharu Takei & Wentao Xu, 2024. "Neuromorphic antennal sensory system," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    3. Shangda Qu & Lin Sun & Song Zhang & Jiaqi Liu & Yue Li & Junchi Liu & Wentao Xu, 2023. "An artificially-intelligent cornea with tactile sensation enables sensory expansion and interaction," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    4. Muhtasim Ul Karim Sadaf & Najam U Sakib & Andrew Pannone & Harikrishnan Ravichandran & Saptarshi Das, 2023. "A bio-inspired visuotactile neuron for multisensory integration," Nature Communications, Nature, vol. 14(1), pages 1-12, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ao Liu & Huihui Zhu & Taoyu Zou & Youjin Reo & Gi-Seong Ryu & Yong-Young Noh, 2022. "Evaporated nanometer chalcogenide films for scalable high-performance complementary electronics," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    2. Yongxi Ou & Wilson Yanez & Run Xiao & Max Stanley & Supriya Ghosh & Boyang Zheng & Wei Jiang & Yu-Sheng Huang & Timothy Pillsbury & Anthony Richardella & Chaoxing Liu & Tony Low & Vincent H. Crespi & , 2022. "ZrTe2/CrTe2: an epitaxial van der Waals platform for spintronics," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    3. Padinhare Cholakkal Harikesh & Chi-Yuan Yang & Deyu Tu & Jennifer Y. Gerasimov & Abdul Manan Dar & Adam Armada-Moreira & Matteo Massetti & Renee Kroon & David Bliman & Roger Olsson & Eleni Stavrinidou, 2022. "Organic electrochemical neurons and synapses with ion mediated spiking," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    4. Peiyun Li & Junwei Shi & Yuqiu Lei & Zhen Huang & Ting Lei, 2022. "Switching p-type to high-performance n-type organic electrochemical transistors via doped state engineering," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    5. Ji Hwan Kim & Roman Halaksa & Il-Young Jo & Hyungju Ahn & Peter A. Gilhooly-Finn & Inho Lee & Sungjun Park & Christian B. Nielsen & Myung-Han Yoon, 2023. "Peculiar transient behaviors of organic electrochemical transistors governed by ion injection directionality," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    6. Dehui Zhang & Dong Xu & Yuhang Li & Yi Luo & Jingtian Hu & Jingxuan Zhou & Yucheng Zhang & Boxuan Zhou & Peiqi Wang & Xurong Li & Bijie Bai & Huaying Ren & Laiyuan Wang & Ao Zhang & Mona Jarrahi & Yu , 2024. "Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    7. Xudong Ji & Xuanyi Lin & Jonathan Rivnay, 2023. "Organic electrochemical transistors as on-site signal amplifiers for electrochemical aptamer-based sensing," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    8. Cian Gabbett & Luke Doolan & Kevin Synnatschke & Laura Gambini & Emmet Coleman & Adam G. Kelly & Shixin Liu & Eoin Caffrey & Jose Munuera & Catriona Murphy & Stefano Sanvito & Lewys Jones & Jonathan N, 2024. "Quantitative analysis of printed nanostructured networks using high-resolution 3D FIB-SEM nanotomography," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    9. Pei-Yu Huang & Bi-Yi Jiang & Hong-Ji Chen & Jia-Yi Xu & Kang Wang & Cheng-Yi Zhu & Xin-Yan Hu & Dong Li & Liang Zhen & Fei-Chi Zhou & Jing-Kai Qin & Cheng-Yan Xu, 2023. "Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    10. Xiaosong Wu & Shaocong Wang & Wei Huang & Yu Dong & Zhongrui Wang & Weiguo Huang, 2023. "Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    11. Omnia Samy & Amine El Moutaouakil, 2021. "A Review on MoS 2 Energy Applications: Recent Developments and Challenges," Energies, MDPI, vol. 14(15), pages 1-20, July.
    12. Pengzhan Li & Mingzhen Zhang & Qingli Zhou & Qinghua Zhang & Donggang Xie & Ge Li & Zhuohui Liu & Zheng Wang & Erjia Guo & Meng He & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2024. "Reconfigurable optoelectronic transistors for multimodal recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    13. Matteo Cucchi & Anton Weissbach & Lukas M. Bongartz & Richard Kantelberg & Hsin Tseng & Hans Kleemann & Karl Leo, 2022. "Thermodynamics of organic electrochemical transistors," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    14. Yang Gao & Yuchen Zhou & Xudong Ji & Austin J. Graham & Christopher M. Dundas & Ismar E. Miniel Mahfoud & Bailey M. Tibbett & Benjamin Tan & Gina Partipilo & Ananth Dodabalapur & Jonathan Rivnay & Ben, 2024. "A hybrid transistor with transcriptionally controlled computation and plasticity," Nature Communications, Nature, vol. 15(1), pages 1-13, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-36935-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.