IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-36205-9.html
   My bibliography  Save this article

Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning

Author

Listed:
  • Xiaosong Wu

    (Chinese Academy of Sciences)

  • Shaocong Wang

    (University of Hong Kong)

  • Wei Huang

    (Chinese Academy of Sciences)

  • Yu Dong

    (Chinese Academy of Sciences)

  • Zhongrui Wang

    (University of Hong Kong)

  • Weiguo Huang

    (Chinese Academy of Sciences
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China
    University of Chinese Academy of Sciences)

Abstract

In-sensor multi-task learning is not only the key merit of biological visions but also a primary goal of artificial-general-intelligence. However, traditional silicon-vision-chips suffer from large time/energy overheads. Further, training conventional deep-learning models is neither scalable nor affordable on edge-devices. Here, a material-algorithm co-design is proposed to emulate human retina and the affordable learning paradigm. Relying on a bottle-brush-shaped semiconducting p-NDI with efficient exciton-dissociations and through-space charge-transport characteristics, a wearable transistor-based dynamic in-sensor Reservoir-Computing system manifesting excellent separability, fading memory, and echo state property on different tasks is developed. Paired with a ‘readout function’ on memristive organic diodes, the RC recognizes handwritten letters and numbers, and classifies diverse costumes with accuracies of 98.04%, 88.18%, and 91.76%, respectively (higher than all reported organic semiconductors). In addition to 2D images, the spatiotemporal dynamics of RC naturally extract features of event-based videos, classifying 3 types of hand gestures at an accuracy of 98.62%. Further, the computing cost is significantly lower than that of the conventional artificial-neural-networks. This work provides a promising material-algorithm co-design for affordable and highly efficient photonic neuromorphic systems.

Suggested Citation

  • Xiaosong Wu & Shaocong Wang & Wei Huang & Yu Dong & Zhongrui Wang & Weiguo Huang, 2023. "Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-36205-9
    DOI: 10.1038/s41467-023-36205-9
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-36205-9
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-36205-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Chao Du & Fuxi Cai & Mohammed A. Zidan & Wen Ma & Seung Hwan Lee & Wei D. Lu, 2017. "Reservoir computing using dynamic memristors for temporal information processing," Nature Communications, Nature, vol. 8(1), pages 1-10, December.
    2. Ming-Yang Li & Sheng-Kai Su & H.-S. Philip Wong & Lain-Jong Li, 2019. "How 2D semiconductors could extend Moore’s law," Nature, Nature, vol. 567(7747), pages 169-170, March.
    3. Padinhare Cholakkal Harikesh & Chi-Yuan Yang & Deyu Tu & Jennifer Y. Gerasimov & Abdul Manan Dar & Adam Armada-Moreira & Matteo Massetti & Renee Kroon & David Bliman & Roger Olsson & Eleni Stavrinidou, 2022. "Organic electrochemical neurons and synapses with ion mediated spiking," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    4. Zhongrui Wang & Mingyi Rao & Jin-Woo Han & Jiaming Zhang & Peng Lin & Yunning Li & Can Li & Wenhao Song & Shiva Asapu & Rivu Midya & Ye Zhuo & Hao Jiang & Jung Ho Yoon & Navnidhi Kumar Upadhyay & Saum, 2018. "Capacitive neural network with neuro-transistors," Nature Communications, Nature, vol. 9(1), pages 1-10, December.
    5. Xudong Ji & Bryan D. Paulsen & Gary K. K. Chik & Ruiheng Wu & Yuyang Yin & Paddy K. L. Chan & Jonathan Rivnay, 2021. "Mimicking associative learning using an ion-trapping non-volatile synaptic organic electrochemical transistor," Nature Communications, Nature, vol. 12(1), pages 1-12, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pengzhan Li & Mingzhen Zhang & Qingli Zhou & Qinghua Zhang & Donggang Xie & Ge Li & Zhuohui Liu & Zheng Wang & Erjia Guo & Meng He & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2024. "Reconfigurable optoelectronic transistors for multimodal recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    2. Changsong Gao & Di Liu & Chenhui Xu & Weidong Xie & Xianghong Zhang & Junhua Bai & Zhixian Lin & Cheng Zhang & Yuanyuan Hu & Tailiang Guo & Huipeng Chen, 2024. "Toward grouped-reservoir computing: organic neuromorphic vertical transistor with distributed reservoir states for efficient recognition and prediction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pengzhan Li & Mingzhen Zhang & Qingli Zhou & Qinghua Zhang & Donggang Xie & Ge Li & Zhuohui Liu & Zheng Wang & Erjia Guo & Meng He & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2024. "Reconfigurable optoelectronic transistors for multimodal recognition," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    2. Zhiwei Chen & Wenjie Li & Zhen Fan & Shuai Dong & Yihong Chen & Minghui Qin & Min Zeng & Xubing Lu & Guofu Zhou & Xingsen Gao & Jun-Ming Liu, 2023. "All-ferroelectric implementation of reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    3. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    4. Jongmin Lee & Bum Ho Jeong & Eswaran Kamaraj & Dohyung Kim & Hakjun Kim & Sanghyuk Park & Hui Joon Park, 2023. "Light-enhanced molecular polarity enabling multispectral color-cognitive memristor for neuromorphic visual system," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    5. Ui Yeon Won & Quoc An Vu & Sung Bum Park & Mi Hyang Park & Van Dam Do & Hyun Jun Park & Heejun Yang & Young Hee Lee & Woo Jong Yu, 2023. "Multi-neuron connection using multi-terminal floating–gate memristor for unsupervised learning," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    6. Yanfei Zhao & Mukesh Tripathi & Kristiāns Čerņevičs & Ahmet Avsar & Hyun Goo Ji & Juan Francisco Gonzalez Marin & Cheol-Yeon Cheon & Zhenyu Wang & Oleg V. Yazyev & Andras Kis, 2023. "Electrical spectroscopy of defect states and their hybridization in monolayer MoS2," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    7. Lu Li & Qinqin Wang & Fanfan Wu & Qiaoling Xu & Jinpeng Tian & Zhiheng Huang & Qinghe Wang & Xuan Zhao & Qinghua Zhang & Qinkai Fan & Xiuzhen Li & Yalin Peng & Yangkun Zhang & Kunshan Ji & Aomiao Zhi , 2024. "Epitaxy of wafer-scale single-crystal MoS2 monolayer via buffer layer control," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    8. Yang, J. & Primo, E. & Aleja, D. & Criado, R. & Boccaletti, S. & Alfaro-Bittner, K., 2022. "Implementing and morphing Boolean gates with adaptive synchronization: The case of spiking neurons," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    9. Giovanni Maria Matrone & Eveline R. W. Doremaele & Abhijith Surendran & Zachary Laswick & Sophie Griggs & Gang Ye & Iain McCulloch & Francesca Santoro & Jonathan Rivnay & Yoeri Burgt, 2024. "A modular organic neuromorphic spiking circuit for retina-inspired sensory coding and neurotransmitter-mediated neural pathways," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    10. Padinhare Cholakkal Harikesh & Chi-Yuan Yang & Deyu Tu & Jennifer Y. Gerasimov & Abdul Manan Dar & Adam Armada-Moreira & Matteo Massetti & Renee Kroon & David Bliman & Roger Olsson & Eleni Stavrinidou, 2022. "Organic electrochemical neurons and synapses with ion mediated spiking," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    11. Zhuohui Liu & Qinghua Zhang & Donggang Xie & Mingzhen Zhang & Xinyan Li & Hai Zhong & Ge Li & Meng He & Dashan Shang & Can Wang & Lin Gu & Guozhen Yang & Kuijuan Jin & Chen Ge, 2023. "Interface-type tunable oxygen ion dynamics for physical reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    12. Zhongfang Zhang & Xiaolong Zhao & Xumeng Zhang & Xiaohu Hou & Xiaolan Ma & Shuangzhu Tang & Ying Zhang & Guangwei Xu & Qi Liu & Shibing Long, 2022. "In-sensor reservoir computing system for latent fingerprint recognition with deep ultraviolet photo-synapses and memristor array," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    13. Peiyun Li & Junwei Shi & Yuqiu Lei & Zhen Huang & Ting Lei, 2022. "Switching p-type to high-performance n-type organic electrochemical transistors via doped state engineering," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    14. Yi Xing & Mingjie Zhou & Yueguang Si & Chi-Yuan Yang & Liang-Wen Feng & Qilin Wu & Fei Wang & Xiaomin Wang & Wei Huang & Yuhua Cheng & Ruilin Zhang & Xiaozheng Duan & Jun Liu & Ping Song & Hengda Sun , 2023. "Integrated opposite charge grafting induced ionic-junction fiber," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    15. Jaehyun Kang & Taeyoon Kim & Suman Hu & Jaewook Kim & Joon Young Kwak & Jongkil Park & Jong Keuk Park & Inho Kim & Suyoun Lee & Sangbum Kim & YeonJoo Jeong, 2022. "Cluster-type analogue memristor by engineering redox dynamics for high-performance neuromorphic computing," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    16. Laura E. Suárez & Agoston Mihalik & Filip Milisav & Kenji Marshall & Mingze Li & Petra E. Vértes & Guillaume Lajoie & Bratislav Misic, 2024. "Connectome-based reservoir computing with the conn2res toolbox," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    17. Yiming Sun & Tao Lin & Na Lei & Xing Chen & Wang Kang & Zhiyuan Zhao & Dahai Wei & Chao Chen & Simin Pang & Linglong Hu & Liu Yang & Enxuan Dong & Li Zhao & Lei Liu & Zhe Yuan & Aladin Ullrich & Chris, 2023. "Experimental demonstration of a skyrmion-enhanced strain-mediated physical reservoir computing system," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    18. Chengpeng Jiang & Jiaqi Liu & Yao Ni & Shangda Qu & Lu Liu & Yue Li & Lu Yang & Wentao Xu, 2023. "Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    19. Tian Zhang & Xin Guo & Pan Wang & Xinyi Fan & Zichen Wang & Yan Tong & Decheng Wang & Limin Tong & Linjun Li, 2024. "High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    20. Ji Hwan Kim & Roman Halaksa & Il-Young Jo & Hyungju Ahn & Peter A. Gilhooly-Finn & Inho Lee & Sungjun Park & Christian B. Nielsen & Myung-Han Yoon, 2023. "Peculiar transient behaviors of organic electrochemical transistors governed by ion injection directionality," Nature Communications, Nature, vol. 14(1), pages 1-12, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-36205-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.