IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-46246-3.html
   My bibliography  Save this article

Cross-layer transmission realized by light-emitting memristor for constructing ultra-deep neural network with transfer learning ability

Author

Listed:
  • Zhenjia Chen

    (Fuzhou University
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China)

  • Zhenyuan Lin

    (Fuzhou University
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China)

  • Ji Yang

    (Fuzhou University)

  • Cong Chen

    (Fuzhou University
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China)

  • Di Liu

    (Fuzhou University
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China)

  • Liuting Shan

    (Fuzhou University
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China)

  • Yuanyuan Hu

    (Hunan University)

  • Tailiang Guo

    (Fuzhou University
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China)

  • Huipeng Chen

    (Fuzhou University
    Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China)

Abstract

Deep neural networks have revolutionized several domains, including autonomous driving, cancer detection, and drug design, and are the foundation for massive artificial intelligence models. However, hardware neural network reports still mainly focus on shallow networks (2 to 5 layers). Implementing deep neural networks in hardware is challenging due to the layer-by-layer structure, resulting in long training times, signal interference, and low accuracy due to gradient explosion/vanishing. Here, we utilize negative ultraviolet photoconductive light-emitting memristors with intrinsic parallelism and hardware-software co-design to achieve electrical information’s optical cross-layer transmission. We propose a hybrid ultra-deep photoelectric neural network and an ultra-deep super-resolution reconstruction neural network using light-emitting memristors and cross-layer block, expanding the networks to 54 and 135 layers, respectively. Further, two networks enable transfer learning, approaching or surpassing software-designed networks in multi-dataset recognition and high-resolution restoration tasks. These proposed strategies show great potential for high-precision multifunctional hardware neural networks and edge artificial intelligence.

Suggested Citation

  • Zhenjia Chen & Zhenyuan Lin & Ji Yang & Cong Chen & Di Liu & Liuting Shan & Yuanyuan Hu & Tailiang Guo & Huipeng Chen, 2024. "Cross-layer transmission realized by light-emitting memristor for constructing ultra-deep neural network with transfer learning ability," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46246-3
    DOI: 10.1038/s41467-024-46246-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-46246-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-46246-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Karan Singhal & Shekoofeh Azizi & Tao Tu & S. Sara Mahdavi & Jason Wei & Hyung Won Chung & Nathan Scales & Ajay Tanwani & Heather Cole-Lewis & Stephen Pfohl & Perry Payne & Martin Seneviratne & Paul G, 2023. "Publisher Correction: Large language models encode clinical knowledge," Nature, Nature, vol. 620(7973), pages 19-19, August.
    2. Yitong Chen & Maimaiti Nazhamaiti & Han Xu & Yao Meng & Tiankuang Zhou & Guangpu Li & Jingtao Fan & Qi Wei & Jiamin Wu & Fei Qiao & Lu Fang & Qionghai Dai, 2023. "All-analog photoelectronic chip for high-speed vision tasks," Nature, Nature, vol. 623(7985), pages 48-57, November.
    3. Kaifeng Bi & Lingxi Xie & Hengheng Zhang & Xin Chen & Xiaotao Gu & Qi Tian, 2023. "Accurate medium-range global weather forecasting with 3D neural networks," Nature, Nature, vol. 619(7970), pages 533-538, July.
    4. Kaushik Roy & Akhilesh Jaiswal & Priyadarshini Panda, 2019. "Towards spike-based machine intelligence with neuromorphic computing," Nature, Nature, vol. 575(7784), pages 607-617, November.
    5. Hanchuan Peng & Peng Xie & Lijuan Liu & Xiuli Kuang & Yimin Wang & Lei Qu & Hui Gong & Shengdian Jiang & Anan Li & Zongcai Ruan & Liya Ding & Zizhen Yao & Chao Chen & Mengya Chen & Tanya L. Daigle & R, 2021. "Morphological diversity of single neurons in molecularly defined cell types," Nature, Nature, vol. 598(7879), pages 174-181, October.
    6. Rong Chen & Xiao Tang & Yuxuan Zhao & Zeyu Shen & Meng Zhang & Yusheng Shen & Tiantian Li & Casper Ho Yin Chung & Lijuan Zhang & Ji Wang & Binbin Cui & Peng Fei & Yusong Guo & Shengwang Du & Shuhuai Y, 2023. "Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    7. P. Baldi & P. Sadowski & D. Whiteson, 2014. "Searching for exotic particles in high-energy physics with deep learning," Nature Communications, Nature, vol. 5(1), pages 1-9, September.
    8. Liuting Shan & Qizhen Chen & Rengjian Yu & Changsong Gao & Lujian Liu & Tailiang Guo & Huipeng Chen, 2023. "A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    9. Karan Singhal & Shekoofeh Azizi & Tao Tu & S. Sara Mahdavi & Jason Wei & Hyung Won Chung & Nathan Scales & Ajay Tanwani & Heather Cole-Lewis & Stephen Pfohl & Perry Payne & Martin Seneviratne & Paul G, 2023. "Large language models encode clinical knowledge," Nature, Nature, vol. 620(7972), pages 172-180, August.
    10. Peng Yao & Huaqiang Wu & Bin Gao & Jianshi Tang & Qingtian Zhang & Wenqiang Zhang & J. Joshua Yang & He Qian, 2020. "Fully hardware-implemented memristor convolutional neural network," Nature, Nature, vol. 577(7792), pages 641-646, January.
    11. Kaifeng Bi & Lingxi Xie & Hengheng Zhang & Xin Chen & Xiaotao Gu & Qi Tian, 2023. "Author Correction: Accurate medium-range global weather forecasting with 3D neural networks," Nature, Nature, vol. 621(7980), pages 45-45, September.
    12. Smriti Chawla & Anja Rockstroh & Melanie Lehman & Ellca Ratther & Atishay Jain & Anuneet Anand & Apoorva Gupta & Namrata Bhattacharya & Sarita Poonia & Priyadarshini Rai & Nirjhar Das & Angshul Majumd, 2022. "Gene expression based inference of cancer drug sensitivity," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    13. Chenhao Wang & Xinyi Xu & Xiaodong Pi & Mark D. Butala & Wen Huang & Lei Yin & Wenbing Peng & Munir Ali & Srikrishna Chanakya Bodepudi & Xvsheng Qiao & Yang Xu & Wei Sun & Deren Yang, 2022. "Neuromorphic device based on silicon nanosheets," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fabian Dvorak & Regina Stumpf & Sebastian Fehrler & Urs Fischbacher, 2024. "Generative AI Triggers Welfare-Reducing Decisions in Humans," Papers 2401.12773, arXiv.org.
    2. Ruomin Zhu & Sam Lilak & Alon Loeffler & Joseph Lizier & Adam Stieg & James Gimzewski & Zdenka Kuncic, 2023. "Online dynamical learning and sequence memory with neuromorphic nanowire networks," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    3. Chenhao Wang & Xinyi Xu & Xiaodong Pi & Mark D. Butala & Wen Huang & Lei Yin & Wenbing Peng & Munir Ali & Srikrishna Chanakya Bodepudi & Xvsheng Qiao & Yang Xu & Wei Sun & Deren Yang, 2022. "Neuromorphic device based on silicon nanosheets," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    4. Soroosh Tayebi Arasteh & Tianyu Han & Mahshad Lotfinia & Christiane Kuhl & Jakob Nikolas Kather & Daniel Truhn & Sven Nebelung, 2024. "Large language models streamline automated machine learning for clinical studies," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    5. Huijun Zhang & Mingjie Zhang & Ran Yi & Yaxin Liu & Qiuzi Han Wen & Xin Meng, 2024. "Growing Importance of Micro-Meteorology in the New Power System: Review, Analysis and Case Study," Energies, MDPI, vol. 17(6), pages 1-33, March.
    6. Mattia Cavaiola & Federico Cassola & Davide Sacchetti & Francesco Ferrari & Andrea Mazzino, 2024. "Hybrid AI-enhanced lightning flash prediction in the medium-range forecast horizon," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    7. Min, Fuhong & Zhang, Wen & Ji, Ziyi & Zhang, Lei, 2021. "Switching dynamics of a non-autonomous FitzHugh-Nagumo circuit with piecewise-linear flux-controlled memristor," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).
    8. Peng Chen & Fenghao Liu & Peng Lin & Peihong Li & Yu Xiao & Bihua Zhang & Gang Pan, 2023. "Open-loop analog programmable electrochemical memory array," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    9. Djohan Bonnet & Tifenn Hirtzlin & Atreya Majumdar & Thomas Dalgaty & Eduardo Esmanhotto & Valentina Meli & Niccolo Castellani & Simon Martin & Jean-François Nodin & Guillaume Bourgeois & Jean-Michel P, 2023. "Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    10. Yulin Feng & Yizhou Zhang & Zheng Zhou & Peng Huang & Lifeng Liu & Xiaoyan Liu & Jinfeng Kang, 2024. "Memristor-based storage system with convolutional autoencoder-based image compression network," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    11. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    12. Ying Zhang & Ge-Qi Mao & Xiaolong Zhao & Yu Li & Meiyun Zhang & Zuheng Wu & Wei Wu & Huajun Sun & Yizhong Guo & Lihua Wang & Xumeng Zhang & Qi Liu & Hangbing Lv & Kan-Hao Xue & Guangwei Xu & Xiangshui, 2021. "Evolution of the conductive filament system in HfO2-based memristors observed by direct atomic-scale imaging," Nature Communications, Nature, vol. 12(1), pages 1-10, December.
    13. Choi, Woo Sik & Jang, Jun Tae & Kim, Donguk & Yang, Tae Jun & Kim, Changwook & Kim, Hyungjin & Kim, Dae Hwan, 2022. "Influence of Al2O3 layer on InGaZnO memristor crossbar array for neuromorphic applications," Chaos, Solitons & Fractals, Elsevier, vol. 156(C).
    14. Yueyang Jia & Qianqian Yang & Yue-Wen Fang & Yue Lu & Maosong Xie & Jianyong Wei & Jianjun Tian & Linxing Zhang & Rui Yang, 2024. "Giant tunnelling electroresistance in atomic-scale ferroelectric tunnel junctions," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    15. Xingan Jiang & Xueyun Wang & Xiaolei Wang & Xiangping Zhang & Ruirui Niu & Jianming Deng & Sheng Xu & Yingzhuo Lun & Yanyu Liu & Tianlong Xia & Jianming Lu & Jiawang Hong, 2022. "Manipulation of current rectification in van der Waals ferroionic CuInP2S6," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    16. Da Liu & Ming Xu & Dongxiao Niu & Shoukai Wang & Sai Liang, 2016. "Forecast Modelling via Variations in Binary Image-Encoded Information Exploited by Deep Learning Neural Networks," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-9, June.
    17. Alsuwian, Turki & Kousar, Farhana & Rasheed, Umbreen & Imran, Muhammad & Hussain, Fayyaz & Arif Khalil, R.M. & Algadi, Hassan & Batool, Najaf & Khera, Ejaz Ahmad & Kiran, Saira & Ashiq, Muhammad Naeem, 2021. "First principles investigation of physically conductive bridge filament formation of aluminum doped perovskite materials for neuromorphic memristive applications," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    18. Dong Gue Roe & Dong Hae Ho & Yoon Young Choi & Young Jin Choi & Seongchan Kim & Sae Byeok Jo & Moon Sung Kang & Jong-Hyun Ahn & Jeong Ho Cho, 2023. "Humanlike spontaneous motion coordination of robotic fingers through spatial multi-input spike signal multiplexing," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    19. Ruibin Mao & Bo Wen & Arman Kazemi & Yahui Zhao & Ann Franchesca Laguna & Rui Lin & Ngai Wong & Michael Niemier & X. Sharon Hu & Xia Sheng & Catherine E. Graves & John Paul Strachan & Can Li, 2022. "Experimentally validated memristive memory augmented neural network with efficient hashing and similarity search," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    20. Wang, Jun & Cao, Junxing & Fu, Jingcheng & Xu, Hanqing, 2022. "Missing well logs prediction using deep learning integrated neural network with the self-attention mechanism," Energy, Elsevier, vol. 261(PB).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46246-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.