IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v157y2022ics0960077922002090.html
   My bibliography  Save this article

Effect of weight overlap region on neuromorphic system with memristive synaptic devices

Author

Listed:
  • Lee, Geun Ho
  • Kim, Tae-Hyeon
  • Song, Min Suk
  • Park, Jinwoo
  • Kim, Sungjoon
  • Hong, Kyungho
  • Kim, Yoon
  • Park, Byung-Gook
  • Kim, Hyungjin

Abstract

Recently, hardware-based neural network using memristive devices, so called neuromorphic system, has been extensively studied. Especially, on-chip (in situ) learning methods where training occurs inside hardware structure itself have been proposed and optimized based on memristor crossbar arrays regarding the linearity of weight-update characteristics. In this study, we analyze the effect of conductance overlap region of memristor on the recognition accuracy for on-chip learning simulation. The effect of conductance overlap region on recognition accuracy for modified national institute of standards and technology (MNIST) dataset is studied with an identical potentiation/depression pulse applied to Pt/Al2O3/TiOx/Ti/Pt stacked memristor. The overlap range can be varied by different pulse amplitude, and the training characteristics of memristive neural network is significantly dependent on the weight-update overlap region.

Suggested Citation

  • Lee, Geun Ho & Kim, Tae-Hyeon & Song, Min Suk & Park, Jinwoo & Kim, Sungjoon & Hong, Kyungho & Kim, Yoon & Park, Byung-Gook & Kim, Hyungjin, 2022. "Effect of weight overlap region on neuromorphic system with memristive synaptic devices," Chaos, Solitons & Fractals, Elsevier, vol. 157(C).
    • Handle: RePEc:eee:chsofr:v:157:y:2022:i:c:s0960077922002090
    DOI: 10.1016/j.chaos.2022.111999
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077922002090
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.chaos.2022.111999?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. M. Prezioso & F. Merrikh-Bayat & B. D. Hoskins & G. C. Adam & K. K. Likharev & D. B. Strukov, 2015. "Training and operation of an integrated neuromorphic network based on metal-oxide memristors," Nature, Nature, vol. 521(7550), pages 61-64, May.
    2. Fabien Alibart & Elham Zamanidoost & Dmitri B. Strukov, 2013. "Pattern classification by memristive crossbar circuits using ex situ and in situ training," Nature Communications, Nature, vol. 4(1), pages 1-7, October.
    3. F. Merrikh Bayat & M. Prezioso & B. Chakrabarti & H. Nili & I. Kataeva & D. Strukov, 2018. "Implementation of multilayer perceptron network with highly uniform passive memristive crossbar circuits," Nature Communications, Nature, vol. 9(1), pages 1-7, December.
    4. M. Prezioso & M. R. Mahmoodi & F. Merrikh Bayat & H. Nili & H. Kim & A. Vincent & D. B. Strukov, 2018. "Spike-timing-dependent plasticity learning of coincidence detection with passively integrated memristive circuits," Nature Communications, Nature, vol. 9(1), pages 1-8, December.
    5. Mikhaylov, A.N. & Guseinov, D.V. & Belov, A.I. & Korolev, D.S. & Shishmakova, V.A. & Koryazhkina, M.N. & Filatov, D.O. & Gorshkov, O.N. & Maldonado, D. & Alonso, F.J. & Roldán, J.B. & Krichigin, A.V. , 2021. "Stochastic resonance in a metal-oxide memristive device," Chaos, Solitons & Fractals, Elsevier, vol. 144(C).
    6. Surazhevsky, I.A. & Demin, V.A. & Ilyasov, A.I. & Emelyanov, A.V. & Nikiruy, K.E. & Rylkov, V.V. & Shchanikov, S.A. & Bordanov, I.A. & Gerasimova, S.A. & Guseinov, D.V. & Malekhonova, N.V. & Pavlov, D, 2021. "Noise-assisted persistence and recovery of memory state in a memristive spiking neuromorphic network," Chaos, Solitons & Fractals, Elsevier, vol. 146(C).
    7. Peng Yao & Huaqiang Wu & Bin Gao & Jianshi Tang & Qingtian Zhang & Wenqiang Zhang & J. Joshua Yang & He Qian, 2020. "Fully hardware-implemented memristor convolutional neural network," Nature, Nature, vol. 577(7792), pages 641-646, January.
    8. H. Kim & M. R. Mahmoodi & H. Nili & D. B. Strukov, 2021. "4K-memristor analog-grade passive crossbar circuit," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    9. Park, Jinwoo & Kim, Tae-Hyeon & Kim, Sungjoon & Lee, Geun Ho & Nili, Hussein & Kim, Hyungjin, 2021. "Conduction mechanism effect on physical unclonable function using Al2O3/TiOX memristors," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).
    10. Kim, Tae-Hyeon & Kim, Sungjoon & Hong, Kyungho & Park, Jinwoo & Hwang, Yeongjin & Park, Byung-Gook & Kim, Hyungjin, 2021. "Multilevel switching memristor by compliance current adjustment for off-chip training of neuromorphic system," Chaos, Solitons & Fractals, Elsevier, vol. 153(P2).
    11. Yanan Zhong & Jianshi Tang & Xinyi Li & Bin Gao & He Qian & Huaqiang Wu, 2021. "Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    12. Agudov, N.V. & Dubkov, A.A. & Safonov, A.V. & Krichigin, A.V. & Kharcheva, A.A. & Guseinov, D.V. & Koryazhkina, M.N. & Novikov, A.S. & Shishmakova, V.A. & Antonov, I.N. & Carollo, A. & Spagnolo, B., 2021. "Stochastic model of memristor based on the length of conductive region," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    13. E. L. Pankratov & B. Spagnolo, 2005. "Optimization of impurity profile for p-n-junction in heterostructures," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 46(1), pages 15-19, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lee, Geun Ho & Kim, Tae-Hyeon & Youn, Sangwook & Park, Jinwoo & Kim, Sungjoon & Kim, Hyungjin, 2023. "Low-fluctuation nonlinear model using incremental step pulse programming with memristive devices," Chaos, Solitons & Fractals, Elsevier, vol. 170(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Choi, Woo Sik & Kim, Donguk & Yang, Tae Jun & Chae, Inseok & Kim, Changwook & Kim, Hyungjin & Kim, Dae Hwan, 2022. "Electrode-dependent electrical switching characteristics of InGaZnO memristor," Chaos, Solitons & Fractals, Elsevier, vol. 158(C).
    2. Choi, Woo Sik & Jang, Jun Tae & Kim, Donguk & Yang, Tae Jun & Kim, Changwook & Kim, Hyungjin & Kim, Dae Hwan, 2022. "Influence of Al2O3 layer on InGaZnO memristor crossbar array for neuromorphic applications," Chaos, Solitons & Fractals, Elsevier, vol. 156(C).
    3. Kim, Tae-Hyeon & Kim, Sungjoon & Hong, Kyungho & Park, Jinwoo & Hwang, Yeongjin & Park, Byung-Gook & Kim, Hyungjin, 2021. "Multilevel switching memristor by compliance current adjustment for off-chip training of neuromorphic system," Chaos, Solitons & Fractals, Elsevier, vol. 153(P2).
    4. Maldonado, D. & Aguilera-Pedregosa, C. & Vinuesa, G. & García, H. & Dueñas, S. & Castán, H. & Aldana, S. & González, M.B. & Moreno, E. & Jiménez-Molinos, F. & Campabadal, F. & Roldán, J.B., 2022. "An experimental and simulation study of the role of thermal effects on variability in TiN/Ti/HfO2/W resistive switching nonlinear devices," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).
    5. Peng Chen & Fenghao Liu & Peng Lin & Peihong Li & Yu Xiao & Bihua Zhang & Gang Pan, 2023. "Open-loop analog programmable electrochemical memory array," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    6. Setoudeh, Farbod & Dezhdar, Mohammad Matin & Najafi, M., 2022. "Nonlinear analysis and chaos synchronization of a memristive-based chaotic system using adaptive control technique in noisy environments," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
    7. Filatov, D.O. & Koryazhkina, M.N. & Novikov, A.S. & Shishmakova, V.A. & Shenina, M.E. & Antonov, I.N. & Gorshkov, O.N. & Agudov, N.V. & Carollo, A. & Valenti, D. & Spagnolo, B., 2022. "Effect of internal noise on the relaxation time of an yttria stabilized zirconia-based memristor," Chaos, Solitons & Fractals, Elsevier, vol. 156(C).
    8. Taheri, Alireza Ghomi & Setoudeh, Farbod & Tavakoli, Mohammad Bagher & Feizi, Esmaeil, 2022. "Nonlinear analysis of memcapacitor-based hyperchaotic oscillator by using adaptive multi-step differential transform method," Chaos, Solitons & Fractals, Elsevier, vol. 159(C).
    9. Setoudeh, Farbod & Dousti, Massoud, 2022. "Analysis and implementation of a meminductor-based colpitts sinusoidal oscillator," Chaos, Solitons & Fractals, Elsevier, vol. 156(C).
    10. Mahata, Chandreswar & Kim, Sungjun, 2021. "Electrical and optical artificial synapses properties of TiN-nanoparticles incorporated HfAlO-alloy based memristor," Chaos, Solitons & Fractals, Elsevier, vol. 153(P1).
    11. Ryu, Hojeong & Kim, Sungjun, 2021. "Implementation of a reservoir computing system using the short-term effects of Pt/HfO2/TaOx/TiN memristors with self-rectification," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    12. Lee, Geun Ho & Kim, Tae-Hyeon & Youn, Sangwook & Park, Jinwoo & Kim, Sungjoon & Kim, Hyungjin, 2023. "Low-fluctuation nonlinear model using incremental step pulse programming with memristive devices," Chaos, Solitons & Fractals, Elsevier, vol. 170(C).
    13. Vasileiadis, Nikolaos & Loukas, Panagiotis & Karakolis, Panagiotis & Ioannou-Sougleridis, Vassilios & Normand, Pascal & Ntinas, Vasileios & Fyrigos, Iosif-Angelos & Karafyllidis, Ioannis & Sirakoulis,, 2021. "Multi-level resistance switching and random telegraph noise analysis of nitride based memristors," Chaos, Solitons & Fractals, Elsevier, vol. 153(P1).
    14. Surazhevsky, I.A. & Demin, V.A. & Ilyasov, A.I. & Emelyanov, A.V. & Nikiruy, K.E. & Rylkov, V.V. & Shchanikov, S.A. & Bordanov, I.A. & Gerasimova, S.A. & Guseinov, D.V. & Malekhonova, N.V. & Pavlov, D, 2021. "Noise-assisted persistence and recovery of memory state in a memristive spiking neuromorphic network," Chaos, Solitons & Fractals, Elsevier, vol. 146(C).
    15. Kim, Dahye & Kim, Sunghun & Kim, Sungjun, 2021. "Logic-in-memory application of CMOS compatible silicon nitride memristor," Chaos, Solitons & Fractals, Elsevier, vol. 153(P2).
    16. Wang, Yang & Li, Huanyun & Guan, Yan & Chen, Mingshu, 2022. "Predefined-time chaos synchronization of memristor chaotic systems by using simplified control inputs," Chaos, Solitons & Fractals, Elsevier, vol. 161(C).
    17. Ping, Zhu, 2023. "Analytical equivalent transformation method for nonlinear stochastic dynamics with multiple noises in high dimensions," Chaos, Solitons & Fractals, Elsevier, vol. 176(C).
    18. Djohan Bonnet & Tifenn Hirtzlin & Atreya Majumdar & Thomas Dalgaty & Eduardo Esmanhotto & Valentina Meli & Niccolo Castellani & Simon Martin & Jean-François Nodin & Guillaume Bourgeois & Jean-Michel P, 2023. "Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    19. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    20. Jin, Yanfei & Wang, Haotian & Xu, Pengfei, 2023. "Noise-induced enhancement of stability and resonance in a tri-stable system with time-delayed feedback," Chaos, Solitons & Fractals, Elsevier, vol. 168(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:157:y:2022:i:c:s0960077922002090. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.