IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-46387-5.html
   My bibliography  Save this article

Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array

Author

Listed:
  • Dehui Zhang

    (University of California)

  • Dong Xu

    (University of California)

  • Yuhang Li

    (University of California)

  • Yi Luo

    (University of California)

  • Jingtian Hu

    (University of California)

  • Jingxuan Zhou

    (University of California)

  • Yucheng Zhang

    (University of California)

  • Boxuan Zhou

    (University of California)

  • Peiqi Wang

    (University of California)

  • Xurong Li

    (University of California)

  • Bijie Bai

    (University of California)

  • Huaying Ren

    (University of California)

  • Laiyuan Wang

    (University of California)

  • Ao Zhang

    (University of California)

  • Mona Jarrahi

    (University of California
    University of California)

  • Yu Huang

    (University of California
    University of California)

  • Aydogan Ozcan

    (University of California
    University of California)

  • Xiangfeng Duan

    (University of California
    University of California)

Abstract

Nonlinear optical processing of ambient natural light is highly desired for computational imaging and sensing. Strong optical nonlinear response under weak broadband incoherent light is essential for this purpose. By merging 2D transparent phototransistors (TPTs) with liquid crystal (LC) modulators, we create an optoelectronic neuron array that allows self-amplitude modulation of spatially incoherent light, achieving a large nonlinear contrast over a broad spectrum at orders-of-magnitude lower intensity than achievable in most optical nonlinear materials. We fabricated a 10,000-pixel array of optoelectronic neurons, and experimentally demonstrated an intelligent imaging system that instantly attenuates intense glares while retaining the weaker-intensity objects captured by a cellphone camera. This intelligent glare-reduction is important for various imaging applications, including autonomous driving, machine vision, and security cameras. The rapid nonlinear processing of incoherent broadband light might also find applications in optical computing, where nonlinear activation functions for ambient light conditions are highly sought.

Suggested Citation

  • Dehui Zhang & Dong Xu & Yuhang Li & Yi Luo & Jingtian Hu & Jingxuan Zhou & Yucheng Zhang & Boxuan Zhou & Peiqi Wang & Xurong Li & Bijie Bai & Huaying Ren & Laiyuan Wang & Ao Zhang & Mona Jarrahi & Yu , 2024. "Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46387-5
    DOI: 10.1038/s41467-024-46387-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-46387-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-46387-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zhaoyang Lin & Yuan Liu & Udayabagya Halim & Mengning Ding & Yuanyue Liu & Yiliu Wang & Chuancheng Jia & Peng Chen & Xidong Duan & Chen Wang & Frank Song & Mufan Li & Chengzhang Wan & Yu Huang & Xiang, 2018. "Solution-processable 2D semiconductors for high-performance large-area electronics," Nature, Nature, vol. 562(7726), pages 254-258, October.
    2. Lukas Mennel & Joanna Symonowicz & Stefan Wachter & Dmitry K. Polyushkin & Aday J. Molina-Mendoza & Thomas Mueller, 2020. "Ultrafast machine vision with 2D material neural network image sensors," Nature, Nature, vol. 579(7797), pages 62-66, March.
    3. Dehui Zhang & Zhen Xu & Zhengyu Huang & Audrey Rose Gutierrez & Cameron J. Blocker & Che-Hung Liu & Miao-Bin Lien & Gong Cheng & Zhe Liu & Il Yong Chun & Jeffrey A. Fessler & Zhaohui Zhong & Theodore , 2021. "Neural network based 3D tracking with a graphene transparent focal stack imaging system," Nature Communications, Nature, vol. 12(1), pages 1-7, December.
    4. Zhuochao Wang & Guangwei Hu & Xinwei Wang & Xumin Ding & Kuang Zhang & Haoyu Li & Shah Nawaz Burokur & Qun Wu & Jian Liu & Jiubin Tan & Cheng-Wei Qiu, 2022. "Single-layer spatial analog meta-processor for imaging processing," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ao Liu & Huihui Zhu & Taoyu Zou & Youjin Reo & Gi-Seong Ryu & Yong-Young Noh, 2022. "Evaporated nanometer chalcogenide films for scalable high-performance complementary electronics," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    2. Dehui Zhang & Zhen Xu & Gong Cheng & Zhe Liu & Audrey Rose Gutierrez & Wenzhe Zang & Theodore B. Norris & Zhaohui Zhong, 2022. "Strongly enhanced THz generation enabled by a graphene hot-carrier fast lane," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    3. Yongxi Ou & Wilson Yanez & Run Xiao & Max Stanley & Supriya Ghosh & Boyang Zheng & Wei Jiang & Yu-Sheng Huang & Timothy Pillsbury & Anthony Richardella & Chaoxing Liu & Tony Low & Vincent H. Crespi & , 2022. "ZrTe2/CrTe2: an epitaxial van der Waals platform for spintronics," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    4. Yurou Jia & Suying Zhang & Xuan Zhang & Houyou Long & Caibin Xu & Yechao Bai & Ying Cheng & Dajian Wu & Mingxi Deng & Cheng-Wei Qiu & Xiaojun Liu, 2024. "Compact meta-differentiator for achieving isotropically high-contrast ultrasonic imaging," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    5. Xinyu Chen & Yufeng Xie & Yaochen Sheng & Hongwei Tang & Zeming Wang & Yu Wang & Yin Wang & Fuyou Liao & Jingyi Ma & Xiaojiao Guo & Ling Tong & Hanqi Liu & Hao Liu & Tianxiang Wu & Jiaxin Cao & Sitong, 2021. "Wafer-scale functional circuits based on two dimensional semiconductors with fabrication optimized by machine learning," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    6. Xingchen Pang & Yang Wang & Yuyan Zhu & Zhenhan Zhang & Du Xiang & Xun Ge & Haoqi Wu & Yongbo Jiang & Zizheng Liu & Xiaoxian Liu & Chunsen Liu & Weida Hu & Peng Zhou, 2024. "Non-volatile rippled-assisted optoelectronic array for all-day motion detection and recognition," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    7. Haihui Lan & Luyang Wang & Runze He & Shuyi Huang & Jinqiu Yu & Jinming Guo & Jingrui Luo & Yiling Li & Jinyang Zhang & Jiaxin Lin & Shunping Zhang & Mengqi Zeng & Lei Fu, 2023. "2D quasi-layered material with domino structure," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    8. Chengpeng Jiang & Jiaqi Liu & Yao Ni & Shangda Qu & Lu Liu & Yue Li & Lu Yang & Wentao Xu, 2023. "Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    9. Tian Zhang & Xin Guo & Pan Wang & Xinyi Fan & Zichen Wang & Yan Tong & Decheng Wang & Limin Tong & Linjun Li, 2024. "High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    10. Doeon Lee & Minseong Park & Yongmin Baek & Byungjoon Bae & Junseok Heo & Kyusang Lee, 2022. "In-sensor image memorization and encoding via optical neurons for bio-stimulus domain reduction toward visual cognitive processing," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    11. Robert Tseng & Sung-Tsun Wang & Tanveer Ahmed & Yi-Yu Pan & Shih-Chieh Chen & Che-Chi Shih & Wu-Wei Tsai & Hai-Ching Chen & Chi-Chung Kei & Tsung-Te Chou & Wen-Ching Hung & Jyh-Chen Chen & Yi-Hou Kuo , 2023. "Wide-range and area-selective threshold voltage tunability in ultrathin indium oxide transistors," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    12. Yan Sun & Shuting Xu & Zheqi Xu & Jiamin Tian & Mengmeng Bai & Zhiying Qi & Yue Niu & Hein Htet Aung & Xiaolu Xiong & Junfeng Han & Cuicui Lu & Jianbo Yin & Sheng Wang & Qing Chen & Reshef Tenne & All, 2022. "Mesoscopic sliding ferroelectricity enabled photovoltaic random access memory for material-level artificial vision system," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    13. Cian Gabbett & Luke Doolan & Kevin Synnatschke & Laura Gambini & Emmet Coleman & Adam G. Kelly & Shixin Liu & Eoin Caffrey & Jose Munuera & Catriona Murphy & Stefano Sanvito & Lewys Jones & Jonathan N, 2024. "Quantitative analysis of printed nanostructured networks using high-resolution 3D FIB-SEM nanotomography," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    14. Pei-Yu Huang & Bi-Yi Jiang & Hong-Ji Chen & Jia-Yi Xu & Kang Wang & Cheng-Yi Zhu & Xin-Yan Hu & Dong Li & Liang Zhen & Fei-Chi Zhou & Jing-Kai Qin & Cheng-Yan Xu, 2023. "Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    15. Ke Yang & Yanghao Wang & Pek Jun Tiw & Chaoming Wang & Xiaolong Zou & Rui Yuan & Chang Liu & Ge Li & Chen Ge & Si Wu & Teng Zhang & Ru Huang & Yuchao Yang, 2024. "High-order sensory processing nanocircuit based on coupled VO2 oscillators," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    16. Mitsumasa Nakajima & Katsuma Inoue & Kenji Tanaka & Yasuo Kuniyoshi & Toshikazu Hashimoto & Kohei Nakajima, 2022. "Physical deep learning with biologically inspired training method: gradient-free approach for physical hardware," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    17. Omnia Samy & Amine El Moutaouakil, 2021. "A Review on MoS 2 Energy Applications: Recent Developments and Challenges," Energies, MDPI, vol. 14(15), pages 1-20, July.
    18. Ming Deng & Michele Cotrufo & Jian Wang & Jianji Dong & Zhichao Ruan & Andrea Alù & Lin Chen, 2024. "Broadband angular spectrum differentiation using dielectric metasurfaces," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    19. Xiaopeng Feng & Chenglong Li & Jinmei Song & Yuhong He & Wei Qu & Weijun Li & Keke Guo & Lulu Liu & Bai Yang & Haotong Wei, 2024. "Differential perovskite hemispherical photodetector for intelligent imaging and location tracking," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    20. Guangdong Zhou & Jie Li & Qunliang Song & Lidan Wang & Zhijun Ren & Bai Sun & Xiaofang Hu & Wenhua Wang & Gaobo Xu & Xiaodie Chen & Lan Cheng & Feichi Zhou & Shukai Duan, 2023. "Full hardware implementation of neuromorphic visual system based on multimodal optoelectronic resistive memory arrays for versatile image processing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-46387-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.