IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-29856-7.html
   My bibliography  Save this article

Integrated photonic metasystem for image classifications at telecommunication wavelength

Author

Listed:
  • Zi Wang

    (University of Delaware)

  • Lorry Chang

    (University of Delaware)

  • Feifan Wang

    (University of Delaware)

  • Tiantian Li

    (University of Delaware)

  • Tingyi Gu

    (University of Delaware)

Abstract

Miniaturized image classifiers are potential for revolutionizing their applications in optical communication, autonomous vehicles, and healthcare. With subwavelength structure enabled directional diffraction and dispersion engineering, the light propagation through multi-layer metasurfaces achieves wavelength-selective image recognitions on a silicon photonic platform at telecommunication wavelength. The metasystems implement high-throughput vector-by-matrix multiplications, enabled by near 103 nanoscale phase shifters as weight elements within 0.135 mm2 footprints. The diffraction manifested computing capability incorporates the fabrication and measurement related phase fluctuations, and thus the pre-trained metasystem can handle uncertainties in inputs without post-tuning. Here we demonstrate three functional metasystems: a 15-pixel spatial pattern classifier that reaches near 90% accuracy with femtosecond inputs, a multi-channel wavelength demultiplexer, and a hyperspectral image classifier. The diffractive metasystem provides an alternative machine learning architecture for photonic integrated circuits, with densely integrated phase shifters, spatially multiplexed throughput, and data processing capabilities.

Suggested Citation

  • Zi Wang & Lorry Chang & Feifan Wang & Tiantian Li & Tingyi Gu, 2022. "Integrated photonic metasystem for image classifications at telecommunication wavelength," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-29856-7
    DOI: 10.1038/s41467-022-29856-7
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-29856-7
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-29856-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zi Wang & Tiantian Li & Anishkumar Soman & Dun Mao & Thomas Kananen & Tingyi Gu, 2019. "On-chip wavefront shaping with dielectric metasurface," Nature Communications, Nature, vol. 10(1), pages 1-7, December.
    2. Lianlin Li & Hengxin Ruan & Che Liu & Ying Li & Ya Shuang & Andrea Alù & Cheng-Wei Qiu & Tie Jun Cui, 2019. "Machine-learning reprogrammable metasurface imager," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    3. Gun-Yeal Lee & Jong-Young Hong & SoonHyoung Hwang & Seokil Moon & Hyeokjung Kang & Sohee Jeon & Hwi Kim & Jun-Ho Jeong & Byoungho Lee, 2018. "Metasurface eyepiece for augmented reality," Nature Communications, Nature, vol. 9(1), pages 1-10, December.
    4. Tengfeng Zhu & Yihan Zhou & Yijie Lou & Hui Ye & Min Qiu & Zhichao Ruan & Shanhui Fan, 2017. "Plasmonic computing of spatial differentiation," Nature Communications, Nature, vol. 8(1), pages 1-6, August.
    5. Wim Bogaerts & Daniel Pérez & José Capmany & David A. B. Miller & Joyce Poon & Dirk Englund & Francesco Morichetti & Andrea Melloni, 2020. "Programmable photonic circuits," Nature, Nature, vol. 586(7828), pages 207-216, October.
    6. Zhu Wang & Soongyu Yi & Ang Chen & Ming Zhou & Ting Shan Luk & Anthony James & John Nogan & Willard Ross & Graham Joe & Alireza Shahsafi & Ken Xingze Wang & Mikhail A. Kats & Zongfu Yu, 2019. "Single-shot on-chip spectral sensors based on photonic crystal slabs," Nature Communications, Nature, vol. 10(1), pages 1-6, December.
    7. MohammadSadegh Faraji-Dana & Ehsan Arbabi & Amir Arbabi & Seyedeh Mahsa Kamali & Hyounghan Kwon & Andrei Faraon, 2018. "Compact folded metasurface spectrometer," Nature Communications, Nature, vol. 9(1), pages 1-8, December.
    8. Xingjie Ni & Alexander V. Kildishev & Vladimir M. Shalaev, 2013. "Metasurface holograms for visible light," Nature Communications, Nature, vol. 4(1), pages 1-6, December.
    9. Zhoufeng Ying & Chenghao Feng & Zheng Zhao & Shounak Dhar & Hamed Dalir & Jiaqi Gu & Yue Cheng & Richard Soref & David Z. Pan & Ray T. Chen, 2020. "Electronic-photonic arithmetic logic unit for high-speed computing," Nature Communications, Nature, vol. 11(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jingtian Hu & Deniz Mengu & Dimitrios C. Tzarouchis & Brian Edwards & Nader Engheta & Aydogan Ozcan, 2024. "Diffractive optical computing in free space," Nature Communications, Nature, vol. 15(1), pages 1-21, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michele Cotrufo & Akshaj Arora & Sahitya Singh & Andrea Alù, 2023. "Dispersion engineered metasurfaces for broadband, high-NA, high-efficiency, dual-polarization analog image processing," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    2. Zhaoyi Li & Raphaël Pestourie & Joon-Suh Park & Yao-Wei Huang & Steven G. Johnson & Federico Capasso, 2022. "Inverse design enables large-scale high-performance meta-optics reshaping virtual reality," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    3. Gang Wu & Mohamed Abid & Mohamed Zerara & Jiung Cho & Miri Choi & Cormac Ó Coileáin & Kuan-Ming Hung & Ching-Ray Chang & Igor V. Shvets & Han-Chun Wu, 2024. "Miniaturized spectrometer with intrinsic long-term image memory," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    4. Weihan Li & Qian Ma & Che Liu & Yunfeng Zhang & Xianning Wu & Jiawei Wang & Shizhao Gao & Tianshuo Qiu & Tonghao Liu & Qiang Xiao & Jiaxuan Wei & Ting Ting Gu & Zhize Zhou & Fashuai Li & Qiang Cheng &, 2023. "Intelligent metasurface system for automatic tracking of moving targets and wireless communications based on computer vision," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    5. Nicholas A. Güsken & Ming Fu & Maximilian Zapf & Michael P. Nielsen & Paul Dichtl & Robert Röder & Alex S. Clark & Stefan A. Maier & Carsten Ronning & Rupert F. Oulton, 2023. "Emission enhancement of erbium in a reverse nanofocusing waveguide," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    6. Minkyung Kim & Dasol Lee & Younghwan Yang & Yeseul Kim & Junsuk Rho, 2022. "Reaching the highest efficiency of spin Hall effect of light in the near-infrared using all-dielectric metasurfaces," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    7. H. H. Zhu & J. Zou & H. Zhang & Y. Z. Shi & S. B. Luo & N. Wang & H. Cai & L. X. Wan & B. Wang & X. D. Jiang & J. Thompson & X. S. Luo & X. H. Zhou & L. M. Xiao & W. Huang & L. Patrick & M. Gu & L. C., 2022. "Space-efficient optical computing with an integrated chip diffractive neural network," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    8. Yueqiang Hu & Yuting Jiang & Yi Zhang & Xing Yang & Xiangnian Ou & Ling Li & Xianghong Kong & Xingsi Liu & Cheng-Wei Qiu & Huigao Duan, 2023. "Asymptotic dispersion engineering for ultra-broadband meta-optics," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    9. Yurou Jia & Suying Zhang & Xuan Zhang & Houyou Long & Caibin Xu & Yechao Bai & Ying Cheng & Dajian Wu & Mingxi Deng & Cheng-Wei Qiu & Xiaojun Liu, 2024. "Compact meta-differentiator for achieving isotropically high-contrast ultrasonic imaging," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    10. Jingyi Wang & Beibei Pan & Zi Wang & Jiakai Zhang & Zhiqi Zhou & Lu Yao & Yanan Wu & Wuwei Ren & Jianyu Wang & Haiming Ji & Jingyi Yu & Baile Chen, 2024. "Single-pixel p-graded-n junction spectrometers," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    11. Yang Yang & Robert J. Chapman & Ben Haylock & Francesco Lenzini & Yogesh N. Joglekar & Mirko Lobino & Alberto Peruzzo, 2024. "Programmable high-dimensional Hamiltonian in a photonic waveguide array," Nature Communications, Nature, vol. 15(1), pages 1-7, December.
    12. Soongyu Yi & Jin Xiang & Ming Zhou & Zhicheng Wu & Lan Yang & Zongfu Yu, 2021. "Angle-based wavefront sensing enabled by the near fields of flat optics," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    13. Bowen Bai & Qipeng Yang & Haowen Shu & Lin Chang & Fenghe Yang & Bitao Shen & Zihan Tao & Jing Wang & Shaofu Xu & Weiqiang Xie & Weiwen Zou & Weiwei Hu & John E. Bowers & Xingjun Wang, 2023. "Microcomb-based integrated photonic processing unit," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    14. Brandon Born & Sung-Hoon Lee & Jung-Hwan Song & Jeong Yub Lee & Woong Ko & Mark L. Brongersma, 2023. "Off-axis metasurfaces for folded flat optics," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    15. Mark Dong & Julia M. Boyle & Kevin J. Palm & Matthew Zimmermann & Alex Witte & Andrew J. Leenheer & Daniel Dominguez & Gerald Gilbert & Matt Eichenfield & Dirk Englund, 2023. "Synchronous micromechanically resonant programmable photonic circuits," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    16. Fei Zhang & Yinghui Guo & Mingbo Pu & Lianwei Chen & Mingfeng Xu & Minghao Liao & Lanting Li & Xiong Li & Xiaoliang Ma & Xiangang Luo, 2023. "Meta-optics empowered vector visual cryptography for high security and rapid decryption," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    17. Mehmet Berkay On & Farshid Ashtiani & David Sanchez-Jacome & Daniel Perez-Lopez & S. J. Ben Yoo & Andrea Blanco-Redondo, 2024. "Programmable integrated photonics for topological Hamiltonians," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    18. Leal Filho, Walter & Wall, Tony & Rui Mucova, Serafino Afonso & Nagy, Gustavo J. & Balogun, Abdul-Lateef & Luetz, Johannes M. & Ng, Artie W. & Kovaleva, Marina & Safiul Azam, Fardous Mohammad & Alves,, 2022. "Deploying artificial intelligence for climate change adaptation," Technological Forecasting and Social Change, Elsevier, vol. 180(C).
    19. Qingbin Fan & Weizhu Xu & Xuemei Hu & Wenqi Zhu & Tao Yue & Cheng Zhang & Feng Yan & Lu Chen & Henri J. Lezec & Yanqing Lu & Amit Agrawal & Ting Xu, 2022. "Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    20. Han Zhao & Bingzhao Li & Huan Li & Mo Li, 2022. "Enabling scalable optical computing in synthetic frequency dimension using integrated cavity acousto-optics," Nature Communications, Nature, vol. 13(1), pages 1-7, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-29856-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.