IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-43674-5.html
   My bibliography  Save this article

Overlapping speckle correlation algorithm for high-resolution imaging and tracking of objects in unknown scattering media

Author

Listed:
  • Yaoyao Shi

    (Nanjing University of Aeronautics and Astronautics
    Nanjing University of Aeronautics and Astronautics
    Nanjing University of Aeronautics and Astronautics)

  • Wei Sheng

    (Nanjing University of Aeronautics and Astronautics)

  • Yangyang Fu

    (Nanjing University of Aeronautics and Astronautics)

  • Youwen Liu

    (Nanjing University of Aeronautics and Astronautics)

Abstract

Optical imaging in scattering media is important to many fields but remains challenging. Recent methods have focused on imaging through thin scattering layers or thicker scattering media with prior knowledge of the sample, but this still limits practical applications. Here, we report an imaging method named ‘speckle kinetography’ that enables high-resolution imaging in unknown scattering media with thicknesses up to about 6 transport mean free paths. Speckle kinetography non-invasively records a series of incoherent speckle images accompanied by object motion and the inherently retained object information is extracted through an overlapping speckle correlation algorithm to construct the object’s autocorrelation for imaging. Under single-colour light-emitting diode, white light, and fluorescence illumination, we experimentally demonstrate 1 μm resolution imaging and tracking of objects moving in scattering samples, while reducing the requirements for prior knowledge. We anticipate this method will enable imaging in currently inaccessible scenarios.

Suggested Citation

  • Yaoyao Shi & Wei Sheng & Yangyang Fu & Youwen Liu, 2023. "Overlapping speckle correlation algorithm for high-resolution imaging and tracking of objects in unknown scattering media," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-43674-5
    DOI: 10.1038/s41467-023-43674-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-43674-5
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-023-43674-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ann Finkbeiner, 2015. "Astronomy: Laser focus," Nature, Nature, vol. 517(7535), pages 430-432, January.
    2. Albert Redo-Sanchez & Barmak Heshmat & Alireza Aghasi & Salman Naqvi & Mingjie Zhang & Justin Romberg & Ramesh Raskar, 2016. "Terahertz time-gated spectral imaging for content extraction through layered structures," Nature Communications, Nature, vol. 7(1), pages 1-7, November.
    3. Jacopo Bertolotti & Elbert G. van Putten & Christian Blum & Ad Lagendijk & Willem L. Vos & Allard P. Mosk, 2012. "Non-invasive imaging through opaque scattering layers," Nature, Nature, vol. 491(7423), pages 232-234, November.
    4. Y. Jauregui-Sánchez & H. Penketh & J. Bertolotti, 2022. "Author Correction: Tracking moving objects through scattering media via speckle correlations," Nature Communications, Nature, vol. 13(1), pages 1-1, December.
    5. Gordon Wetzstein & Aydogan Ozcan & Sylvain Gigan & Shanhui Fan & Dirk Englund & Marin Soljačić & Cornelia Denz & David A. B. Miller & Demetri Psaltis, 2020. "Inference in artificial intelligence with deep optics and photonics," Nature, Nature, vol. 588(7836), pages 39-47, December.
    6. David B. Lindell & Gordon Wetzstein, 2020. "Three-dimensional imaging through scattering media based on confocal diffuse tomography," Nature Communications, Nature, vol. 11(1), pages 1-8, December.
    7. Dongyu Du & Xin Jin & Rujia Deng & Jinshi Kang & Hongkun Cao & Yihui Fan & Zhiheng Li & Haoqian Wang & Xiangyang Ji & Jingyan Song, 2022. "A boundary migration model for imaging within volumetric scattering media," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    8. Tian Shi & Liangsheng Li & He Cai & Xianli Zhu & Qingfan Shi & Ning Zheng, 2022. "Computational imaging of moving objects obscured by a random corridor via speckle correlations," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    9. Matthew O’Toole & David B. Lindell & Gordon Wetzstein, 2018. "Confocal non-line-of-sight imaging based on the light-cone transform," Nature, Nature, vol. 555(7696), pages 338-341, March.
    10. Y. Jauregui-Sánchez & H. Penketh & J. Bertolotti, 2022. "Tracking moving objects through scattering media via speckle correlations," Nature Communications, Nature, vol. 13(1), pages 1-6, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dongyu Du & Xin Jin & Rujia Deng & Jinshi Kang & Hongkun Cao & Yihui Fan & Zhiheng Li & Haoqian Wang & Xiangyang Ji & Jingyan Song, 2022. "A boundary migration model for imaging within volumetric scattering media," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    2. Qihang Zhang & Janaka C. Gamekkanda & Ajinkya Pandit & Wenlong Tang & Charles Papageorgiou & Chris Mitchell & Yihui Yang & Michael Schwaerzler & Tolutola Oyetunde & Richard D. Braatz & Allan S. Myerso, 2023. "Extracting particle size distribution from laser speckle with a physics-enhanced autocorrelation-based estimator (PEACE)," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    3. Florian Willomitzer & Prasanna V. Rangarajan & Fengqiang Li & Muralidhar M. Balaji & Marc P. Christensen & Oliver Cossairt, 2021. "Fast non-line-of-sight imaging with high-resolution and wide field of view using synthetic wavelength holography," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    4. Chung Il Park & Seungah Choe & Woorim Lee & Wonjae Choi & Miso Kim & Hong Min Seung & Yoon Young Kim, 2023. "Ultrasonic barrier-through imaging by Fabry-Perot resonance-tailoring panel," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    5. Sungsam Kang & Yongwoo Kwon & Hojun Lee & Seho Kim & Jin Hee Hong & Seokchan Yoon & Wonshik Choi, 2023. "Tracing multiple scattering trajectories for deep optical imaging in scattering media," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    6. H. H. Zhu & J. Zou & H. Zhang & Y. Z. Shi & S. B. Luo & N. Wang & H. Cai & L. X. Wan & B. Wang & X. D. Jiang & J. Thompson & X. S. Luo & X. H. Zhou & L. M. Xiao & W. Huang & L. Patrick & M. Gu & L. C., 2022. "Space-efficient optical computing with an integrated chip diffractive neural network," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    7. Yunmin Yang & Binbin Chu & Jiayi Cheng & Jiali Tang & Bin Song & Houyu Wang & Yao He, 2022. "Bacteria eat nanoprobes for aggregation-enhanced imaging and killing diverse microorganisms," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    8. Xintong Liu & Jianyu Wang & Leping Xiao & Zuoqiang Shi & Xing Fu & Lingyun Qiu, 2023. "Non-line-of-sight imaging with arbitrary illumination and detection pattern," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    9. Lei Zhu & Fernando Soldevila & Claudio Moretti & Alexandra d’Arco & Antoine Boniface & Xiaopeng Shao & Hilton B. Aguiar & Sylvain Gigan, 2022. "Large field-of-view non-invasive imaging through scattering layers using fluctuating random illumination," Nature Communications, Nature, vol. 13(1), pages 1-6, December.
    10. Robinson Czajkowski & John Murray-Bruce, 2024. "Two-edge-resolved three-dimensional non-line-of-sight imaging with an ordinary camera," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    11. Takuya Nakata & Sinan Chen & Masahide Nakamura, 2022. "Uni-Messe: Unified Rule-Based Message Delivery Service for Efficient Context-Aware Service Integration," Energies, MDPI, vol. 15(5), pages 1-18, February.
    12. Anqi Ji & Jung-Hwan Song & Qitong Li & Fenghao Xu & Ching-Ting Tsai & Richard C. Tiberio & Bianxiao Cui & Philippe Lalanne & Pieter G. Kik & David A. B. Miller & Mark L. Brongersma, 2022. "Quantitative phase contrast imaging with a nonlocal angle-selective metasurface," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    13. Elena Goi & Steffen Schoenhardt & Min Gu, 2022. "Direct retrieval of Zernike-based pupil functions using integrated diffractive deep neural networks," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    14. Md Sadman Sakib Rahman & Tianyi Gan & Emir Arda Deger & Çağatay Işıl & Mona Jarrahi & Aydogan Ozcan, 2023. "Learning diffractive optical communication around arbitrary opaque occlusions," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    15. Y. Jauregui-Sánchez & H. Penketh & J. Bertolotti, 2022. "Tracking moving objects through scattering media via speckle correlations," Nature Communications, Nature, vol. 13(1), pages 1-6, December.
    16. Tian Shi & Liangsheng Li & He Cai & Xianli Zhu & Qingfan Shi & Ning Zheng, 2022. "Computational imaging of moving objects obscured by a random corridor via speckle correlations," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    17. Ji Hyun Nam & Eric Brandt & Sebastian Bauer & Xiaochun Liu & Marco Renna & Alberto Tosi & Eftychios Sifakis & Andreas Velten, 2021. "Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second," Nature Communications, Nature, vol. 12(1), pages 1-10, December.
    18. Zhipeng Yu & Huanhao Li & Wannian Zhao & Po-Sheng Huang & Yu-Tsung Lin & Jing Yao & Wenzhao Li & Qi Zhao & Pin Chieh Wu & Bo Li & Patrice Genevet & Qinghua Song & Puxiang Lai, 2024. "High-security learning-based optical encryption assisted by disordered metasurface," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    19. Yuriy Leonidovich Zhukovskiy & Daria Evgenievna Batueva & Alexandra Dmitrievna Buldysko & Bernard Gil & Valeriia Vladimirovna Starshaia, 2021. "Fossil Energy in the Framework of Sustainable Development: Analysis of Prospects and Development of Forecast Scenarios," Energies, MDPI, vol. 14(17), pages 1-28, August.
    20. Xiaohua Feng & Yayao Ma & Liang Gao, 2022. "Compact light field photography towards versatile three-dimensional vision," Nature Communications, Nature, vol. 13(1), pages 1-10, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-43674-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.