IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-44864-5.html
   My bibliography  Save this article

Noise learning of instruments for high-contrast, high-resolution and fast hyperspectral microscopy and nanoscopy

Author

Listed:
  • Hao He

    (Xiamen University
    Xiamen University
    Southern University of Science and Technology)

  • Maofeng Cao

    (Xiamen University)

  • Yun Gao

    (Xiamen University)

  • Peng Zheng

    (Xiamen University)

  • Sen Yan

    (Xiamen University)

  • Jin-Hui Zhong

    (Southern University of Science and Technology)

  • Lei Wang

    (Xiamen University)

  • Dayong Jin

    (Southern University of Science and Technology
    University of Technology Sydney)

  • Bin Ren

    (Xiamen University
    Tan Kah Kee Innovation Laboratory)

Abstract

The low scattering efficiency of Raman scattering makes it challenging to simultaneously achieve good signal-to-noise ratio (SNR), high imaging speed, and adequate spatial and spectral resolutions. Here, we report a noise learning (NL) approach that estimates the intrinsic noise distribution of each instrument by statistically learning the noise in the pixel-spatial frequency domain. The estimated noise is then removed from the noisy spectra. This enhances the SNR by ca. 10 folds, and suppresses the mean-square error by almost 150 folds. NL allows us to improve the positioning accuracy and spatial resolution and largely eliminates the impact of thermal drift on tip-enhanced Raman spectroscopic nanoimaging. NL is also applicable to enhance SNR in fluorescence and photoluminescence imaging. Our method manages the ground truth spectra and the instrumental noise simultaneously within the training dataset, which bypasses the tedious labelling of huge dataset required in conventional deep learning, potentially shifting deep learning from sample-dependent to instrument-dependent.

Suggested Citation

  • Hao He & Maofeng Cao & Yun Gao & Peng Zheng & Sen Yan & Jin-Hui Zhong & Lei Wang & Dayong Jin & Bin Ren, 2024. "Noise learning of instruments for high-contrast, high-resolution and fast hyperspectral microscopy and nanoscopy," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-44864-5
    DOI: 10.1038/s41467-024-44864-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-44864-5
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-44864-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Tianye Huang & Xuecou Tu & Changqing Shen & Binjie Zheng & Junzhuan Wang & Hao Wang & Kaveh Khaliji & Sang Hyun Park & Zhiyong Liu & Teng Yang & Zhidong Zhang & Lei Shao & Xuesong Li & Tony Low & Yi S, 2022. "Observation of chiral and slow plasmons in twisted bilayer graphene," Nature, Nature, vol. 605(7908), pages 63-68, May.
    2. Cheng Zong & Ranjith Premasiri & Haonan Lin & Yimin Huang & Chi Zhang & Chen Yang & Bin Ren & Lawrence D. Ziegler & Ji-Xin Cheng, 2019. "Plasmon-enhanced stimulated Raman scattering microscopy with single-molecule detection sensitivity," Nature Communications, Nature, vol. 10(1), pages 1-11, December.
    3. R. Zhang & Y. Zhang & Z. C. Dong & S. Jiang & C. Zhang & L. G. Chen & L. Zhang & Y. Liao & J. Aizpurua & Y. Luo & J. L. Yang & J. G. Hou, 2013. "Chemical mapping of a single molecule by plasmon-enhanced Raman scattering," Nature, Nature, vol. 498(7452), pages 82-86, June.
    4. Chi-Sing Ho & Neal Jean & Catherine A. Hogan & Lena Blackmon & Stefanie S. Jeffrey & Mark Holodniy & Niaz Banaei & Amr A. E. Saleh & Stefano Ermon & Jennifer Dionne, 2019. "Rapid identification of pathogenic bacteria using Raman spectroscopy and deep learning," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    5. Joonhee Lee & Kevin T. Crampton & Nicholas Tallarida & V. Ara Apkarian, 2019. "Visualizing vibrational normal modes of a single molecule with atomically confined light," Nature, Nature, vol. 568(7750), pages 78-82, April.
    6. Logan G. Wright & Tatsuhiro Onodera & Martin M. Stein & Tianyu Wang & Darren T. Schachter & Zoey Hu & Peter L. McMahon, 2022. "Deep physical neural networks trained with backpropagation," Nature, Nature, vol. 601(7894), pages 549-555, January.
    7. Jian Feng Li & Yi Fan Huang & Yong Ding & Zhi Lin Yang & Song Bo Li & Xiao Shun Zhou & Feng Ru Fan & Wei Zhang & Zhi You Zhou & De Yin Wu & Bin Ren & Zhong Lin Wang & Zhong Qun Tian, 2010. "Shell-isolated nanoparticle-enhanced Raman spectroscopy," Nature, Nature, vol. 464(7287), pages 392-395, March.
    8. Håkon Høgset & Conor C. Horgan & James P. K. Armstrong & Mads S. Bergholt & Vincenzo Torraca & Qu Chen & Timothy J. Keane & Laurence Bugeon & Margaret J. Dallman & Serge Mostowy & Molly M. Stevens, 2020. "In vivo biomolecular imaging of zebrafish embryos using confocal Raman spectroscopy," Nature Communications, Nature, vol. 11(1), pages 1-12, December.
    9. Luhong Jin & Bei Liu & Fenqiang Zhao & Stephen Hahn & Bowei Dong & Ruiyan Song & Timothy C. Elston & Yingke Xu & Klaus M. Hahn, 2020. "Deep learning enables structured illumination microscopy with low light levels and enhanced speed," Nature Communications, Nature, vol. 11(1), pages 1-7, December.
    10. Charalambos Kallepitis & Mads S. Bergholt & Manuel M. Mazo & Vincent Leonardo & Stacey C. Skaalure & Stephanie A. Maynard & Molly M. Stevens, 2017. "Quantitative volumetric Raman imaging of three dimensional cell cultures," Nature Communications, Nature, vol. 8(1), pages 1-9, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang Luo & Alberto Martin-Jimenez & Michele Pisarra & Fernando Martin & Manish Garg & Klaus Kern, 2023. "Imaging and controlling coherent phonon wave packets in single graphene nanoribbons," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    2. Jack Griffiths & Tamás Földes & Bart Nijs & Rohit Chikkaraddy & Demelza Wright & William M. Deacon & Dénes Berta & Charlie Readman & David-Benjamin Grys & Edina Rosta & Jeremy J. Baumberg, 2021. "Resolving sub-angstrom ambient motion through reconstruction from vibrational spectra," Nature Communications, Nature, vol. 12(1), pages 1-8, December.
    3. Jiří Doležal & Sofia Canola & Prokop Hapala & Rodrigo Cezar Campos Ferreira & Pablo Merino & Martin Švec, 2022. "Evidence of exciton-libron coupling in chirally adsorbed single molecules," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    4. Linfei Li & Jeremy F. Schultz & Sayantan Mahapatra & Zhongyi Lu & Xu Zhang & Nan Jiang, 2022. "Chemically identifying single adatoms with single-bond sensitivity during oxidation reactions of borophene," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    5. S. E. Ammerman & V. Jelic & Y. Wei & V. N. Breslin & M. Hassan & N. Everett & S. Lee & Q. Sun & C. A. Pignedoli & P. Ruffieux & R. Fasel & T. L. Cocker, 2021. "Lightwave-driven scanning tunnelling spectroscopy of atomically precise graphene nanoribbons," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    6. Fan Cai & Yuesong Jiang & Wanqing Song & Kai-Hung Lu & Tongbo Zhu, 2024. "Short-Term Wind Turbine Blade Icing Wind Power Prediction Based on PCA-fLsm," Energies, MDPI, vol. 17(6), pages 1-15, March.
    7. Zhi Chang & Huijun Yang & Xingyu Zhu & Ping He & Haoshen Zhou, 2022. "A stable quasi-solid electrolyte improves the safe operation of highly efficient lithium-metal pouch cells in harsh environments," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    8. Xiang-Dong Chen & En-Hui Wang & Long-Kun Shan & Ce Feng & Yu Zheng & Yang Dong & Guang-Can Guo & Fang-Wen Sun, 2021. "Focusing the electromagnetic field to 10−6λ for ultra-high enhancement of field-matter interaction," Nature Communications, Nature, vol. 12(1), pages 1-7, December.
    9. Zhi Chang & Huijun Yang & Anqiang Pan & Ping He & Haoshen Zhou, 2022. "An improved 9 micron thick separator for a 350 Wh/kg lithium metal rechargeable pouch cell," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    10. Chao-Yu Li & Ming Chen & Shuai Liu & Xinyao Lu & Jinhui Meng & Jiawei Yan & Héctor D. Abruña & Guang Feng & Tianquan Lian, 2022. "Unconventional interfacial water structure of highly concentrated aqueous electrolytes at negative electrode polarizations," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    11. Alexandre Girard & Anneli Cooper & Samuel Mabbott & Barbara Bradley & Steven Asiala & Lauren Jamieson & Caroline Clucas & Paul Capewell & Francesco Marchesi & Matthew P Gibbins & Franziska Hentzschel , 2021. "Raman spectroscopic analysis of skin as a diagnostic tool for Human African Trypanosomiasis," PLOS Pathogens, Public Library of Science, vol. 17(11), pages 1-28, November.
    12. Xiaoxia Chang & Sudarshan Vijay & Yaran Zhao & Nicholas J. Oliveira & Karen Chan & Bingjun Xu, 2022. "Understanding the complementarities of surface-enhanced infrared and Raman spectroscopies in CO adsorption and electrochemical reduction," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    13. Yang Luo & Frank Neubrech & Alberto Martin-Jimenez & Na Liu & Klaus Kern & Manish Garg, 2024. "Real-time tracking of coherent oscillations of electrons in a nanodevice by photo-assisted tunnelling," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    14. Jiangtao Lv & Yingjie Wu & Jingying Liu & Youning Gong & Guangyuan Si & Guangwei Hu & Qing Zhang & Yupeng Zhang & Jian-Xin Tang & Michael S. Fuhrer & Hongsheng Chen & Stefan A. Maier & Cheng-Wei Qiu &, 2023. "Hyperbolic polaritonic crystals with configurable low-symmetry Bloch modes," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    15. Guowen Yuan & Weilin Liu & Xianlei Huang & Zihao Wan & Chao Wang & Bing Yao & Wenjie Sun & Hang Zheng & Kehan Yang & Zhenjia Zhou & Yuefeng Nie & Jie Xu & Libo Gao, 2023. "Stacking transfer of wafer-scale graphene-based van der Waals superlattices," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    16. Tianyu Wang & Jialin Meng & Xufeng Zhou & Yue Liu & Zhenyu He & Qi Han & Qingxuan Li & Jiajie Yu & Zhenhai Li & Yongkai Liu & Hao Zhu & Qingqing Sun & David Wei Zhang & Peining Chen & Huisheng Peng & , 2022. "Reconfigurable neuromorphic memristor network for ultralow-power smart textile electronics," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    17. Alberto Signoroni & Alessandro Ferrari & Stefano Lombardi & Mattia Savardi & Stefania Fontana & Karissa Culbreath, 2023. "Hierarchical AI enables global interpretation of culture plates in the era of digital microbiology," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    18. Md Tauhidul Islam & Zixia Zhou & Hongyi Ren & Masoud Badiei Khuzani & Daniel Kapp & James Zou & Lu Tian & Joseph C. Liao & Lei Xing, 2023. "Revealing hidden patterns in deep neural network feature space continuum via manifold learning," Nature Communications, Nature, vol. 14(1), pages 1-20, December.
    19. Lu Zhang & Wencai Yi & Junfang Li & Guoying Wei & Guangcheng Xi & Lanqun Mao, 2023. "Surfactant-free interfacial growth of graphdiyne hollow microspheres and the mechanistic origin of their SERS activity," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    20. Fu Wan & Lingling Du & Weigen Chen & Pinyi Wang & Jianxin Wang & Haiyang Shi, 2017. "A Novel Method to Directly Analyze Dissolved Acetic Acid in Transformer Oil without Extraction Using Raman Spectroscopy," Energies, MDPI, vol. 10(7), pages 1-12, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-44864-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.