IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-34780-x.html
   My bibliography  Save this article

Path sampling of recurrent neural networks by incorporating known physics

Author

Listed:
  • Sun-Ting Tsai

    (University of Maryland
    University of Maryland)

  • Eric Fields

    (University of Maryland
    University of Maryland)

  • Yijia Xu

    (University of Maryland
    University of Maryland
    NIST/University of Maryland)

  • En-Jui Kuo

    (University of Maryland
    NIST/University of Maryland)

  • Pratyush Tiwary

    (University of Maryland
    University of Maryland)

Abstract

Recurrent neural networks have seen widespread use in modeling dynamical systems in varied domains such as weather prediction, text prediction and several others. Often one wishes to supplement the experimentally observed dynamics with prior knowledge or intuition about the system. While the recurrent nature of these networks allows them to model arbitrarily long memories in the time series used in training, it makes it harder to impose prior knowledge or intuition through generic constraints. In this work, we present a path sampling approach based on principle of Maximum Caliber that allows us to include generic thermodynamic or kinetic constraints into recurrent neural networks. We show the method here for a widely used type of recurrent neural network known as long short-term memory network in the context of supplementing time series collected from different application domains. These include classical Molecular Dynamics of a protein and Monte Carlo simulations of an open quantum system continuously losing photons to the environment and displaying Rabi oscillations. Our method can be easily generalized to other generative artificial intelligence models and to generic time series in different areas of physical and social sciences, where one wishes to supplement limited data with intuition or theory based corrections.

Suggested Citation

  • Sun-Ting Tsai & Eric Fields & Yijia Xu & En-Jui Kuo & Pratyush Tiwary, 2022. "Path sampling of recurrent neural networks by incorporating known physics," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-34780-x
    DOI: 10.1038/s41467-022-34780-x
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-34780-x
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-34780-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kathryn Tunyasuvunakool & Jonas Adler & Zachary Wu & Tim Green & Michal Zielinski & Augustin Žídek & Alex Bridgland & Andrew Cowie & Clemens Meyer & Agata Laydon & Sameer Velankar & Gerard J. Kleywegt, 2021. "Highly accurate protein structure prediction for the human proteome," Nature, Nature, vol. 596(7873), pages 590-596, August.
    2. John Jumper & Richard Evans & Alexander Pritzel & Tim Green & Michael Figurnov & Olaf Ronneberger & Kathryn Tunyasuvunakool & Russ Bates & Augustin Žídek & Anna Potapenko & Alex Bridgland & Clemens Me, 2021. "Highly accurate protein structure prediction with AlphaFold," Nature, Nature, vol. 596(7873), pages 583-589, August.
    3. Yihang Wang & João Marcelo Lamim Ribeiro & Pratyush Tiwary, 2019. "Past–future information bottleneck for sampling molecular reaction coordinate simultaneously with thermodynamics and kinetics," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    4. Shuo Feng & Xintao Yan & Haowei Sun & Yiheng Feng & Henry X. Liu, 2021. "Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment," Nature Communications, Nature, vol. 12(1), pages 1-14, December.
    5. David Silver & Aja Huang & Chris J. Maddison & Arthur Guez & Laurent Sifre & George van den Driessche & Julian Schrittwieser & Ioannis Antonoglou & Veda Panneershelvam & Marc Lanctot & Sander Dieleman, 2016. "Mastering the game of Go with deep neural networks and tree search," Nature, Nature, vol. 529(7587), pages 484-489, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Patrick Bryant & Gabriele Pozzati & Wensi Zhu & Aditi Shenoy & Petras Kundrotas & Arne Elofsson, 2022. "Predicting the structure of large protein complexes using AlphaFold and Monte Carlo tree search," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    2. Min Yan & Can Huang & Peter Bienstman & Peter Tino & Wei Lin & Jie Sun, 2024. "Emerging opportunities and challenges for the future of reservoir computing," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    3. Deyun Qiu & Jinxin V. Pei & James E. O. Rosling & Vandana Thathy & Dongdi Li & Yi Xue & John D. Tanner & Jocelyn Sietsma Penington & Yi Tong Vincent Aw & Jessica Yi Han Aw & Guoyue Xu & Abhai K. Tripa, 2022. "A G358S mutation in the Plasmodium falciparum Na+ pump PfATP4 confers clinically-relevant resistance to cipargamin," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    4. Shuo-Shuo Liu & Tian-Xia Jiang & Fan Bu & Ji-Lan Zhao & Guang-Fei Wang & Guo-Heng Yang & Jie-Yan Kong & Yun-Fan Qie & Pei Wen & Li-Bin Fan & Ning-Ning Li & Ning Gao & Xiao-Bo Qiu, 2024. "Molecular mechanisms underlying the BIRC6-mediated regulation of apoptosis and autophagy," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    5. Xiaoke Yang & Mingqi Zhu & Xue Lu & Yuxin Wang & Junyu Xiao, 2024. "Architecture and activation of human muscle phosphorylase kinase," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    6. Kristy Rochon & Brianna L. Bauer & Nathaniel A. Roethler & Yuli Buckley & Chih-Chia Su & Wei Huang & Rajesh Ramachandran & Maria S. K. Stoll & Edward W. Yu & Derek J. Taylor & Jason A. Mears, 2024. "Structural basis for regulated assembly of the mitochondrial fission GTPase Drp1," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    7. Fan Lu & Liang Zhu & Thomas Bromberger & Jun Yang & Qiannan Yang & Jianmin Liu & Edward F. Plow & Markus Moser & Jun Qin, 2022. "Mechanism of integrin activation by talin and its cooperation with kindlin," Nature Communications, Nature, vol. 13(1), pages 1-19, December.
    8. Martin F. Peter & Christian Gebhardt & Rebecca Mächtel & Gabriel G. Moya Muñoz & Janin Glaenzer & Alessandra Narducci & Gavin H. Thomas & Thorben Cordes & Gregor Hagelueken, 2022. "Cross-validation of distance measurements in proteins by PELDOR/DEER and single-molecule FRET," Nature Communications, Nature, vol. 13(1), pages 1-19, December.
    9. Jutta Diessl & Jens Berndtsson & Filomena Broeskamp & Lukas Habernig & Verena Kohler & Carmela Vazquez-Calvo & Arpita Nandy & Carlotta Peselj & Sofia Drobysheva & Ludovic Pelosi & F.-Nora Vögtle & Fab, 2022. "Manganese-driven CoQ deficiency," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    10. Alexander Kroll & Sahasra Ranjan & Martin K. M. Engqvist & Martin J. Lercher, 2023. "A general model to predict small molecule substrates of enzymes based on machine and deep learning," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    11. Lisa-Marie Appel & Vedran Franke & Johannes Benedum & Irina Grishkovskaya & Xué Strobl & Anton Polyansky & Gregor Ammann & Sebastian Platzer & Andrea Neudolt & Anna Wunder & Lena Walch & Stefanie Kais, 2023. "The SPOC domain is a phosphoserine binding module that bridges transcription machinery with co- and post-transcriptional regulators," Nature Communications, Nature, vol. 14(1), pages 1-22, December.
    12. Maciej K. Kocylowski & Hande Aypek & Wolfgang Bildl & Martin Helmstädter & Philipp Trachte & Bernhard Dumoulin & Sina Wittösch & Lukas Kühne & Ute Aukschun & Carolin Teetzen & Oliver Kretz & Botond Ga, 2022. "A slit-diaphragm-associated protein network for dynamic control of renal filtration," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    13. Michael A. Longo & Sunetra Roy & Yue Chen & Karl-Heinz Tomaszowski & Andrew S. Arvai & Jordan T. Pepper & Rebecca A. Boisvert & Selvi Kunnimalaiyaan & Caezanne Keshvani & David Schild & Albino Bacolla, 2023. "RAD51C-XRCC3 structure and cancer patient mutations define DNA replication roles," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    14. Zachary C. Drake & Justin T. Seffernick & Steffen Lindert, 2022. "Protein complex prediction using Rosetta, AlphaFold, and mass spectrometry covalent labeling," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    15. Leonardo Betancurt-Anzola & Markel Martínez-Carranza & Marc Delarue & Kelly M. Zatopek & Andrew F. Gardner & Ludovic Sauguet, 2023. "Molecular basis for proofreading by the unique exonuclease domain of Family-D DNA polymerases," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    16. Karin Vogel & Tobias Bläske & Marie-Kristin Nagel & Christoph Globisch & Shane Maguire & Lorenz Mattes & Christian Gude & Michael Kovermann & Karin Hauser & Christine Peter & Erika Isono, 2022. "Lipid-mediated activation of plasma membrane-localized deubiquitylating enzymes modulate endosomal trafficking," Nature Communications, Nature, vol. 13(1), pages 1-19, December.
    17. Robin Anger & Laetitia Pieulle & Meriam Shahin & Odile Valette & Hugo Guenno & Artemis Kosta & Vladimir Pelicic & Rémi Fronzes, 2023. "Structure of a heteropolymeric type 4 pilus from a monoderm bacterium," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    18. Jie Li & Haonan Zhang & Dongyu Li & Ya-Jun Liu & Edward A. Bayer & Qiu Cui & Yingang Feng & Ping Zhu, 2023. "Structure of the transcription open complex of distinct σI factors," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    19. Hongmin Cai & Shimeng Guo & Youwei Xu & Jun Sun & Junrui Li & Zhikan Xia & Yi Jiang & Xin Xie & H. Eric Xu, 2024. "Cryo-EM structures of adenosine receptor A3AR bound to selective agonists," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    20. Yi C. Zeng & Meghna Sobti & Ada Quinn & Nicola J. Smith & Simon H. J. Brown & Jamie I. Vandenberg & Renae M. Ryan & Megan L. O’Mara & Alastair G. Stewart, 2023. "Structural basis of promiscuous substrate transport by Organic Cation Transporter 1," Nature Communications, Nature, vol. 14(1), pages 1-14, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-34780-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.