IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.25162.html

Quantum Transformer BSDE Solver via Multi-Layer Fully-Connected Variational Quantum Circuits

Author

Listed:
  • Howard Su
  • Huan-Hsin Tseng
  • Chi-Sheng Chen
  • Lance Bai

Abstract

Solving high-dimensional parabolic partial differential equations (PDEs) is important in engineering, physics, and stochastic control. Deep BSDE methods reformulate semilinear PDEs as backward stochastic differential equations and admit a model-based reinforcement learning interpretation, where trajectories are generated from known stochastic dynamics while a trainable model learns the gradient-related control process. We propose a Quantum Transformer BSDE solver based on Multi-Layer Fully-Connected Variational Quantum Circuits (FC-VQC). The method treats the normalized state trajectory as time--coordinate tokens and applies causal self-attention to learn interactions in the adapted BSDE gradient process. All trainable model parameters are contained within the FC-VQC embedding, projection, feed-forward, and decoder modules, while attention and structural operations remain classical and parameter-free. Experiments on three d=36 PDE benchmarks show that QTransformer consistently improves over the non-attentive FC-VQC baseline and outperforms the classical Transformer at compact hidden widths, while the wider classical Transformer achieves the best overall accuracy. These results demonstrate that combining causal attention with FC-VQC provides an effective quantum architecture for high-dimensional BSDE trajectory learning.

Suggested Citation

  • Howard Su & Huan-Hsin Tseng & Chi-Sheng Chen & Lance Bai, 2026. "Quantum Transformer BSDE Solver via Multi-Layer Fully-Connected Variational Quantum Circuits," Papers 2607.25162, arXiv.org.
  • Handle: RePEc:arx:papers:2607.25162
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.25162
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. M. Cerezo & Akira Sone & Tyler Volkoff & Lukasz Cincio & Patrick J. Coles, 2021. "Cost function dependent barren plateaus in shallow parametrized quantum circuits," Nature Communications, Nature, vol. 12(1), pages 1-12, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elies Gil-Fuster & Jens Eisert & Carlos Bravo-Prieto, 2024. "Understanding quantum machine learning also requires rethinking generalization," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    2. Arul Rhik Mazumder & Shreyan Ronit Mazumder, 2026. "Depth-Efficient Quantum Topological Data Analysis for Regime-Specific Detection of Financial Stress," Papers 2607.09906, arXiv.org.
    3. Eric R. Anschuetz & Bobak T. Kiani, 2022. "Quantum variational algorithms are swamped with traps," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    4. Enrico Fontana & Dylan Herman & Shouvanik Chakrabarti & Niraj Kumar & Romina Yalovetzky & Jamie Heredge & Shree Hari Sureshbabu & Marco Pistoia, 2024. "Characterizing barren plateaus in quantum ansätze with the adjoint representation," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    5. Matthias C. Caro & Hsin-Yuan Huang & M. Cerezo & Kunal Sharma & Andrew Sornborger & Lukasz Cincio & Patrick J. Coles, 2022. "Generalization in quantum machine learning from few training data," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    6. He, Zhimin & Deng, Maijie & Zheng, Shenggen & Li, Lvzhou & Situ, Haozhen, 2023. "GSQAS: Graph Self-supervised Quantum Architecture Search," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    7. Sofiene Jerbi & Lukas J. Fiderer & Hendrik Poulsen Nautrup & Jonas M. Kübler & Hans J. Briegel & Vedran Dunjko, 2023. "Quantum machine learning beyond kernel methods," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    8. Manuel S. Rudolph & Jacob Miller & Danial Motlagh & Jing Chen & Atithi Acharya & Alejandro Perdomo-Ortiz, 2023. "Synergistic pretraining of parametrized quantum circuits via tensor networks," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    9. Bingzhi Zhang & Junyu Liu & Xiao-Chuan Wu & Liang Jiang & Quntao Zhuang, 2024. "Dynamical transition in controllable quantum neural networks with large depth," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    10. Matthias C. Caro & Hsin-Yuan Huang & Nicholas Ezzell & Joe Gibbs & Andrew T. Sornborger & Lukasz Cincio & Patrick J. Coles & Zoë Holmes, 2023. "Out-of-distribution generalization for learning quantum dynamics," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    11. Samson Wang & Enrico Fontana & M. Cerezo & Kunal Sharma & Akira Sone & Lukasz Cincio & Patrick J. Coles, 2021. "Noise-induced barren plateaus in variational quantum algorithms," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    12. Yuxuan Du & Min-Hsiu Hsieh & Dacheng Tao, 2025. "Efficient learning for linear properties of bounded-gate quantum circuits," Nature Communications, Nature, vol. 16(1), pages 1-8, December.
    13. Michael Ragone & Bojko N. Bakalov & Frédéric Sauvage & Alexander F. Kemper & Carlos Ortiz Marrero & Martín Larocca & M. Cerezo, 2024. "A Lie algebraic theory of barren plateaus for deep parameterized quantum circuits," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    14. M. Cerezo & Martin Larocca & Diego García-Martín & N. L. Diaz & Paolo Braccia & Enrico Fontana & Manuel S. Rudolph & Pablo Bermejo & Aroosa Ijaz & Supanut Thanasilp & Eric R. Anschuetz & Zoë Holmes, 2025. "Does provable absence of barren plateaus imply classical simulability?," Nature Communications, Nature, vol. 16(1), pages 1-15, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.25162. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.