IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2303.16585.html
   My bibliography  Save this paper

Quantum Deep Hedging

Author

Listed:
  • El Amine Cherrat
  • Snehal Raj
  • Iordanis Kerenidis
  • Abhishek Shekhar
  • Ben Wood
  • Jon Dee
  • Shouvanik Chakrabarti
  • Richard Chen
  • Dylan Herman
  • Shaohan Hu
  • Pierre Minssen
  • Ruslan Shaydulin
  • Yue Sun
  • Romina Yalovetzky
  • Marco Pistoia

Abstract

Quantum machine learning has the potential for a transformative impact across industry sectors and in particular in finance. In our work we look at the problem of hedging where deep reinforcement learning offers a powerful framework for real markets. We develop quantum reinforcement learning methods based on policy-search and distributional actor-critic algorithms that use quantum neural network architectures with orthogonal and compound layers for the policy and value functions. We prove that the quantum neural networks we use are trainable, and we perform extensive simulations that show that quantum models can reduce the number of trainable parameters while achieving comparable performance and that the distributional approach obtains better performance than other standard approaches, both classical and quantum. We successfully implement the proposed models on a trapped-ion quantum processor, utilizing circuits with up to $16$ qubits, and observe performance that agrees well with noiseless simulation. Our quantum techniques are general and can be applied to other reinforcement learning problems beyond hedging.

Suggested Citation

  • El Amine Cherrat & Snehal Raj & Iordanis Kerenidis & Abhishek Shekhar & Ben Wood & Jon Dee & Shouvanik Chakrabarti & Richard Chen & Dylan Herman & Shaohan Hu & Pierre Minssen & Ruslan Shaydulin & Yue , 2023. "Quantum Deep Hedging," Papers 2303.16585, arXiv.org, revised Nov 2023.
  • Handle: RePEc:arx:papers:2303.16585
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2303.16585
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Magnus Wiese & Lianjun Bai & Ben Wood & Hans Buehler, 2019. "Deep Hedging: Learning to Simulate Equity Option Markets," Papers 1911.01700, arXiv.org.
    2. Alhussein Fawzi & Matej Balog & Aja Huang & Thomas Hubert & Bernardino Romera-Paredes & Mohammadamin Barekatain & Alexander Novikov & Francisco J. R. Ruiz & Julian Schrittwieser & Grzegorz Swirszcz & , 2022. "Discovering faster matrix multiplication algorithms with reinforcement learning," Nature, Nature, vol. 610(7930), pages 47-53, October.
    3. Hans Buehler & Lukas Gonon & Josef Teichmann & Ben Wood & Baranidharan Mohan & Jonathan Kochems, 2019. "Deep Hedging: Hedging Derivatives Under Generic Market Frictions Using Reinforcement Learning," Swiss Finance Institute Research Paper Series 19-80, Swiss Finance Institute.
    4. Hyeong Kyu Choi, 2018. "Stock Price Correlation Coefficient Prediction with ARIMA-LSTM Hybrid Model," Papers 1808.01560, arXiv.org, revised Oct 2018.
    5. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    6. Magnus Wiese & Ben Wood & Alexandre Pachoud & Ralf Korn & Hans Buehler & Phillip Murray & Lianjun Bai, 2021. "Multi-Asset Spot and Option Market Simulation," Papers 2112.06823, arXiv.org.
    7. Samson Wang & Enrico Fontana & M. Cerezo & Kunal Sharma & Akira Sone & Lukasz Cincio & Patrick J. Coles, 2021. "Noise-induced barren plateaus in variational quantum algorithms," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    8. Iordanis Kerenidis & Anupam Prakash & D'aniel Szil'agyi, 2019. "Quantum Algorithms for Portfolio Optimization," Papers 1908.08040, arXiv.org.
    9. Jarrod R. McClean & Sergio Boixo & Vadim N. Smelyanskiy & Ryan Babbush & Hartmut Neven, 2018. "Barren plateaus in quantum neural network training landscapes," Nature Communications, Nature, vol. 9(1), pages 1-6, December.
    10. Phillip Murray & Ben Wood & Hans Buehler & Magnus Wiese & Mikko S. Pakkanen, 2022. "Deep Hedging: Continuous Reinforcement Learning for Hedging of General Portfolios across Multiple Risk Aversions," Papers 2207.07467, arXiv.org.
    11. Hans Buehler & Phillip Murray & Mikko S. Pakkanen & Ben Wood, 2021. "Deep Hedging: Learning to Remove the Drift under Trading Frictions with Minimal Equivalent Near-Martingale Measures," Papers 2111.07844, arXiv.org, revised Jan 2022.
    12. Dylan Herman & Cody Googin & Xiaoyuan Liu & Alexey Galda & Ilya Safro & Yue Sun & Marco Pistoia & Yuri Alexeev, 2022. "A Survey of Quantum Computing for Finance," Papers 2201.02773, arXiv.org, revised Jun 2022.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weilong Fu & Ali Hirsa & Jorg Osterrieder, 2022. "Simulating financial time series using attention," Papers 2207.00493, arXiv.org.
    2. Elies Gil-Fuster & Jens Eisert & Carlos Bravo-Prieto, 2024. "Understanding quantum machine learning also requires rethinking generalization," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Eric R. Anschuetz & Bobak T. Kiani, 2022. "Quantum variational algorithms are swamped with traps," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    4. Matthias C. Caro & Hsin-Yuan Huang & M. Cerezo & Kunal Sharma & Andrew Sornborger & Lukasz Cincio & Patrick J. Coles, 2022. "Generalization in quantum machine learning from few training data," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    5. He, Zhimin & Deng, Maijie & Zheng, Shenggen & Li, Lvzhou & Situ, Haozhen, 2023. "GSQAS: Graph Self-supervised Quantum Architecture Search," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    6. Sofiene Jerbi & Lukas J. Fiderer & Hendrik Poulsen Nautrup & Jonas M. Kübler & Hans J. Briegel & Vedran Dunjko, 2023. "Quantum machine learning beyond kernel methods," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    7. Dylan Herman & Cody Googin & Xiaoyuan Liu & Alexey Galda & Ilya Safro & Yue Sun & Marco Pistoia & Yuri Alexeev, 2022. "A Survey of Quantum Computing for Finance," Papers 2201.02773, arXiv.org, revised Jun 2022.
    8. Magnus Wiese & Phillip Murray & Ralf Korn, 2023. "Sig-Splines: universal approximation and convex calibration of time series generative models," Papers 2307.09767, arXiv.org.
    9. Masanori Hirano & Kentaro Minami & Kentaro Imajo, 2023. "Adversarial Deep Hedging: Learning to Hedge without Price Process Modeling," Papers 2307.13217, arXiv.org.
    10. Manuel S. Rudolph & Jacob Miller & Danial Motlagh & Jing Chen & Atithi Acharya & Alejandro Perdomo-Ortiz, 2023. "Synergistic pretraining of parametrized quantum circuits via tensor networks," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    11. Samuel N. Cohen & Christoph Reisinger & Sheng Wang, 2022. "Estimating risks of option books using neural-SDE market models," Papers 2202.07148, arXiv.org.
    12. Samuel N. Cohen & Derek Snow & Lukasz Szpruch, 2021. "Black-box model risk in finance," Papers 2102.04757, arXiv.org.
    13. Magnus Wiese & Phillip Murray, 2022. "Risk-Neutral Market Simulation," Papers 2202.13996, arXiv.org.
    14. Sohum Thakkar & Skander Kazdaghli & Natansh Mathur & Iordanis Kerenidis & Andr'e J. Ferreira-Martins & Samurai Brito, 2023. "Improved Financial Forecasting via Quantum Machine Learning," Papers 2306.12965, arXiv.org, revised Apr 2024.
    15. Magnus Wiese & Ben Wood & Alexandre Pachoud & Ralf Korn & Hans Buehler & Phillip Murray & Lianjun Bai, 2021. "Multi-Asset Spot and Option Market Simulation," Papers 2112.06823, arXiv.org.
    16. Bakalli, Gaetan & Guerrier, Stéphane & Scaillet, Olivier, 2023. "A penalized two-pass regression to predict stock returns with time-varying risk premia," Journal of Econometrics, Elsevier, vol. 237(2).
    17. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    18. Wang, Yudong & Hao, Xianfeng, 2022. "Forecasting the real prices of crude oil: A robust weighted least squares approach," Energy Economics, Elsevier, vol. 116(C).
    19. Tobias Götze & Marc Gürtler & Eileen Witowski, 2020. "Improving CAT bond pricing models via machine learning," Journal of Asset Management, Palgrave Macmillan, vol. 21(5), pages 428-446, September.
    20. Wen, Danyan & Liu, Li & Wang, Yudong & Zhang, Yaojie, 2022. "Forecasting crude oil market returns: Enhanced moving average technical indicators," Resources Policy, Elsevier, vol. 76(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2303.16585. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.