IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1802.03042.html
   My bibliography  Save this paper

Deep Hedging

Author

Listed:
  • Hans Buhler
  • Lukas Gonon
  • Josef Teichmann
  • Ben Wood

Abstract

We present a framework for hedging a portfolio of derivatives in the presence of market frictions such as transaction costs, market impact, liquidity constraints or risk limits using modern deep reinforcement machine learning methods. We discuss how standard reinforcement learning methods can be applied to non-linear reward structures, i.e. in our case convex risk measures. As a general contribution to the use of deep learning for stochastic processes, we also show that the set of constrained trading strategies used by our algorithm is large enough to $\epsilon$-approximate any optimal solution. Our algorithm can be implemented efficiently even in high-dimensional situations using modern machine learning tools. Its structure does not depend on specific market dynamics, and generalizes across hedging instruments including the use of liquid derivatives. Its computational performance is largely invariant in the size of the portfolio as it depends mainly on the number of hedging instruments available. We illustrate our approach by showing the effect on hedging under transaction costs in a synthetic market driven by the Heston model, where we outperform the standard "complete market" solution.

Suggested Citation

  • Hans Buhler & Lukas Gonon & Josef Teichmann & Ben Wood, 2018. "Deep Hedging," Papers 1802.03042, arXiv.org.
    • Handle: RePEc:arx:papers:1802.03042
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1802.03042
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mingxin Xu, 2006. "Risk measure pricing and hedging in incomplete markets," Annals of Finance, Springer, vol. 2(1), pages 51-71, January.
    2. Jan Kallsen & Johannes Muhle-Karbe, 2015. "Option Pricing And Hedging With Small Transaction Costs," Mathematical Finance, Wiley Blackwell, vol. 25(4), pages 702-723, October.
    3. David W. Lu, 2017. "Agent Inspired Trading Using Recurrent Reinforcement Learning and LSTM Neural Networks," Papers 1707.07338, arXiv.org.
    4. Igor Halperin, 2017. "QLBS: Q-Learner in the Black-Scholes(-Merton) Worlds," Papers 1712.04609, arXiv.org, revised Sep 2019.
    5. Johannes Muhle-Karbe & Max Reppen & H. Mete Soner, 2016. "A Primer on Portfolio Choice with Small Transaction Costs," Papers 1612.01302, arXiv.org, revised May 2017.
    6. John Moody & Lizhong Wu, "undated". "Optimization of Trading Systems and Portfolios," Computing in Economics and Finance 1997 55, Society for Computational Economics.
    7. Mark Broadie & Özgür Kaya, 2006. "Exact Simulation of Stochastic Volatility and Other Affine Jump Diffusion Processes," Operations Research, INFORMS, vol. 54(2), pages 217-231, April.
    8. A. E. Whalley & P. Wilmott, 1997. "An Asymptotic Analysis of an Optimal Hedging Model for Option Pricing with Transaction Costs," Mathematical Finance, Wiley Blackwell, vol. 7(3), pages 307-324, July.
    9. Ilhan, Aytaç & Jonsson, Mattias & Sircar, Ronnie, 2009. "Optimal static-dynamic hedges for exotic options under convex risk measures," Stochastic Processes and their Applications, Elsevier, vol. 119(10), pages 3608-3632, October.
    10. Susanne Klöppel & Martin Schweizer, 2007. "Dynamic Indifference Valuation Via Convex Risk Measures," Mathematical Finance, Wiley Blackwell, vol. 17(4), pages 599-627, October.
    11. Hans FÃllmer & Peter Leukert, 2000. "Efficient hedging: Cost versus shortfall risk," Finance and Stochastics, Springer, vol. 4(2), pages 117-146.
    12. Zhengyao Jiang & Dixing Xu & Jinjun Liang, 2017. "A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem," Papers 1706.10059, arXiv.org, revised Jul 2017.
    13. Aharon Ben‐Tal & Marc Teboulle, 2007. "An Old‐New Concept Of Convex Risk Measures: The Optimized Certainty Equivalent," Mathematical Finance, Wiley Blackwell, vol. 17(3), pages 449-476, July.
    14. Burgert, Christian & Ruschendorf, Ludger, 2006. "Consistent risk measures for portfolio vectors," Insurance: Mathematics and Economics, Elsevier, vol. 38(2), pages 289-297, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexandre Carbonneau & Fr'ed'eric Godin, 2021. "Deep equal risk pricing of financial derivatives with non-translation invariant risk measures," Papers 2107.11340, arXiv.org.
    2. Ludovic Gouden`ege & Andrea Molent & Antonino Zanette, 2023. "Backward Hedging for American Options with Transaction Costs," Papers 2305.06805, arXiv.org, revised Jun 2023.
    3. Shota Imaki & Kentaro Imajo & Katsuya Ito & Kentaro Minami & Kei Nakagawa, 2021. "No-Transaction Band Network: A Neural Network Architecture for Efficient Deep Hedging," Papers 2103.01775, arXiv.org.
    4. Zachary Feinstein & Birgit Rudloff, 2018. "Scalar multivariate risk measures with a single eligible asset," Papers 1807.10694, arXiv.org, revised Feb 2021.
    5. Xinfu Chen & Min Dai & Wei Jiang & Cong Qin, 2022. "Asymptotic analysis of long‐term investment with two illiquid and correlated assets," Mathematical Finance, Wiley Blackwell, vol. 32(4), pages 1133-1169, October.
    6. Fischer, Thomas G., 2018. "Reinforcement learning in financial markets - a survey," FAU Discussion Papers in Economics 12/2018, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    7. Leitner Johannes, 2007. "Pricing and hedging with globally and instantaneously vanishing risk," Statistics & Risk Modeling, De Gruyter, vol. 25(4/2007), pages 1-22, October.
    8. Bruno Bouchard & Ludovic Moreau & Mete H. Soner, 2016. "Hedging under an expected loss constraint with small transaction costs," Post-Print hal-00863562, HAL.
    9. William B. Haskell & Wenjie Huang & Huifu Xu, 2018. "Preference Elicitation and Robust Optimization with Multi-Attribute Quasi-Concave Choice Functions," Papers 1805.06632, arXiv.org.
    10. F. Godin, 2016. "Minimizing CVaR in global dynamic hedging with transaction costs," Quantitative Finance, Taylor & Francis Journals, vol. 16(3), pages 461-475, March.
    11. Michael Monoyios, 2004. "Performance of utility-based strategies for hedging basis risk," Quantitative Finance, Taylor & Francis Journals, vol. 4(3), pages 245-255.
    12. Ben Hambly & Renyuan Xu & Huining Yang, 2021. "Recent Advances in Reinforcement Learning in Finance," Papers 2112.04553, arXiv.org, revised Feb 2023.
    13. Johannes Muhle-Karbe & Max Reppen & H. Mete Soner, 2016. "A Primer on Portfolio Choice with Small Transaction Costs," Papers 1612.01302, arXiv.org, revised May 2017.
    14. Adam W. Kolkiewicz, 2016. "Efficient Hedging Of Path–Dependent Options," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 19(05), pages 1-27, August.
    15. Blanka Horvath & Josef Teichmann & Zan Zuric, 2021. "Deep Hedging under Rough Volatility," Papers 2102.01962, arXiv.org.
    16. Takuji Arai & Masaaki Fukasawa, 2011. "Convex risk measures for good deal bounds," Papers 1108.1273, arXiv.org.
    17. Martin Herdegen & Johannes Muhle-Karbe, 2018. "Stability of Radner equilibria with respect to small frictions," Finance and Stochastics, Springer, vol. 22(2), pages 443-502, April.
    18. Wayne King Ming Chan, 2015. "RAROC-Based Contingent Claim Valuation," PhD Thesis, Finance Discipline Group, UTS Business School, University of Technology, Sydney, number 3-2015.
    19. Wayne King Ming Chan, 2015. "RAROC-Based Contingent Claim Valuation," PhD Thesis, Finance Discipline Group, UTS Business School, University of Technology, Sydney, number 21, July-Dece.
    20. Shuo Sun & Rundong Wang & Bo An, 2021. "Reinforcement Learning for Quantitative Trading," Papers 2109.13851, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1802.03042. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.