IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2109.14438.html
   My bibliography  Save this paper

Conditional Value-at-Risk for Quantitative Trading: A Direct Reinforcement Learning Approach

Author

Listed:
  • Ali Al-Ameer
  • Khaled Alshehri

Abstract

We propose a convex formulation for a trading system with the Conditional Value-at-Risk as a risk-adjusted performance measure under the notion of Direct Reinforcement Learning. Due to convexity, the proposed approach can uncover a lucrative trading policy in a "pure" online manner where it can interactively learn and update the policy without multi-epoch training and validation. We assess our proposed algorithm on a real financial market where it trades one of the largest US trust funds, SPDR, for three years. Numerical experiments demonstrate the algorithm's robustness in detecting central market-regime switching. Moreover, the results show the algorithm's effectiveness in extracting profitable policy while meeting an investor's risk preference under a conservative frictional market with a transaction cost of 0.15% per trade.

Suggested Citation

  • Ali Al-Ameer & Khaled Alshehri, 2021. "Conditional Value-at-Risk for Quantitative Trading: A Direct Reinforcement Learning Approach," Papers 2109.14438, arXiv.org.
    • Handle: RePEc:arx:papers:2109.14438
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2109.14438
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. James M. Poterba & John B. Shoven, 2002. "Exchange-Traded Funds: A New Investment Option for Taxable Investors," American Economic Review, American Economic Association, vol. 92(2), pages 422-427, May.
    2. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    3. David W. Lu, 2017. "Agent Inspired Trading Using Recurrent Reinforcement Learning and LSTM Neural Networks," Papers 1707.07338, arXiv.org.
    4. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    5. Andrew J. Morton & Stanley R. Pliska, 1995. "Optimal Portfolio Management With Fixed Transaction Costs," Mathematical Finance, Wiley Blackwell, vol. 5(4), pages 337-356, October.
    6. Matthew Norton & Valentyn Khokhlov & Stan Uryasev, 2021. "Calculating CVaR and bPOE for common probability distributions with application to portfolio optimization and density estimation," Annals of Operations Research, Springer, vol. 299(1), pages 1281-1315, April.
    7. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    8. Shushang Zhu & Masao Fukushima, 2009. "Worst-Case Conditional Value-at-Risk with Application to Robust Portfolio Management," Operations Research, INFORMS, vol. 57(5), pages 1155-1168, October.
    9. Yoshiharu Sato, 2019. "Model-Free Reinforcement Learning for Financial Portfolios: A Brief Survey," Papers 1904.04973, arXiv.org, revised May 2019.
    10. M. H. A. Davis & A. R. Norman, 1990. "Portfolio Selection with Transaction Costs," Mathematics of Operations Research, INFORMS, vol. 15(4), pages 676-713, November.
    11. Rockafellar, R. Tyrrell & Uryasev, Stanislav, 2002. "Conditional value-at-risk for general loss distributions," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1443-1471, July.
    12. Andreas Humpe & Peter Macmillan, 2009. "Can macroeconomic variables explain long-term stock market movements? A comparison of the US and Japan," Applied Financial Economics, Taylor & Francis Journals, vol. 19(2), pages 111-119.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruili Sun & Tiefeng Ma & Shuangzhe Liu & Milind Sathye, 2019. "Improved Covariance Matrix Estimation for Portfolio Risk Measurement: A Review," JRFM, MDPI, vol. 12(1), pages 1-34, March.
    2. Viet Anh Nguyen & Fan Zhang & Shanshan Wang & Jose Blanchet & Erick Delage & Yinyu Ye, 2021. "Robustifying Conditional Portfolio Decisions via Optimal Transport," Papers 2103.16451, arXiv.org, revised Apr 2024.
    3. Davi Valladão & Thuener Silva & Marcus Poggi, 2019. "Time-consistent risk-constrained dynamic portfolio optimization with transactional costs and time-dependent returns," Annals of Operations Research, Springer, vol. 282(1), pages 379-405, November.
    4. Martin Branda & Max Bucher & Michal Červinka & Alexandra Schwartz, 2018. "Convergence of a Scholtes-type regularization method for cardinality-constrained optimization problems with an application in sparse robust portfolio optimization," Computational Optimization and Applications, Springer, vol. 70(2), pages 503-530, June.
    5. Jun-Ya Gotoh & Keita Shinozaki & Akiko Takeda, 2013. "Robust portfolio techniques for mitigating the fragility of CVaR minimization and generalization to coherent risk measures," Quantitative Finance, Taylor & Francis Journals, vol. 13(10), pages 1621-1635, October.
    6. Dai, Zhifeng & Zhu, Huan, 2021. "Indicator selection and stock return predictability," The North American Journal of Economics and Finance, Elsevier, vol. 57(C).
    7. van Staden, Pieter M. & Dang, Duy-Minh & Forsyth, Peter A., 2021. "The surprising robustness of dynamic Mean-Variance portfolio optimization to model misspecification errors," European Journal of Operational Research, Elsevier, vol. 289(2), pages 774-792.
    8. Tamara Teplova & Mikova Evgeniia & Qaiser Munir & Nataliya Pivnitskaya, 2023. "Black-Litterman model with copula-based views in mean-CVaR portfolio optimization framework with weight constraints," Economic Change and Restructuring, Springer, vol. 56(1), pages 515-535, February.
    9. Jun-ya Gotoh & Akiko Takeda & Rei Yamamoto, 2014. "Interaction between financial risk measures and machine learning methods," Computational Management Science, Springer, vol. 11(4), pages 365-402, October.
    10. Su, Xiaoshan & Li, Yuhan, 2024. "Robust portfolio selection with subjective risk aversion under dependence uncertainty," Economic Modelling, Elsevier, vol. 132(C).
    11. Krastyu Georgiev & Young Kim & Stoyan Stoyanov, 2015. "Periodic portfolio revision with transaction costs," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 81(3), pages 337-359, June.
    12. Strub, Moris S. & Li, Duan & Cui, Xiangyu & Gao, Jianjun, 2019. "Discrete-time mean-CVaR portfolio selection and time-consistency induced term structure of the CVaR," Journal of Economic Dynamics and Control, Elsevier, vol. 108(C).
    13. Zhu, Bo & Zhang, Tianlun, 2021. "Long-term wealth growth portfolio allocation under parameter uncertainty: A non-conservative robust approach," The North American Journal of Economics and Finance, Elsevier, vol. 57(C).
    14. Bedi, Prateek & Nashier, Tripti, 2020. "On the investment credentials of Bitcoin: A cross-currency perspective," Research in International Business and Finance, Elsevier, vol. 51(C).
    15. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.
    16. Nathan Lassance & Victor DeMiguel & Frédéric Vrins, 2022. "Optimal Portfolio Diversification via Independent Component Analysis," Operations Research, INFORMS, vol. 70(1), pages 55-72, January.
    17. Liusha Yang & Romain Couillet & Matthew R. McKay, 2015. "A Robust Statistics Approach to Minimum Variance Portfolio Optimization," Papers 1503.08013, arXiv.org.
    18. Christoph Belak & Lukas Mich & Frank T. Seifried, 2019. "Optimal Investment for Retail Investors with Flooredand Capped Costs," Working Paper Series 2019-06, University of Trier, Research Group Quantitative Finance and Risk Analysis.
    19. Maillet, Bertrand & Tokpavi, Sessi & Vaucher, Benoit, 2015. "Global minimum variance portfolio optimisation under some model risk: A robust regression-based approach," European Journal of Operational Research, Elsevier, vol. 244(1), pages 289-299.
    20. Svitlana Vyetrenko & David Byrd & Nick Petosa & Mahmoud Mahfouz & Danial Dervovic & Manuela Veloso & Tucker Hybinette Balch, 2019. "Get Real: Realism Metrics for Robust Limit Order Book Market Simulations," Papers 1912.04941, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2109.14438. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.