IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2306.17178.html
   My bibliography  Save this paper

Optimal Execution Using Reinforcement Learning

Author

Listed:
  • Cong Zheng
  • Jiafa He
  • Can Yang

Abstract

This work is about optimal order execution, where a large order is split into several small orders to maximize the implementation shortfall. Based on the diversity of cryptocurrency exchanges, we attempt to extract cross-exchange signals by aligning data from multiple exchanges for the first time. Unlike most previous studies that focused on using single-exchange information, we discuss the impact of cross-exchange signals on the agent's decision-making in the optimal execution problem. Experimental results show that cross-exchange signals can provide additional information for the optimal execution of cryptocurrency to facilitate the optimal execution process.

Suggested Citation

  • Cong Zheng & Jiafa He & Can Yang, 2023. "Optimal Execution Using Reinforcement Learning," Papers 2306.17178, arXiv.org.
    • Handle: RePEc:arx:papers:2306.17178
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2306.17178
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gur Huberman & Werner Stanzl, 2005. "Optimal Liquidity Trading," Review of Finance, European Finance Association, vol. 9(2), pages 165-200.
    2. Jakob Albers & Mihai Cucuringu & Sam Howison & Alexander Y. Shestopaloff, 2021. "Fragmentation, Price Formation and Cross-Impact in Bitcoin Markets," Applied Mathematical Finance, Taylor & Francis Journals, vol. 28(5), pages 395-448, September.
    3. David Byrd & Sruthi Palaparthi & Maria Hybinette & Tucker Hybinette Balch, 2020. "The Importance of Low Latency to Order Book Imbalance Trading Strategies," Papers 2006.08682, arXiv.org.
    4. Rama Cont & Arseniy Kukanov & Sasha Stoikov, 2014. "The Price Impact of Order Book Events," Journal of Financial Econometrics, Oxford University Press, vol. 12(1), pages 47-88.
    5. Wenhang Bao & Xiao-yang Liu, 2019. "Multi-Agent Deep Reinforcement Learning for Liquidation Strategy Analysis," Papers 1906.11046, arXiv.org.
    6. Álvaro Cartea & Ryan Donnelly & Sebastian Jaimungal, 2018. "Enhancing trading strategies with order book signals," Applied Mathematical Finance, Taylor & Francis Journals, vol. 25(1), pages 1-35, January.
    7. Jakob Albers & Mihai Cucuringu & Sam Howison & Alexander Y. Shestopaloff, 2021. "Fragmentation, Price Formation, and Cross-Impact in Bitcoin Markets," Papers 2108.09750, arXiv.org.
    8. Schnaubelt, Matthias, 2022. "Deep reinforcement learning for the optimal placement of cryptocurrency limit orders," European Journal of Operational Research, Elsevier, vol. 296(3), pages 993-1006.
    9. Bertsimas, Dimitris & Lo, Andrew W., 1998. "Optimal control of execution costs," Journal of Financial Markets, Elsevier, vol. 1(1), pages 1-50, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schnaubelt, Matthias, 2022. "Deep reinforcement learning for the optimal placement of cryptocurrency limit orders," European Journal of Operational Research, Elsevier, vol. 296(3), pages 993-1006.
    2. Kashyap, Ravi, 2020. "David vs Goliath (You against the Markets), A dynamic programming approach to separate the impact and timing of trading costs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    3. Schnaubelt, Matthias, 2020. "Deep reinforcement learning for the optimal placement of cryptocurrency limit orders," FAU Discussion Papers in Economics 05/2020, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    4. Sim, Min Kyu & Deng, Shijie, 2020. "Estimation of level-I hidden liquidity using the dynamics of limit order-book," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 540(C).
    5. Curatola, Giuliano, 2022. "Price impact, strategic interaction and portfolio choice," The North American Journal of Economics and Finance, Elsevier, vol. 59(C).
    6. Olivier Guéant & Charles-Albert Lehalle, 2015. "General Intensity Shapes In Optimal Liquidation," Mathematical Finance, Wiley Blackwell, vol. 25(3), pages 457-495, July.
    7. Fengpei Li & Vitalii Ihnatiuk & Ryan Kinnear & Anderson Schneider & Yuriy Nevmyvaka, 2022. "Do price trajectory data increase the efficiency of market impact estimation?," Papers 2205.13423, arXiv.org, revised Mar 2023.
    8. Samuel N. Cohen & Lukasz Szpruch, 2011. "A limit order book model for latency arbitrage," Papers 1110.4811, arXiv.org.
    9. Somayeh Moazeni & Thomas F. Coleman & Yuying Li, 2016. "Smoothing and parametric rules for stochastic mean-CVaR optimal execution strategy," Annals of Operations Research, Springer, vol. 237(1), pages 99-120, February.
    10. Steven L. Heston & Robert A. Korajczyk & Ronnie Sadka, 2010. "Intraday Patterns in the Cross‐section of Stock Returns," Journal of Finance, American Finance Association, vol. 65(4), pages 1369-1407, August.
    11. Oehmke, Martin, 2014. "Liquidating illiquid collateral," Journal of Economic Theory, Elsevier, vol. 149(C), pages 183-210.
    12. Antonio Briola & Silvia Bartolucci & Tomaso Aste, 2024. "Deep Limit Order Book Forecasting," Papers 2403.09267, arXiv.org, revised Mar 2024.
    13. Griese, Knut & Kempf, Alexander, 2005. "Liquiditätsdynamik am deutschen Aktienmarkt," CFR Working Papers 05-12, University of Cologne, Centre for Financial Research (CFR).
    14. Chen, Yuanyuan & Gao, Xuefeng & Li, Duan, 2018. "Optimal order execution using hidden orders," Journal of Economic Dynamics and Control, Elsevier, vol. 94(C), pages 89-116.
    15. Frey, Stefan & Sandås, Patrik, 2009. "The impact of iceberg orders in limit order books," CFR Working Papers 09-06, University of Cologne, Centre for Financial Research (CFR).
    16. Charles-Albert Lehalle & Eyal Neuman, 2019. "Incorporating signals into optimal trading," Finance and Stochastics, Springer, vol. 23(2), pages 275-311, April.
    17. Dimitri Vayanos & Jiang Wang, 2012. "Market Liquidity -- Theory and Empirical Evidence," NBER Working Papers 18251, National Bureau of Economic Research, Inc.
    18. Dieter Hendricks & Diane Wilcox, 2014. "A reinforcement learning extension to the Almgren-Chriss model for optimal trade execution," Papers 1403.2229, arXiv.org.
    19. Ryosuke Ishii, 2009. "Optimal Execution in an Evolutionary Setting," KIER Working Papers 670, Kyoto University, Institute of Economic Research.
    20. Du, Bian & Zhu, Hongliang & Zhao, Jingdong, 2016. "Optimal execution in high-frequency trading with Bayesian learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 461(C), pages 767-777.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2306.17178. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.