IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2508.16589.html
   My bibliography  Save this paper

ARL-Based Multi-Action Market Making with Hawkes Processes and Variable Volatility

Author

Listed:
  • Ziyi Wang
  • Carmine Ventre
  • Maria Polukarov

Abstract

We advance market-making strategies by integrating Adversarial Reinforcement Learning (ARL), Hawkes Processes, and variable volatility levels while also expanding the action space available to market makers (MMs). To enhance the adaptability and robustness of these strategies -- which can quote always, quote only on one side of the market or not quote at all -- we shift from the commonly used Poisson process to the Hawkes process, which better captures real market dynamics and self-exciting behaviors. We then train and evaluate strategies under volatility levels of 2 and 200. Our findings show that the 4-action MM trained in a low-volatility environment effectively adapts to high-volatility conditions, maintaining stable performance and providing two-sided quotes at least 92\% of the time. This indicates that incorporating flexible quoting mechanisms and realistic market simulations significantly enhances the effectiveness of market-making strategies.

Suggested Citation

  • Ziyi Wang & Carmine Ventre & Maria Polukarov, 2025. "ARL-Based Multi-Action Market Making with Hawkes Processes and Variable Volatility," Papers 2508.16589, arXiv.org.
    • Handle: RePEc:arx:papers:2508.16589
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2508.16589
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Anatoliy Swishchuk & Aiden Huffman, 2020. "General Compound Hawkes Processes in Limit Order Books," Risks, MDPI, vol. 8(1), pages 1-25, March.
    2. Ana Roldan Contreras & Anatoliy Swishchuk, 2022. "Optimal Liquidation, Acquisition and Market Making Problems in HFT under Hawkes Models for LOB," Risks, MDPI, vol. 10(8), pages 1-32, August.
    3. Olivier Gu'eant & Charles-Albert Lehalle & Joaquin Fernandez Tapia, 2011. "Dealing with the Inventory Risk. A solution to the market making problem," Papers 1105.3115, arXiv.org, revised Aug 2012.
    4. Thomas Spooner & Rahul Savani, 2020. "Robust Market Making via Adversarial Reinforcement Learning," Papers 2003.01820, arXiv.org, revised Jul 2020.
    5. Toke, Ioane Muni & Pomponio, Fabrizio, 2012. "Modelling trades-through in a limit order book using hawkes processes," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 6, pages 1-23.
    6. Emmanuel Bacry & Iacopo Mastromatteo & Jean-Franc{c}ois Muzy, 2015. "Hawkes processes in finance," Papers 1502.04592, arXiv.org, revised May 2015.
    7. Xiaofei Lu & Frédéric Abergel, 2018. "High-dimensional Hawkes processes for limit order books: modelling, empirical analysis and numerical calibration," Quantitative Finance, Taylor & Francis Journals, vol. 18(2), pages 249-264, February.
    8. Emmanuel Bacry & Thibault Jaisson & Jean--François Muzy, 2016. "Estimation of slowly decreasing Hawkes kernels: application to high-frequency order book dynamics," Quantitative Finance, Taylor & Francis Journals, vol. 16(8), pages 1179-1201, August.
    9. Olivier Guéant, 2017. "Optimal market making," Applied Mathematical Finance, Taylor & Francis Journals, vol. 24(2), pages 112-154, March.
    10. Qi Guo & Bruno Remillard & Anatoliy Swishchuk, 2020. "Multivariate General Compound Point Processes in Limit Order Books," Papers 2008.00124, arXiv.org.
    11. Xiaofei Lu & Frédéric Abergel, 2017. "Limit order book modelling with high dimensional Hawkes processes," Working Papers hal-01512430, HAL.
    12. Ioane Muni Toke & Fabrizio Pomponio, 2012. "Modelling Trades-Through in a Limit Order Book Using Hawkes Processes," Post-Print hal-00745554, HAL.
    13. E. Bacry & S. Delattre & M. Hoffmann & J. F. Muzy, 2013. "Modelling microstructure noise with mutually exciting point processes," Quantitative Finance, Taylor & Francis Journals, vol. 13(1), pages 65-77, January.
    14. Frédéric Abergel & Aymen Jedidi, 2015. "Long-Time Behavior of a Hawkes Process--Based Limit Order Book," Post-Print hal-01121711, HAL.
    15. Ho, Thomas & Stoll, Hans R., 1981. "Optimal dealer pricing under transactions and return uncertainty," Journal of Financial Economics, Elsevier, vol. 9(1), pages 47-73, March.
    16. Emmanuel Bacry & Sylvain Delattre & Marc Hoffmann & Jean-François Muzy, 2013. "Modelling microstructure noise with mutually exciting point processes," Post-Print hal-01313995, HAL.
    17. Xiaofei Lu & Frédéric Abergel, 2018. "High dimensional Hawkes processes for limit order books Modelling, empirical analysis and numerical calibration," Post-Print hal-01686122, HAL.
    18. Marco Avellaneda & Sasha Stoikov, 2008. "High-frequency trading in a limit order book," Quantitative Finance, Taylor & Francis Journals, vol. 8(3), pages 217-224.
    19. Nicholas T. Chan and Christian Shelton, 2001. "An Adaptive Electronic Market-Maker," Computing in Economics and Finance 2001 146, Society for Computational Economics.
    20. Large, Jeremy, 2007. "Measuring the resiliency of an electronic limit order book," Journal of Financial Markets, Elsevier, vol. 10(1), pages 1-25, February.
    21. repec:hal:wpaper:hal-01121711 is not listed on IDEAS
    22. Thomas Spooner & John Fearnley & Rahul Savani & Andreas Koukorinis, 2018. "Market Making via Reinforcement Learning," Papers 1804.04216, arXiv.org.
    23. Qi Guo & Bruno Remillard & Anatoliy Swishchuk, 2020. "Multivariate General Compound Point Processes in Limit Order Books," Risks, MDPI, vol. 8(3), pages 1-20, September.
    24. Emmanuel Bacry & Jean-Fran�ois Muzy, 2014. "Hawkes model for price and trades high-frequency dynamics," Quantitative Finance, Taylor & Francis Journals, vol. 14(7), pages 1147-1166, July.
    25. Olivier Gu'eant, 2016. "Optimal market making," Papers 1605.01862, arXiv.org, revised May 2017.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maxime Morariu-Patrichi & Mikko Pakkanen, 2018. "State-dependent Hawkes processes and their application to limit order book modelling," CREATES Research Papers 2018-26, Department of Economics and Business Economics, Aarhus University.
    2. Maxime Morariu-Patrichi & Mikko S. Pakkanen, 2018. "State-dependent Hawkes processes and their application to limit order book modelling," Papers 1809.08060, arXiv.org, revised Sep 2021.
    3. Ziyi Wang & Carmine Ventre & Maria Polukarov, 2025. "Robust Market Making: To Quote, or not To Quote," Papers 2508.16588, arXiv.org.
    4. Ioane Muni Toke & Nakahiro Yoshida, 2020. "Marked point processes and intensity ratios for limit order book modeling," Papers 2001.08442, arXiv.org.
    5. Nelson Vadori & Leo Ardon & Sumitra Ganesh & Thomas Spooner & Selim Amrouni & Jared Vann & Mengda Xu & Zeyu Zheng & Tucker Balch & Manuela Veloso, 2022. "Towards Multi-Agent Reinforcement Learning driven Over-The-Counter Market Simulations," Papers 2210.07184, arXiv.org, revised Aug 2023.
    6. Xiaofei Lu & Frédéric Abergel, 2018. "High dimensional Hawkes processes for limit order books Modelling, empirical analysis and numerical calibration," Post-Print hal-01686122, HAL.
    7. Luca Lalor & Anatoliy Swishchuk, 2025. "Event-Based Limit Order Book Simulation under a Neural Hawkes Process: Application in Market-Making," Papers 2502.17417, arXiv.org.
    8. Yann Bilodeau, 2020. "Deep limit order book events dynamics," Working Papers 20-4, HEC Montreal, Canada Research Chair in Risk Management.
    9. Marcello Rambaldi & Emmanuel Bacry & Jean-Franc{c}ois Muzy, 2018. "Disentangling and quantifying market participant volatility contributions," Papers 1807.07036, arXiv.org.
    10. Xiaofei Lu & Frédéric Abergel, 2017. "Limit order book modelling with high dimensional Hawkes processes," Working Papers hal-01512430, HAL.
    11. Timoth'ee Fabre & Ioane Muni Toke, 2024. "Neural Hawkes: Non-Parametric Estimation in High Dimension and Causality Analysis in Cryptocurrency Markets," Papers 2401.09361, arXiv.org, revised Nov 2024.
    12. Hai-Chuan Xu & Wei-Xing Zhou, 2020. "Modeling aggressive market order placements with Hawkes factor models," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-12, January.
    13. Bruno Gav{s}perov & Zvonko Kostanjv{c}ar, 2022. "Deep Reinforcement Learning for Market Making Under a Hawkes Process-Based Limit Order Book Model," Papers 2207.09951, arXiv.org.
    14. Ana Roldan Contreras & Anatoliy Swishchuk, 2022. "Optimal Liquidation, Acquisition and Market Making Problems in HFT under Hawkes Models for LOB," Risks, MDPI, vol. 10(8), pages 1-32, August.
    15. Luca Lalor & Anatoliy Swishchuk, 2024. "Reinforcement Learning in Non-Markov Market-Making," Papers 2410.14504, arXiv.org, revised Nov 2024.
    16. Choi, So Eun & Jang, Hyun Jin & Lee, Kyungsub & Zheng, Harry, 2021. "Optimal market-Making strategies under synchronised order arrivals with deep neural networks," Journal of Economic Dynamics and Control, Elsevier, vol. 125(C).
    17. Joseph Jerome & Leandro Sanchez-Betancourt & Rahul Savani & Martin Herdegen, 2022. "Model-based gym environments for limit order book trading," Papers 2209.07823, arXiv.org.
    18. Bruno Gašperov & Stjepan Begušić & Petra Posedel Šimović & Zvonko Kostanjčar, 2021. "Reinforcement Learning Approaches to Optimal Market Making," Mathematics, MDPI, vol. 9(21), pages 1-22, October.
    19. Sumitra Ganesh & Nelson Vadori & Mengda Xu & Hua Zheng & Prashant Reddy & Manuela Veloso, 2019. "Reinforcement Learning for Market Making in a Multi-agent Dealer Market," Papers 1911.05892, arXiv.org.
    20. Emmanuel Bacry & Iacopo Mastromatteo & Jean-Franc{c}ois Muzy, 2015. "Hawkes processes in finance," Papers 1502.04592, arXiv.org, revised May 2015.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2508.16589. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.