IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.24878.html

Entropy-Regularized Certainty-Equivalent Bellman Policies for Risk-Sensitive Market Making

Author

Listed:
  • Tenghan Zhong

Abstract

We study a finite-inventory risk-sensitive market making problem in which a dealer controls bid and ask quotes, faces Brownian midprice risk, and receives liquidity-taking orders through point processes with quote-dependent intensities. The objective is the certainty equivalent induced by exponential utility with terminal and running inventory penalties. We introduce an exact discrete entropy-regularized Bellman operator that applies log-sum-exp regularization to deterministic-action certainty-equivalent scores, rather than to a risk-neutral one-step reward. This distinction is essential because the exponential certainty equivalent does not commute with quote randomization. For time step \(h\) and entropy parameter \(\lambda\), we prove uniform convergence to the unregularized continuous-time risk-sensitive value at rate \[ O\bigl(h+\lambda(1+|\log\lambda|)\bigr). \] We also prove certainty-equivalent performance bounds for the induced Gibbs policies under a fresh-sampling relaxed implementation, in which quote marks are sampled at potential fill events rather than frozen over a time step. Under a quadratic growth condition on the Hamiltonian in the relevant quote coordinates, these policies concentrate around the unregularized optimal quote set. Finally, we show that a lower-cost Hamiltonian-Gibbs proxy satisfies a certainty-equivalent performance bound of the same order as the exact Bellman Gibbs policy. Numerical experiments in an Avellaneda--Stoikov specification support the predicted scaling for discretization error, entropy bias, policy gap, quote concentration, and exact-versus-proxy consistency.

Suggested Citation

  • Tenghan Zhong, 2026. "Entropy-Regularized Certainty-Equivalent Bellman Policies for Risk-Sensitive Market Making," Papers 2605.24878, arXiv.org.
  • Handle: RePEc:arx:papers:2605.24878
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.24878
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marco Avellaneda & Sasha Stoikov, 2008. "High-frequency trading in a limit order book," Quantitative Finance, Taylor & Francis Journals, vol. 8(3), pages 217-224.
    2. Olivier Gu'eant & Charles-Albert Lehalle & Joaquin Fernandez Tapia, 2011. "Dealing with the Inventory Risk. A solution to the market making problem," Papers 1105.3115, arXiv.org, revised Aug 2012.
    3. Thomas Spooner & Rahul Savani, 2020. "Robust Market Making via Adversarial Reinforcement Learning," Papers 2003.01820, arXiv.org, revised Jul 2020.
    4. Yanwei Jia, 2024. "Continuous-time Risk-sensitive Reinforcement Learning via Quadratic Variation Penalty," Papers 2404.12598, arXiv.org, revised Mar 2026.
    5. Jonathan Ch'avez-Casillas & Jos'e E. Figueroa-L'opez & Chuyi Yu & Yi Zhang, 2024. "Adaptive Optimal Market Making Strategies with Inventory Liquidation Cos," Papers 2405.11444, arXiv.org.
    6. Pietro Fodra & Mauricio Labadie, 2012. "High-frequency market-making with inventory constraints and directional bets," Papers 1206.4810, arXiv.org.
    7. Pietro Fodra & Mauricio Labadie, 2012. "High-frequency market-making with inventory constraints and directional bets," Working Papers hal-00675925, HAL.
    8. Ho, Thomas & Stoll, Hans R., 1981. "Optimal dealer pricing under transactions and return uncertainty," Journal of Financial Economics, Elsevier, vol. 9(1), pages 47-73, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charalampos Kleitsikas & Stefanos Leonardos & Carmine Ventre, 2025. "Performative Market Making," Papers 2508.04344, arXiv.org, revised Feb 2026.
    2. Sofiene El Aoud & Frédéric Abergel, 2015. "A stochastic control approach for options market making," Post-Print hal-01061852, HAL.
    3. Philippe Bergault & David Evangelista & Olivier Gu'eant & Douglas Vieira, 2018. "Closed-form approximations in multi-asset market making," Papers 1810.04383, arXiv.org, revised Sep 2022.
    4. Qing-Qing Yang & Wai-Ki Ching & Jiawen Gu & Tak-Kuen Siu, 2020. "Trading strategy with stochastic volatility in a limit order book market," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(1), pages 277-301, June.
    5. Olivier Gu'eant, 2016. "Optimal market making," Papers 1605.01862, arXiv.org, revised May 2017.
    6. Burcu Aydoğan & Ömür Uğur & Ümit Aksoy, 2023. "Optimal Limit Order Book Trading Strategies with Stochastic Volatility in the Underlying Asset," Computational Economics, Springer;Society for Computational Economics, vol. 62(1), pages 289-324, June.
    7. Baron Law & Frederi Viens, 2019. "Market Making under a Weakly Consistent Limit Order Book Model," Papers 1903.07222, arXiv.org, revised Jan 2020.
    8. Diego Zabaljauregui, 2020. "Optimal market making under partial information and numerical methods for impulse control games with applications," Papers 2009.06521, arXiv.org.
    9. Campi, Luciano & Zabaljauregui, Diego, 2020. "Optimal market making under partial information with general intensities," LSE Research Online Documents on Economics 104612, London School of Economics and Political Science, LSE Library.
    10. Thomas Spooner & Rahul Savani, 2020. "Robust Market Making via Adversarial Reinforcement Learning," Papers 2003.01820, arXiv.org, revised Jul 2020.
    11. Ziyi Wang & Carmine Ventre & Maria Polukarov, 2025. "ARL-Based Multi-Action Market Making with Hawkes Processes and Variable Volatility," Papers 2508.16589, arXiv.org.
    12. Nelson Vadori & Leo Ardon & Sumitra Ganesh & Thomas Spooner & Selim Amrouni & Jared Vann & Mengda Xu & Zeyu Zheng & Tucker Balch & Manuela Veloso, 2022. "Towards Multi-Agent Reinforcement Learning driven Over-The-Counter Market Simulations," Papers 2210.07184, arXiv.org, revised Aug 2023.
    13. Joseph Jerome & Leandro Sanchez-Betancourt & Rahul Savani & Martin Herdegen, 2022. "Model-based gym environments for limit order book trading," Papers 2209.07823, arXiv.org.
    14. Pietro Fodra & Huy^en Pham, 2013. "High frequency trading and asymptotics for small risk aversion in a Markov renewal model," Papers 1310.1756, arXiv.org, revised Jan 2015.
    15. Yang Li & Zhi Chen, 2025. "FinFlowRL: An Imitation-Reinforcement Learning Framework for Adaptive Stochastic Control in Finance," Papers 2510.15883, arXiv.org.
    16. Pietro Fodra & Huyen Pham, 2013. "High frequency trading in a Markov renewal model," Working Papers hal-00867113, HAL.
    17. Ziyi Wang & Carmine Ventre & Maria Polukarov, 2025. "Robust Market Making: To Quote, or not To Quote," Papers 2508.16588, arXiv.org.
    18. Marc Hoffmann & Mauricio Labadie & Charles-Albert Lehalle & Gilles Pagès & Huyên Pham & Mathieu Rosenbaum, 2013. "Optimization and statistical methods for high frequency finance," Post-Print hal-01102785, HAL.
    19. Diego Zabaljauregui & Luciano Campi, 2019. "Optimal market making under partial information with general intensities," Papers 1902.01157, arXiv.org, revised Apr 2020.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.24878. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.