IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2510.15883.html
   My bibliography  Save this paper

FinFlowRL: An Imitation-Reinforcement Learning Framework for Adaptive Stochastic Control in Finance

Author

Listed:
  • Yang Li
  • Zhi Chen

Abstract

Traditional stochastic control methods in finance struggle in real world markets due to their reliance on simplifying assumptions and stylized frameworks. Such methods typically perform well in specific, well defined environments but yield suboptimal results in changed, non stationary ones. We introduce FinFlowRL, a novel framework for financial optimal stochastic control. The framework pretrains an adaptive meta policy learning from multiple expert strategies, then finetunes through reinforcement learning in the noise space to optimize the generative process. By employing action chunking generating action sequences rather than single decisions, it addresses the non Markovian nature of markets. FinFlowRL consistently outperforms individually optimized experts across diverse market conditions.

Suggested Citation

  • Yang Li & Zhi Chen, 2025. "FinFlowRL: An Imitation-Reinforcement Learning Framework for Adaptive Stochastic Control in Finance," Papers 2510.15883, arXiv.org.
    • Handle: RePEc:arx:papers:2510.15883
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2510.15883
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Madhavan, Ananth, 2000. "Market microstructure: A survey," Journal of Financial Markets, Elsevier, vol. 3(3), pages 205-258, August.
    2. Olivier Gu'eant & Charles-Albert Lehalle & Joaquin Fernandez Tapia, 2011. "Dealing with the Inventory Risk. A solution to the market making problem," Papers 1105.3115, arXiv.org, revised Aug 2012.
    3. Emmanuel Bacry & Iacopo Mastromatteo & Jean-Franc{c}ois Muzy, 2015. "Hawkes processes in finance," Papers 1502.04592, arXiv.org, revised May 2015.
    4. Pietro Fodra & Mauricio Labadie, 2012. "High-frequency market-making with inventory constraints and directional bets," Papers 1206.4810, arXiv.org.
    5. Harris, Larry, 2002. "Trading and Exchanges: Market Microstructure for Practitioners," OUP Catalogue, Oxford University Press, number 9780195144703.
    6. Merton, Robert C., 1976. "Option pricing when underlying stock returns are discontinuous," Journal of Financial Economics, Elsevier, vol. 3(1-2), pages 125-144.
    7. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    8. Black, Fischer & Scholes, Myron S, 1973. "The Pricing of Options and Corporate Liabilities," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 637-654, May-June.
    9. Merton, Robert C, 1969. "Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 247-257, August.
    10. Marco Avellaneda & Sasha Stoikov, 2008. "High-frequency trading in a limit order book," Quantitative Finance, Taylor & Francis Journals, vol. 8(3), pages 217-224.
    11. Pietro Fodra & Mauricio Labadie, 2012. "High-frequency market-making with inventory constraints and directional bets," Working Papers hal-00675925, HAL.
    12. Olivier Guéant, 2016. "The Financial Mathematics of Market Liquidity: From Optimal Execution to Market Making," Post-Print hal-01393136, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang Li & Zhi Chen & Steve Y. Yang & Ruixun Zhang, 2025. "FinFlowRL: An Imitation-Reinforcement Learning Framework for Adaptive Stochastic Control in Finance," Papers 2509.17964, arXiv.org.
    2. Yang Li & Zhi Chen & Steve Yang, 2025. "FlowHFT: Imitation Learning via Flow Matching Policy for Optimal High-Frequency Trading under Diverse Market Conditions," Papers 2505.05784, arXiv.org, revised May 2025.
    3. Sofiene El Aoud & Frédéric Abergel, 2015. "A stochastic control approach for options market making," Post-Print hal-01061852, HAL.
    4. Philippe Bergault & David Evangelista & Olivier Gu'eant & Douglas Vieira, 2018. "Closed-form approximations in multi-asset market making," Papers 1810.04383, arXiv.org, revised Sep 2022.
    5. Qing-Qing Yang & Wai-Ki Ching & Jiawen Gu & Tak-Kuen Siu, 2020. "Trading strategy with stochastic volatility in a limit order book market," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(1), pages 277-301, June.
    6. Olivier Guéant, 2016. "The Financial Mathematics of Market Liquidity: From Optimal Execution to Market Making," Post-Print hal-01393136, HAL.
    7. Jian'an Zhang, 2025. "Risk-Sensitive Option Market Making with Arbitrage-Free eSSVI Surfaces: A Constrained RL and Stochastic Control Bridge," Papers 2510.04569, arXiv.org.
    8. Olivier Gu'eant, 2016. "Optimal market making," Papers 1605.01862, arXiv.org, revised May 2017.
    9. Pietro Fodra & Huy^en Pham, 2013. "High frequency trading and asymptotics for small risk aversion in a Markov renewal model," Papers 1310.1756, arXiv.org, revised Jan 2015.
    10. Pietro Fodra & Huyen Pham, 2013. "High frequency trading in a Markov renewal model," Working Papers hal-00867113, HAL.
    11. Charalampos Kleitsikas & Stefanos Leonardos & Carmine Ventre, 2025. "Performative Market Making," Papers 2508.04344, arXiv.org.
    12. Marc Hoffmann & Mauricio Labadie & Charles-Albert Lehalle & Gilles Pagès & Huyên Pham & Mathieu Rosenbaum, 2013. "Optimization and statistical methods for high frequency finance," Post-Print hal-01102785, HAL.
    13. Burcu Aydoğan & Ömür Uğur & Ümit Aksoy, 2023. "Optimal Limit Order Book Trading Strategies with Stochastic Volatility in the Underlying Asset," Computational Economics, Springer;Society for Computational Economics, vol. 62(1), pages 289-324, June.
    14. Baron Law & Frederi Viens, 2019. "Market Making under a Weakly Consistent Limit Order Book Model," Papers 1903.07222, arXiv.org, revised Jan 2020.
    15. Diego Zabaljauregui, 2020. "Optimal market making under partial information and numerical methods for impulse control games with applications," Papers 2009.06521, arXiv.org.
    16. Campi, Luciano & Zabaljauregui, Diego, 2020. "Optimal market making under partial information with general intensities," LSE Research Online Documents on Economics 104612, London School of Economics and Political Science, LSE Library.
    17. Bjork, Tomas, 2009. "Arbitrage Theory in Continuous Time," OUP Catalogue, Oxford University Press, edition 3, number 9780199574742.
    18. Thomas Spooner & Rahul Savani, 2020. "Robust Market Making via Adversarial Reinforcement Learning," Papers 2003.01820, arXiv.org, revised Jul 2020.
    19. Hanousek, Jan & Novotný, Jan, 2012. "Price jumps in Visegrad-country stock markets: An empirical analysis," Emerging Markets Review, Elsevier, vol. 13(2), pages 184-201.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2510.15883. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.