IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2307.02375.html
   My bibliography  Save this paper

Online Learning of Order Flow and Market Impact with Bayesian Change-Point Detection Methods

Author

Listed:
  • Ioanna-Yvonni Tsaknaki
  • Fabrizio Lillo
  • Piero Mazzarisi

Abstract

Financial order flow exhibits a remarkable level of persistence, wherein buy (sell) trades are often followed by subsequent buy (sell) trades over extended periods. This persistence can be attributed to the division and gradual execution of large orders. Consequently, distinct order flow regimes might emerge, which can be identified through suitable time series models applied to market data. In this paper, we propose the use of Bayesian online change-point detection (BOCPD) methods to identify regime shifts in real-time and enable online predictions of order flow and market impact. To enhance the effectiveness of our approach, we have developed a novel BOCPD method using a score-driven approach. This method accommodates temporal correlations and time-varying parameters within each regime. Through empirical application to NASDAQ data, we have found that: (i) Our newly proposed model demonstrates superior out-of-sample predictive performance compared to existing models that assume i.i.d. behavior within each regime; (ii) When examining the residuals, our model demonstrates good specification in terms of both distributional assumptions and temporal correlations; (iii) Within a given regime, the price dynamics exhibit a concave relationship with respect to time and volume, mirroring the characteristics of actual large orders; (iv) By incorporating regime information, our model produces more accurate online predictions of order flow and market impact compared to models that do not consider regimes.

Suggested Citation

  • Ioanna-Yvonni Tsaknaki & Fabrizio Lillo & Piero Mazzarisi, 2023. "Online Learning of Order Flow and Market Impact with Bayesian Change-Point Detection Methods," Papers 2307.02375, arXiv.org.
  • Handle: RePEc:arx:papers:2307.02375
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2307.02375
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jean-Philippe Bouchaud & Yuval Gefen & Marc Potters & Matthieu Wyart, 2004. "Fluctuations and response in financial markets: the subtle nature of 'random' price changes," Quantitative Finance, Taylor & Francis Journals, vol. 4(2), pages 176-190.
    2. Diebold, Francis X. & Inoue, Atsushi, 2001. "Long memory and regime switching," Journal of Econometrics, Elsevier, vol. 105(1), pages 131-159, November.
    3. Bence Toth & Zoltan Eisler & Jean-Philippe Bouchaud, 2016. "The square-root impact law also holds for option markets," Papers 1602.03043, arXiv.org.
    4. J. Donier & J. Bonart & I. Mastromatteo & J.-P. Bouchaud, 2015. "A fully consistent, minimal model for non-linear market impact," Quantitative Finance, Taylor & Francis Journals, vol. 15(7), pages 1109-1121, July.
    5. Jonathan Donier & Julius Bonart & Iacopo Mastromatteo & Jean-Philippe Bouchaud, 2014. "A fully consistent, minimal model for non-linear market impact," Papers 1412.0141, arXiv.org, revised Mar 2015.
    6. Lillo Fabrizio & Farmer J. Doyne, 2004. "The Long Memory of the Efficient Market," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 8(3), pages 1-35, September.
    7. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    8. Yuki Sato & Kiyoshi Kanazawa, 2023. "Can we infer microscopic financial information from the long memory in market-order flow?: a quantitative test of the Lillo-Mike-Farmer model," Papers 2301.13505, arXiv.org, revised Aug 2023.
    9. F. Lillo & Szabolcs Mike & J. Doyne Farmer, 2004. "A theory for long-memory in supply and demand," Papers cond-mat/0412708, arXiv.org, revised Mar 2005.
    10. Gabriella Vaglica & Fabrizio Lillo & Rosario N. Mantegna, 2010. "Statistical identification with hidden Markov models of large order splitting strategies in an equity market," Papers 1003.2981, arXiv.org.
    11. Tóth, Bence & Palit, Imon & Lillo, Fabrizio & Farmer, J. Doyne, 2015. "Why is equity order flow so persistent?," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 218-239.
    12. Esteban Moro & Javier Vicente & Luis G. Moyano & Austin Gerig & J. Doyne Farmer & Gabriella Vaglica & Fabrizio Lillo & Rosario N. Mantegna, 2009. "Market impact and trading profile of large trading orders in stock markets," Papers 0908.0202, arXiv.org.
    13. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Optimal Formulations for Nonlinear Autoregressive Processes," Tinbergen Institute Discussion Papers 14-103/III, Tinbergen Institute.
    14. Zoubin Ghahramani, 2015. "Probabilistic machine learning and artificial intelligence," Nature, Nature, vol. 521(7553), pages 452-459, May.
    15. Yuki Sato & Kiyoshi Kanazawa, 2023. "Exact solution to a generalised Lillo-Mike-Farmer model with heterogeneous order-splitting strategies," Papers 2306.13378, arXiv.org, revised Nov 2023.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fabrizio Lillo, 2021. "Order flow and price formation," Papers 2105.00521, arXiv.org.
    2. Damian Eduardo Taranto & Giacomo Bormetti & Jean-Philippe Bouchaud & Fabrizio Lillo & Bence Toth, 2016. "Linear models for the impact of order flow on prices II. The Mixture Transition Distribution model," Papers 1604.07556, arXiv.org.
    3. Damian Eduardo Taranto & Giacomo Bormetti & Jean-Philippe Bouchaud & Fabrizio Lillo & Bence Toth, 2016. "Linear models for the impact of order flow on prices I. Propagators: Transient vs. History Dependent Impact," Papers 1602.02735, arXiv.org.
    4. Frédéric Bucci & Michael Benzaquen & Fabrizio Lillo & Jean-Philippe Bouchaud, 2019. "Slow Decay of Impact in Equity Markets: Insights from the ANcerno Database," Post-Print hal-02323357, HAL.
    5. Yuki Sato & Kiyoshi Kanazawa, 2023. "Exact solution to a generalised Lillo-Mike-Farmer model with heterogeneous order-splitting strategies," Papers 2306.13378, arXiv.org, revised Nov 2023.
    6. Olivier Guéant, 2016. "The Financial Mathematics of Market Liquidity: From Optimal Execution to Market Making," Post-Print hal-01393136, HAL.
    7. Zoltan Eisler & Jean-Philippe Bouchaud, 2016. "Price impact without order book: A study of the OTC credit index market," Papers 1609.04620, arXiv.org.
    8. Fr'ed'eric Bucci & Michael Benzaquen & Fabrizio Lillo & Jean-Philippe Bouchaud, 2019. "Slow decay of impact in equity markets: insights from the ANcerno database," Papers 1901.05332, arXiv.org, revised Jan 2019.
    9. Yamamoto, Ryuichi, 2019. "Dynamic Predictor Selection And Order Splitting In A Limit Order Market," Macroeconomic Dynamics, Cambridge University Press, vol. 23(5), pages 1757-1792, July.
    10. Thibault Jaisson, 2014. "Market impact as anticipation of the order flow imbalance," Papers 1402.1288, arXiv.org.
    11. B. Tóth & Z. Eisler & F. Lillo & J. Kockelkoren & J.-P. Bouchaud & J.D. Farmer, 2012. "How does the market react to your order flow?," Quantitative Finance, Taylor & Francis Journals, vol. 12(7), pages 1015-1024, May.
    12. Emilio Said, 2022. "Market Impact: Empirical Evidence, Theory and Practice," Working Papers hal-03668669, HAL.
    13. Kevin Primicerio & Damien Challet, 2018. "Large large-trader activity weakens the long memory of limit order markets," Papers 1803.08390, arXiv.org.
    14. Bonart, Julius & Lillo, Fabrizio, 2018. "A continuous and efficient fundamental price on the discrete order book grid," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 503(C), pages 698-713.
    15. Bence Toth & Imon Palit & Fabrizio Lillo & J. Doyne Farmer, 2011. "Why is order flow so persistent?," Papers 1108.1632, arXiv.org, revised Nov 2014.
    16. Joshin Murai, 2016. "A model of transaction signs with order splitting and public information," Evolutionary and Institutional Economics Review, Springer, vol. 13(2), pages 469-480, December.
    17. Axioglou, Christos & Skouras, Spyros, 2011. "Markets change every day: Evidence from the memory of trade direction," Journal of Empirical Finance, Elsevier, vol. 18(3), pages 423-446, June.
    18. Martin D. Gould & Mason A. Porter & Sam D. Howison, 2015. "The Long Memory of Order Flow in the Foreign Exchange Spot Market," Papers 1504.04354, arXiv.org, revised Oct 2015.
    19. Bence Toth & Yves Lemperiere & Cyril Deremble & Joachim de Lataillade & Julien Kockelkoren & Jean-Philippe Bouchaud, 2011. "Anomalous price impact and the critical nature of liquidity in financial markets," Papers 1105.1694, arXiv.org, revised Nov 2011.
    20. Julius Bonart & Fabrizio Lillo, 2016. "A continuous and efficient fundamental price on the discrete order book grid," Papers 1608.00756, arXiv.org, revised Aug 2016.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2307.02375. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.