IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2007.15545.html
   My bibliography  Save this paper

Modelling time-varying interactions in complex systems: the Score Driven Kinetic Ising Model

Author

Listed:
  • Carlo Campajola
  • Domenico Di Gangi
  • Fabrizio Lillo
  • Daniele Tantari

Abstract

A common issue when analyzing real-world complex systems is that the interactions between the elements often change over time: this makes it difficult to find optimal models that describe this evolution and that can be estimated from data, particularly when the driving mechanisms are not known. Here we offer a new perspective on the development of models for time-varying interactions introducing a generalization of the well-known Kinetic Ising Model (KIM), a minimalistic pairwise constant interactions model which has found applications in multiple scientific disciplines. Keeping arbitrary choices of dynamics to a minimum and seeking information theoretical optimality, the Score-Driven methodology lets us significantly increase the knowledge that can be extracted from data using the simple KIM. In particular, we first identify a parameter whose value at a given time can be directly associated with the local predictability of the dynamics. Then we introduce a method to dynamically learn the value of such parameter from the data, without the need of specifying parametrically its dynamics. Finally, we extend our framework to disentangle different sources (e.g. endogenous vs exogenous) of predictability in real time. We apply our methodology to several complex systems including financial markets, temporal (social) networks, and neuronal populations. Our results show that the Score-Driven KIM produces insightful descriptions of the systems, allowing to predict forecasting accuracy in real time as well as to separate different components of the dynamics. This provides a significant methodological improvement for data analysis in a wide range of disciplines.

Suggested Citation

  • Carlo Campajola & Domenico Di Gangi & Fabrizio Lillo & Daniele Tantari, 2020. "Modelling time-varying interactions in complex systems: the Score Driven Kinetic Ising Model," Papers 2007.15545, arXiv.org, revised Aug 2021.
  • Handle: RePEc:arx:papers:2007.15545
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2007.15545
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. F. Blasques & S. J. Koopman & A. Lucas, 2015. "Information-theoretic optimality of observation-driven time series models for continuous responses," Biometrika, Biometrika Trust, vol. 102(2), pages 325-343.
    2. Hautsch, Nikolaus & Hess, Dieter & Veredas, David, 2011. "The impact of macroeconomic news on quote adjustments, noise, and informational volatility," Journal of Banking & Finance, Elsevier, vol. 35(10), pages 2733-2746, October.
    3. BAUWENS, Luc & VEREDAS, David, 1999. "The stochastic conditional duration model: a latent factor model for the analysis of financial durations," LIDAM Discussion Papers CORE 1999058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. Fabrizio Lillo & Salvatore Miccich� & Michele Tumminello & Jyrki Piilo & Rosario N. Mantegna, 2015. "How news affects the trading behaviour of different categories of investors in a financial market," Quantitative Finance, Taylor & Francis Journals, vol. 15(2), pages 213-229, February.
    5. Stephen J. Hardiman & Nicolas Bercot & Jean-Philippe Bouchaud, 2013. "Critical reflexivity in financial markets: a Hawkes process analysis," Papers 1302.1405, arXiv.org, revised Jun 2013.
    6. Vladimir Filimonov & Didier Sornette, 2012. "Quantifying reflexivity in financial markets: towards a prediction of flash crashes," Papers 1201.3572, arXiv.org, revised Apr 2012.
    7. Albert J. Menkveld & Bart Zhou Yueshen, 2019. "The Flash Crash: A Cautionary Tale About Highly Fragmented Markets," Management Science, INFORMS, vol. 65(10), pages 4470-4488, October.
    8. Bauwens, Luc & Veredas, David, 2004. "The stochastic conditional duration model: a latent variable model for the analysis of financial durations," Journal of Econometrics, Elsevier, vol. 119(2), pages 381-412, April.
    9. Chuliá, Helena & Martens, Martin & Dijk, Dick van, 2010. "Asymmetric effects of federal funds target rate changes on S&P100 stock returns, volatilities and correlations," Journal of Banking & Finance, Elsevier, vol. 34(4), pages 834-839, April.
    10. Christian Francq & Lajos Horváth, 2011. "Merits and Drawbacks of Variance Targeting in GARCH Models," Journal of Financial Econometrics, Oxford University Press, vol. 9(4), pages 619-656.
    11. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107630024.
    12. Stephen Hardiman & Nicolas Bercot & Jean-Philippe Bouchaud, 2013. "Critical reflexivity in financial markets: a Hawkes process analysis," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 86(10), pages 1-9, October.
    13. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    14. Tauchen, George E & Pitts, Mark, 1983. "The Price Variability-Volume Relationship on Speculative Markets," Econometrica, Econometric Society, vol. 51(2), pages 485-505, March.
    15. Stephen J. Hardiman & Jean-Philippe Bouchaud, 2014. "Branching ratio approximation for the self-exciting Hawkes process," Papers 1403.5227, arXiv.org, revised Oct 2014.
    16. Carlo Campajola & Fabrizio Lillo & Daniele Tantari, 2020. "Unveiling the relation between herding and liquidity with trader lead-lag networks," Quantitative Finance, Taylor & Francis Journals, vol. 20(11), pages 1765-1778, November.
    17. Mazzarisi, P. & Barucca, P. & Lillo, F. & Tantari, D., 2020. "A dynamic network model with persistent links and node-specific latent variables, with an application to the interbank market," European Journal of Operational Research, Elsevier, vol. 281(1), pages 50-65.
    18. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    19. Carlo Campajola & Fabrizio Lillo & Daniele Tantari, 2019. "Unveiling the relation between herding and liquidity with trader lead-lag networks," Papers 1909.10807, arXiv.org, revised Mar 2020.
    20. Vladimir Filimonov & Didier Sornette, 2012. "Quantifying Reflexivity in Financial Markets: Towards a Prediction of Flash Crashes," Swiss Finance Institute Research Paper Series 12-02, Swiss Finance Institute.
    21. Francesco Calvori & Drew Creal & Siem Jan Koopman & André Lucas, 2017. "Testing for Parameter Instability across Different Modeling Frameworks," Journal of Financial Econometrics, Oxford University Press, vol. 15(2), pages 223-246.
    22. Tucci, Marco P., 1995. "Time-varying parameters: a critical introduction," Structural Change and Economic Dynamics, Elsevier, vol. 6(2), pages 237-260, June.
    23. Christian M. Hafner & Hans Manner, 2012. "Dynamic stochastic copula models: estimation, inference and applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(2), pages 269-295, March.
    24. V. Filimonov & D. Sornette, 2015. "Apparent criticality and calibration issues in the Hawkes self-excited point process model: application to high-frequency financial data," Quantitative Finance, Taylor & Francis Journals, vol. 15(8), pages 1293-1314, August.
    25. Spencer Wheatley & Alexander Wehrli & Didier Sornette, 2019. "The endo–exo problem in high frequency financial price fluctuations and rejecting criticality," Quantitative Finance, Taylor & Francis Journals, vol. 19(7), pages 1165-1178, July.
    26. Francisco (F.) Blasques & Andre (A.) Lucas & Andries van Vlodrop, 2017. "Finite Sample Optimality of Score-Driven Volatility Models," Tinbergen Institute Discussion Papers 17-111/III, Tinbergen Institute.
    27. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    28. D. Sornette, 2014. "Physics and Financial Economics (1776-2014): Puzzles, Ising and Agent-Based models," Papers 1404.0243, arXiv.org.
    29. Andrei Kirilenko & Albert S. Kyle & Mehrdad Samadi & Tugkan Tuzun, 2017. "The Flash Crash: High-Frequency Trading in an Electronic Market," Journal of Finance, American Finance Association, vol. 72(3), pages 967-998, June.
    30. Shephard, Neil (ed.), 2005. "Stochastic Volatility: Selected Readings," OUP Catalogue, Oxford University Press, number 9780199257201.
    31. Stefan Bornholdt, 2001. "Expectation Bubbles In A Spin Model Of Markets: Intermittency From Frustration Across Scales," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 12(05), pages 667-674.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francesco Calvori & Drew Creal & Siem Jan Koopman & Andre Lucas, 2014. "Testing for Parameter Instability in Competing Modeling Frameworks," Tinbergen Institute Discussion Papers 14-010/IV/DSF71, Tinbergen Institute.
    2. Tobias Eckernkemper & Bastian Gribisch, 2021. "Intraday conditional value at risk: A periodic mixed‐frequency generalized autoregressive score approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(5), pages 883-910, August.
    3. Domenico Di Gangi & Giacomo Bormetti & Fabrizio Lillo, 2022. "Score Driven Generalized Fitness Model for Sparse and Weighted Temporal Networks," Papers 2202.09854, arXiv.org, revised Mar 2022.
    4. Buccheri, Giuseppe & Corsi, Fulvio & Flandoli, Franco & Livieri, Giulia, 2021. "The continuous-time limit of score-driven volatility models," Journal of Econometrics, Elsevier, vol. 221(2), pages 655-675.
    5. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    6. Mathieu Rosenbaum & Jianfei Zhang, 2022. "On the universality of the volatility formation process: when machine learning and rough volatility agree," Papers 2206.14114, arXiv.org.
    7. Swishchuk, Anatoliy & Zagst, Rudi & Zeller, Gabriela, 2021. "Hawkes processes in insurance: Risk model, application to empirical data and optimal investment," Insurance: Mathematics and Economics, Elsevier, vol. 101(PA), pages 107-124.
    8. Nguyen, Hoang & Javed, Farrukh, 2021. "Dynamic relationship between Stock and Bond returns: A GAS MIDAS copula approach," Working Papers 2021:15, Örebro University, School of Business.
    9. Leopoldo Catania & Anna Gloria Billé, 2017. "Dynamic spatial autoregressive models with autoregressive and heteroskedastic disturbances," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(6), pages 1178-1196, September.
    10. Antoine Fosset & Jean-Philippe Bouchaud & Michael Benzaquen, 2020. "Non-parametric Estimation of Quadratic Hawkes Processes for Order Book Events," Papers 2005.05730, arXiv.org.
    11. Marco Bazzi & Francisco Blasques & Siem Jan Koopman & Andre Lucas, 2017. "Time-Varying Transition Probabilities for Markov Regime Switching Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(3), pages 458-478, May.
    12. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Information Theoretic Optimality of Observation Driven Time Series Models," Tinbergen Institute Discussion Papers 14-046/III, Tinbergen Institute.
    13. Didier SORNETTE, 2014. "Physics and Financial Economics (1776-2014): Puzzles, Ising and Agent-Based Models," Swiss Finance Institute Research Paper Series 14-25, Swiss Finance Institute.
    14. Blasques, Francisco & van Brummelen, Janneke & Koopman, Siem Jan & Lucas, André, 2022. "Maximum likelihood estimation for score-driven models," Journal of Econometrics, Elsevier, vol. 227(2), pages 325-346.
    15. Hai-Chuan Xu & Wei-Xing Zhou, 2020. "Modeling aggressive market order placements with Hawkes factor models," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-12, January.
    16. Blasques, Francisco & Ji, Jiangyu & Lucas, André, 2016. "Semiparametric score driven volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 58-69.
    17. Drew Creal & Siem Jan Koopman & André Lucas & Marcin Zamojski, 2015. "Generalized Autoregressive Method of Moments," Tinbergen Institute Discussion Papers 15-138/III, Tinbergen Institute, revised 06 Jul 2018.
    18. Mauro Bernardi & Leopoldo Catania, 2015. "Switching-GAS Copula Models With Application to Systemic Risk," Papers 1504.03733, arXiv.org, revised Jan 2016.
    19. D. Sornette, 2014. "Physics and Financial Economics (1776-2014): Puzzles, Ising and Agent-Based models," Papers 1404.0243, arXiv.org.
    20. Antoine Fosset & Jean-Philippe Bouchaud & Michael Benzaquen, 2020. "Non-parametric Estimation of Quadratic Hawkes Processes for Order Book Events," Working Papers hal-02998555, HAL.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2007.15545. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.