IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i21p3320-d1504802.html
   My bibliography  Save this article

TVGeAN: Tensor Visibility Graph-Enhanced Attention Network for Versatile Multivariant Time Series Learning Tasks

Author

Listed:
  • Mohammed Baz

    (Department of Computer Engineering, College of Computers and Information Technology, Taif University, Taif 21944, Saudi Arabia)

Abstract

This paper introduces Tensor Visibility Graph-enhanced Attention Networks (TVGeAN), a novel graph autoencoder model specifically designed for MTS learning tasks. The underlying approach of TVGeAN is to combine the power of complex networks in representing time series as graphs with the strengths of Graph Neural Networks (GNNs) in learning from graph data. TVGeAN consists of two new main components: TVG which extend the capabilities of visibility graph algorithms in representing MTSs by converting them into weighted temporal graphs where both the nodes and the edges are tensors. Each node in the TVG represents the MTS observations at a particular time, while the weights of the edges are defined based on the visibility angle algorithm. The second main component of the proposed model is GeAN, a novel graph attention mechanism developed to seamlessly integrate the temporal interactions represented in the nodes and edges of the graphs into the core learning process. GeAN achieves this by using the outer product to quantify the pairwise interactions of nodes and edges at a fine-grained level and a bilinear model to effectively distil the knowledge interwoven in these representations. From an architectural point of view, TVGeAN builds on the autoencoder approach complemented by sparse and variational learning units. The sparse learning unit is used to promote inductive learning in TVGeAN, and the variational learning unit is used to endow TVGeAN with generative capabilities. The performance of the TVGeAN model is extensively evaluated against four widely cited MTS benchmarks for both supervised and unsupervised learning tasks. The results of these evaluations show the high performance of TVGeAN for various MTS learning tasks. In particular, TVGeAN can achieve an average root mean square error of 6.8 for the C-MPASS dataset (i.e., regression learning tasks) and a precision close to one for the SMD, MSL, and SMAP datasets (i.e., anomaly detection learning tasks), which are better results than most published works.

Suggested Citation

  • Mohammed Baz, 2024. "TVGeAN: Tensor Visibility Graph-Enhanced Attention Network for Versatile Multivariant Time Series Learning Tasks," Mathematics, MDPI, vol. 12(21), pages 1-33, October.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:21:p:3320-:d:1504802
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/21/3320/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/21/3320/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ana Lazcano & Pedro Javier Herrera & Manuel Monge, 2023. "A Combined Model Based on Recurrent Neural Networks and Graph Convolutional Networks for Financial Time Series Forecasting," Mathematics, MDPI, vol. 11(1), pages 1-21, January.
    2. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178, Decembrie.
    3. Yang, Yue & Yang, Huijie, 2008. "Complex network-based time series analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(5), pages 1381-1386.
    4. Markku Lanne & Henri Nyberg, 2016. "Generalized Forecast Error Variance Decomposition for Linear and Nonlinear Multivariate Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(4), pages 595-603, August.
    5. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mario Figueiredo & Yuri F. Saporito, 2023. "Forecasting the term structure of commodities future prices using machine learning," Digital Finance, Springer, vol. 5(1), pages 57-90, March.
    2. Avanzi, Benjamin & Taylor, Greg & Vu, Phuong Anh & Wong, Bernard, 2020. "A multivariate evolutionary generalised linear model framework with adaptive estimation for claims reserving," Insurance: Mathematics and Economics, Elsevier, vol. 93(C), pages 50-71.
    3. Tomoya Mori & Daisuke Murakami, 2025. "Sustainability of cities under declining population and decreasing distance frictions: The case of Japan," KIER Working Papers 1117, Kyoto University, Institute of Economic Research.
    4. Sudhamayee, K. & Krishna, M. Gopal & Manimaran, P., 2023. "Simplicial network analysis on EEG signals," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    5. François R. Velde, 2009. "Chronicle of a Deflation Unforetold," Journal of Political Economy, University of Chicago Press, vol. 117(4), pages 591-634, August.
    6. Wen Xu, 2016. "Estimation of Dynamic Panel Data Models with Stochastic Volatility Using Particle Filters," Econometrics, MDPI, vol. 4(4), pages 1-13, October.
    7. Labib Shami & Teddy Lazebnik, 2024. "Implementing Machine Learning Methods in Estimating the Size of the Non-observed Economy," Computational Economics, Springer;Society for Computational Economics, vol. 63(4), pages 1459-1476, April.
    8. Blasques, F. & Francq, Christian & Laurent, Sébastien, 2024. "Autoregressive conditional betas," Journal of Econometrics, Elsevier, vol. 238(2).
    9. Alejandro Rodriguez & Esther Ruiz, 2009. "Bootstrap prediction intervals in state–space models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 167-178, March.
    10. Parrini, Alessandro, 2013. "Importance Sampling for Portfolio Credit Risk in Factor Copula Models," MPRA Paper 103745, University Library of Munich, Germany.
    11. Jean-Luc Gaffard, 2014. "Crise de la théorie et crise de la politique économique. Des modèles d'équilibre général stochastique aux modèles de dynamique hors de l'équilibre," Revue économique, Presses de Sciences-Po, vol. 65(1), pages 71-96.
    12. Salman Huseynov, 2021. "Long and short memory in dynamic term structure models," CREATES Research Papers 2021-15, Department of Economics and Business Economics, Aarhus University.
    13. Tsionas, Mike G., 2021. "Bayesian forecasting with the structural damped trend model," International Journal of Production Economics, Elsevier, vol. 234(C).
    14. Tommaso Proietti, 2002. "Some Reflections on Trend-Cycle Decompositions with Correlated Components," Econometrics 0209002, University Library of Munich, Germany.
    15. Tobias Hartl & Roland Jucknewitz, 2022. "Approximate state space modelling of unobserved fractional components," Econometric Reviews, Taylor & Francis Journals, vol. 41(1), pages 75-98, January.
    16. Broto Carmen & Ruiz Esther, 2009. "Testing for Conditional Heteroscedasticity in the Components of Inflation," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 13(2), pages 1-30, May.
    17. Marczak, Martyna & Proietti, Tommaso, 2016. "Outlier detection in structural time series models: The indicator saturation approach," International Journal of Forecasting, Elsevier, vol. 32(1), pages 180-202.
    18. Oreste Napolitano & Alberto Montagnoli, 2010. "The European Unemployment Gap and the Role of Monetary Policy," Economics Bulletin, AccessEcon, vol. 30(2), pages 1346-1358.
    19. Liu, Keshi & Weng, Tongfeng & Gu, Changgui & Yang, Huijie, 2020. "Visibility graph analysis of Bitcoin price series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 538(C).
    20. Joshua Chan & Arnaud Doucet & Roberto León-González & Rodney W. Strachan, 2018. "Multivariate Stochastic Volatility with Co-Heteroscedasticity," Working Paper series 18-38, Rimini Centre for Economic Analysis.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:21:p:3320-:d:1504802. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.