IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0333379.html
   My bibliography  Save this article

TIC-FusionNet: A multimodal deep learning framework with temporal decomposition and attention-based fusion for time series forecasting

Author

Listed:
  • Liyu Chen
  • Xiangwei Fan

Abstract

We propose TIC-FusionNet, a trend-aware multimodal deep learning framework for time series forecasting with integrated visual signal analysis, aimed at addressing the limitations of unimodal and short-range dependency models in noisy financial environments. The architecture combines Exponential Moving Average (EMA) decomposition for denoising and trend extraction, a lightweight Linear Transformer for efficient long-sequence temporal modeling, and a spatial–channel CNN with CBAM attention to capture morphological patterns from candlestick chart images. A gated fusion mechanism adaptively integrates numerical and visual modalities based on context relevance, enabling dynamic feature weighting under varying market conditions. We evaluate TIC-FusionNet on six real-world stock datasets, including four major Chinese and U.S. companies—Amazon, Tesla, Kweichow Moutai, Ping An Insurance, China Vanke—and Apple—covering diverse market sectors and volatility patterns. The model is compared against a broad range of baselines, including statistical models (ARIMA), classical machine learning methods (Random Forest, SVR), recurrent and convolutional neural networks (LSTM, TCN, CNN-only), and recent Transformer-based architectures (Informer, Autoformer, Crossformer, iTransformer). Experimental results demonstrate that TIC-FusionNet achieves consistently superior predictive accuracy and generalization, outperforming state-of-the-art baselines across all datasets. Extensive ablation studies verify the critical role of each architectural component, while attention-based interpretability analysis highlights the dominant technical indicators under different volatility regimes. These findings not only confirm the effectiveness of multimodal integration in capturing complementary temporal–visual cues, but also provide valuable insights into model decision-making. The proposed framework offers a robust, scalable, and interpretable solution for multimodal temporal prediction tasks, with strong potential for deployment in intelligent forecasting, sensor fusion, and risk-aware decision-making systems.

Suggested Citation

  • Liyu Chen & Xiangwei Fan, 2025. "TIC-FusionNet: A multimodal deep learning framework with temporal decomposition and attention-based fusion for time series forecasting," PLOS ONE, Public Library of Science, vol. 20(10), pages 1-35, October.
  • Handle: RePEc:plo:pone00:0333379
    DOI: 10.1371/journal.pone.0333379
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0333379
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0333379&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0333379?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    2. Fischer, Thomas & Krauss, Christopher, 2018. "Deep learning with long short-term memory networks for financial market predictions," European Journal of Operational Research, Elsevier, vol. 270(2), pages 654-669.
    3. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrés García-Medina & Ester Aguayo-Moreno, 2024. "LSTM–GARCH Hybrid Model for the Prediction of Volatility in Cryptocurrency Portfolios," Computational Economics, Springer;Society for Computational Economics, vol. 63(4), pages 1511-1542, April.
    2. Yang, Xiaoqi & Vagnani, Gianluca & Dong, Yan & Ji, Xu, 2024. "Short selling and firms’ long-term stock return volatility: Evidence from Chinese concept stocks in Hong Kong," Finance Research Letters, Elsevier, vol. 70(C).
    3. Pierre J. Venter & Eben Maré, 2020. "GARCH Generated Volatility Indices of Bitcoin and CRIX," JRFM, MDPI, vol. 13(6), pages 1-15, June.
    4. Paul Handro & Bogdan Dima, 2024. "Analyzing Financial Markets Efficiency: Insights from a Bibliometric and Content Review," Journal of Financial Studies, Institute of Financial Studies, vol. 16(9), pages 119-175, May.
    5. Mikhail Makushkin & Victor Lapshin, 2023. "Dynamic Nelson–Siegel model for market risk estimation of bonds: Practical implementation," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 69, pages 5-27.
    6. Xiufeng Yan, 2021. "Autoregressive conditional duration modelling of high frequency data," Papers 2111.02300, arXiv.org.
    7. DUȚĂ, Violeta, 2018. "Using The Symmetric Models Garch (1.1) And Garch-M (1.1) To Investigate Volatility And Persistence For The European And Us Financial Markets," Studii Financiare (Financial Studies), Centre of Financial and Monetary Research "Victor Slavescu", vol. 22(1), pages 64-86.
    8. Wu, Qi & Yan, Xing, 2019. "Capturing deep tail risk via sequential learning of quantile dynamics," Journal of Economic Dynamics and Control, Elsevier, vol. 109(C).
    9. Benjamin R. Auer, 2019. "Does the strength of capital market anomalies exhibit seasonal patterns?," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 43(1), pages 91-103, January.
    10. Wang, Yijun & Andreeva, Galina & Martin-Barragan, Belen, 2023. "Machine learning approaches to forecasting cryptocurrency volatility: Considering internal and external determinants," International Review of Financial Analysis, Elsevier, vol. 90(C).
    11. Guillaume Coqueret, 2016. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02088097, HAL.
    12. Yoontae Hwang & Stefan Zohren, 2025. "Signature-Informed Transformer for Asset Allocation," Papers 2510.03129, arXiv.org.
    13. Michele Vodret & Iacopo Mastromatteo & Bence Tóth & Michael Benzaquen, 2023. "Microfounding GARCH models and beyond: a Kyle-inspired model with adaptive agents," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 18(3), pages 599-625, July.
    14. Weilong Fu & Ali Hirsa & Jorg Osterrieder, 2022. "Simulating financial time series using attention," Papers 2207.00493, arXiv.org.
    15. Aliyu, Shehu Usman Rano, 2020. "What have we learnt from modelling stock returns in Nigeria: Higgledy-piggledy?," MPRA Paper 110382, University Library of Munich, Germany, revised 06 Jun 2021.
    16. Yutong Chen & Paul Bilokon & Conan Hales & Laura Kerr, 2023. "Real-time VaR Calculations for Crypto Derivatives in kdb+/q," Papers 2309.06393, arXiv.org.
    17. Lu Wang & Feng Ma & Guoshan Liu & Qiaoqi Lang, 2023. "Do extreme shocks help forecast oil price volatility? The augmented GARCH‐MIDAS approach," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 2056-2073, April.
    18. Kei Katahira & Yu Chen, 2019. "Heterogeneous wealth distribution, round-trip trading and the emergence of volatility clustering in Speculation Game," Papers 1909.03185, arXiv.org.
    19. Tetsuya Takaishi, 2021. "Time-varying properties of asymmetric volatility and multifractality in Bitcoin," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-21, February.
    20. Jan Jakub Szczygielski & Chimwemwe Chipeta, 2023. "Properties of returns and variance and the implications for time series modelling: Evidence from South Africa," Modern Finance, Modern Finance Institute, vol. 1(1), pages 35-55.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0333379. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.