IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v678y2025ics0378437125006004.html

Time series forecasting enhanced by Lyapunov exponent via attention mechanism

Author

Listed:
  • Lima, Reneé Rodrigues
  • Alves, Jerson Leite
  • dos Santos, Francisco Alves
  • Misturini, Davi Wanderley
  • Florindo, Joao B.

Abstract

This paper proposes a novel time series forecasting approach that integrates chaos theory and deep learning. By computing local Lyapunov exponents over a sliding window, we extract the dynamic structure of the time series and inject this information into deep models via a self-attention mechanism. This enriched representation enhances the model’s ability to capture nonlinear and “quasi-chaotic” patterns. We apply our method to three deep learning architectures (N-BEATS, LSTM, and GRU), comparing their standard and chaotic-aware versions across seven datasets—one synthetic and six real-world datasets from finance, energy, traffic, and climate domains. Experimental results show that our approach improves forecasting accuracy by an average of 28.0% over traditional deep learning models and 30.8% compared to state-of-the-art methods, according to MAE, RMSE, and MAPE metrics. These findings highlight the potential of combining Lyapunov-based local dynamics and attention mechanisms for robust and interpretable forecasting, especially in complex time series with nonlinear behaviors.

Suggested Citation

  • Lima, Reneé Rodrigues & Alves, Jerson Leite & dos Santos, Francisco Alves & Misturini, Davi Wanderley & Florindo, Joao B., 2025. "Time series forecasting enhanced by Lyapunov exponent via attention mechanism," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 678(C).
  • Handle: RePEc:eee:phsmap:v:678:y:2025:i:c:s0378437125006004
    DOI: 10.1016/j.physa.2025.130948
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437125006004
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2025.130948?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Xinhe Liu & Wenmin Wang, 2024. "Deep Time Series Forecasting Models: A Comprehensive Survey," Mathematics, MDPI, vol. 12(10), pages 1-33, May.
    2. Huang, Xiaoqiao & Li, Qiong & Tai, Yonghang & Chen, Zaiqing & Liu, Jun & Shi, Junsheng & Liu, Wuming, 2022. "Time series forecasting for hourly photovoltaic power using conditional generative adversarial network and Bi-LSTM," Energy, Elsevier, vol. 246(C).
    3. Cheng, Wei & Wang, Yan & Peng, Zheng & Ren, Xiaodong & Shuai, Yubei & Zang, Shengyin & Liu, Hao & Cheng, Hao & Wu, Jiagui, 2021. "High-efficiency chaotic time series prediction based on time convolution neural network," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).
    4. Karakasidis, Theodoros E. & Charakopoulos, Avraam, 2009. "Detection of low-dimensional chaos in wind time series," Chaos, Solitons & Fractals, Elsevier, vol. 41(4), pages 1723-1732.
    5. Noman Khan & Ijaz Ul Haq & Fath U Min Ullah & Samee Ullah Khan & Mi Young Lee, 2021. "CL-Net: ConvLSTM-Based Hybrid Architecture for Batteries’ State of Health and Power Consumption Forecasting," Mathematics, MDPI, vol. 9(24), pages 1-22, December.
    6. Sun, Ying & Zhang, Luying & Yao, Minghui, 2023. "Chaotic time series prediction of nonlinear systems based on various neural network models," Chaos, Solitons & Fractals, Elsevier, vol. 175(P1).
    7. Prasina, A. & Pandi, V. Samuthira & Nancy, W. & Thilagam, K. & Veena, K. & Muniyappan, A., 2025. "Synchronization and chimeras in asymmetrically coupled memristive Tabu learning neuron network," Applied Mathematics and Computation, Elsevier, vol. 489(C).
    8. Aderemi Adewumi & Jimmy Kagamba & Alex Alochukwu, 2016. "Application of Chaos Theory in the Prediction of Motorised Traffic Flows on Urban Networks," Mathematical Problems in Engineering, Hindawi, vol. 2016, pages 1-15, January.
    9. Kugiumtzis Dimitris, 2008. "Evaluation of Surrogate and Bootstrap Tests for Nonlinearity in Time Series," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 12(1), pages 1-26, March.
    10. Valle, João & Bruno, Odemir Martinez, 2025. "Forecasting chaotic time series: Comparative performance of LSTM-based and Transformer-based neural network," Chaos, Solitons & Fractals, Elsevier, vol. 192(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miao, Hua & Zhu, Wei & Dan, Yuanhong & Yu, Nanxiang, 2024. "Chaotic time series prediction based on multi-scale attention in a multi-agent environment," Chaos, Solitons & Fractals, Elsevier, vol. 183(C).
    2. Feng, Jiacheng & Jiang, Lin & Yan, Lianshan & He, Xingchen & Yi, Anlin & Pan, Wei & Luo, Bin, 2024. "Modeling of high-dimensional time-delay chaotic system based on Fourier neural operator," Chaos, Solitons & Fractals, Elsevier, vol. 188(C).
    3. Pedro Reis & Ana Paula Serra & Jo~ao Gama, 2025. "The Role of Deep Learning in Financial Asset Management: A Systematic Review," Papers 2503.01591, arXiv.org.
    4. Li Wang & Xing-Lu Gao & Wei-Xing Zhou, 2023. "Testing For Intrinsic Multifractality In The Global Grain Spot Market Indices: A Multifractal Detrended Fluctuation Analysis," FRACTALS (fractals), World Scientific Publishing Co. Pte. Ltd., vol. 31(07), pages 1-24.
    5. Nadimi, Reza & Goto, Mika, 2025. "A novel decision support system for enhancing long-term forecast accuracy in virtual power plants using bidirectional long short-term memory networks," Applied Energy, Elsevier, vol. 382(C).
    6. Wenting Zhao & Haoran Xu & Peng Chen & Juan Zhang & Jing Li & Tingting Cai, 2025. "Elastic Momentum-Enhanced Adaptive Hybrid Method for Short-Term Load Forecasting," Energies, MDPI, vol. 18(13), pages 1-25, June.
    7. Xiao, Zenan & Huang, Xiaoqiao & Liu, Jun & Li, Chengli & Tai, Yonghang, 2023. "A novel method based on time series ensemble model for hourly photovoltaic power prediction," Energy, Elsevier, vol. 276(C).
    8. Sizhe Xie & Yao Li & Peng Wang, 2024. "Optimal Scheduling of Off-Site Industrial Production in the Context of Distributed Photovoltaics," Energies, MDPI, vol. 17(9), pages 1-18, April.
    9. Adir Saly-Kaufmann & Kieran Wood & Jan Peter-Calliess & Stefan Zohren, 2026. "Deep Learning for Financial Time Series: A Large-Scale Benchmark of Risk-Adjusted Performance," Papers 2603.01820, arXiv.org.
    10. Filipe R. Ramos & Luisa M. Martinez & Luis F. Martinez & Ricardo Abreu & Lihki Rubio, 2025. "Mapping e-commerce trends in the USA: a time series and deep learning approach," Journal of Marketing Analytics, Palgrave Macmillan, vol. 13(3), pages 606-634, September.
    11. Zhang, Yunfei & Zhou, Zhihua & Liu, Junwei & Yuan, Jianjuan, 2022. "Data augmentation for improving heating load prediction of heating substation based on TimeGAN," Energy, Elsevier, vol. 260(C).
    12. Chang, Tian-Pau & Ko, Hong-Hsi & Liu, Feng-Jiao & Chen, Pai-Hsun & Chang, Ying-Pin & Liang, Ying-Hsin & Jang, Horng-Yuan & Lin, Tsung-Chi & Chen, Yi-Hwa, 2012. "Fractal dimension of wind speed time series," Applied Energy, Elsevier, vol. 93(C), pages 742-749.
    13. Huang, Songtao & Zhou, Qingguo & Shen, Jun & Zhou, Heng & Yong, Binbin, 2024. "Multistage spatio-temporal attention network based on NODE for short-term PV power forecasting," Energy, Elsevier, vol. 290(C).
    14. Kang, Mingu & Hong, Joongi & Kim, Suntae, 2025. "Harnessing technical indicators with deep learning based price forecasting for cryptocurrency trading," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 660(C).
    15. Papapetrou, M. & Kugiumtzis, D., 2013. "Markov chain order estimation with conditional mutual information," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(7), pages 1593-1601.
    16. repec:jss:jstsof:33:i05 is not listed on IDEAS
    17. Tian, Zhirui & Wang, Jiyang, 2023. "A wind speed prediction system based on new data preprocessing strategy and improved multi-objective optimizer," Renewable Energy, Elsevier, vol. 215(C).
    18. Hong Wu & Haipeng Liu & Huaiping Jin & Yanping He, 2024. "Ultra-Short-Term Photovoltaic Power Prediction by NRGA-BiLSTM Considering Seasonality and Periodicity of Data," Energies, MDPI, vol. 17(18), pages 1-19, September.
    19. Kun Zheng & Zhiyuan Sun & Yi Song & Chen Zhang & Chunyu Zhang & Fuhao Chang & Dechang Yang & Xueqian Fu, 2025. "Stochastic Scenario Generation Methods for Uncertainty in Wind and Photovoltaic Power Outputs: A Comprehensive Review," Energies, MDPI, vol. 18(3), pages 1-31, January.
    20. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    21. Chen, Baoliang & Liu, Yonggui, 2025. "Data driven-based health prognostics and charge estimation for lithium-ion batteries under varying discharging patterns," Energy, Elsevier, vol. 335(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:678:y:2025:i:c:s0378437125006004. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.