IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2509.10542.html

Adaptive Temporal Fusion Transformers for Cryptocurrency Price Prediction

Author

Listed:
  • Arash Peik
  • Mohammad Ali Zare Chahooki
  • Amin Milani Fard
  • Mehdi Agha Sarram

Abstract

Precise short-term price prediction in the highly volatile cryptocurrency market is critical for informed trading strategies. Although Temporal Fusion Transformers (TFTs) have shown potential, their direct use often struggles in the face of the market's non-stationary nature and extreme volatility. This paper introduces an adaptive TFT modeling approach leveraging dynamic subseries lengths and pattern-based categorization to enhance short-term forecasting. We propose a novel segmentation method where subseries end at relative maxima, identified when the price increase from the preceding minimum surpasses a threshold, thus capturing significant upward movements, which act as key markers for the end of a growth phase, while potentially filtering the noise. Crucially, the fixed-length pattern ending each subseries determines the category assigned to the subsequent variable-length subseries, grouping typical market responses that follow similar preceding conditions. A distinct TFT model trained for each category is specialized in predicting the evolution of these subsequent subseries based on their initial steps after the preceding peak. Experimental results on ETH-USDT 10-minute data over a two-month test period demonstrate that our adaptive approach significantly outperforms baseline fixed-length TFT and LSTM models in prediction accuracy and simulated trading profitability. Our combination of adaptive segmentation and pattern-conditioned forecasting enables more robust and responsive cryptocurrency price prediction.

Suggested Citation

  • Arash Peik & Mohammad Ali Zare Chahooki & Amin Milani Fard & Mehdi Agha Sarram, 2025. "Adaptive Temporal Fusion Transformers for Cryptocurrency Price Prediction," Papers 2509.10542, arXiv.org.
  • Handle: RePEc:arx:papers:2509.10542
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2509.10542
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erdinc Akyildirim & Oguzhan Cepni & Shaen Corbet & Gazi Salah Uddin, 2023. "Forecasting mid-price movement of Bitcoin futures using machine learning," Annals of Operations Research, Springer, vol. 330(1), pages 553-584, November.
    2. Eduardo Ramos-P'erez & Pablo J. Alonso-Gonz'alez & Jos'e Javier N'u~nez-Vel'azquez, 2021. "Multi-Transformer: A New Neural Network-Based Architecture for Forecasting S&P Volatility," Papers 2109.12621, arXiv.org.
    3. Yhlas Sovbetov, 2018. "Factors Influencing Cryptocurrency Prices: Evidence from Bitcoin, Ethereum, Dash, Litcoin, and Monero," Journal of Economics and Financial Analysis, Tripal Publishing House, vol. 2(2), pages 1-27.
    4. Cai, Jun, 1994. "A Markov Model of Switching-Regime ARCH," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(3), pages 309-316, July.
    5. Chuen Yik Kang & Chin Poo Lee & Kian Ming Lim, 2022. "Cryptocurrency Price Prediction with Convolutional Neural Network and Stacked Gated Recurrent Unit," Data, MDPI, vol. 7(11), pages 1-13, October.
    6. Bouteska, Ahmed & Abedin, Mohammad Zoynul & Hajek, Petr & Yuan, Kunpeng, 2024. "Cryptocurrency price forecasting – A comparative analysis of ensemble learning and deep learning methods," International Review of Financial Analysis, Elsevier, vol. 92(C).
    7. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    8. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    9. Marco Bazzi & Francisco Blasques & Siem Jan Koopman & Andre Lucas, 2017. "Time-Varying Transition Probabilities for Markov Regime Switching Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(3), pages 458-478, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arash Peik & Mohammad Ali Zare Chahooki & Amin Milani Fard & Mehdi Agha Sarram, 2024. "Leveraging Time Series Categorization and Temporal Fusion Transformers to Improve Cryptocurrency Price Forecasting," Papers 2412.14529, arXiv.org.
    2. Ataurima Arellano, Miguel & Rodríguez, Gabriel, 2020. "Empirical modeling of high-income and emerging stock and Forex market return volatility using Markov-switching GARCH models," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    3. Chun-Chang Lee & Chih-Min Liang & Hsing-Jung Chou, 2013. "Identifying Taiwan real estate cycle turning points- An application of the multivariate Markov-switching autoregressive Model," Advances in Management and Applied Economics, SCIENPRESS Ltd, vol. 3(2), pages 1-1.
    4. John M. Maheu & Thomas H. McCurdy, 2002. "Nonlinear Features of Realized FX Volatility," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 668-681, November.
    5. Fédéric Holm-Hadulla & Kirstin Hubrich, 2017. "Macroeconomic Implications of Oil Price Fluctuations : A Regime-Switching Framework for the Euro Area," Finance and Economics Discussion Series 2017-063, Board of Governors of the Federal Reserve System (U.S.).
    6. Aloui, Chaker & Hammoudeh, Shawkat & Hamida, Hela Ben, 2015. "Price discovery and regime shift behavior in the relationship between sharia stocks and sukuk: A two-state Markov switching analysis," Pacific-Basin Finance Journal, Elsevier, vol. 34(C), pages 121-135.
    7. Liu, Yue & Sun, Huaping & Zhang, Jijian & Taghizadeh-Hesary, Farhad, 2020. "Detection of volatility regime-switching for crude oil price modeling and forecasting," Resources Policy, Elsevier, vol. 69(C).
    8. Marie Bessec, 2019. "Revisiting the transitional dynamics of business cycle phases with mixed-frequency data," Econometric Reviews, Taylor & Francis Journals, vol. 38(7), pages 711-732, August.
    9. Bu, Ruijun & Cheng, Jie & Hadri, Kaddour, 2016. "Reducible diffusions with time-varying transformations with application to short-term interest rates," Economic Modelling, Elsevier, vol. 52(PA), pages 266-277.
    10. Pelletier, Denis, 2006. "Regime switching for dynamic correlations," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 445-473.
    11. Soo Khoon Goh & Guay Lim & Nilss Olekalns, 2006. "Deviations from uncovered interest parity in Malaysia," Applied Financial Economics, Taylor & Francis Journals, vol. 16(10), pages 745-759.
    12. Ali Atiah Alzahrani, 2025. "Multi-Agent Regime-Conditioned Diffusion (MARCD) for CVaR-Constrained Portfolio Decisions," Papers 2510.10807, arXiv.org, revised Nov 2025.
    13. Pan, Zhiyuan & Xiao, Dongli & Dong, Qingma & Liu, Li, 2022. "Structural breaks, macroeconomic fundamentals and cross hedge ratio," Finance Research Letters, Elsevier, vol. 47(PA).
    14. Yuan, Chunming, 2011. "The exchange rate and macroeconomic determinants: Time-varying transitional dynamics," The North American Journal of Economics and Finance, Elsevier, vol. 22(2), pages 197-220, August.
    15. Kodjovi G. Assoe, 1998. "Regime-Switching in Emerging Stock Market Returns," Multinational Finance Journal, Multinational Finance Journal, vol. 2(2), pages 101-132, June.
    16. Baele, L., 2003. "Volatility Spillover Effects in European Equity Markets," Other publications TiSEM dae0be49-4f32-433e-822b-1, Tilburg University, School of Economics and Management.
    17. Baele, Lieven, 2005. "Volatility Spillover Effects in European Equity Markets," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 40(2), pages 373-401, June.
    18. Raphaël Homayoun Boroumand & Stéphane Goutte & Simon Porcher & Thomas Porcher, 2014. "A Conditional Markov Regime Switching Model to Study Margins: Application to the French Fuel Retail Markets," Working Papers hal-01090837, HAL.
    19. Aknouche, Abdelhakim, 2024. "Periodically homogeneous Markov chains: The discrete state space case," MPRA Paper 122287, University Library of Munich, Germany.
    20. Gao, Guangyuan & Ho, Kin-Yip & Shi, Yanlin, 2020. "Long memory or regime switching in volatility? Evidence from high-frequency returns on the U.S. stock indices," Pacific-Basin Finance Journal, Elsevier, vol. 61(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2509.10542. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.