IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v655y2024ics0378437124006940.html

Short-term freeway traffic speed multistep prediction using an iTransformer model

Author

Listed:
  • Zou, Yajie
  • Chen, Yubin
  • Xu, Yajiao
  • Zhang, Hao
  • Zhang, Siyang

Abstract

Accurate prediction of the freeway traffic speed is important for enhancing intelligent transportation management and assisting with route planning. Current traffic speed prediction studies usually neglect predictions extending to an hour or longer. Thus, to address this gap, the inverted Transformer (iTransformer) model is utilized to predict freeway speeds across intervals from 5 to 150 minutes. The iTransformer model provides a global view by encapsulating the entire time series from each detector into variate tokens, allowing it to capture the complex patterns and dependencies that change over time. Additionally, a multi-head attention mechanism is employed to identify short-term and long-term speed patterns. This study validates the prediction performance of iTransformer by using the traffic speed data from an interstate freeway in Minnesota, comparing it against traditional traffic prediction methods and two other Transformer models. Results indicate that the iTransformer model outperforms these benchmark approaches, particularly when predicting speed over 60 minutes for peak hour periods.

Suggested Citation

  • Zou, Yajie & Chen, Yubin & Xu, Yajiao & Zhang, Hao & Zhang, Siyang, 2024. "Short-term freeway traffic speed multistep prediction using an iTransformer model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 655(C).
  • Handle: RePEc:eee:phsmap:v:655:y:2024:i:c:s0378437124006940
    DOI: 10.1016/j.physa.2024.130185
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437124006940
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2024.130185?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Li, Qinyin & Cheng, Rongjun & Ge, Hongxia, 2023. "Short-term vehicle speed prediction based on BiLSTM-GRU model considering driver heterogeneity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 610(C).
    2. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    3. Zhai, Linbo & Yang, Yong & Song, Shudian & Ma, Shuyue & Zhu, Xiumin & Yang, Feng, 2021. "Self-supervision Spatiotemporal Part-Whole Convolutional Neural Network for Traffic Prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 579(C).
    4. Wu, Shubo & Zou, Yajie & Wu, Lingtao & Zhang, Yue, 2023. "Application of Bayesian model averaging for modeling time headway distribution," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 620(C).
    5. Yang, Di & Li, Hong & Wang, Peng & Yuan, Lihong, 2024. "Multistep traffic speed prediction: A sequence-to-sequence spatio-temporal attention model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 638(C).
    6. Ma, Changxi & Zhao, Mingxi, 2023. "Spatio-temporal multi-graph convolutional network based on wavelet analysis for vehicle speed prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    7. Feng, Huifang & Jiang, Xintong, 2022. "Multi-step ahead traffic speed prediction based on gated temporal graph convolution network," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 606(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ma, Changxi & Zhao, Mingxi, 2025. "Urban rail transit passenger flow prediction using large language model under multi-source spatiotemporal data fusion," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 675(C).
    2. Xinyi Mao & Gen Liu & Jian Wang & Yongbo Lai, 2025. "BiTCN-ISInformer: A Parallel Model for Regional Air Pollutant Concentration Prediction Using Bidirectional Temporal Convolutional Network and Enhanced Informer," Sustainability, MDPI, vol. 17(19), pages 1-27, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ma, Changxi & Zhao, Mingxi, 2025. "Urban rail transit passenger flow prediction using large language model under multi-source spatiotemporal data fusion," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 675(C).
    2. Li, Yong & Wang, Jiajun & Kang, Liujiang, 2025. "Light attention-based neural networks for traffic flow prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 673(C).
    3. Ma, Changxi & Zhao, Mingxi, 2023. "Spatio-temporal multi-graph convolutional network based on wavelet analysis for vehicle speed prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    4. Frederick Nsambu Kijjambu & Benjamin Musiita & Asaph Kaburura Katarangi & Geoffrey Kahangane & Sheilla Akampwera, 2023. "Determinants of Uganda’s Debt Sustainability: The Public Debt Dynamics Model in Perspective," Journal of Economics and Behavioral Studies, AMH International, vol. 15(4), pages 106-124.
    5. Hoang Anh Nguyen & Nhat Hoang Bach, 2026. "QI-HRNN: a quantum-inspired hybrid framework for resilient currency forecasting under extreme market conditions," Digital Finance, Springer, vol. 8(2), pages 1-40, June.
    6. Jang, Junkyu, 2025. "Selective news selection model for explainable stock prediction via cross-attention integration," Finance Research Letters, Elsevier, vol. 85(PD).
    7. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    8. He, Miao & Jiang, Weiwei & Gu, Weixi, 2024. "TriChronoNet: Advancing electricity price prediction with Multi-module fusion," Applied Energy, Elsevier, vol. 371(C).
    9. Tiantian Tu, 2025. "Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting," Papers 2504.19309, arXiv.org.
    10. Ali Atiah Alzahrani, 2025. "Multi-Agent Regime-Conditioned Diffusion (MARCD) for CVaR-Constrained Portfolio Decisions," Papers 2510.10807, arXiv.org, revised Nov 2025.
    11. Sengupta, Shovon & Chakraborty, Tanujit & Singh, Sunny Kumar, 2025. "Forecasting CPI inflation under economic policy and geopolitical uncertainties," International Journal of Forecasting, Elsevier, vol. 41(3), pages 953-981.
    12. Vegard H. Larsen & Leif Anders Thorsrud, 2026. "Using Transformers and Reinforcement Learning as Narrative Filters in Macroeconomics," Working Papers No 02/2026, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    13. Dong, Hanjiang & Zhu, Jizhong & Li, Shenglin & Wu, Wanli & Zhu, Haohao & Fan, Junwei, 2023. "Short-term residential household reactive power forecasting considering active power demand via deep Transformer sequence-to-sequence networks," Applied Energy, Elsevier, vol. 329(C).
    14. Ma, Tian & Wang, Wanwan & Jiang, Fuwei, 2025. "Machine learning the performance of hedge fund," Journal of International Money and Finance, Elsevier, vol. 155(C).
    15. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    16. Adir Saly-Kaufmann & Kieran Wood & Jan Peter-Calliess & Stefan Zohren, 2026. "Deep Learning for Financial Time Series: A Large-Scale Benchmark of Risk-Adjusted Performance," Papers 2603.01820, arXiv.org.
    17. Kate Murray & Andrea Rossi & Diego Carraro & Andrea Visentin, 2023. "On Forecasting Cryptocurrency Prices: A Comparison of Machine Learning, Deep Learning, and Ensembles," Forecasting, MDPI, vol. 5(1), pages 1-14, January.
    18. Abdelfatah, Omar Sharafeldin Mohamed, 2026. "Machine Learning Approaches for Improving Demand Forecasting Accuracy in Retail Supply Chains," SocArXiv 4z9be_v1, Center for Open Science.
    19. Frison, Lilli & Gölzhäuser, Simon & Bitterling, Moritz & Kramer, Wolfgang, 2024. "Evaluating different artificial neural network forecasting approaches for optimizing district heating network operation," Energy, Elsevier, vol. 307(C).
    20. Kuang, Haoxuan & Deng, Kunxiang & You, Linlin & Li, Jun, 2025. "Citywide electric vehicle charging demand prediction approach considering urban region and dynamic influences," Energy, Elsevier, vol. 320(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:655:y:2024:i:c:s0378437124006940. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.