IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v655y2024ics0378437124006940.html
   My bibliography  Save this article

Short-term freeway traffic speed multistep prediction using an iTransformer model

Author

Listed:
  • Zou, Yajie
  • Chen, Yubin
  • Xu, Yajiao
  • Zhang, Hao
  • Zhang, Siyang

Abstract

Accurate prediction of the freeway traffic speed is important for enhancing intelligent transportation management and assisting with route planning. Current traffic speed prediction studies usually neglect predictions extending to an hour or longer. Thus, to address this gap, the inverted Transformer (iTransformer) model is utilized to predict freeway speeds across intervals from 5 to 150 minutes. The iTransformer model provides a global view by encapsulating the entire time series from each detector into variate tokens, allowing it to capture the complex patterns and dependencies that change over time. Additionally, a multi-head attention mechanism is employed to identify short-term and long-term speed patterns. This study validates the prediction performance of iTransformer by using the traffic speed data from an interstate freeway in Minnesota, comparing it against traditional traffic prediction methods and two other Transformer models. Results indicate that the iTransformer model outperforms these benchmark approaches, particularly when predicting speed over 60 minutes for peak hour periods.

Suggested Citation

  • Zou, Yajie & Chen, Yubin & Xu, Yajiao & Zhang, Hao & Zhang, Siyang, 2024. "Short-term freeway traffic speed multistep prediction using an iTransformer model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 655(C).
  • Handle: RePEc:eee:phsmap:v:655:y:2024:i:c:s0378437124006940
    DOI: 10.1016/j.physa.2024.130185
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437124006940
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2024.130185?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Li, Qinyin & Cheng, Rongjun & Ge, Hongxia, 2023. "Short-term vehicle speed prediction based on BiLSTM-GRU model considering driver heterogeneity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 610(C).
    2. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    3. Zhai, Linbo & Yang, Yong & Song, Shudian & Ma, Shuyue & Zhu, Xiumin & Yang, Feng, 2021. "Self-supervision Spatiotemporal Part-Whole Convolutional Neural Network for Traffic Prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 579(C).
    4. Wu, Shubo & Zou, Yajie & Wu, Lingtao & Zhang, Yue, 2023. "Application of Bayesian model averaging for modeling time headway distribution," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 620(C).
    5. Yang, Di & Li, Hong & Wang, Peng & Yuan, Lihong, 2024. "Multistep traffic speed prediction: A sequence-to-sequence spatio-temporal attention model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 638(C).
    6. Ma, Changxi & Zhao, Mingxi, 2023. "Spatio-temporal multi-graph convolutional network based on wavelet analysis for vehicle speed prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    7. Feng, Huifang & Jiang, Xintong, 2022. "Multi-step ahead traffic speed prediction based on gated temporal graph convolution network," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 606(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ma, Changxi & Zhao, Mingxi, 2023. "Spatio-temporal multi-graph convolutional network based on wavelet analysis for vehicle speed prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    2. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    3. Tiantian Tu, 2025. "Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting," Papers 2504.19309, arXiv.org.
    4. Dong, Hanjiang & Zhu, Jizhong & Li, Shenglin & Wu, Wanli & Zhu, Haohao & Fan, Junwei, 2023. "Short-term residential household reactive power forecasting considering active power demand via deep Transformer sequence-to-sequence networks," Applied Energy, Elsevier, vol. 329(C).
    5. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    6. Kate Murray & Andrea Rossi & Diego Carraro & Andrea Visentin, 2023. "On Forecasting Cryptocurrency Prices: A Comparison of Machine Learning, Deep Learning, and Ensembles," Forecasting, MDPI, vol. 5(1), pages 1-14, January.
    7. Md. Iftekharul Alam Efat & Petr Hajek & Mohammad Zoynul Abedin & Rahat Uddin Azad & Md. Al Jaber & Shuvra Aditya & Mohammad Kabir Hassan, 2024. "Deep-learning model using hybrid adaptive trend estimated series for modelling and forecasting sales," Annals of Operations Research, Springer, vol. 339(1), pages 297-328, August.
    8. Nascimento, Erick Giovani Sperandio & de Melo, Talison A.C. & Moreira, Davidson M., 2023. "A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy," Energy, Elsevier, vol. 278(C).
    9. Sprangers, Olivier & Wadman, Wander & Schelter, Sebastian & de Rijke, Maarten, 2024. "Hierarchical forecasting at scale," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1689-1700.
    10. Aleksandr Simonyan, 2024. "BreakGPT: Leveraging Large Language Models for Predicting Asset Price Surges," Papers 2411.06076, arXiv.org.
    11. Shichao Huang & Jing Zhang & Yu He & Xiaofan Fu & Luqin Fan & Gang Yao & Yongjun Wen, 2022. "Short-Term Load Forecasting Based on the CEEMDAN-Sample Entropy-BPNN-Transformer," Energies, MDPI, vol. 15(10), pages 1-14, May.
    12. Tom Liu & Stephen Roberts & Stefan Zohren, 2023. "Deep Inception Networks: A General End-to-End Framework for Multi-asset Quantitative Strategies," Papers 2307.05522, arXiv.org.
    13. Runyao Yu & Yuchen Tao & Fabian Leimgruber & Tara Esterl & Jochen L. Cremer, 2025. "OrderFusion: Encoding Orderbook for End-to-End Probabilistic Intraday Electricity Price Prediction," Papers 2502.06830, arXiv.org, revised May 2025.
    14. Liu, Dinggao & Chen, Kaijie & Cai, Yi & Tang, Zhenpeng, 2024. "Interpretable EU ETS Phase 4 prices forecasting based on deep generative data augmentation approach," Finance Research Letters, Elsevier, vol. 61(C).
    15. de Azevedo Takara, Lucas & Teixeira, Ana Clara & Yazdanpanah, Hamed & Mariani, Viviana Cocco & dos Santos Coelho, Leandro, 2024. "Optimizing multi-step wind power forecasting: Integrating advanced deep neural networks with stacking-based probabilistic learning," Applied Energy, Elsevier, vol. 369(C).
    16. Du, Pei & Yang, Dongchuan & Li, Yanzhao & Wang, Jianzhou, 2024. "An innovative interpretable combined learning model for wind speed forecasting," Applied Energy, Elsevier, vol. 358(C).
    17. Hu, Zhiyuan & Yang, Rui & Fang, Liang & Wang, Zhuo & Zhao, Yinghua, 2024. "Research on vehicle speed prediction model based on traffic flow information fusion," Energy, Elsevier, vol. 292(C).
    18. Shiyu Liu & Ou Liu & Junyang Chen, 2023. "A Review on Business Analytics: Definitions, Techniques, Applications and Challenges," Mathematics, MDPI, vol. 11(4), pages 1-20, February.
    19. Gomez, William & Wang, Fu-Kwun & Chou, Jia-Hong, 2024. "Li-ion battery capacity prediction using improved temporal fusion transformer model," Energy, Elsevier, vol. 296(C).
    20. Gupta, Abhijit, 2025. "Decoding Futures Price Dynamics: A Regularized Sparse Autoencoder for Interpretable Multi-Horizon Forecasting and Factor Discovery," OSF Preprints 4rzky_v1, Center for Open Science.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:655:y:2024:i:c:s0378437124006940. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.