IDEAS home Printed from https://ideas.repec.org/a/gam/jforec/v7y2025i3p41-d1716625.html

SegmentedCrossformer—A Novel and Enhanced Cross-Time and Cross-Dimensional Transformer for Multivariate Time Series Forecasting

Author

Listed:
  • Zijiang Yang

    (Deptartment of Information & Communication Sciences, Sophia University, Tokyo 102-8554, Japan)

  • Tad Gonsalves

    (Deptartment of Information & Communication Sciences, Sophia University, Tokyo 102-8554, Japan)

Abstract

Multivariate Time Series Forecasting (MTSF) has been innovated with a series of models in the last two decades, ranging from traditional statistical approaches to RNN-based models. However, recent contributions from deep learning to time series problems have made huge progress with a series of Transformer-based models. Despite the breakthroughs by attention mechanisms applied to deep learning areas, many challenges remain to be solved with more sophisticated models. Existing Transformers known as attention-based models outperform classical models with abilities to capture temporal dependencies and better strategies for learning dependencies among variables as well as in the time domain in an efficient manner. Aiming to solve those issues, we propose a novel Transformer—SegmentedCrossformer (SCF), a Transformer-based model that considers both time and dependencies among variables in an efficient manner. The model is built upon the encoder–decoder architecture in different scales and compared with the previous state of the art. Experimental results on different datasets show the effectiveness of SCF with unique advantages and efficiency.

Suggested Citation

  • Zijiang Yang & Tad Gonsalves, 2025. "SegmentedCrossformer—A Novel and Enhanced Cross-Time and Cross-Dimensional Transformer for Multivariate Time Series Forecasting," Forecasting, MDPI, vol. 7(3), pages 1-20, August.
  • Handle: RePEc:gam:jforec:v:7:y:2025:i:3:p:41-:d:1716625
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-9394/7/3/41/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2571-9394/7/3/41/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. G. E. P. Box & G. M. Jenkins & J. F. MacGregor, 1974. "Some Recent Advances in Forecasting and Control," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 23(2), pages 158-179, June.
    2. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    3. Holt, Charles C., 2004. "Author's retrospective on 'Forecasting seasonals and trends by exponentially weighted moving averages'," International Journal of Forecasting, Elsevier, vol. 20(1), pages 11-13.
    4. Holt, Charles C., 2004. "Forecasting seasonals and trends by exponentially weighted moving averages," International Journal of Forecasting, Elsevier, vol. 20(1), pages 5-10.
    5. Xinhe Liu & Wenmin Wang, 2024. "Deep Time Series Forecasting Models: A Comprehensive Survey," Mathematics, MDPI, vol. 12(10), pages 1-33, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tiantian Tu, 2025. "Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting," Papers 2504.19309, arXiv.org.
    2. Fieger, Peter & Rice, John, 2016. "Modelling Chinese Inbound Tourism Arrivals into Christchurch," MPRA Paper 75468, University Library of Munich, Germany.
    3. Zhen Zeng & Rachneet Kaur & Suchetha Siddagangappa & Saba Rahimi & Tucker Balch & Manuela Veloso, 2023. "Financial Time Series Forecasting using CNN and Transformer," Papers 2304.04912, arXiv.org.
    4. Amirhossein Sohrabbeig & Omid Ardakanian & Petr Musilek, 2023. "Decompose and Conquer: Time Series Forecasting with Multiseasonal Trend Decomposition Using Loess," Forecasting, MDPI, vol. 5(4), pages 1-13, December.
    5. Simona Mikšíková & David Ulčák & František Kuda, 2022. "Analysis of Malfunctions in Selected Parking Systems in the Czech Republic," Sustainability, MDPI, vol. 14(3), pages 1-10, February.
    6. Dyna Heng & Anna Ivanova & Rodrigo Mariscal & Ms. Uma Ramakrishnan & Joyce Wong, 2016. "Advancing Financial Development in Latin America and the Caribbean," IMF Working Papers 2016/081, International Monetary Fund.
    7. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    8. Karzan Mahdi Ghafour & Abdulqadir Rahomee Ahmed Aljanabi, 2023. "The role of forecasting in preventing supply chain disruptions during the COVID-19 pandemic: a distributor-retailer perspective," Operations Management Research, Springer, vol. 16(2), pages 780-793, June.
    9. Andrea Kolková, 2024. "Data Analysis in Demand Forecasting: A Case Study of Poetry Book Sales in the European Area," Central European Business Review, Prague University of Economics and Business, vol. 2024(5), pages 51-69.
    10. Koopman, Siem Jan & Ooms, Marius, 2006. "Forecasting daily time series using periodic unobserved components time series models," Computational Statistics & Data Analysis, Elsevier, vol. 51(2), pages 885-903, November.
    11. Betty X.Y. Chu & Cathy W.S. Chen, 2026. "Robust Prediction Intervals for Time Series Forecasting: A Bootstrap and Bayesian Approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 45(5), pages 2309-2331, August.
    12. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    13. Kosuke Kawakami & Hirokazu Kobayashi & Kazuhide Nakata, 2021. "Seasonal Inventory Management Model for Raw Materials in Steel Industry," Interfaces, INFORMS, vol. 51(4), pages 312-324, July.
    14. Xianbo Li, 2022. "Sequence Model and Prediction for Sustainable Enrollments in Chinese Universities," Sustainability, MDPI, vol. 15(1), pages 1-25, December.
    15. Jayesh Thaker & Robert Höller, 2022. "A Comparative Study of Time Series Forecasting of Solar Energy Based on Irradiance Classification," Energies, MDPI, vol. 15(8), pages 1-26, April.
    16. Andrea Kolková & Petr Rozehnal, 2022. "Hybrid demand forecasting models: pre-pandemic and pandemic use studies," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 17(3), pages 699-725, September.
    17. Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
    18. Minghao Ran & Yingchao Wang & Qilu Qin & Jindi Huang & Jiading Jiang, 2025. "An Improved Grey Prediction Model Integrating Periodic Decomposition and Aggregation for Renewable Energy Forecasting: Case Studies of Solar and Wind Power," Sustainability, MDPI, vol. 17(11), pages 1-31, May.
    19. Theresa Maria Rausch & Tobias Albrecht & Daniel Baier, 2022. "Beyond the beaten paths of forecasting call center arrivals: on the use of dynamic harmonic regression with predictor variables," Journal of Business Economics, Springer, vol. 92(4), pages 675-706, May.
    20. Xi Wu & Adam Blake, 2023. "The Impact of the COVID-19 Crisis on Air Travel Demand: Some Evidence From China," SAGE Open, , vol. 13(1), pages 21582440231, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jforec:v:7:y:2025:i:3:p:41-:d:1716625. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.