IDEAS home Printed from https://ideas.repec.org/a/eee/transb/v118y2018icp281-317.html
   My bibliography  Save this article

Dynamic factor model for network traffic state forecast

Author

Listed:
  • Ma, Tao
  • Zhou, Zhou
  • Antoniou, Constantinos

Abstract

We propose a dynamic factor model to forecast traffic state for groups of locations. The model decomposes the grouped traffic time series into the latent common factor component and idiosyncratic component. It uses a few latent factor series to represent the comovement of the underlying dynamics of grouped traffic flows, and idiosyncratic component to represent location-specific traffic characteristics. The dynamic factor model is estimated by the maximum likelihood method via an iterative EM (expectation maximization) algorithm. The traffic state forecast for each location is a combination of the respective forecast from the common factor component and idiosyncratic component. The dynamic factor model exhibits four advantages. It provides an excellent way to (1) seamlessly incorporate spatial correlations among grouped traffic flows into forecast; (2) produce forecast simultaneously for group locations; (3) perform dimension reduction such that high-dimension grouped traffic time series can be modeled at a low-dimension space; (4) consider not only location-specific information but also global common dynamics in the forecast. Meanwhile, it also has capacity to accommodate typical characteristics of traffic flows including temporal correlation, seasonality, structural change in mean and/or covariance function, and cointegration. Forecast accuracy is significantly improved across highway network as well as urban road network in comparison with the Sparse VAR and ARIMA models. The proposed method is suitable for large-scale network traffic forecast in the context of big data environment. This research provides sufficient evidence that justified the importance and efficacy of spatial correlation for predictive accuracy and attempts to fill the gaps in literature of traffic forecast for groups of locations.

Suggested Citation

  • Ma, Tao & Zhou, Zhou & Antoniou, Constantinos, 2018. "Dynamic factor model for network traffic state forecast," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 281-317.
  • Handle: RePEc:eee:transb:v:118:y:2018:i:c:p:281-317
    DOI: 10.1016/j.trb.2018.10.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0191261517306604
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.trb.2018.10.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Breitung, Jörg & Tenhofen, Jörn, 2011. "GLS Estimation of Dynamic Factor Models," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1150-1166.
    2. Bates, Brandon J. & Plagborg-Møller, Mikkel & Stock, James H. & Watson, Mark W., 2013. "Consistent factor estimation in dynamic factor models with structural instability," Journal of Econometrics, Elsevier, vol. 177(2), pages 289-304.
    3. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    4. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2004. "The generalized dynamic factor model consistency and rates," Journal of Econometrics, Elsevier, vol. 119(2), pages 231-255, April.
    5. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    6. Kamarianakis, Yiannis & Prastacos, Poulicos, 2002. "Space-time modeling of traffic flow," ERSA conference papers ersa02p141, European Regional Science Association.
    7. Zivot, Eric & Andrews, Donald W K, 2002. "Further Evidence on the Great Crash, the Oil-Price Shock, and the Unit-Root Hypothesis," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 25-44, January.
    8. R. H. Shumway & D. S. Stoffer, 1982. "An Approach To Time Series Smoothing And Forecasting Using The Em Algorithm," Journal of Time Series Analysis, Wiley Blackwell, vol. 3(4), pages 253-264, July.
    9. Jenelius, Erik & Koutsopoulos, Haris N., 2013. "Travel time estimation for urban road networks using low frequency probe vehicle data," Transportation Research Part B: Methodological, Elsevier, vol. 53(C), pages 64-81.
    10. Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996. "Efficient Tests for an Autoregressive Unit Root," Econometrica, Econometric Society, vol. 64(4), pages 813-836, July.
    11. Paul I. Richards, 1956. "Shock Waves on the Highway," Operations Research, INFORMS, vol. 4(1), pages 42-51, February.
    12. Deng, Wen & Lei, Hao & Zhou, Xuesong, 2013. "Traffic state estimation and uncertainty quantification based on heterogeneous data sources: A three detector approach," Transportation Research Part B: Methodological, Elsevier, vol. 57(C), pages 132-157.
    13. Marco Del Negro & Christopher Otrok, 2008. "Dynamic factor models with time-varying parameters: measuring changes in international business cycles," Staff Reports 326, Federal Reserve Bank of New York.
    14. Choi, In, 2012. "Efficient Estimation Of Factor Models," Econometric Theory, Cambridge University Press, vol. 28(2), pages 274-308, April.
    15. Daganzo, Carlos F., 2005. "A variational formulation of kinematic waves: basic theory and complex boundary conditions," Transportation Research Part B: Methodological, Elsevier, vol. 39(2), pages 187-196, February.
    16. Domenico Giannone & Lucrezia Reichlin & David H. Small, 2005. "Nowcasting GDP and inflation: the real-time informational content of macroeconomic data releases," Finance and Economics Discussion Series 2005-42, Board of Governors of the Federal Reserve System (U.S.).
    17. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    18. Engle, Robert & Granger, Clive, 2015. "Co-integration and error correction: Representation, estimation, and testing," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 39(3), pages 106-135.
    19. Newell, G. F., 1993. "A simplified theory of kinematic waves in highway traffic, part II: Queueing at freeway bottlenecks," Transportation Research Part B: Methodological, Elsevier, vol. 27(4), pages 289-303, August.
    20. Daganzo, Carlos F., 1995. "The cell transmission model, part II: Network traffic," Transportation Research Part B: Methodological, Elsevier, vol. 29(2), pages 79-93, April.
    21. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    22. Forni, Mario & Lippi, Marco, 2001. "The Generalized Dynamic Factor Model: Representation Theory," Econometric Theory, Cambridge University Press, vol. 17(6), pages 1113-1141, December.
    23. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    24. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    25. Newell, G. F., 1993. "A simplified theory of kinematic waves in highway traffic, part I: General theory," Transportation Research Part B: Methodological, Elsevier, vol. 27(4), pages 281-287, August.
    26. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    27. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    28. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    29. Dickey, David A & Fuller, Wayne A, 1981. "Likelihood Ratio Statistics for Autoregressive Time Series with a Unit Root," Econometrica, Econometric Society, vol. 49(4), pages 1057-1072, June.
    30. Li, Baibing & Martin, Elaine B. & Morris, A. Julian, 2002. "On principal component analysis in L1," Computational Statistics & Data Analysis, Elsevier, vol. 40(3), pages 471-474, September.
    31. Granger, C. W. J., 1981. "Some properties of time series data and their use in econometric model specification," Journal of Econometrics, Elsevier, vol. 16(1), pages 121-130, May.
    32. Wang, Yibing & Papageorgiou, Markos, 2005. "Real-time freeway traffic state estimation based on extended Kalman filter: a general approach," Transportation Research Part B: Methodological, Elsevier, vol. 39(2), pages 141-167, February.
    33. Tao Cheng & James Haworth & Jiaqiu Wang, 2012. "Spatio-temporal autocorrelation of road network data," Journal of Geographical Systems, Springer, vol. 14(4), pages 389-413, October.
    34. Domenico Giannone & Lucrezia Reichlin & David Small, 2008. "Nowcasting: the real time informational content of macroeconomic data releases," ULB Institutional Repository 2013/6409, ULB -- Universite Libre de Bruxelles.
    35. Daganzo, Carlos F., 1994. "The cell transmission model: A dynamic representation of highway traffic consistent with the hydrodynamic theory," Transportation Research Part B: Methodological, Elsevier, vol. 28(4), pages 269-287, August.
    36. Qiao, Fengxiang & Yang, Hai & Lam, William H. K., 2001. "Intelligent simulation and prediction of traffic flow dispersion," Transportation Research Part B: Methodological, Elsevier, vol. 35(9), pages 843-863, November.
    37. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501, Decembrie.
    38. Castillo, Enrique & Menéndez, José María & Sánchez-Cambronero, Santos, 2008. "Predicting traffic flow using Bayesian networks," Transportation Research Part B: Methodological, Elsevier, vol. 42(5), pages 482-509, June.
    39. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    40. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    41. Newell, G. F., 1993. "A simplified theory of kinematic waves in highway traffic, part III: Multi-destination flows," Transportation Research Part B: Methodological, Elsevier, vol. 27(4), pages 305-313, August.
    42. Ma, Tao & Zhou, Zhou & Abdulhai, Baher, 2015. "Nonlinear multivariate time–space threshold vector error correction model for short term traffic state prediction," Transportation Research Part B: Methodological, Elsevier, vol. 76(C), pages 27-47.
    43. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    44. Coogan, Samuel & Flores, Christopher & Varaiya, Pravin, 2017. "Traffic predictive control from low-rank structure," Transportation Research Part B: Methodological, Elsevier, vol. 97(C), pages 1-22.
    45. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    46. Phillips, Peter C B & Ouliaris, S, 1990. "Asymptotic Properties of Residual Based Tests for Cointegration," Econometrica, Econometric Society, vol. 58(1), pages 165-193, January.
    47. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    48. Watson, Mark W. & Engle, Robert F., 1983. "Alternative algorithms for the estimation of dynamic factor, mimic and varying coefficient regression models," Journal of Econometrics, Elsevier, vol. 23(3), pages 385-400, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Junzhuo Li & Wenyong Li & Guan Lian, 2022. "Optimal Aggregate Size of Traffic Sequence Data Based on Fuzzy Entropy and Mutual Information," Sustainability, MDPI, vol. 14(22), pages 1-17, November.
    2. Chen, Xinqiang & Chen, Huixing & Yang, Yongsheng & Wu, Huafeng & Zhang, Wenhui & Zhao, Jiansen & Xiong, Yong, 2021. "Traffic flow prediction by an ensemble framework with data denoising and deep learning model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 565(C).
    3. Chen, Yi-Ting & Sun, Edward W. & Chang, Ming-Feng & Lin, Yi-Bing, 2021. "Pragmatic real-time logistics management with traffic IoT infrastructure: Big data predictive analytics of freight travel time for Logistics 4.0," International Journal of Production Economics, Elsevier, vol. 238(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    2. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," PSE Working Papers halshs-02262202, HAL.
    3. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    4. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers halshs-02262202, HAL.
    5. Ma, Tao & Zhou, Zhou & Abdulhai, Baher, 2015. "Nonlinear multivariate time–space threshold vector error correction model for short term traffic state prediction," Transportation Research Part B: Methodological, Elsevier, vol. 76(C), pages 27-47.
    6. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    7. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    8. Doz, Catherine & Giannone, Domenico & Reichlin, Lucrezia, 2011. "A two-step estimator for large approximate dynamic factor models based on Kalman filtering," Journal of Econometrics, Elsevier, vol. 164(1), pages 188-205, September.
    9. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    10. Pilar Poncela & Esther Ruiz, 2016. "Small- Versus Big-Data Factor Extraction in Dynamic Factor Models: An Empirical Assessment," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 401-434, Emerald Group Publishing Limited.
    11. Forni, Mario & Hallin, Marc & Lippi, Marco & Zaffaroni, Paolo, 2015. "Dynamic factor models with infinite-dimensional factor spaces: One-sided representations," Journal of Econometrics, Elsevier, vol. 185(2), pages 359-371.
    12. Bai, Jushan & Liao, Yuan, 2016. "Efficient estimation of approximate factor models via penalized maximum likelihood," Journal of Econometrics, Elsevier, vol. 191(1), pages 1-18.
    13. George Kapetanios & Massimiliano Marcellino, 2009. "A parametric estimation method for dynamic factor models of large dimensions," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 208-238, March.
    14. Bork, Lasse, 2009. "Estimating US Monetary Policy Shocks Using a Factor-Augmented Vector Autoregression: An EM Algorithm Approach," Finance Research Group Working Papers F-2009-03, University of Aarhus, Aarhus School of Business, Department of Business Studies.
    15. Stock, James H. & Watson, Mark, 2011. "Dynamic Factor Models," Scholarly Articles 28469541, Harvard University Department of Economics.
    16. Rua, António, 2017. "A wavelet-based multivariate multiscale approach for forecasting," International Journal of Forecasting, Elsevier, vol. 33(3), pages 581-590.
    17. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2010. "Are disaggregate data useful for factor analysis in forecasting French GDP?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 132-144.
    18. Bräuning, Falk & Koopman, Siem Jan, 2014. "Forecasting macroeconomic variables using collapsed dynamic factor analysis," International Journal of Forecasting, Elsevier, vol. 30(3), pages 572-584.
    19. Matteo Barigozzi, 2023. "Asymptotic equivalence of Principal Components and Quasi Maximum Likelihood estimators in Large Approximate Factor Models," Papers 2307.09864, arXiv.org, revised Sep 2023.
    20. Bańbura, Marta & Giannone, Domenico & Lenza, Michele, 2015. "Conditional forecasts and scenario analysis with vector autoregressions for large cross-sections," International Journal of Forecasting, Elsevier, vol. 31(3), pages 739-756.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transb:v:118:y:2018:i:c:p:281-317. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/548/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.