IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2005-7.html
   My bibliography  Save this paper

Time Series Forecasting: The Case for the Single Source of Error State Space

Author

Listed:
  • J Keith Ord
  • Ralph D Snyder

    ()

  • Anne B Koehler
  • Rob J Hyndman

    ()

  • Mark Leeds

Abstract

The state space approach to modelling univariate time series is now widely used both in theory and in applications. However, the very richness of the framework means that quite different model formulations are possible, even when they purport to describe the same phenomena. In this paper, we examine the single source of error [SSOE] scheme, which has perfectly correlated error components. We then proceed to compare SSOE to the more common version of the state space models, for which all the error terms are independent; we refer to this as the multiple source of error [MSOE] scheme. As expected, there are many similarities between the MSOE and SSOE schemes, but also some important differences. Both have ARIMA models as their reduced forms, although the mapping is more transparent for SSOE. Further, SSOE does not require a canonical form to complete its specification. An appealing feature of SSOE is that the estimates of the state variables converge in probability to their true values, thereby leading to a formal inferential structure for the ad-hoc exponential smoothing methods for forecasting. The parameter space for SSOE models may be specified to match that of the corresponding ARIMA scheme, or it may be restricted to meaningful sub-spaces, as for MSOE but with somewhat different outcomes. The SSOE formulation enables straightforward extensions to certain classes of non-linear models, including a linear trend with multiplicative seasonals version that underlies the Holt-Winters forecasting method. Conditionally heteroscedastic models may be developed in a similar manner. Finally we note that smoothing and decomposition, two crucial practical issues, may be performed within the SSOE framework.

Suggested Citation

  • J Keith Ord & Ralph D Snyder & Anne B Koehler & Rob J Hyndman & Mark Leeds, 2005. "Time Series Forecasting: The Case for the Single Source of Error State Space," Monash Econometrics and Business Statistics Working Papers 7/05, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2005-7
    as

    Download full text from publisher

    File URL: http://www.buseco.monash.edu.au/ebs/pubs/wpapers/2005/wp7-05.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. Peter R. Winters, 1960. "Forecasting Sales by Exponentially Weighted Moving Averages," Management Science, INFORMS, vol. 6(3), pages 324-342, April.
    2. Koehler, Anne B. & Snyder, Ralph D. & Ord, J. Keith, 2001. "Forecasting models and prediction intervals for the multiplicative Holt-Winters method," International Journal of Forecasting, Elsevier, pages 269-286.
    3. Snyder, Ralph D & Ord, J Keith & Koehler, Anne B, 2001. "Prediction Intervals for ARIMA Models," Journal of Business & Economic Statistics, American Statistical Association, pages 217-225.
    4. Charles Nelson & Eric Zivot, 2000. "Why are Beveridge-Nelson and Unobserved-Component Decompositions of GDP so Different?," Econometric Society World Congress 2000 Contributed Papers 0692, Econometric Society.
    5. Hyndman, R.J. & Koehler, A.B. & Ord, J.K. & Snyder, R.D., 2001. "Prediction Intervals for Exponential Smoothing State Space Models," Monash Econometrics and Business Statistics Working Papers 11/01, Monash University, Department of Econometrics and Business Statistics.
    6. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    7. Rob Hyndman & Muhammad Akram & Blyth Archibald, 2008. "The admissible parameter space for exponential smoothing models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 60(2), pages 407-426, June.
    8. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    9. Billah, Baki & King, Maxwell L. & Snyder, Ralph D. & Koehler, Anne B., 2006. "Exponential smoothing model selection for forecasting," International Journal of Forecasting, Elsevier, pages 239-247.
    10. Forbes, C.S. & Snyder, R.D. & Shami, R.S., 2000. "Bayesian Exponential Smoothing," Monash Econometrics and Business Statistics Working Papers 7/00, Monash University, Department of Econometrics and Business Statistics.
    11. H. Theil & S. Wage, 1964. "Some Observations on Adaptive Forecasting," Management Science, INFORMS, vol. 10(2), pages 198-206, January.
    12. Harvey, Andrew & Ruiz, Esther & Sentana, Enrique, 1992. "Unobserved component time series models with Arch disturbances," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 129-157.
    13. Lawton, Richard, 1998. "How should additive Holt-Winters estimates be corrected?," International Journal of Forecasting, Elsevier, vol. 14(3), pages 393-403, September.
    14. Andrew Harvey & Siem Jan Koopman, 2000. "Signal extraction and the formulation of unobserved components models," Econometrics Journal, Royal Economic Society, vol. 3(1), pages 84-107.
    15. Proietti, Tommaso & Harvey, Andrew, 2000. "A Beveridge-Nelson smoother," Economics Letters, Elsevier, vol. 67(2), pages 139-146, May.
    16. I. Gijbels & A. Pope & M. P. Wand, 1999. "Understanding exponential smoothing via kernel regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(1), pages 39-50.
    17. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. George Athanasopoulos & Rob J. Hyndman, 2006. "Modelling and forecasting Australian domestic tourism," Monash Econometrics and Business Statistics Working Papers 19/06, Monash University, Department of Econometrics and Business Statistics.
    2. Gould, Phillip G. & Koehler, Anne B. & Ord, J. Keith & Snyder, Ralph D. & Hyndman, Rob J. & Vahid-Araghi, Farshid, 2008. "Forecasting time series with multiple seasonal patterns," European Journal of Operational Research, Elsevier, vol. 191(1), pages 207-222, November.
    3. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.

    More about this item

    Keywords

    ARIMA; Dynamic Linear Models; Equivalence; Exponential Smoothing; Forecasting; GARCH; Holt's Method; Holt-Winters Method; Kalman Filter; Prediction Intervals.;

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists or Wikipedia pages:
    1. Technology Assessment

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2005-7. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dr Xibin Zhang). General contact details of provider: http://edirc.repec.org/data/dxmonau.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.