IDEAS home Printed from https://ideas.repec.org/p/aah/create/2010-01.html
   My bibliography  Save this paper

Forecasting with nonlinear time series models

Author

Listed:
  • Anders Bredahl Kock

    (CREATES, Aarhus University)

  • Timo Teräsvirta

    (CREATES, Aarhus University)

Abstract

In this paper, nonlinear models are restricted to mean nonlinear parametric models. Several such models popular in time series econometrics are presented and some of their properties discussed. This includes two models based on universal approximators: the Kolmogorov-Gabor polynomial model and two versions of a simple artificial neural network model. Techniques for generating multi-period forecasts from nonlinear models recursively are considered, and the direct (non-recursive) method for this purpose is mentioned as well. Forecasting with complex dynamic systems, albeit less frequently applied to economic forecasting problems, is briefly highlighted. A number of large published studies comparing macroeconomic forecasts obtained using different time series models are discussed, and the paper also contains a small simulation study comparing recursive and direct forecasts in a particular case where the data-generating process is a simple artificial neural network model. Suggestions for further reading conclude the paper.

Suggested Citation

  • Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, Department of Economics and Business Economics, Aarhus University.
    • Handle: RePEc:aah:create:2010-01
    as

    Download full text from publisher

    File URL: https://repec.econ.au.dk/repec/creates/rp/10/rp10_01.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. González Andrés & Teräsvirta Timo, 2008. "Modelling Autoregressive Processes with a Shifting Mean," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 12(1), pages 1-28, March.
    2. Lanne, Markku & Saikkonen, Pentti, 2002. "Threshold Autoregressions for Strongly Autocorrelated Time Series," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 282-289, April.
    3. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    4. Maravall, Agustin, 1983. "An Application of Nonlinear Time Series Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 1(1), pages 66-74, January.
    5. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521779654.
    6. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    7. Norman R. Swanson & Halbert White, 1997. "A Model Selection Approach To Real-Time Macroeconomic Forecasting Using Linear Models And Artificial Neural Networks," The Review of Economics and Statistics, MIT Press, vol. 79(4), pages 540-550, November.
    8. Jaditz, Ted & Riddick, Leigh A. & Sayers, Chera L., 1998. "MULTIVARIATE NONLINEAR FORECASTING Using Financial Information to Forecast the Real Sector," Macroeconomic Dynamics, Cambridge University Press, vol. 2(3), pages 369-382, September.
    9. Hansen, Bruce E, 1996. "Inference When a Nuisance Parameter Is Not Identified under the Null Hypothesis," Econometrica, Econometric Society, vol. 64(2), pages 413-430, March.
    10. Dick van Dijk & Timo Terasvirta & Philip Hans Franses, 2002. "Smooth Transition Autoregressive Models — A Survey Of Recent Developments," Econometric Reviews, Taylor & Francis Journals, vol. 21(1), pages 1-47.
    11. Maximo Camacho, 2004. "Vector smooth transition regression models for US GDP and the composite index of leading indicators," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(3), pages 173-196.
    12. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    13. Kuan, Chung-Ming & Liu, Tung, 1995. "Forecasting Exchange Rates Using Feedforward and Recurrent Neural Networks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(4), pages 347-364, Oct.-Dec..
    14. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    15. Marcellino, Massimliano, 2004. "Forecasting EMU macroeconomic variables," International Journal of Forecasting, Elsevier, vol. 20(2), pages 359-372.
    16. Mark Podolskij & Mathias Vetter, 2009. "Understanding limit theorems for semimartingales: a short survey," CREATES Research Papers 2009-47, Department of Economics and Business Economics, Aarhus University.
    17. Chung-Ming Kuan, 2006. "Artificial Neural Networks," IEAS Working Paper : academic research 06-A010, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    18. Krolzig, Hans-Martin & Hendry, David F., 2001. "Computer automation of general-to-specific model selection procedures," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 831-866, June.
    19. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    20. Kock Anders Bredahl, 2011. "Forecasting with Universal Approximators and a Learning Algorithm," Journal of Time Series Econometrics, De Gruyter, vol. 3(3), pages 1-32, October.
    21. Isabel Casas & Irene Gijbels, 2009. "Unstable volatility functions: the break preserving local linear estimator," CREATES Research Papers 2009-48, Department of Economics and Business Economics, Aarhus University.
    22. Engle, Robert F. & White (the late), Halbert (ed.), 1999. "Cointegration, Causality, and Forecasting: Festschrift in Honour of Clive W. J. Granger," OUP Catalogue, Oxford University Press, number 9780198296836.
    23. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    24. Gonzalo, Jesus & Pitarakis, Jean-Yves, 2002. "Estimation and model selection based inference in single and multiple threshold models," Journal of Econometrics, Elsevier, vol. 110(2), pages 319-352, October.
    25. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    26. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    27. Bajo-Rubio, Oscar & Sosvilla-Rivero, Simon & Fernandez-Rodriguez, Fernando, 2001. "Asymmetry in the EMS: New evidence based on non-linear forecasts," European Economic Review, Elsevier, vol. 45(3), pages 451-473, March.
    28. Castle, Jennifer L. & Hendry, David F., 2010. "A low-dimension portmanteau test for non-linearity," Journal of Econometrics, Elsevier, vol. 158(2), pages 231-245, October.
    29. Massimiliano Marcellino, "undated". "Instability and non-linearity in the EMU," Working Papers 211, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    30. Jurgen A. Doornik, 2008. "Encompassing and Automatic Model Selection," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(s1), pages 915-925, December.
    31. Swanson, Norman R & White, Halbert, 1995. "A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 265-275, July.
    32. Michael P. Clements & David F. Hendry, 2001. "Forecasting Non-Stationary Economic Time Series," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262531895, December.
    33. White, Halbert, 2006. "Approximate Nonlinear Forecasting Methods," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 9, pages 459-512, Elsevier.
    34. Rech, Gianluigi, 2002. "Forecasting with artificial neural network models," SSE/EFI Working Paper Series in Economics and Finance 491, Stockholm School of Economics.
    35. Swanson, Norman R. & White, Halbert, 1997. "Forecasting economic time series using flexible versus fixed specification and linear versus nonlinear econometric models," International Journal of Forecasting, Elsevier, vol. 13(4), pages 439-461, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jennifer Castle & David Hendry, 2013. "Semi-automatic Non-linear Model selection," Economics Series Working Papers 654, University of Oxford, Department of Economics.
    2. Oscar Claveria & Enric Monte & Salvador Torra, 2015. "“Self-organizing map analysis of agents’ expectations. Different patterns of anticipation of the 2008 financial crisis”," AQR Working Papers 201508, University of Barcelona, Regional Quantitative Analysis Group, revised Mar 2015.
    3. Oscar Claveria & Salvador Torra, 2013. "“Forecasting Business surveys indicators: neural networks vs. time series models”," IREA Working Papers 201320, University of Barcelona, Research Institute of Applied Economics, revised Nov 2013.
    4. Claveria, Oscar & Torra, Salvador, 2014. "Forecasting tourism demand to Catalonia: Neural networks vs. time series models," Economic Modelling, Elsevier, vol. 36(C), pages 220-228.
    5. Kirstin Hubrich & Timo Teräsvirta, 2013. "Thresholds and Smooth Transitions in Vector Autoregressive Models," CREATES Research Papers 2013-18, Department of Economics and Business Economics, Aarhus University.
    6. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an optimal forecast combination? A stochastic dominance approach applied to the forecast combination puzzle," Working Papers 1206, University of Guelph, Department of Economics and Finance.
    7. Souhaib Ben Taieb & Rob J Hyndman, 2014. "Boosting multi-step autoregressive forecasts," Monash Econometrics and Business Statistics Working Papers 13/14, Monash University, Department of Econometrics and Business Statistics.
    8. Hayashi, Masayoshi, 2014. "Forecasting welfare caseloads: The case of the Japanese public assistance program," Socio-Economic Planning Sciences, Elsevier, vol. 48(2), pages 105-114.
    9. Kock, Anders Bredahl & Teräsvirta, Timo, 2014. "Forecasting performances of three automated modelling techniques during the economic crisis 2007–2009," International Journal of Forecasting, Elsevier, vol. 30(3), pages 616-631.
    10. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    11. Meriam BouAli & Adnen Ben Nasr & Abdelwahed Trabelsi, 2016. "A Nonlinear Approach for Modeling and Forecasting US Business Cycles," International Economic Journal, Taylor & Francis Journals, vol. 30(1), pages 39-74, March.
    12. Ramazan Gencay & Ege Yazgan, 2017. "When Are Wavelets Useful Forecasters?," Working Papers 1704, The Center for Financial Studies (CEFIS), Istanbul Bilgi University.
    13. Shahid IQBAL & Maqbool H. SIAL, 2016. "Projections of Inflation Dynamics for Pakistan: GMDH Approach," Journal of Economics and Political Economy, KSP Journals, vol. 3(3), pages 536-559, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    2. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    3. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    4. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
    5. Kock, Anders Bredahl & Teräsvirta, Timo, 2014. "Forecasting performances of three automated modelling techniques during the economic crisis 2007–2009," International Journal of Forecasting, Elsevier, vol. 30(3), pages 616-631.
    6. Lahiri, Kajal & Yang, Liu, 2013. "Forecasting Binary Outcomes," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106, Elsevier.
    7. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521770415.
    8. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2012. "Was the Recent Downturn in US GDP Predictable?," Working Papers 1210, University of Nevada, Las Vegas , Department of Economics.
    9. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen Miller, 2013. "Forecasting Nevada gross gaming revenue and taxable sales using coincident and leading employment indexes," Empirical Economics, Springer, vol. 44(2), pages 387-417, April.
    10. LeBaron, Blake, 2003. "Non-Linear Time Series Models in Empirical Finance,: Philip Hans Franses and Dick van Dijk, Cambridge University Press, Cambridge, 2000, 296 pp., Paperback, ISBN 0-521-77965-0, $33, [UK pound]22.95, [," International Journal of Forecasting, Elsevier, vol. 19(4), pages 751-752.
    11. Timo Teräsvirta, 2017. "Nonlinear models in macroeconometrics," CREATES Research Papers 2017-32, Department of Economics and Business Economics, Aarhus University.
    12. Ferrara, Laurent & Marcellino, Massimiliano & Mogliani, Matteo, 2015. "Macroeconomic forecasting during the Great Recession: The return of non-linearity?," International Journal of Forecasting, Elsevier, vol. 31(3), pages 664-679.
    13. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    14. Shahid IQBAL & Maqbool H. SIAL, 2016. "Projections of Inflation Dynamics for Pakistan: GMDH Approach," Journal of Economics and Political Economy, KSP Journals, vol. 3(3), pages 536-559, September.
    15. Exterkate, Peter & Groenen, Patrick J.F. & Heij, Christiaan & van Dijk, Dick, 2016. "Nonlinear forecasting with many predictors using kernel ridge regression," International Journal of Forecasting, Elsevier, vol. 32(3), pages 736-753.
    16. Chauvet, Marcelle & Potter, Simon, 2013. "Forecasting Output," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 141-194, Elsevier.
    17. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    18. Ang, Andrew & Bekaert, Geert & Wei, Min, 2007. "Do macro variables, asset markets, or surveys forecast inflation better?," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1163-1212, May.
    19. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    20. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.

    More about this item

    Keywords

    forecast accuracy; Kolmogorov-Gabor; nearest neighbour; neural network; nonlinear regression;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2010-01. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.