IDEAS home Printed from https://ideas.repec.org/p/aah/create/2011-28.html
   My bibliography  Save this paper

Forecasting performance of three automated modelling techniques during the economic crisis 2007-2009

Author

Listed:
  • Anders Bredahl Kock

    (Aarhus University and CREATES)

  • Timo Teräsvirta

    (Aarhus University and CREATES)

Abstract

In this work we consider forecasting macroeconomic variables dur- ing an economic crisis. The focus is on a specific class of models, the so-called single hidden-layer feedforward autoregressive neural net- work models. What makes these models interesting in the present context is that they form a class of universal approximators and may be expected to work well during exceptional periods such as major economic crises. These models are often difficult to estimate, and we follow the idea of White (2006) to transform the speci?fication and non- linear estimation problem into a linear model selection and estimation problem. To this end we employ three automatic modelling devices. One of them is White's QuickNet, but we also consider Autometrics, well known to time series econometricians, and the Marginal Bridge Estimator, better known to statisticians and microeconometricians. The performance of these three model selectors is compared by look- ing at the accuracy of the forecasts of the estimated neural network models. We apply the neural network model and the three modelling techniques to monthly industrial production and unemployment se- ries of the G7 countries and the four Scandinavian ones, and focus on forecasting during the economic crisis 2007-2009. Forecast accuracy is measured by the root mean square forecast error. Hypothesis testing is also used to compare the performance of the different techniques with each other.

Suggested Citation

  • Anders Bredahl Kock & Timo Teräsvirta, 2011. "Forecasting performance of three automated modelling techniques during the economic crisis 2007-2009," CREATES Research Papers 2011-28, Department of Economics and Business Economics, Aarhus University.
  • Handle: RePEc:aah:create:2011-28
    as

    Download full text from publisher

    File URL: https://repec.econ.au.dk/repec/creates/rp/11/rp11_28.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    2. Norman R. Swanson & Halbert White, 1997. "A Model Selection Approach To Real-Time Macroeconomic Forecasting Using Linear Models And Artificial Neural Networks," The Review of Economics and Statistics, MIT Press, vol. 79(4), pages 540-550, November.
    3. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    4. Teodosio Perez‐Amaral & Giampiero M. Gallo & Halbert White, 2003. "A Flexible Tool for Model Building: the Relevant Transformation of the Inputs Network Approach (RETINA)," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 821-838, December.
    5. Racine, Jeff, 2000. "Consistent cross-validatory model-selection for dependent data: hv-block cross-validation," Journal of Econometrics, Elsevier, vol. 99(1), pages 39-61, November.
    6. David F. Hendry & Hans-Martin Krolzig, 2005. "The Properties of Automatic "GETS" Modelling," Economic Journal, Royal Economic Society, vol. 115(502), pages 32-61, March.
    7. Krolzig, Hans-Martin & Hendry, David F., 2001. "Computer automation of general-to-specific model selection procedures," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 831-866, June.
    8. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    9. Terasvirta, Timo & Tjostheim, Dag & Granger, Clive W. J., 2010. "Modelling Nonlinear Economic Time Series," OUP Catalogue, Oxford University Press, number 9780199587155.
    10. Klaus Nordhausen, 2009. "The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition by Trevor Hastie, Robert Tibshirani, Jerome Friedman," International Statistical Review, International Statistical Institute, vol. 77(3), pages 482-482, December.
    11. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    12. Clements, Michael P. & Hendry, David F. (ed.), 2011. "The Oxford Handbook of Economic Forecasting," OUP Catalogue, Oxford University Press, number 9780195398649.
    13. Engle, Robert F. & White (the late), Halbert (ed.), 1999. "Cointegration, Causality, and Forecasting: Festschrift in Honour of Clive W. J. Granger," OUP Catalogue, Oxford University Press, number 9780198296836.
    14. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    15. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    16. Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, Department of Economics and Business Economics, Aarhus University.
    17. Castle, Jennifer & Shephard, Neil (ed.), 2009. "The Methodology and Practice of Econometrics: A Festschrift in Honour of David F. Hendry," OUP Catalogue, Oxford University Press, number 9780199237197.
    18. Swanson, Norman R & White, Halbert, 1995. "A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 265-275, July.
    19. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    20. White, Halbert, 2006. "Approximate Nonlinear Forecasting Methods," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 9, pages 459-512, Elsevier.
    21. Swanson, Norman R. & White, Halbert, 1997. "Forecasting economic time series using flexible versus fixed specification and linear versus nonlinear econometric models," International Journal of Forecasting, Elsevier, vol. 13(4), pages 439-461, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Oscar Claveria & Enric Monte & Salvador Torra, 2015. "“Self-organizing map analysis of agents’ expectations. Different patterns of anticipation of the 2008 financial crisis”," AQR Working Papers 201508, University of Barcelona, Regional Quantitative Analysis Group, revised Mar 2015.
    2. Ferrara, Laurent & Marcellino, Massimiliano & Mogliani, Matteo, 2015. "Macroeconomic forecasting during the Great Recession: The return of non-linearity?," International Journal of Forecasting, Elsevier, vol. 31(3), pages 664-679.
    3. Jena, Pradyot Ranjan & Majhi, Ritanjali & Kalli, Rajesh & Managi, Shunsuke & Majhi, Babita, 2021. "Impact of COVID-19 on GDP of major economies: Application of the artificial neural network forecaster," Economic Analysis and Policy, Elsevier, vol. 69(C), pages 324-339.
    4. Lee Jinu, 2019. "A Neural Network Method for Nonlinear Time Series Analysis," Journal of Time Series Econometrics, De Gruyter, vol. 11(1), pages 1-18, January.
    5. Oscar Claveria & Enric Monte & Salvador Torra, 2017. "“Regional tourism demand forecasting with machine learning models: Gaussian process regression vs. neural network models in a multiple-input multiple-output setting"," IREA Working Papers 201701, University of Barcelona, Research Institute of Applied Economics, revised Jan 2017.
    6. Jahn, Malte, 2018. "Artificial neural network regression models: Predicting GDP growth," HWWI Research Papers 185, Hamburg Institute of International Economics (HWWI).
    7. Jahn, Malte, 2020. "Artificial neural network regression models in a panel setting: Predicting economic growth," Economic Modelling, Elsevier, vol. 91(C), pages 148-154.
    8. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2020. "Machine Learning Advances for Time Series Forecasting," Papers 2012.12802, arXiv.org, revised Apr 2021.
    9. Oscar Claveria & Enric Monte & Salvador Torra, 2016. "Modelling cross-dependencies between Spain’s regional tourism markets with an extension of the Gaussian process regression model," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 7(3), pages 341-357, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    2. Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, Department of Economics and Business Economics, Aarhus University.
    3. Exterkate, Peter & Groenen, Patrick J.F. & Heij, Christiaan & van Dijk, Dick, 2016. "Nonlinear forecasting with many predictors using kernel ridge regression," International Journal of Forecasting, Elsevier, vol. 32(3), pages 736-753.
    4. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    5. Camila Epprecht & Dominique Guegan & Álvaro Veiga, 2013. "Comparing variable selection techniques for linear regression: LASSO and Autometrics," Documents de travail du Centre d'Economie de la Sorbonne 13080, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    6. Camila Epprecht & Dominique Guegan & Álvaro Veiga & Joel Correa da Rosa, 2017. "Variable selection and forecasting via automated methods for linear models: LASSO/adaLASSO and Autometrics," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00917797, HAL.
    7. Kock Anders Bredahl, 2011. "Forecasting with Universal Approximators and a Learning Algorithm," Journal of Time Series Econometrics, De Gruyter, vol. 3(3), pages 1-32, October.
    8. Bec, Frédérique & Mogliani, Matteo, 2015. "Nowcasting French GDP in real-time with surveys and “blocked” regressions: Combining forecasts or pooling information?," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1021-1042.
    9. Lahiri, Kajal & Yang, Liu, 2013. "Forecasting Binary Outcomes," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106, Elsevier.
    10. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    11. Felix Pretis & Lea Schneider & Jason E. Smerdon & David F. Hendry, 2016. "Detecting Volcanic Eruptions In Temperature Reconstructions By Designed Break-Indicator Saturation," Journal of Economic Surveys, Wiley Blackwell, vol. 30(3), pages 403-429, July.
    12. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2020. "Machine Learning Advances for Time Series Forecasting," Papers 2012.12802, arXiv.org, revised Apr 2021.
    13. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    14. Heikki Kauppi & Timo Virtanen, 2018. "Boosting Non-linear Predictabilityof Macroeconomic Time Series," Discussion Papers 124, Aboa Centre for Economics.
    15. Nikolay Robinzonov & Klaus Wohlrabe, 2010. "Freedom of Choice in Macroeconomic Forecasting ," CESifo Economic Studies, CESifo, vol. 56(2), pages 192-220, June.
    16. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen Miller, 2013. "Forecasting Nevada gross gaming revenue and taxable sales using coincident and leading employment indexes," Empirical Economics, Springer, vol. 44(2), pages 387-417, April.
    17. Kauppi, Heikki & Virtanen, Timo, 2021. "Boosting nonlinear predictability of macroeconomic time series," International Journal of Forecasting, Elsevier, vol. 37(1), pages 151-170.
    18. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    19. Shahid IQBAL & Maqbool H. SIAL, 2016. "Projections of Inflation Dynamics for Pakistan: GMDH Approach," Journal of Economics and Political Economy, KSP Journals, vol. 3(3), pages 536-559, September.
    20. Galvão, Ana Beatriz, 2013. "Changes in predictive ability with mixed frequency data," International Journal of Forecasting, Elsevier, vol. 29(3), pages 395-410.

    More about this item

    Keywords

    Autometrics; economic forecasting; Marginal Bridge estimator; neural network; nonlinear time series model; Wilcoxon's signed-rank test;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2011-28. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.econ.au.dk/afn/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.