IDEAS home Printed from https://ideas.repec.org/p/aah/create/2011-27.html
   My bibliography  Save this paper

Forecasting Macroeconomic Variables using Neural Network Models and Three Automated Model Selection Techniques

Author

Listed:
  • Anders Bredahl Kock

    (Aarhus University and CREATES)

  • Timo Teräsvirta

    (Aarhus University and CREATES)

Abstract

In this paper we consider the forecasting performance of a well-defined class of flexible models, the so-called single hidden-layer feedforward neural network models. A major aim of our study is to find out whether they, due to their flexibility, are as useful tools in economic forecasting as some previous studies have indicated. When forecasting with neural network models one faces several problems, all of which influence the accuracy of the forecasts. First, neural networks are often hard to estimate due to their highly nonlinear structure. In fact, their parameters are not even globally identified. Recently, White (2006) presented a solution that amounts to converting the specification and nonlinear estimation problem into a linear model selection and estimation problem. He called this procedure the QuickNet and we shall compare its performance to two other procedures which are built on the linearisation idea: the Marginal Bridge Estimator and Autometrics. Second, one must decide whether forecasting should be carried out recursively or directly. Comparisons of these two methodss exist for linear models and here these comparisons are extended to neural networks. Finally, a nonlinear model such as the neural network model is not appropriate if the data is generated by a linear mechanism. Hence, it might be appropriate to test the null of linearity prior to building a nonlinear model. We investigate whether this kind of pretesting improves the forecast accuracy compared to the case where this is not done.

Suggested Citation

  • Anders Bredahl Kock & Timo Teräsvirta, 2011. "Forecasting Macroeconomic Variables using Neural Network Models and Three Automated Model Selection Techniques," CREATES Research Papers 2011-27, Department of Economics and Business Economics, Aarhus University.
  • Handle: RePEc:aah:create:2011-27
    as

    Download full text from publisher

    File URL: https://repec.econ.au.dk/repec/creates/rp/11/rp11_27.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    2. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    3. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    4. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    5. Teodosio Perez‐Amaral & Giampiero M. Gallo & Halbert White, 2003. "A Flexible Tool for Model Building: the Relevant Transformation of the Inputs Network Approach (RETINA)," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 821-838, December.
    6. Racine, Jeff, 2000. "Consistent cross-validatory model-selection for dependent data: hv-block cross-validation," Journal of Econometrics, Elsevier, vol. 99(1), pages 39-61, November.
    7. Lee, Tae-Hwy & White, Halbert & Granger, Clive W. J., 1993. "Testing for neglected nonlinearity in time series models : A comparison of neural network methods and alternative tests," Journal of Econometrics, Elsevier, vol. 56(3), pages 269-290, April.
    8. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    9. Kuan, Chung-Ming & Liu, Tung, 1995. "Forecasting Exchange Rates Using Feedforward and Recurrent Neural Networks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(4), pages 347-364, Oct.-Dec..
    10. David F. Hendry & Hans-Martin Krolzig, 2005. "The Properties of Automatic "GETS" Modelling," Economic Journal, Royal Economic Society, vol. 115(502), pages 32-61, March.
    11. Costantini, Mauro & Kunst, Robert M., 2011. "On the Usefulness of the Diebold-Mariano Test in the Selection of Prediction Models," Economics Series 276, Institute for Advanced Studies.
    12. Goffe, William L. & Ferrier, Gary D. & Rogers, John, 1994. "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 65-99.
    13. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    14. Terasvirta, Timo & Tjostheim, Dag & Granger, Clive W. J., 2010. "Modelling Nonlinear Economic Time Series," OUP Catalogue, Oxford University Press, number 9780199587155.
    15. Klaus Nordhausen, 2009. "The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition by Trevor Hastie, Robert Tibshirani, Jerome Friedman," International Statistical Review, International Statistical Institute, vol. 77(3), pages 482-482, December.
    16. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    17. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    18. Engle, Robert F. & White (the late), Halbert (ed.), 1999. "Cointegration, Causality, and Forecasting: Festschrift in Honour of Clive W. J. Granger," OUP Catalogue, Oxford University Press, number 9780198296836.
    19. MArcelo C. Medeiros & Eduardo F.Mendes, 2012. "Estimating High-Dimensional Time Series Models," Textos para discussão 602, Department of Economics PUC-Rio (Brazil).
    20. Novales, Alfonso, 2005. "Comments on: "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination"," International Journal of Forecasting, Elsevier, vol. 21(4), pages 775-780.
    21. Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, Department of Economics and Business Economics, Aarhus University.
    22. Massimiliano Marcellino, "undated". "Instability and non-linearity in the EMU," Working Papers 211, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    23. Swanson, Norman R & White, Halbert, 1995. "A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 265-275, July.
    24. White, Halbert, 2006. "Approximate Nonlinear Forecasting Methods," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 9, pages 459-512, Elsevier.
    25. Rech, Gianluigi, 2002. "Forecasting with artificial neural network models," SSE/EFI Working Paper Series in Economics and Finance 491, Stockholm School of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Felix Pretis & Lea Schneider & Jason E. Smerdon & David F. Hendry, 2016. "Detecting Volcanic Eruptions In Temperature Reconstructions By Designed Break-Indicator Saturation," Journal of Economic Surveys, Wiley Blackwell, vol. 30(3), pages 403-429, July.
    2. Muhammad Nadim Hanif & Khurrum S. Mughal & Javed Iqbal, 2018. "A Thick ANN Model for Forecasting Inflation," SBP Working Paper Series 99, State Bank of Pakistan, Research Department.
    3. Anna Almosova & Niek Andresen, 2023. "Nonlinear inflation forecasting with recurrent neural networks," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(2), pages 240-259, March.
    4. Andrii Babii & Eric Ghysels & Jonas Striaukas, 2023. "Econometrics of Machine Learning Methods in Economic Forecasting," Papers 2308.10993, arXiv.org.
    5. Kauppi, Heikki & Virtanen, Timo, 2021. "Boosting nonlinear predictability of macroeconomic time series," International Journal of Forecasting, Elsevier, vol. 37(1), pages 151-170.
    6. Kock, Anders Bredahl & Teräsvirta, Timo, 2014. "Forecasting performances of three automated modelling techniques during the economic crisis 2007–2009," International Journal of Forecasting, Elsevier, vol. 30(3), pages 616-631.
    7. Håvard Hungnes, 2018. "Encompassing tests for evaluating multi-step system forecasts invariant to linear transformations," Discussion Papers 871, Statistics Norway, Research Department.
    8. Wang, Lu & Ma, Feng & Hao, Jianyang & Gao, Xinxin, 2021. "Forecasting crude oil volatility with geopolitical risk: Do time-varying switching probabilities play a role?," International Review of Financial Analysis, Elsevier, vol. 76(C).
    9. Lee Jinu, 2019. "A Neural Network Method for Nonlinear Time Series Analysis," Journal of Time Series Econometrics, De Gruyter, vol. 11(1), pages 1-18, January.
    10. Tae-Hwy Lee & Zhou Xi & Ru Zhang, 2013. "Testing for Neglected Nonlinearity Using Regularized Artificial Neural Networks," Working Papers 201422, University of California at Riverside, Department of Economics, revised Apr 2012.
    11. Heikki Kauppi & Timo Virtanen, 2018. "Boosting Non-linear Predictabilityof Macroeconomic Time Series," Discussion Papers 124, Aboa Centre for Economics.
    12. Anders Bredahl Kock & Laurent A.F. Callot, 2012. "Oracle Efficient Estimation and Forecasting with the Adaptive LASSO and the Adaptive Group LASSO in Vector Autoregressions," CREATES Research Papers 2012-38, Department of Economics and Business Economics, Aarhus University.
    13. Tea Šestanović & Josip Arnerić, 2021. "Can Recurrent Neural Networks Predict Inflation in Euro Zone as Good as Professional Forecasters?," Mathematics, MDPI, vol. 9(19), pages 1-13, October.
    14. Daniel Wochner, 2020. "Dynamic Factor Trees and Forests – A Theory-led Machine Learning Framework for Non-Linear and State-Dependent Short-Term U.S. GDP Growth Predictions," KOF Working papers 20-472, KOF Swiss Economic Institute, ETH Zurich.
    15. Kock Anders Bredahl, 2011. "Forecasting with Universal Approximators and a Learning Algorithm," Journal of Time Series Econometrics, De Gruyter, vol. 3(3), pages 1-32, October.
    16. Vito Polito & Yunyi Zhang, 2021. "Tackling Large Outliers in Macroeconomic Data with Vector Artificial Neural Network Autoregression," CESifo Working Paper Series 9395, CESifo.
    17. Håvard Hungnes, 2020. "Equal predictability test for multi-step-ahead system forecasts invariant to linear transformations," Discussion Papers 931, Statistics Norway, Research Department.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kock, Anders Bredahl & Teräsvirta, Timo, 2014. "Forecasting performances of three automated modelling techniques during the economic crisis 2007–2009," International Journal of Forecasting, Elsevier, vol. 30(3), pages 616-631.
    2. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    3. Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, Department of Economics and Business Economics, Aarhus University.
    4. Exterkate, Peter & Groenen, Patrick J.F. & Heij, Christiaan & van Dijk, Dick, 2016. "Nonlinear forecasting with many predictors using kernel ridge regression," International Journal of Forecasting, Elsevier, vol. 32(3), pages 736-753.
    5. Ferrara, Laurent & Marcellino, Massimiliano & Mogliani, Matteo, 2015. "Macroeconomic forecasting during the Great Recession: The return of non-linearity?," International Journal of Forecasting, Elsevier, vol. 31(3), pages 664-679.
    6. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    7. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    8. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    9. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen Miller, 2013. "Forecasting Nevada gross gaming revenue and taxable sales using coincident and leading employment indexes," Empirical Economics, Springer, vol. 44(2), pages 387-417, April.
    10. Galvão, Ana Beatriz, 2013. "Changes in predictive ability with mixed frequency data," International Journal of Forecasting, Elsevier, vol. 29(3), pages 395-410.
    11. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    12. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    13. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2012. "Was the Recent Downturn in US GDP Predictable?," Working Papers 1210, University of Nevada, Las Vegas , Department of Economics.
    14. Heikki Kauppi & Timo Virtanen, 2018. "Boosting Non-linear Predictabilityof Macroeconomic Time Series," Discussion Papers 124, Aboa Centre for Economics.
    15. Nikolay Robinzonov & Klaus Wohlrabe, 2010. "Freedom of Choice in Macroeconomic Forecasting ," CESifo Economic Studies, CESifo Group, vol. 56(2), pages 192-220, June.
    16. Milas, Costas & Rothman, Philip, 2008. "Out-of-sample forecasting of unemployment rates with pooled STVECM forecasts," International Journal of Forecasting, Elsevier, vol. 24(1), pages 101-121.
    17. Tea Šestanović & Josip Arnerić, 2021. "Neural network structure identification in inflation forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(1), pages 62-79, January.
    18. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    19. Neil Shephard & Kevin Sheppard, 2010. "Realising the future: forecasting with high-frequency-based volatility (HEAVY) models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 197-231.
    20. Camila Epprecht & Dominique Guegan & Álvaro Veiga, 2013. "Comparing variable selection techniques for linear regression: LASSO and Autometrics," Documents de travail du Centre d'Economie de la Sorbonne 13080, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.

    More about this item

    Keywords

    artificial neural network; forecast comparison; model selection; nonlinear autoregressive model; nonlinear time series; root mean square forecast error; Wilcoxon’s signed-rank test;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2011-27. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.