IDEAS home Printed from https://ideas.repec.org/a/bpj/jtsmet/v3y2011i3n3.html
   My bibliography  Save this article

Forecasting with Universal Approximators and a Learning Algorithm

Author

Listed:
  • Kock Anders Bredahl

    (Aarhus University and CREATES)

Abstract

This paper applies three universal approximators for forecasting. They are the Artificial Neural Networks, the Kolmogorov-Gabor polynomials, as well as the Elliptic Basis Function Networks. We are particularly interested in the relative performance and stability of these. Even though forecast combination has a long history in econometrics focus has not been on proving loss bounds for the combination rules applied. We apply the Weighted Average Algorithm (WAA) of Kivinen & Warmuth (1999) for which such loss bounds exist. Specifically, one can bound the worst case performance of the WAA compared to the performance of the best single model in the set of models combined from. The use of universal approximators along with a combination scheme for which explicit loss bounds exist should give a solid theoretical foundation to the way the forecasts are performed. The practical performance will be investigated by considering various monthly postwar macroeconomic data sets for the G7 as well as the Scandinavian countries.

Suggested Citation

  • Kock Anders Bredahl, 2011. "Forecasting with Universal Approximators and a Learning Algorithm," Journal of Time Series Econometrics, De Gruyter, vol. 3(3), pages 1-32, October.
  • Handle: RePEc:bpj:jtsmet:v:3:y:2011:i:3:n:3
    DOI: 10.2202/1941-1928.1084
    as

    Download full text from publisher

    File URL: https://doi.org/10.2202/1941-1928.1084
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.2202/1941-1928.1084?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Engle, Robert F. & White (the late), Halbert (ed.), 1999. "Cointegration, Causality, and Forecasting: Festschrift in Honour of Clive W. J. Granger," OUP Catalogue, Oxford University Press, number 9780198296836, Decembrie.
    2. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    3. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    4. Swanson, Norman R & White, Halbert, 1995. "A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 265-275, July.
    5. White, Halbert, 2006. "Approximate Nonlinear Forecasting Methods," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 9, pages 459-512, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, Department of Economics and Business Economics, Aarhus University.
    2. Shahid IQBAL & Maqbool H. SIAL, 2016. "Projections of Inflation Dynamics for Pakistan: GMDH Approach," Journal of Economics and Political Economy, KSP Journals, vol. 3(3), pages 536-559, September.
    3. Tae-Hwy Lee & Zhou Xi & Ru Zhang, 2013. "Testing for Neglected Nonlinearity Using Regularized Artificial Neural Networks," Working Papers 201422, University of California at Riverside, Department of Economics, revised Apr 2012.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kock, Anders Bredahl & Teräsvirta, Timo, 2014. "Forecasting performances of three automated modelling techniques during the economic crisis 2007–2009," International Journal of Forecasting, Elsevier, vol. 30(3), pages 616-631.
    2. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    3. Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, Department of Economics and Business Economics, Aarhus University.
    4. Exterkate, Peter & Groenen, Patrick J.F. & Heij, Christiaan & van Dijk, Dick, 2016. "Nonlinear forecasting with many predictors using kernel ridge regression," International Journal of Forecasting, Elsevier, vol. 32(3), pages 736-753.
    5. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    6. Lahiri, Kajal & Yang, Liu, 2013. "Forecasting Binary Outcomes," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106, Elsevier.
    7. Vito Polito & Yunyi Zhang, 2021. "Tackling Large Outliers in Macroeconomic Data with Vector Artificial Neural Network Autoregression," CESifo Working Paper Series 9395, CESifo.
    8. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle," Working Paper series 17_12, Rimini Centre for Economic Analysis.
    9. Mihaela Bratu (Simionescu), 2012. "Improving the accuracy of consensus forecasts for the EURO area," Review of Applied Socio-Economic Research, Pro Global Science Association, vol. 4(2), pages 11-15, Decembre.
    10. Bec, Frédérique & Mogliani, Matteo, 2015. "Nowcasting French GDP in real-time with surveys and “blocked” regressions: Combining forecasts or pooling information?," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1021-1042.
    11. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    12. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    13. Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen Miller, 2013. "Forecasting Nevada gross gaming revenue and taxable sales using coincident and leading employment indexes," Empirical Economics, Springer, vol. 44(2), pages 387-417, April.
    14. Štefan Lyócsa & Roman Horváth, 2018. "Stock Market Contagion: a New Approach," Open Economies Review, Springer, vol. 29(3), pages 547-577, July.
    15. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2018. "Quantile forecast combination using stochastic dominance," Empirical Economics, Springer, vol. 55(4), pages 1717-1755, December.
    16. Nikolay Robinzonov & Klaus Wohlrabe, 2010. "Freedom of Choice in Macroeconomic Forecasting ," CESifo Economic Studies, CESifo Group, vol. 56(2), pages 192-220, June.
    17. Lee Jinu, 2019. "A Neural Network Method for Nonlinear Time Series Analysis," Journal of Time Series Econometrics, De Gruyter, vol. 11(1), pages 1-18, January.
    18. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    19. Huck, Nicolas, 2010. "Pairs trading and outranking: The multi-step-ahead forecasting case," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1702-1716, December.
    20. Dbouk, Wassim & Jamali, Ibrahim, 2018. "Predicting daily oil prices: Linear and non-linear models," Research in International Business and Finance, Elsevier, vol. 46(C), pages 149-165.

    More about this item

    Keywords

    forecasting; universal approximators; elliptic basis function network; forecast combination; weighted average algorithm;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:jtsmet:v:3:y:2011:i:3:n:3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.