IDEAS home Printed from https://ideas.repec.org/p/bca/bocawp/07-1.html
   My bibliography  Save this paper

How Far Can Forecasting Models Forecast? Forecast Content Horizons for Some Important Macroeconomic Variables

Author

Listed:
  • John Galbraith
  • Greg Tkacz

Abstract

For stationary transformations of variables, there exists a maximum horizon beyond which forecasts can provide no more information about the variable than is present in the unconditional mean. Meteorological forecasts, typically excepting only experimental or exploratory situations, are not reported beyond this horizon; by contrast, little generally accepted information about such maximum horizons is available for economic variables. The authors estimate such content horizons for a variety of economic variables, and compare these with the maximum horizons that they observe reported in a large sample of empirical economic forecasting studies. The authors find that many published studies provide forecasts exceeding, often by substantial margins, their estimates of the content horizon for the particular variable and frequency. The authors suggest some simple reporting practices for forecasts that could potentially bring greater transparency to the process of making and interpreting economic forecasts.

Suggested Citation

  • John Galbraith & Greg Tkacz, 2007. "How Far Can Forecasting Models Forecast? Forecast Content Horizons for Some Important Macroeconomic Variables," Staff Working Papers 07-1, Bank of Canada.
  • Handle: RePEc:bca:bocawp:07-1
    as

    Download full text from publisher

    File URL: https://www.bankofcanada.ca/wp-content/uploads/2010/02/wp07-1.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wen, Yi & Zeng, Bing, 1999. "A simple nonlinear filter for economic time series analysis," Economics Letters, Elsevier, vol. 64(2), pages 151-160, August.
    2. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2003. "Do financial variables help forecasting inflation and real activity in the euro area?," Journal of Monetary Economics, Elsevier, vol. 50(6), pages 1243-1255, September.
    3. Gary Koop & Simon M. Potter, 2003. "Forecasting in large macroeconomic panels using Bayesian Model Averaging," Staff Reports 163, Federal Reserve Bank of New York.
    4. Bos, Charles S. & Franses, Philip Hans & Ooms, Marius, 2002. "Inflation, forecast intervals and long memory regression models," International Journal of Forecasting, Elsevier, vol. 18(2), pages 243-264.
    5. Najand, Mohammad & Bond, Charlotte, 2000. "Structural models of exchange rate determination," Journal of Multinational Financial Management, Elsevier, vol. 10(1), pages 15-27, January.
    6. Gordon R. Richards, 2004. "A fractal forecasting model for financial time series," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(8), pages 586-601.
    7. Lee, Jim, 1999. "Alternative P* Models of Inflation Forecasts," Economic Inquiry, Western Economic Association International, vol. 37(2), pages 312-325, April.
    8. Vivien Guiraud & Michel Terraza & Olivier Darné, 2004. "Forecasts of the seasonal fractional integrated series," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(1), pages 1-17.
    9. Kilian, Lutz & Taylor, Mark P., 2003. "Why is it so difficult to beat the random walk forecast of exchange rates?," Journal of International Economics, Elsevier, vol. 60(1), pages 85-107, May.
    10. Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
    11. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    12. Boero, Gianna & Marrocu, Emanuela, 2004. "The performance of SETAR models: a regime conditional evaluation of point, interval and density forecasts," International Journal of Forecasting, Elsevier, vol. 20(2), pages 305-320.
    13. Robertson, Donald, 1992. "Term Structure Forecasts of Inflation," Economic Journal, Royal Economic Society, vol. 102(414), pages 1083-1093, September.
    14. Philip Hans Franses & Yoshinori Kawasaki, 2004. "Do seasonal unit roots matter for forecasting monthly industrial production?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 77-88.
    15. Clarida, Richard H. & Sarno, Lucio & Taylor, Mark P. & Valente, Giorgio, 2003. "The out-of-sample success of term structure models as exchange rate predictors: a step beyond," Journal of International Economics, Elsevier, vol. 60(1), pages 61-83, May.
    16. Schunk, Donald L, 2001. "The Relative Forecasting Performance of the Divisia and Simple Sum Monetary Aggregates," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 33(2), pages 272-283, May.
    17. Lucio Sarno, 2003. "Nonlinear Exchange Rate Models: A Selective Overview," Rivista di Politica Economica, SIPI Spa, vol. 93(4), pages 3-46, July-Augu.
    18. Sarno,Lucio & Taylor,Mark P., 2003. "The Economics of Exchange Rates," Cambridge Books, Cambridge University Press, number 9780521485845.
    19. Engel, Charles & Hamilton, James D, 1990. "Long Swings in the Dollar: Are They in the Data and Do Markets Know It?," American Economic Review, American Economic Association, vol. 80(4), pages 689-713, September.
    20. Chung-Shu Wu & Ruey S. Tsay, 2003. "Forecasting with leading indicators revisited," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(8), pages 603-617.
    21. Elliott, Graham & Timmermann, Allan, 2004. "Optimal forecast combinations under general loss functions and forecast error distributions," Journal of Econometrics, Elsevier, vol. 122(1), pages 47-79, September.
    22. Mr. Toshitaka Sekine, 2001. "Modeling and Forecasting Inflation in Japan," IMF Working Papers 2001/082, International Monetary Fund.
    23. Sune Karlsson & Tor Jacobson, 2004. "Finding good predictors for inflation: a Bayesian model averaging approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(7), pages 479-496.
    24. Hurvich, Clifford M., 2002. "Multistep forecasting of long memory series using fractional exponential models," International Journal of Forecasting, Elsevier, vol. 18(2), pages 167-179.
    25. Anderson, Richard G. & Hoffman, Dennis L. & Rasche, Robert H., 2002. "A vector error-correction forecasting model of the US economy," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 569-598, December.
    26. Stockton, David J & Glassman, James E, 1987. "An Evaluation of the Forecast Performance of Alternative Models of Inflation," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 108-117, February.
    27. Giorgio Valente & Lucio Sarno, 2004. "Comparing the accuracy of density forecasts from competing models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(8), pages 541-557.
    28. Richard Deaves, 1996. "Forecasting Canadian Short-Term Interest Rates," Canadian Journal of Economics, Canadian Economics Association, vol. 29(3), pages 615-634, August.
    29. Franses, Philip Hans & van Dijk, Dick, 2005. "The forecasting performance of various models for seasonality and nonlinearity for quarterly industrial production," International Journal of Forecasting, Elsevier, vol. 21(1), pages 87-102.
    30. Diebold, Francis X. & Li, Canlin, 2006. "Forecasting the term structure of government bond yields," Journal of Econometrics, Elsevier, vol. 130(2), pages 337-364, February.
    31. Cheung, Y. -W. & Chinn, M. D., 1998. "Integration, cointegration and the forecast consistency of structural exchange rate models," Journal of International Money and Finance, Elsevier, vol. 17(5), pages 813-830, October.
    32. Pena, Daniel & Poncela, Pilar, 2004. "Forecasting with nonstationary dynamic factor models," Journal of Econometrics, Elsevier, vol. 119(2), pages 291-321, April.
    33. Hubrich, Kirstin, 2005. "Forecasting euro area inflation: Does aggregating forecasts by HICP component improve forecast accuracy?," International Journal of Forecasting, Elsevier, vol. 21(1), pages 119-136.
    34. Thomas Lindh, 2004. "Medium-term forecasts of potential GDP and inflation using age structure information," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(1), pages 19-49.
    35. Campbell R. Harvey, 1997. "The Relation between the Term Structure of Interest Rates and Canadian Economic Growth," Canadian Journal of Economics, Canadian Economics Association, vol. 30(1), pages 169-193, February.
    36. McCrae, Michael, et al, 2002. "Can Cointegration-Based Forecasting Outperform Univariate Models? An Application to Asian Exchange Rates," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 21(5), pages 355-380, August.
    37. Eitrheim, Oyvind & Husebo, Tore Anders & Nymoen, Ragnar, 1999. "Equilibrium-correction vs. differencing in macroeconometric forecasting," Economic Modelling, Elsevier, vol. 16(4), pages 515-544, December.
    38. Duy, Timothy A. & Thoma, Mark A., 1998. "Modeling and Forecasting Cointegrated Variables: Some Practical Experience," Journal of Economics and Business, Elsevier, vol. 50(3), pages 291-307, May.
    39. Canova, Fabio & Ciccarelli, Matteo, 2004. "Forecasting and turning point predictions in a Bayesian panel VAR model," Journal of Econometrics, Elsevier, vol. 120(2), pages 327-359, June.
    40. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    41. Joseph, Nathan Lael, 2001. "Model Specification and Forecasting Foreign Exchange Rates with Vector Autoregressions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(7), pages 451-484, November.
    42. William W. Chow, 2004. "An outlier robust hierarchical Bayes model for forecasting: the case of Hong Kong," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 99-114.
    43. Clements, M.P. & Hendry, D.F., 1992. "Forecasting in Cointegrated Systems," Economics Series Working Papers 99139, University of Oxford, Department of Economics.
    44. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-218, March.
    45. Richard H. Clarida & Mark P. Taylor, 1997. "The Term Structure Of Forward Exchange Premiums And The Forecastability Of Spot Exchange Rates: Correcting The Errors," The Review of Economics and Statistics, MIT Press, vol. 79(3), pages 353-361, August.
    46. Maximo Camacho, 2004. "Vector smooth transition regression models for US GDP and the composite index of leading indicators," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(3), pages 173-196.
    47. Woon Gyu Choi, 2002. "The Inverted Fisher Hypothesis: Inflation Forecastability and Asset Substitution," IMF Staff Papers, Palgrave Macmillan, vol. 49(2), pages 1-4.
    48. Alan A. Carruth & Mark A. Hooker & Andrew J. Oswald, 1998. "Unemployment Equilibria And Input Prices: Theory And Evidence From The United States," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 621-628, November.
    49. Evans, Martin & Wachtel, Paul, 1993. "Inflation Regimes and the," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 25(3), pages 475-511, August.
    50. Meade, Nigel, 2002. "A comparison of the accuracy of short term foreign exchange forecasting methods," International Journal of Forecasting, Elsevier, vol. 18(1), pages 67-83.
    51. Rapach, David E. & Wohar, Mark E., 2002. "Testing the monetary model of exchange rate determination: new evidence from a century of data," Journal of International Economics, Elsevier, vol. 58(2), pages 359-385, December.
    52. Fletcher, Donna J. & Gulley, O. David, 1996. "Forecasting the real interest rate," The North American Journal of Economics and Finance, Elsevier, vol. 7(1), pages 55-76.
    53. Laura Brown & Saeed Moshiri, 2004. "Unemployment variation over the business cycles: a comparison of forecasting models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(7), pages 497-511.
    54. Siddique, Akhtar & Sweeney, Richard J., 1998. "Forecasting real exchange rates1," Journal of International Money and Finance, Elsevier, vol. 17(1), pages 63-70, February.
    55. Margaret R. Maier & Nigel Meade, 2003. "Evidence of long memory in short-term interest rates," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(8), pages 553-568.
    56. Chan Guk Huh, 1996. "Some evidence on the efficacy of the UK inflation targeting regime: an out-of-sample forecast approach," International Finance Discussion Papers 565, Board of Governors of the Federal Reserve System (U.S.).
    57. Tambakis, Demosthenes N & Van Royen, Anne-Sophie, 2002. "Conditional Predictability of Daily Exchange Rates," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 21(5), pages 301-315, August.
    58. Qi, Min & Wu, Yangru, 2003. "Nonlinear prediction of exchange rates with monetary fundamentals," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 623-640, December.
    59. Villani, Mattias, 2001. "Bayesian prediction with cointegrated vector autoregressions," International Journal of Forecasting, Elsevier, vol. 17(4), pages 585-605.
    60. Paul Hallwood & Ronald MacDonald, 2008. "International Money and Finance," Working papers 2008-02, University of Connecticut, Department of Economics.
    61. Sarantis, Nicholas, 1999. "Modeling non-linearities in real effective exchange rates," Journal of International Money and Finance, Elsevier, vol. 18(1), pages 27-45, January.
    62. Boothe, Paul & Glassman, Debra, 1987. "Comparing exchange rate forecasting models : Accuracy versus profitability," International Journal of Forecasting, Elsevier, vol. 3(1), pages 65-79.
    63. Martin Evans & Paul Wachtel, 1993. "Inflation regimes and the sources of inflation uncertainty," Proceedings, Federal Reserve Bank of Cleveland, pages 475-520.
    64. Michael F. Bleaney, 1998. "Exchange Rate Forecasts at Long Horizons: Are Error-Correction Models Superior?," Canadian Journal of Economics, Canadian Economics Association, vol. 31(4), pages 852-864, November.
    65. De Gooijer, Jan G. & Ray, Bonnie K. & Krager, Horst, 1998. "Forecasting exchange rates using TSMARS," Journal of International Money and Finance, Elsevier, vol. 17(3), pages 513-534, June.
    66. Clements, Michael P. & Smith, Jeremy, 2001. "Evaluating forecasts from SETAR models of exchange rates," Journal of International Money and Finance, Elsevier, vol. 20(1), pages 133-148, February.
    67. Man, K. S., 2003. "Long memory time series and short term forecasts," International Journal of Forecasting, Elsevier, vol. 19(3), pages 477-491.
    68. Le Bihan, Herve & Sedillot, Franck, 2000. "Do core inflation measures help forecast inflation?: Out-of-sample evidence from French data," Economics Letters, Elsevier, vol. 69(3), pages 261-266, December.
    69. Franses, Philip Hans & Ooms, Marius, 1997. "A periodic long-memory model for quarterly UK inflation," International Journal of Forecasting, Elsevier, vol. 13(1), pages 117-126, March.
    70. DeJong, David N. & Ingram, Beth F. & Whiteman, Charles H., 2000. "A Bayesian approach to dynamic macroeconomics," Journal of Econometrics, Elsevier, vol. 98(2), pages 203-223, October.
    71. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    72. Choi, Jae-Young & Ratti, Ronald A., 2000. "The Predictive Power of Alternative Indicators of Monetary Policy," Journal of Macroeconomics, Elsevier, vol. 22(4), pages 581-610, October.
    73. Garcia-Ferrer, Antonio & Poncela, Pilar, 2002. "Forecasting European GNP Data through Common Factor Models and Other Procedures," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 21(4), pages 225-244, July.
    74. Clements, Michael P. & Galvao, Ana Beatriz, 2004. "A comparison of tests of nonlinear cointegration with application to the predictability of US interest rates using the term structure," International Journal of Forecasting, Elsevier, vol. 20(2), pages 219-236.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olivier Fortin‐Gagnon & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "A large Canadian database for macroeconomic analysis," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 55(4), pages 1799-1833, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
    2. Medel, Carlos & Camilleri, Gilmour & Hsu, Hsiang-Ling & Kania, Stefan & Touloumtzoglou, Miltiadis, 2015. "Robustness in Foreign Exchange Rate Forecasting Models: Economics-based Modelling After the Financial Crisis," MPRA Paper 65290, University Library of Munich, Germany.
    3. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    4. Clarida, Richard H. & Sarno, Lucio & Taylor, Mark P. & Valente, Giorgio, 2003. "The out-of-sample success of term structure models as exchange rate predictors: a step beyond," Journal of International Economics, Elsevier, vol. 60(1), pages 61-83, May.
    5. Ledenyov, Dimitri O. & Ledenyov, Viktor O., 2015. "Wave function method to forecast foreign currencies exchange rates at ultra high frequency electronic trading in foreign currencies exchange markets," MPRA Paper 67470, University Library of Munich, Germany.
    6. Carlo Altavilla & Paul De Grauwe, 2010. "Non-linearities in the relation between the exchange rate and its fundamentals," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 15(1), pages 1-21.
    7. Jan G. De Gooijer & Rob J. Hyndman, 2005. "25 Years of IIF Time Series Forecasting: A Selective Review," Monash Econometrics and Business Statistics Working Papers 12/05, Monash University, Department of Econometrics and Business Statistics.
    8. Wright, Jonathan H., 2008. "Bayesian Model Averaging and exchange rate forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 329-341, October.
    9. Christopher J. Neely & Lucio Sarno, 2002. "How well do monetary fundamentals forecast exchange rates?," Review, Federal Reserve Bank of St. Louis, vol. 84(Sep), pages 51-74.
    10. Sarno, Lucio & Valente, Giorgio, 2005. "Empirical exchange rate models and currency risk: some evidence from density forecasts," Journal of International Money and Finance, Elsevier, vol. 24(2), pages 363-385, March.
    11. Wu, Jyh-Lin & Hu, Yu-Hau, 2009. "New evidence on nominal exchange rate predictability," Journal of International Money and Finance, Elsevier, vol. 28(6), pages 1045-1063, October.
    12. Todd E. Clark & Michael W. McCracken, 2009. "Combining Forecasts from Nested Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 303-329, June.
    13. Lukas Menkhoff & Mark P. Taylor, 2007. "The Obstinate Passion of Foreign Exchange Professionals: Technical Analysis," Journal of Economic Literature, American Economic Association, vol. 45(4), pages 936-972, December.
    14. Todd E. Clark & Michael W. McCracken, 2009. "Improving Forecast Accuracy By Combining Recursive And Rolling Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(2), pages 363-395, May.
    15. David Alan Peel & Pantelis Promponas, 2016. "Forecasting the nominal exchange rate movements in a changing world. The case of the U.S. and the U.K," Working Papers 144439514, Lancaster University Management School, Economics Department.
    16. Anthony Garratt & Kevin Lee, 2006. "Investing Under Model Uncertainty: Decision Based Evaluation of Exchange Rate and Interest Rate Forecasts in the US, UK and Japan," Birkbeck Working Papers in Economics and Finance 0616, Birkbeck, Department of Economics, Mathematics & Statistics.
    17. Garratt, Anthony & Lee, Kevin, 2010. "Investing under model uncertainty: Decision based evaluation of exchange rate forecasts in the US, UK and Japan," Journal of International Money and Finance, Elsevier, vol. 29(3), pages 403-422, April.
    18. Firat Melih Yilmaz & Ozer Arabaci, 2021. "Should Deep Learning Models be in High Demand, or Should They Simply be a Very Hot Topic? A Comprehensive Study for Exchange Rate Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 217-245, January.
    19. Carlo Altavilla & Paul De Grauwe, 2010. "Forecasting and combining competing models of exchange rate determination," Applied Economics, Taylor & Francis Journals, vol. 42(27), pages 3455-3480.
    20. Sager, Michael & Taylor, Mark P., 2014. "Generating currency trading rules from the term structure of forward foreign exchange premia," Journal of International Money and Finance, Elsevier, vol. 44(C), pages 230-250.

    More about this item

    Keywords

    Econometric and statistical methods; Business fluctuations and cycles;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocawp:07-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.