IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Advances in Forecasting Under Instability

  • Barbara Rossi

The forecasting literature has identi fied two important, broad issues. The fi rst stylized fact is that the predictive content is unstable over time; the second is that in-sample predictive content does not necessarily translate into out-of-sample predictive ability, nor ensures the stability of the predictive relation over time. The objective of this chapter is to understand what we have learned about forecasting in the presence of instabilities, especially regarding the two questions above. The empirical evidence raises a multitude of questions. If in-sample tests provide poor guidance to out-of-sample forecasting ability, what should researchers do? If there are statistically significant instabilities in the Granger-causality relationships, how do researchers establish whether there is any Granger-causality at all? And if there is substantial instability in predictive relationships, how do researchers establish which models is the "best" forecasting model? And finally, if a model forecasts poorly, why is that, and how should researchers proceed to improve the forecasting models? In this chapter, we will answer these questions by discussing various methodologies for inference as well as estimation that have been recently proposed in the literature. We also provide an empirical analysis of the usefulness of the existing methodologies using an extensive database of macroeconomic predictors of output growth and inflation.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1934348
File Function: main text
Download Restriction: no

Paper provided by Duke University, Department of Economics in its series Working Papers with number 11-20.

as
in new window

Length: 138
Date of creation: 2011
Date of revision:
Handle: RePEc:duk:dukeec:11-20
Contact details of provider: Postal: Department of Economics Duke University 213 Social Sciences Building Box 90097 Durham, NC 27708-0097
Phone: (919) 660-1800
Fax: (919) 684-8974
Web page: http://econ.duke.edu/

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Gabriel Perez-Quiros & Allan Timmermann, 2000. "Firm Size and Cyclical Variations in Stock Returns," Journal of Finance, American Finance Association, vol. 55(3), pages 1229-1262, 06.
  2. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
  3. Marquering, Wessel & Verbeek, Marno, 2004. "The Economic Value of Predicting Stock Index Returns and Volatility," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 39(02), pages 407-429, June.
  4. Todd E. Clark & Michael W. McCracken, 2007. "Averaging forecasts from VARs with uncertain instabilities," Finance and Economics Discussion Series 2007-42, Board of Governors of the Federal Reserve System (U.S.).
  5. Anne-Sofie Jore & James Mitchell & Shaun P. Vahey, 2008. "Combining forecast densities from VARs with uncertain instabilities," Working Paper 2008/01, Norges Bank.
  6. Inoue, Atsushi & Kilian, Lutz, 2002. "In-sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 0195, European Central Bank.
  7. Akhter Faroque & William Veloce & Jean-Francois Lamarche, 2012. "Have structural changes eliminated the out-of-sample ability of financial variables to forecast real activity after the mid-1980s? Evidence from the Canadian economy," Applied Economics, Taylor & Francis Journals, vol. 44(30), pages 3965-3985, October.
  8. Jon Faust & Jonathan H. Wright, 2007. "Comparing Greenbook and Reduced Form Forecasts using a Large Realtime Dataset," NBER Working Papers 13397, National Bureau of Economic Research, Inc.
  9. Carstensen, Kai & Wohlrabe, Klaus & Ziegler, Christina, 2010. "Predictive Ability of Business Cycle Indicators under Test: A Case Study for the Euro Area Industrial Production," Discussion Papers in Economics 11442, University of Munich, Department of Economics.
  10. Bekaert, Geert & Hodrick, Robert J, 1992. " Characterizing Predictable Components in Excess Returns on Equity and Foreign Exchange Markets," Journal of Finance, American Finance Association, vol. 47(2), pages 467-509, June.
  11. Yu-Chin Chen & Kenneth Rogoff & Barbara Rossi, 2008. "Can Exchange Rates Forecast Commodity Prices?," NBER Working Papers 13901, National Bureau of Economic Research, Inc.
  12. Todd E. Clark & Michael W. McCracken, 2000. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Econometric Society World Congress 2000 Contributed Papers 0319, Econometric Society.
  13. Swanson, Norman R., 1998. "Money and output viewed through a rolling window," Journal of Monetary Economics, Elsevier, vol. 41(3), pages 455-474, May.
  14. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
  15. Atsushi Inoue & Barbara Rossi, 2011. "Identifying the Sources of Instabilities in Macroeconomic Fluctuations," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1186-1204, November.
  16. Barbara Rossi & Atsushi Inoue, 2011. "Out-of-Sample Forecast Tests Robust to Window Size Choice," Working Papers 11-04, Duke University, Department of Economics.
  17. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
  18. M. Hashem Pesaran & Davide Pettenuzzo & Allan Timmermann, 2006. "Forecasting Time Series Subject to Multiple Structural Breaks," Review of Economic Studies, Oxford University Press, vol. 73(4), pages 1057-1084.
  19. Kenneth D. West & Michael W. McCracken, 1998. "Regression-Based Tests of Predictive Ability," NBER Technical Working Papers 0226, National Bureau of Economic Research, Inc.
  20. Jean Boivin & Marc P. Giannoni, 2003. "Has Monetary Policy Become More Effective?," NBER Working Papers 9459, National Bureau of Economic Research, Inc.
  21. Philippe Bacchetta & Eric van Wincoop & Toni Beutler, 2010. "Can Parameter Instability Explain the Meese-Rogoff Puzzle?," NBER Chapters, in: NBER International Seminar on Macroeconomics 2009, pages 125-173 National Bureau of Economic Research, Inc.
  22. Hamilton, James D., 1988. "Rational-expectations econometric analysis of changes in regime : An investigation of the term structure of interest rates," Journal of Economic Dynamics and Control, Elsevier, vol. 12(2-3), pages 385-423.
  23. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-56, July.
  24. Timmermann, Allan, 2008. "Elusive return predictability," International Journal of Forecasting, Elsevier, vol. 24(1), pages 1-18.
  25. Raffaella Giacomini & Barbara Rossi, 2006. "How Stable is the Forecasting Performance of the Yield Curve for Output Growth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 68(s1), pages 783-795, December.
  26. Kozicki, Sharon & Tinsley, P. A., 2001. "Shifting endpoints in the term structure of interest rates," Journal of Monetary Economics, Elsevier, vol. 47(3), pages 613-652, June.
  27. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
  28. Antonello D'Agostino & Paolo Surico, 2012. "A Century of Inflation Forecasts," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1097-1106, November.
  29. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-58, May.
  30. Castelnuovo, Efrem & Greco, Luciano & Raggi, Davide, 2008. "Estimating regime-switching Taylor rules with trend inflation," Research Discussion Papers 20/2008, Bank of Finland.
  31. Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
  32. Smith, Aaron D., 2004. "Forecasting in the Presence of Level Shifts," Working Papers 11985, University of California, Davis, Department of Agricultural and Resource Economics.
  33. Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
  34. Barbara Rossi & Tatevik Sekhposyan, 2010. "Understanding Models' Forecasting Performance," Working Papers 10-56, Duke University, Department of Economics.
  35. David C. Wheelock & Mark E. Wohar, 2009. "Can the term spread predict output growth and recessions? a survey of the literature," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 419-440.
  36. Joscha Beckmann & Ansgar Belke & Michael Kühl, 2011. "The dollar-euro exchange rate and macroeconomic fundamentals: a time-varying coefficient approach," Review of World Economics (Weltwirtschaftliches Archiv), Springer, vol. 147(1), pages 11-40, April.
  37. Giacomini, Raffaella & White, Halbert, 2003. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series qt5jk0j5jh, Department of Economics, UC San Diego.
  38. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
  39. Elena Andreou & Eric Ghysels & Andros Kourtellos, 2007. "Regression Models with Mixed Sampling Frequencies," University of Cyprus Working Papers in Economics 8-2007, University of Cyprus Department of Economics.
  40. Eklund, Jana & Karlsson, Sune, 2005. "Forecast Combination and Model Averaging using Predictive Measures," Working Paper Series 191, Sveriges Riksbank (Central Bank of Sweden).
  41. Fabio Busetti & Juri Marcucci & Giovanni Veronese, 2009. "Comparing forecast accuracy: A Monte Carlo investigation," Temi di discussione (Economic working papers) 723, Bank of Italy, Economic Research and International Relations Area.
  42. Todd E. Clark & Kenneth D. West, 2005. "Approximately normal tests for equal predictive accuracy in nested models," Research Working Paper RWP 05-05, Federal Reserve Bank of Kansas City.
  43. Jes�s Gonzalo & Jean-Yves Pitarakis, 2011. "Regime-Specific Predictability in Predictive Regressions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(2), pages 229-241, June.
  44. D'Agostino, Antonello & Gambetti, Luca & Giannone, Domenico & Giannone, Domenico, 2009. "Macroeconomic Forecasting and Structural Change," Research Technical Papers 8/RT/09, Central Bank of Ireland.
  45. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen Rombouts, 2011. "A Comparison of Forecasting Procedures For Macroeconomic Series: The Contribution of Structural Break Models," CIRANO Working Papers 2011s-13, CIRANO.
  46. Rime, Dagfinn & Sarno, Lucio & Sojli, Elvira, 2010. "Exchange rate forecasting, order flow and macroeconomic information," Journal of International Economics, Elsevier, vol. 80(1), pages 72-88, January.
  47. Rossi, Barbara, 2006. "Are Exchange Rates Really Random Walks? Some Evidence Robust To Parameter Instability," Macroeconomic Dynamics, Cambridge University Press, vol. 10(01), pages 20-38, February.
  48. Inoue, Atsushi & Kilian, Lutz, 2003. "On the selection of forecasting models," Working Paper Series 0214, European Central Bank.
  49. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September.
  50. Altavilla, Carlo & Ciccarelli, Matteo, 2007. "Information combination and forecast (st)ability evidence from vintages of time-series data," Working Paper Series 0846, European Central Bank.
  51. Jan J. J. Groen & Richard Paap & Francesco Ravazzolo, 2013. "Real-Time Inflation Forecasting in a Changing World," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 29-44, January.
  52. Pesaran, M.H. & Timmermann, A., 2003. "Small Sample Properties of Forecasts from Autoregressive Models under Structural Breaks," Cambridge Working Papers in Economics 0331, Faculty of Economics, University of Cambridge.
  53. repec:nsr:niesrd:303 is not listed on IDEAS
  54. Adriana Z. Fernandez & Evan F. Koenig & Alex Nikolsko-Rzhevskyy, 2008. "The relative performance of alternative Taylor rule specifications," Staff Papers, Federal Reserve Bank of Dallas, issue Jun.
  55. Raffaella Giacomini & Barbara Rossi, 2012. "Model comparisons in unstable environments," CeMMAP working papers CWP13/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  56. M. Hashem Pesaran & Andreas Pick, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(2), pages 307-318, April.
  57. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
  58. Elliott, Graham & Timmermann, Allan, 2002. "Optimal Forecast Combination Under General Loss Functions and Forecast Error Distributions," University of California at San Diego, Economics Working Paper Series qt15r9t2q2, Department of Economics, UC San Diego.
  59. David E. Rapach & Mark E. Wohar, 2006. "Structural Breaks and Predictive Regression Models of Aggregate U.S. Stock Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(2), pages 238-274.
  60. Rossi, Barbara, 2005. "Optimal Tests For Nested Model Selection With Underlying Parameter Instability," Econometric Theory, Cambridge University Press, vol. 21(05), pages 962-990, October.
  61. Wright, Jonathan H., 2008. "Bayesian Model Averaging and exchange rate forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 329-341, October.
  62. Andrew Ang & Geert Bekaert, 2001. "Stock Return Predictability: Is it There?," NBER Working Papers 8207, National Bureau of Economic Research, Inc.
  63. John M. Maheu & Stephen Gordon, 2008. "Learning, forecasting and structural breaks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 553-583.
  64. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, 08.
  65. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
  66. Schrimpf, Andreas & Wang, Qingwei, 2010. "A reappraisal of the leading indicator properties of the yield curve under structural instability," International Journal of Forecasting, Elsevier, vol. 26(4), pages 836-857, October.
  67. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
  68. Rossi, Barbara & Giacomini, Raffaella, 2006. "Detecting and Predicting Forecast Breakdowns," Working Papers 06-01, Duke University, Department of Economics.
  69. Garry J. Schinasi & P.A.V.B. Swamy, 1987. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," International Finance Discussion Papers 301, Board of Governors of the Federal Reserve System (U.S.).
  70. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
  71. González, Andrés & Hubrich, Kirstin & Teräsvirta, Timo, 2011. "Forecasting inflation with gradual regime shifts and exogenous information," Working Paper Series 1363, European Central Bank.
  72. Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
  73. Todd E. Clark & Michael W. McCracken, 2007. "Forecasting with small macroeconomic VARs in the presence of instabilities," Finance and Economics Discussion Series 2007-41, Board of Governors of the Federal Reserve System (U.S.).
  74. D'Agostino, Antonello & Giannone, Domenico & Surico, Paolo, 2007. "(Un)Predictability and Macroeconomic Stability," CEPR Discussion Papers 6594, C.E.P.R. Discussion Papers.
  75. Lucio Sarno & Giorgio Valente, 2009. "Exchange Rates and Fundamentals: Footloose or Evolving Relationship?," Journal of the European Economic Association, MIT Press, vol. 7(4), pages 786-830, 06.
  76. repec:lmu:muenar:19719 is not listed on IDEAS
  77. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
  78. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
  79. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
  80. PALM, Franz C. & ZELLNER, Arnold, . "To Combine or not to Combine? Issues of Combining Forecasts," CORE Discussion Papers RP -1027, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  81. Rapach, David E & Wohar, Mark E, 2005. "Regime Changes in International Real Interest Rates: Are They a Monetary Phenomenon?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(5), pages 887-906, October.
  82. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," Review of Financial Studies, Society for Financial Studies, vol. 12(2), pages 405-28.
  83. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
  84. Calhoun, Gray, 2014. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers 32462, Iowa State University, Department of Economics.
  85. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
  86. Elliott, Graham & Muller, Ulrich K., 2007. "Confidence sets for the date of a single break in linear time series regressions," Journal of Econometrics, Elsevier, vol. 141(2), pages 1196-1218, December.
  87. Barbara Rossi & Tatevik Sekhposyan, 2011. "Forecast Optimality Tests in the Presence of Instabilities," Working Papers 11-18, Duke University, Department of Economics.
  88. Manzan, Sebastiano & Zerom, Dawit, 2009. "Are Macroeconomic Variables Useful for Forecasting the Distribution of U.S. Inflation?," MPRA Paper 14387, University Library of Munich, Germany.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:duk:dukeec:11-20. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Department of Economics Webmaster)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.