IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Advances in Forecasting Under Instability

  • Barbara Rossi

The forecasting literature has identi fied two important, broad issues. The fi rst stylized fact is that the predictive content is unstable over time; the second is that in-sample predictive content does not necessarily translate into out-of-sample predictive ability, nor ensures the stability of the predictive relation over time. The objective of this chapter is to understand what we have learned about forecasting in the presence of instabilities, especially regarding the two questions above. The empirical evidence raises a multitude of questions. If in-sample tests provide poor guidance to out-of-sample forecasting ability, what should researchers do? If there are statistically significant instabilities in the Granger-causality relationships, how do researchers establish whether there is any Granger-causality at all? And if there is substantial instability in predictive relationships, how do researchers establish which models is the "best" forecasting model? And finally, if a model forecasts poorly, why is that, and how should researchers proceed to improve the forecasting models? In this chapter, we will answer these questions by discussing various methodologies for inference as well as estimation that have been recently proposed in the literature. We also provide an empirical analysis of the usefulness of the existing methodologies using an extensive database of macroeconomic predictors of output growth and inflation.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1934348
File Function: main text
Download Restriction: no

Paper provided by Duke University, Department of Economics in its series Working Papers with number 11-20.

as
in new window

Length: 138
Date of creation: 2011
Date of revision:
Handle: RePEc:duk:dukeec:11-20
Contact details of provider: Postal: Department of Economics Duke University 213 Social Sciences Building Box 90097 Durham, NC 27708-0097
Phone: (919) 660-1800
Fax: (919) 684-8974
Web page: http://econ.duke.edu/

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Schrimpf, Andreas & Wang, Qingwei, 2010. "A reappraisal of the leading indicator properties of the yield curve under structural instability," International Journal of Forecasting, Elsevier, vol. 26(4), pages 836-857, October.
  2. Timmermann, Allan G, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, C.E.P.R. Discussion Papers.
  3. Kai Carstensen & Klaus Wohlrabe & Christina Ziegler, 2010. "Predictive Ability of Business Cycle Indicators under Test: A Case Study for the Euro Area Industrial Production," CESifo Working Paper Series 3158, CESifo Group Munich.
  4. Atsushi Inoue & Barbara Rossi, 2011. "Identifying the Sources of Instabilities in Macroeconomic Fluctuations," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1186-1204, November.
  5. D'Agostino, Antonello & Giannone, Domenico & Surico, Paolo, 2007. "(Un)Predictability and Macroeconomic Stability," CEPR Discussion Papers 6594, C.E.P.R. Discussion Papers.
  6. Altavilla, Carlo & Ciccarelli, Matteo, 2007. "Information combination and forecast (st)ability evidence from vintages of time-series data," Working Paper Series 0846, European Central Bank.
  7. Barbara Rossi & Tatevik Sekhposyan, 2011. "Forecast Optimality Tests in the Presence of Instabilities," Working Papers 11-18, Duke University, Department of Economics.
  8. Gabriel Perez-Quiros & Allan Timmermann, 2000. "Firm Size and Cyclical Variations in Stock Returns," Journal of Finance, American Finance Association, vol. 55(3), pages 1229-1262, 06.
  9. Francis X. Diebold & Jose A. Lopez, 1996. "Forecast Evaluation and Combination," NBER Technical Working Papers 0192, National Bureau of Economic Research, Inc.
  10. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
  11. Rossi, Barbara, 2005. "Optimal Tests For Nested Model Selection With Underlying Parameter Instability," Econometric Theory, Cambridge University Press, vol. 21(05), pages 962-990, October.
  12. Sharon Kozicki & P.A. Tinsley, 1997. "Shifting endpoints in the term structure of interest rates," Research Working Paper 97-08, Federal Reserve Bank of Kansas City.
  13. Gambetti, Luca & D’Agostino, Antonello & Giannone, Domenico, 2010. "Macroeconomic forecasting and structural change," Working Paper Series 1167, European Central Bank.
  14. Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
  15. Bekaert, Geert & Hodrick, Robert J, 1992. " Characterizing Predictable Components in Excess Returns on Equity and Foreign Exchange Markets," Journal of Finance, American Finance Association, vol. 47(2), pages 467-509, June.
  16. Pesaran, M Hashem & Pettenuzzo, Davide & Timmermann, Allan G, 2004. "Forecasting Time Series Subject to Multiple Structural Breaks," CEPR Discussion Papers 4636, C.E.P.R. Discussion Papers.
  17. Wright, Jonathan H., 2008. "Bayesian Model Averaging and exchange rate forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 329-341, October.
  18. Jean Boivin & Marc P. Giannoni, 2003. "Has Monetary Policy Become More Effective?," NBER Working Papers 9459, National Bureau of Economic Research, Inc.
  19. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-56, July.
  20. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, 08.
  21. Pesaran, M. Hashem & Pick, Andreas, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 307-318.
  22. West, K.D., 1994. "Asymptotic Inference About Predictive Ability," Working papers 9417, Wisconsin Madison - Social Systems.
  23. Marquering, W.A. & Verbeek, M.J.C.M., 2001. "The Economic Value of Predicting Stock Index Returns and Volatility," ERIM Report Series Research in Management ERS-2001-75-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
  24. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
  25. David C. Wheelock & Mark E. Wohar, 2009. "Can the term spread predict output growth and recessions? a survey of the literature," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 419-440.
  26. Manzan, Sebastiano & Zerom, Dawit, 2009. "Are Macroeconomic Variables Useful for Forecasting the Distribution of U.S. Inflation?," MPRA Paper 14387, University Library of Munich, Germany.
  27. John M Maheu & Stephen Gordon, 2007. "Learning, Forecasting and Structural Breaks," Working Papers tecipa-284, University of Toronto, Department of Economics.
  28. repec:lmu:muenar:19719 is not listed on IDEAS
  29. Kenneth D. West & Michael W. McCracken, 1998. "Regression-Based Tests of Predictive Ability," NBER Technical Working Papers 0226, National Bureau of Economic Research, Inc.
  30. Yu-Chin Chen & Kenneth Rogoff & Barbara Rossi, 2008. "Can Exchange Rates Forecast Commodity Prices?," NBER Working Papers 13901, National Bureau of Economic Research, Inc.
  31. Gonzalo, Jesus & Pitarakis, Jean-Yves, 2010. "Regime specific predictability in predictive regressions," Discussion Paper Series In Economics And Econometrics 0916, Economics Division, School of Social Sciences, University of Southampton.
  32. Calhoun, Gray, 2014. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers 32462, Iowa State University, Department of Economics.
  33. Anne Sofie Jore & James Mitchell & Shaun Vahey, 2008. "Combining Forecast Densities from VARs with Uncertain Instabilities," Reserve Bank of New Zealand Discussion Paper Series DP2008/18, Reserve Bank of New Zealand.
  34. David E. Rapach & Mark E. Wohar, 2006. "Structural Breaks and Predictive Regression Models of Aggregate U.S. Stock Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(2), pages 238-274.
  35. Todd E. Clark & Michael W. McCracken, 2007. "Forecasting with small macroeconomic VARs in the presence of instabilities," Finance and Economics Discussion Series 2007-41, Board of Governors of the Federal Reserve System (U.S.).
  36. Hamilton, James D., 1988. "Rational-expectations econometric analysis of changes in regime : An investigation of the term structure of interest rates," Journal of Economic Dynamics and Control, Elsevier, vol. 12(2-3), pages 385-423.
  37. PALM, Franz C. & ZELLNER, Arnold, . "To Combine or not to Combine? Issues of Combining Forecasts," CORE Discussion Papers RP -1027, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  38. Inoue, Atsushi & Kilian, Lutz, 2002. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," CEPR Discussion Papers 3671, C.E.P.R. Discussion Papers.
  39. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
  40. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
  41. Inoue, Atsushi & Kilian, Lutz, 2003. "On the Selection of Forecasting Models," CEPR Discussion Papers 3809, C.E.P.R. Discussion Papers.
  42. Giacomini, Raffaella & White, Halbert, 2003. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series qt5jk0j5jh, Department of Economics, UC San Diego.
  43. Allan Timmermann & M. Hashem Pesaran, 2003. "Small Sample Properties of Forecasts from Autoregressive Models under Structural Breaks," CESifo Working Paper Series 990, CESifo Group Munich.
  44. Fabio Busetti & Juri Marcucci & Giovanni Veronese, 2009. "Comparing forecast accuracy: A Monte Carlo investigation," Temi di discussione (Economic working papers) 723, Bank of Italy, Economic Research and International Relations Area.
  45. Barbara Rossi & Atsushi Inoue, 2011. "Out-of-Sample Forecast Tests Robust to Window Size Choice," Working Papers 11-04, Duke University, Department of Economics.
  46. Rossi, Barbara & Giacomini, Raffaella, 2005. "How Stable is the Forecasting Performance of the Yield Curve for Outpot Growth?," Working Papers 05-08, Duke University, Department of Economics.
  47. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
  48. Groen, J.J.J. & Paap, R., 2009. "Real-time inflation forecasting in a changing world," Econometric Institute Research Papers EI 2009-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  49. Rossi, Barbara & Sekhposyan, Tatevik, 2011. "Understanding models' forecasting performance," Journal of Econometrics, Elsevier, vol. 164(1), pages 158-172, September.
  50. Aaron Smith, 2005. "Forecasting in the presence of level shifts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(8), pages 557-574.
  51. Garry J. Schinasi & P.A.V.B. Swamy, 1987. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," International Finance Discussion Papers 301, Board of Governors of the Federal Reserve System (U.S.).
  52. Kenneth D. West & Todd Clark, 2006. "Approximately Normal Tests for Equal Predictive Accuracy in Nested Models," NBER Technical Working Papers 0326, National Bureau of Economic Research, Inc.
  53. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen Rombouts, 2011. "A comparison of Forecasting Procedures for Macroeconomic Series: The Contribution of Structural Break Models," Working Papers 1113, University of Strathclyde Business School, Department of Economics.
  54. Andreou, Elena & Ghysels, Eric & Kourtellos, Andros, 2010. "Regression models with mixed sampling frequencies," Journal of Econometrics, Elsevier, vol. 158(2), pages 246-261, October.
  55. Amit Goyal & Ivo Welch, 1999. "Predicting the Equity Premium with Dividend Ratios," Yale School of Management Working Papers amz2437, Yale School of Management, revised 01 Nov 2002.
  56. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
  57. Raffaella Giacomini & Barbara Rossi, 2009. "Model Comparisons in Unstable Environments," Working Papers 09-10, Duke University, Department of Economics.
  58. Rapach, David E & Wohar, Mark E, 2005. "Regime Changes in International Real Interest Rates: Are They a Monetary Phenomenon?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(5), pages 887-906, October.
  59. Philippe Bacchetta & Eric van Wincoop & Toni Beutler, 2009. "Can Parameter Instability Explain the Meese-Rogoff Puzzle?," Cahiers de Recherches Economiques du Département d'Econométrie et d'Economie politique (DEEP) 09.08, Université de Lausanne, Faculté des HEC, DEEP.
  60. Michael P. Clements & Philip Hans Franses & Norman R. Swanson, 2003. "Forecasting economic and financial time-series with non-linear models," Departmental Working Papers 200309, Rutgers University, Department of Economics.
  61. Elliott, Graham & Timmermann, Allan, 2002. "Optimal Forecast Combination Under General Loss Functions and Forecast Error Distributions," University of California at San Diego, Economics Working Paper Series qt15r9t2q2, Department of Economics, UC San Diego.
  62. Rime, Dagfinn & Sarno, Lucio & Sojli, Elvira, 2010. "Exchange rate forecasting, order flow and macroeconomic information," Journal of International Economics, Elsevier, vol. 80(1), pages 72-88, January.
  63. Elliott, Graham & Muller, Ulrich K., 2007. "Confidence sets for the date of a single break in linear time series regressions," Journal of Econometrics, Elsevier, vol. 141(2), pages 1196-1218, December.
  64. Rossi, Barbara, 2006. "Are Exchange Rates Really Random Walks? Some Evidence Robust To Parameter Instability," Macroeconomic Dynamics, Cambridge University Press, vol. 10(01), pages 20-38, February.
  65. Antonello D'Agostino & Paolo Surico, 2012. "A Century of Inflation Forecasts," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1097-1106, November.
  66. Swanson, Norman R., 1998. "Money and output viewed through a rolling window," Journal of Monetary Economics, Elsevier, vol. 41(3), pages 455-474, May.
  67. Raffella Giacomini & Barbara Rossi, 2005. "Detecting and Predicting Forecast Breakdowns," UCLA Economics Working Papers 845, UCLA Department of Economics.
  68. Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
  69. Eklund, Jana & Karlsson, Sune, 2005. "Forecast Combination and Model Averaging Using Predictive Measures," CEPR Discussion Papers 5268, C.E.P.R. Discussion Papers.
  70. Joscha Beckmann & Ansgar Belke & Michael Kühl, 2011. "The dollar-euro exchange rate and macroeconomic fundamentals: a time-varying coefficient approach," Review of World Economics (Weltwirtschaftliches Archiv), Springer, vol. 147(1), pages 11-40, April.
  71. Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
  72. Jon Faust & Jonathan H. Wright, 2007. "Comparing Greenbook and Reduced Form Forecasts using a Large Realtime Dataset," NBER Working Papers 13397, National Bureau of Economic Research, Inc.
  73. Timmermann, Allan, 2008. "Elusive return predictability," International Journal of Forecasting, Elsevier, vol. 24(1), pages 1-18.
  74. Andrew Ang & Geert Bekaert, 2001. "Stock Return Predictability: Is it There?," NBER Working Papers 8207, National Bureau of Economic Research, Inc.
  75. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-58, May.
  76. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29.
  77. Andrés González & Kirstin Hubrich & Timo Teräsvirta, 2009. "Forecasting inflation with gradual regime shifts and exogenous information," CREATES Research Papers 2009-03, School of Economics and Management, University of Aarhus.
  78. Akhter Faroque & William Veloce & Jean-Francois Lamarche, 2012. "Have structural changes eliminated the out-of-sample ability of financial variables to forecast real activity after the mid-1980s? Evidence from the Canadian economy," Applied Economics, Taylor & Francis Journals, vol. 44(30), pages 3965-3985, October.
  79. repec:nsr:niesrd:303 is not listed on IDEAS
  80. Sarno, Lucio & Valente, Giorgio, 2008. "Exchange Rates and Fundamentals: Footloose or Evolving Relationship?," CEPR Discussion Papers 6638, C.E.P.R. Discussion Papers.
  81. Castelnuovo, Efrem & Greco, Luciano & Raggi, Davide, 2008. "Estimating regime-switching Taylor rules with trend inflation," Research Discussion Papers 20/2008, Bank of Finland.
  82. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
  83. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
  84. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
  85. Adriana Z. Fernandez & Evan F. Koenig & Alex Nikolsko-Rzhevskyy, 2008. "The relative performance of alternative Taylor rule specifications," Staff Papers, Federal Reserve Bank of Dallas, issue Jun.
  86. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
  87. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," Review of Financial Studies, Society for Financial Studies, vol. 12(2), pages 405-28.
  88. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:duk:dukeec:11-20. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Department of Economics Webmaster)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.