IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Advances in Forecasting Under Instability

  • Barbara Rossi

The forecasting literature has identi fied two important, broad issues. The fi rst stylized fact is that the predictive content is unstable over time; the second is that in-sample predictive content does not necessarily translate into out-of-sample predictive ability, nor ensures the stability of the predictive relation over time. The objective of this chapter is to understand what we have learned about forecasting in the presence of instabilities, especially regarding the two questions above. The empirical evidence raises a multitude of questions. If in-sample tests provide poor guidance to out-of-sample forecasting ability, what should researchers do? If there are statistically significant instabilities in the Granger-causality relationships, how do researchers establish whether there is any Granger-causality at all? And if there is substantial instability in predictive relationships, how do researchers establish which models is the "best" forecasting model? And finally, if a model forecasts poorly, why is that, and how should researchers proceed to improve the forecasting models? In this chapter, we will answer these questions by discussing various methodologies for inference as well as estimation that have been recently proposed in the literature. We also provide an empirical analysis of the usefulness of the existing methodologies using an extensive database of macroeconomic predictors of output growth and inflation.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1934348
File Function: main text
Download Restriction: no

Paper provided by Duke University, Department of Economics in its series Working Papers with number 11-20.

as
in new window

Length: 138
Date of creation: 2011
Date of revision:
Handle: RePEc:duk:dukeec:11-20
Contact details of provider: Postal: Department of Economics Duke University 213 Social Sciences Building Box 90097 Durham, NC 27708-0097
Phone: (919) 660-1800
Fax: (919) 684-8974
Web page: http://econ.duke.edu/

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Gonzalo, Jesus & Pitarakis, Jean-Yves, 2010. "Regime specific predictability in predictive regressions," Discussion Paper Series In Economics And Econometrics 0916, Economics Division, School of Social Sciences, University of Southampton.
  2. Busetti, Fabio & Marcucci, Juri, 2013. "Comparing forecast accuracy: A Monte Carlo investigation," International Journal of Forecasting, Elsevier, vol. 29(1), pages 13-27.
  3. Palm, F. & Zellner, A., 1991. "To combine or not to combine? issues of combining forecasts," CORE Discussion Papers 1991022, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  4. Elena Andreou & Eric Ghysels & Andros Kourtellos, 2007. "Regression Models with Mixed Sampling Frequencies," University of Cyprus Working Papers in Economics 8-2007, University of Cyprus Department of Economics.
  5. Amit Goyal & Ivo Welch, 2002. "Predicting the Equity Premium With Dividend Ratios," NBER Working Papers 8788, National Bureau of Economic Research, Inc.
  6. Inoue, Atsushi & Kilian, Lutz, 2003. "On the selection of forecasting models," Working Paper Series 0214, European Central Bank.
  7. West, K.D. & McCracken, M.W., 1997. "Regression-Based Tests of Predictive Ability," Working papers 9710, Wisconsin Madison - Social Systems.
  8. Anne Sofie Jore & James Mitchell & Shaun Vahey, 2008. "Combining Forecast Densities from VARs with Uncertain Instabilities," Reserve Bank of New Zealand Discussion Paper Series DP2008/18, Reserve Bank of New Zealand.
  9. Akhter Faroque & William Veloce & Jean-Francois Lamarche, 2012. "Have structural changes eliminated the out-of-sample ability of financial variables to forecast real activity after the mid-1980s? Evidence from the Canadian economy," Applied Economics, Taylor & Francis Journals, vol. 44(30), pages 3965-3985, October.
  10. Hamilton, James D., 1988. "Rational-expectations econometric analysis of changes in regime : An investigation of the term structure of interest rates," Journal of Economic Dynamics and Control, Elsevier, vol. 12(2-3), pages 385-423.
  11. Garry J. Schinasi & P.A.V.B. Swamy, 1987. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," Special Studies Papers 212, Board of Governors of the Federal Reserve System (U.S.).
  12. Giacomini, Raffaella & Rossi, Barbara, 2008. "Forecast Comparisons in Unstable Environments," Working Papers 08-04, Duke University, Department of Economics.
  13. Elliott, Graham & Timmermann, Allan, 2002. "Optimal Forecast Combination Under General Loss Functions and Forecast Error Distributions," University of California at San Diego, Economics Working Paper Series qt15r9t2q2, Department of Economics, UC San Diego.
  14. Aaron Smith, 2005. "Forecasting in the presence of level shifts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(8), pages 557-574.
  15. Margaret McConnell & Gabriel Perez Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
  16. Marquering, Wessel & Verbeek, Marno, 2004. "The Economic Value of Predicting Stock Index Returns and Volatility," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 39(02), pages 407-429, June.
  17. Jan J. J. Groen & Richard Paap & Francesco Ravazzolo, 2009. "Real-Time Inflation Forecasting in a Changing World," Working Paper 2009/16, Norges Bank.
  18. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September.
  19. Rime, Dagfinn & Sarno, Lucio & Sojli, Elvira, 2010. "Exchange rate forecasting, order flow and macroeconomic information," Journal of International Economics, Elsevier, vol. 80(1), pages 72-88, January.
  20. Eklund, Jana & Karlsson, Sune, 2005. "Forecast Combination and Model Averaging using Predictive Measures," Working Paper Series 191, Sveriges Riksbank (Central Bank of Sweden).
  21. Rossi, Barbara & Giacomini, Raffaella, 2006. "Detecting and Predicting Forecast Breakdowns," Working Papers 06-01, Duke University, Department of Economics.
  22. Andrés González & Kirstin Hubrich & Timo Teräsvirta, 2009. "Forecasting inflation with gradual regime shifts and exogenous information," CREATES Research Papers 2009-03, School of Economics and Management, University of Aarhus.
  23. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 183-217.
  24. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
  25. Todd E. Clark & Michael W. McCracken, 2007. "Forecasting with small macroeconomic VARs in the presence of instabilities," Finance and Economics Discussion Series 2007-41, Board of Governors of the Federal Reserve System (U.S.).
  26. Gambetti, Luca & D’Agostino, Antonello & Giannone, Domenico, 2010. "Macroeconomic forecasting and structural change," Working Paper Series 1167, European Central Bank.
  27. Perron, P. & Bai, J., 1995. "Estimating and Testing Linear Models with Multiple Structural Changes," Cahiers de recherche 9552, Universite de Montreal, Departement de sciences economiques.
  28. Yu-chin Chen & Kenneth Rogoff & Barbara Rossi, 2008. "Can Exchange Rates Forecast Commodity Prices?," Working Papers UWEC-2008-11-FC, University of Washington, Department of Economics, revised Oct 2009.
  29. Raffaella Giacomini & Halbert White, 2003. "Tests of Conditional Predictive Ability," Econometrics 0308001, EconWPA.
  30. Todd E. Clark & Michael W. McCracken, 2007. "Averaging forecasts from VARs with uncertain instabilities," Finance and Economics Discussion Series 2007-42, Board of Governors of the Federal Reserve System (U.S.).
  31. Rossi, Barbara, 2005. "Optimal Tests For Nested Model Selection With Underlying Parameter Instability," Econometric Theory, Cambridge University Press, vol. 21(05), pages 962-990, October.
  32. Barbara Rossi, 2005. "Are Exchange Rates Really Random Walks? Some Evidence Robust to Parameter Instability," Data 0503001, EconWPA.
  33. Raffaella Giacomini & Barbara Rossi, 2009. "Model Comparisons in Unstable Environments," Working Papers 09-10, Duke University, Department of Economics.
  34. D'Agostino, Antonello & Domenico, Giannone & Surico, Paolo, 2006. "(Un)Predictability and Macroeconomic Stability," Research Technical Papers 5/RT/06, Central Bank of Ireland.
  35. Swanson, Norman R., 1998. "Money and output viewed through a rolling window," Journal of Monetary Economics, Elsevier, vol. 41(3), pages 455-474, May.
  36. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen Rombouts, 2011. "A Comparison of Forecasting Procedures For Macroeconomic Series: The Contribution of Structural Break Models," CIRANO Working Papers 2011s-13, CIRANO.
  37. Barbara Rossi & Atsushi Inoue, 2011. "Out-of-Sample Forecast Tests Robust to Window Size Choice," Working Papers 11-04, Duke University, Department of Economics.
  38. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
  39. Kai Carstensen & Klaus Wohlrabe & Christina Ziegler, 2011. "Predictive Ability of Business Cycle Indicators under Test - A Case Study for the Euro Area Industrial Production," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), Justus-Liebig University Giessen, Department of Statistics and Economics, vol. 231(1), pages 82-106, February.
  40. Elliott, Graham & Muller, Ulrich K., 2007. "Confidence sets for the date of a single break in linear time series regressions," Journal of Econometrics, Elsevier, vol. 141(2), pages 1196-1218, December.
  41. Pesaran, M. Hashem & Pick, Andreas, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 307-318.
  42. Geert Bekaert & Robert J. Hodrick, 1991. "Characterizing Predictable Components in Excess Returns on Equity and Foreign Exchange Markets," NBER Working Papers 3790, National Bureau of Economic Research, Inc.
  43. Gabriel Perez-Quiros & Allan Timmermann, 2000. "Firm Size and Cyclical Variations in Stock Returns," Journal of Finance, American Finance Association, vol. 55(3), pages 1229-1262, 06.
  44. Rapach, David E & Wohar, Mark E, 2005. "Regime Changes in International Real Interest Rates: Are They a Monetary Phenomenon?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(5), pages 887-906, October.
  45. Gary Koop & Dimitris Korobilis, 2009. "Forecasting Inflation Using Dynamic Model Averaging," Working Paper Series 34_09, The Rimini Centre for Economic Analysis, revised Jan 2009.
  46. John M. Maheu & Stephen Gordon, 2004. "Learning, Forecasting and Structural Breaks," Cahiers de recherche 0422, CIRPEE.
  47. Rossi, Barbara & Giacomini, Raffaella, 2005. "How Stable is the Forecasting Performance of the Yield Curve for Outpot Growth?," Working Papers 05-08, Duke University, Department of Economics.
  48. Manzan, Sebastiano & Zerom, Dawit, 2009. "Are Macroeconomic Variables Useful for Forecasting the Distribution of U.S. Inflation?," MPRA Paper 14387, University Library of Munich, Germany.
  49. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
  50. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
  51. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
  52. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
  53. D'Agostino, Antonello & Surico, Paolo, 2011. "A Century of Inflation Forecasts," CEPR Discussion Papers 8292, C.E.P.R. Discussion Papers.
  54. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
  55. Philippe Bacchetta & Eric van Wincoop & Toni Beutler, 2010. "Can Parameter Instability Explain the Meese-Rogoff Puzzle?," NBER Chapters, in: NBER International Seminar on Macroeconomics 2009, pages 125-173 National Bureau of Economic Research, Inc.
  56. Inoue, Atsushi & Kilian, Lutz, 2002. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," CEPR Discussion Papers 3671, C.E.P.R. Discussion Papers.
  57. Barbara Rossi & Tatevik Sekhposyan, 2010. "Understanding Models' Forecasting Performance," Working Papers 10-56, Duke University, Department of Economics.
  58. Castelnuovo, Efrem & Greco, Luciano & Raggi, Davide, 2008. "Estimating regime-switching Taylor rules with trend inflation," Research Discussion Papers 20/2008, Bank of Finland.
  59. Kozicki, Sharon & Tinsley, P. A., 2001. "Shifting endpoints in the term structure of interest rates," Journal of Monetary Economics, Elsevier, vol. 47(3), pages 613-652, June.
  60. repec:lmu:muenar:19719 is not listed on IDEAS
  61. Lucio Sarno & Giorgio Valente, 2009. "Exchange Rates and Fundamentals: Footloose or Evolving Relationship?," Journal of the European Economic Association, MIT Press, vol. 7(4), pages 786-830, 06.
  62. Andrew Ang & Geert Bekaert, 2001. "Stock Return Predictability: Is it There?," NBER Working Papers 8207, National Bureau of Economic Research, Inc.
  63. Schrimpf, Andreas & Wang, Qingwei, 2010. "A reappraisal of the leading indicator properties of the yield curve under structural instability," International Journal of Forecasting, Elsevier, vol. 26(4), pages 836-857, October.
  64. Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
  65. Donald W.K. Andrews, 1990. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Cowles Foundation Discussion Papers 943, Cowles Foundation for Research in Economics, Yale University.
  66. Donald W.K. Andrews, 1988. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Cowles Foundation Discussion Papers 877R, Cowles Foundation for Research in Economics, Yale University, revised Jul 1989.
  67. Min, C.K. & Zellner, A., 1992. ""Bayesian and Non-Bayesian Methods for Combining Models and Forecasts with Applications to Forecasting International Growth Rates"," Papers 90-92-23, California Irvine - School of Social Sciences.
  68. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," Review of Financial Studies, Society for Financial Studies, vol. 12(2), pages 405-28.
  69. Jon Faust & Jonathan H. Wright, 2007. "Comparing Greenbook and Reduced Form Forecasts using a Large Realtime Dataset," NBER Working Papers 13397, National Bureau of Economic Research, Inc.
  70. Timmermann, Allan, 2008. "Elusive return predictability," International Journal of Forecasting, Elsevier, vol. 24(1), pages 1-18.
  71. Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
  72. Francis X. Diebold & Jose A. Lopez, 1996. "Forecast Evaluation and Combination," NBER Technical Working Papers 0192, National Bureau of Economic Research, Inc.
  73. repec:nsr:niesrd:303 is not listed on IDEAS
  74. Jonathan H. Wright, 2003. "Bayesian Model Averaging and exchange rate forecasts," International Finance Discussion Papers 779, Board of Governors of the Federal Reserve System (U.S.).
  75. Jean Boivin & Marc P. Giannoni, 2006. "Has Monetary Policy Become More Effective?," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 445-462, August.
  76. Allan Timmermann & Andrew Patton, 2004. "Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity," Working Papers wp04-05, Warwick Business School, Finance Group.
  77. Atsushi Inoue & Barbara Rossi, 2011. "Identifying the Sources of Instabilities in Macroeconomic Fluctuations," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1186-1204, November.
  78. David C. Wheelock & Mark E. Wohar, 2009. "Can the term spread predict output growth and recessions? a survey of the literature," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 419-440.
  79. Joscha Beckmann & Ansgar Belke & Michael Kühl, 2011. "The dollar-euro exchange rate and macroeconomic fundamentals: a time-varying coefficient approach," Review of World Economics (Weltwirtschaftliches Archiv), Springer, vol. 147(1), pages 11-40, April.
  80. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
  81. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
  82. Barbara Rossi & Tatevik Sekhposyan, 2011. "Forecast Optimality Tests in the Presence of Instabilities," Working Papers 11-18, Duke University, Department of Economics.
  83. Pesaran, M.H. & Pettenuzzo, D. & Timmermann, A., 2004. "‘Forecasting Time Series Subject to Multiple Structural Breaks’," Cambridge Working Papers in Economics 0433, Faculty of Economics, University of Cambridge.
  84. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
  85. David E. Rapach & Mark E. Wohar, 2006. "Structural Breaks and Predictive Regression Models of Aggregate U.S. Stock Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(2), pages 238-274.
  86. Adriana Z. Fernandez & Evan F. Koenig & Alex Nikolsko-Rzhevskyy, 2008. "The relative performance of alternative Taylor rule specifications," Staff Papers, Federal Reserve Bank of Dallas, issue Jun.
  87. Calhoun, Gray, 2014. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers 32462, Iowa State University, Department of Economics.
  88. Altavilla, Carlo & Ciccarelli, Matteo, 2007. "Information combination and forecast (st)ability evidence from vintages of time-series data," Working Paper Series 0846, European Central Bank.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:duk:dukeec:11-20. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Department of Economics Webmaster)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.