IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Advances in Forecasting Under Instability

  • Barbara Rossi

The forecasting literature has identi fied two important, broad issues. The fi rst stylized fact is that the predictive content is unstable over time; the second is that in-sample predictive content does not necessarily translate into out-of-sample predictive ability, nor ensures the stability of the predictive relation over time. The objective of this chapter is to understand what we have learned about forecasting in the presence of instabilities, especially regarding the two questions above. The empirical evidence raises a multitude of questions. If in-sample tests provide poor guidance to out-of-sample forecasting ability, what should researchers do? If there are statistically significant instabilities in the Granger-causality relationships, how do researchers establish whether there is any Granger-causality at all? And if there is substantial instability in predictive relationships, how do researchers establish which models is the "best" forecasting model? And finally, if a model forecasts poorly, why is that, and how should researchers proceed to improve the forecasting models? In this chapter, we will answer these questions by discussing various methodologies for inference as well as estimation that have been recently proposed in the literature. We also provide an empirical analysis of the usefulness of the existing methodologies using an extensive database of macroeconomic predictors of output growth and inflation.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1934348
File Function: main text
Download Restriction: no

Paper provided by Duke University, Department of Economics in its series Working Papers with number 11-20.

as
in new window

Length: 138
Date of creation: 2011
Date of revision:
Handle: RePEc:duk:dukeec:11-20
Contact details of provider: Postal: Department of Economics Duke University 213 Social Sciences Building Box 90097 Durham, NC 27708-0097
Phone: (919) 660-1800
Fax: (919) 684-8974
Web page: http://econ.duke.edu/

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
  2. Schinasi, Garry J. & Swamy, P. A. V. B., 1989. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," Journal of International Money and Finance, Elsevier, vol. 8(3), pages 375-390, September.
  3. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
  4. Michael P. Clements & Philip Hans Franses & Norman R. Swanson, 2003. "Forecasting economic and financial time-series with non-linear models," Departmental Working Papers 200309, Rutgers University, Department of Economics.
  5. M. Hashem Pesaran & Davide Pettenuzzo & Allan Timmermann, 2004. "Forecasting Time Series Subject to Multiple Structural Breaks," CESifo Working Paper Series 1237, CESifo Group Munich.
  6. Giacomini, Raffaella & White, Halbert, 2003. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series qt5jk0j5jh, Department of Economics, UC San Diego.
  7. Raffella Giacomini & Barbara Rossi, 2005. "Detecting and Predicting Forecast Breakdowns," UCLA Economics Working Papers 845, UCLA Department of Economics.
  8. Anne Sofie Jore & James Mitchell & Shaun Vahey, 2008. "Combining Forecast Densities from VARs with Uncertain Instabilities," Reserve Bank of New Zealand Discussion Paper Series DP2008/18, Reserve Bank of New Zealand.
  9. Raffaella Giacomini & Barbara Rossi, 2014. "Model comparisons in unstable environments," Economics Working Papers 1437, Department of Economics and Business, Universitat Pompeu Fabra, revised Jan 2015.
  10. Pesaran, M Hashem & Timmermann, Allan G, 2004. "Small Sample Properties of Forecasts From Autoregressive Models Under Structural Breaks," CEPR Discussion Papers 4401, C.E.P.R. Discussion Papers.
  11. Inoue, Atsushi & Kilian, Lutz, 2006. "On the selection of forecasting models," Journal of Econometrics, Elsevier, vol. 130(2), pages 273-306, February.
  12. D'Agostino, Antonello & Surico, Paolo, 2011. "A Century of Inflation Forecasts," CEPR Discussion Papers 8292, C.E.P.R. Discussion Papers.
  13. Akhter Faroque & William Veloce & Jean-Francois Lamarche, 2012. "Have structural changes eliminated the out-of-sample ability of financial variables to forecast real activity after the mid-1980s? Evidence from the Canadian economy," Applied Economics, Taylor & Francis Journals, vol. 44(30), pages 3965-3985, October.
  14. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-58, May.
  15. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen Rombouts, 2011. "A comparison of Forecasting Procedures for Macroeconomic Series: The Contribution of Structural Break Models," Working Papers 1113, University of Strathclyde Business School, Department of Economics.
  16. Philippe Bacchetta & Eric van Wincoop & Toni Beutler, 2009. "Can Parameter Instability Explain the Meese-Rogoff Puzzle?," Cahiers de Recherches Economiques du Département d'Econométrie et d'Economie politique (DEEP) 09.08, Université de Lausanne, Faculté des HEC, DEEP.
  17. D'Agostino, Antonello & Gambetti, Luca & Giannone, Domenico, 2009. "Macroeconomic Forecasting and Structural Change," CEPR Discussion Papers 7542, C.E.P.R. Discussion Papers.
  18. Pesaran, M. Hashem & Pick, Andreas, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 307-318.
  19. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, 08.
  20. Timmermann, Allan G, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, C.E.P.R. Discussion Papers.
  21. Calhoun, Gray, 2014. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers 32462, Iowa State University, Department of Economics.
  22. Todd E. Clark & Michael W. McCracken, 2006. "Averaging forecasts from VARs with uncertain instabilities," Research Working Paper RWP 06-12, Federal Reserve Bank of Kansas City.
  23. Allan Timmermann & Gabriel Perez-Quiros, 1999. "Firm Size and Cyclical Variations in Stock Returns," FMG Discussion Papers dp335, Financial Markets Group.
  24. Adriana Z. Fernandez & Evan F. Koenig & Alex Nikolsko-Rzhevskyy, 2008. "The relative performance of alternative Taylor rule specifications," Staff Papers, Federal Reserve Bank of Dallas, issue Jun.
  25. Sarno, Lucio & Valente, Giorgio, 2008. "Exchange Rates and Fundamentals: Footloose or Evolving Relationship?," CEPR Discussion Papers 6638, C.E.P.R. Discussion Papers.
  26. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
  27. Rossi, Barbara, 2002. "Optimal Tests for Nested Model Selection with Underlying Parameter Instability," Working Papers 02-05, Duke University, Department of Economics.
  28. Todd E. Clark & Michael W. McCracken, 2000. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Econometric Society World Congress 2000 Contributed Papers 0319, Econometric Society.
  29. Hamilton, James D., 1988. "Rational-expectations econometric analysis of changes in regime : An investigation of the term structure of interest rates," Journal of Economic Dynamics and Control, Elsevier, vol. 12(2-3), pages 385-423.
  30. Marquering, W.A. & Verbeek, M.J.C.M., 2001. "The Economic Value of Predicting Stock Index Returns and Volatility," ERIM Report Series Research in Management ERS-2001-75-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
  31. Perron, P. & Bai, J., 1995. "Estimating and Testing Linear Models with Multiple Structural Changes," Cahiers de recherche 9552, Universite de Montreal, Departement de sciences economiques.
  32. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
  33. Rime, Dagfinn & Sarno, Lucio & Sojli, Elvira, 2009. "Exchange Rate Forecasting, Order Flow and Macroeconomic Information," CEPR Discussion Papers 7225, C.E.P.R. Discussion Papers.
  34. Rossi, Barbara, 2006. "Are Exchange Rates Really Random Walks? Some Evidence Robust To Parameter Instability," Macroeconomic Dynamics, Cambridge University Press, vol. 10(01), pages 20-38, February.
  35. Elliott, Graham & Timmermann, Allan, 2002. "Optimal Forecast Combination Under General Loss Functions and Forecast Error Distributions," University of California at San Diego, Economics Working Paper Series qt15r9t2q2, Department of Economics, UC San Diego.
  36. Kenneth D. West & Michael W. McCracken, 1998. "Regression-Based Tests of Predictive Ability," NBER Technical Working Papers 0226, National Bureau of Economic Research, Inc.
  37. Smith, Aaron D., 2004. "Forecasting in the Presence of Level Shifts," Working Papers 11985, University of California, Davis, Department of Agricultural and Resource Economics.
  38. Atsushi Inoue & Barbara Rossi, 2011. "Identifying the Sources of Instabilities in Macroeconomic Fluctuations," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1186-1204, November.
  39. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
  40. Kenneth Rogoff & Barbara Rossi & Yu-chin Chen, 2008. "Can Exchange Rates Forecast Commodity Prices?," 2008 Meeting Papers 540, Society for Economic Dynamics.
  41. Jan J. J. Groen & Richard Paap & Francesco Ravazzolo, 2013. "Real-Time Inflation Forecasting in a Changing World," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 29-44, January.
  42. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
  43. Gonzalo, Jesus & Pitarakis, Jean-Yves, 2010. "Regime Specific Predictability in Predictive Regressions," MPRA Paper 29190, University Library of Munich, Germany.
  44. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
  45. Eklund, Jana & Karlsson, Sune, 2005. "Forecast Combination and Model Averaging Using Predictive Measures," CEPR Discussion Papers 5268, C.E.P.R. Discussion Papers.
  46. Kenneth D. West, 1994. "Asymptotic Inference About Predictive Ability," Macroeconomics 9410002, EconWPA.
  47. Elena Andreou & Eric Ghysels & Andros Kourtellos, 2007. "Regression Models with Mixed Sampling Frequencies," University of Cyprus Working Papers in Economics 8-2007, University of Cyprus Department of Economics.
  48. John M. Maheu & Stephen Gordon, 2008. "Learning, forecasting and structural breaks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 553-583.
  49. Carstensen, Kai & Wohlrabe, Klaus & Ziegler, Christina, 2010. "Predictive Ability of Business Cycle Indicators under Test: A Case Study for the Euro Area Industrial Production," Discussion Papers in Economics 11442, University of Munich, Department of Economics.
  50. D'Agostino, Antonello & Giannone, Domenico & Surico, Paolo, 2007. "(Un)Predictability and Macroeconomic Stability," CEPR Discussion Papers 6594, C.E.P.R. Discussion Papers.
  51. Altavilla, Carlo & Ciccarelli, Matteo, 2007. "Information combination and forecast (st)ability evidence from vintages of time-series data," Working Paper Series 0846, European Central Bank.
  52. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
  53. Andrés González & Kirstin Hubrich & Timo Teräsvirta, 2009. "Forecasting inflation with gradual regime shifts and exogenous information," CREATES Research Papers 2009-03, School of Economics and Management, University of Aarhus.
  54. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
  55. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
  56. Jonathan H. Wright, 2003. "Bayesian Model Averaging and exchange rate forecasts," International Finance Discussion Papers 779, Board of Governors of the Federal Reserve System (U.S.).
  57. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," Review of Financial Studies, Society for Financial Studies, vol. 12(2), pages 405-28.
  58. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
  59. Swanson, Norman R., 1998. "Money and output viewed through a rolling window," Journal of Monetary Economics, Elsevier, vol. 41(3), pages 455-474, May.
  60. Elliott, Graham & Muller, Ulrich K., 2007. "Confidence sets for the date of a single break in linear time series regressions," Journal of Econometrics, Elsevier, vol. 141(2), pages 1196-1218, December.
  61. Schrimpf, Andreas & Wang, Qingwei, 2010. "A reappraisal of the leading indicator properties of the yield curve under structural instability," International Journal of Forecasting, Elsevier, vol. 26(4), pages 836-857, October.
  62. Atsushi Inoue & Lutz Kilian, 2005. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 371-402.
  63. Fabio Busetti & Juri Marcucci & Giovanni Veronese, 2009. "Comparing forecast accuracy: A Monte Carlo investigation," Temi di discussione (Economic working papers) 723, Bank of Italy, Economic Research and International Relations Area.
  64. Boivin, Jean & Giannoni, Marc, 2006. "Has Monetary Policy Become More Effective?," CEPR Discussion Papers 5463, C.E.P.R. Discussion Papers.
  65. Giacomini, Raffaella & Rossi, Barbara, 2008. "Forecast Comparisons in Unstable Environments," Working Papers 08-04, Duke University, Department of Economics.
  66. Joscha Beckmann & Ansgar Belke & Michael Kühl, 2011. "The dollar-euro exchange rate and macroeconomic fundamentals: a time-varying coefficient approach," Review of World Economics (Weltwirtschaftliches Archiv), Springer, vol. 147(1), pages 11-40, April.
  67. Bekaert, Geert & Hodrick, Robert J, 1992. " Characterizing Predictable Components in Excess Returns on Equity and Foreign Exchange Markets," Journal of Finance, American Finance Association, vol. 47(2), pages 467-509, June.
  68. Rossi, Barbara & Sekhposyan, Tatevik, 2011. "Understanding models' forecasting performance," Journal of Econometrics, Elsevier, vol. 164(1), pages 158-172, September.
  69. repec:nsr:niesrd:303 is not listed on IDEAS
  70. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
  71. Rapach, David E & Wohar, Mark E, 2005. "Regime Changes in International Real Interest Rates: Are They a Monetary Phenomenon?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(5), pages 887-906, October.
  72. David C. Wheelock & Mark E. Wohar, 2009. "Can the term spread predict output growth and recessions? a survey of the literature," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 419-440.
  73. Barbara Rossi & Tatevik Sekhposyan, 2011. "Forecast Optimality Tests in the Presence of Instabilities," Working Papers 11-18, Duke University, Department of Economics.
  74. David E. Rapach & Mark E. Wohar, 2006. "Structural Breaks and Predictive Regression Models of Aggregate U.S. Stock Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(2), pages 238-274.
  75. Donald W.K. Andrews, 1990. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Cowles Foundation Discussion Papers 943, Cowles Foundation for Research in Economics, Yale University.
  76. Sharon Kozicki & P.A. Tinsley, 1997. "Shifting endpoints in the term structure of interest rates," Research Working Paper 97-08, Federal Reserve Bank of Kansas City.
  77. Timmermann, Allan, 2008. "Elusive return predictability," International Journal of Forecasting, Elsevier, vol. 24(1), pages 1-18.
  78. Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
  79. Andrew Ang & Geert Bekaert, 2001. "Stock Return Predictability: Is it There?," NBER Working Papers 8207, National Bureau of Economic Research, Inc.
  80. Barbara Rossi & Atsushi Inoue, 2011. "Out-of-Sample Forecast Tests Robust to Window Size Choice," Working Papers 11-04, Duke University, Department of Economics.
  81. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
  82. Castelnuovo, Efrem & Greco, Luciano & Raggi, Davide, 2008. "Estimating regime-switching Taylor rules with trend inflation," Research Discussion Papers 20/2008, Bank of Finland.
  83. Raffaella Giacomini & Barbara Rossi, 2006. "How Stable is the Forecasting Performance of the Yield Curve for Output Growth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 68(s1), pages 783-795, December.
  84. repec:lmu:muenar:19719 is not listed on IDEAS
  85. Palm, F. & Zellner, A., 1991. "To combine or not to combine? issues of combining forecasts," CORE Discussion Papers 1991022, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  86. Manzan, Sebastiano & Zerom, Dawit, 2009. "Are Macroeconomic Variables Useful for Forecasting the Distribution of U.S. Inflation?," MPRA Paper 14387, University Library of Munich, Germany.
  87. Todd E. Clark & Michael W. McCracken, 2007. "Forecasting with small macroeconomic VARs in the presence of instabilities," Finance and Economics Discussion Series 2007-41, Board of Governors of the Federal Reserve System (U.S.).
  88. Jon Faust & Jonathan H. Wright, 2007. "Comparing Greenbook and Reduced Form Forecasts using a Large Realtime Dataset," NBER Working Papers 13397, National Bureau of Economic Research, Inc.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:duk:dukeec:11-20. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Department of Economics Webmaster)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.