Advanced Search
MyIDEAS: Login

Advances in Forecasting Under Instability

Contents:

Author Info

  • Barbara Rossi

Abstract

The forecasting literature has identi fied two important, broad issues. The fi rst stylized fact is that the predictive content is unstable over time; the second is that in-sample predictive content does not necessarily translate into out-of-sample predictive ability, nor ensures the stability of the predictive relation over time. The objective of this chapter is to understand what we have learned about forecasting in the presence of instabilities, especially regarding the two questions above. The empirical evidence raises a multitude of questions. If in-sample tests provide poor guidance to out-of-sample forecasting ability, what should researchers do? If there are statistically significant instabilities in the Granger-causality relationships, how do researchers establish whether there is any Granger-causality at all? And if there is substantial instability in predictive relationships, how do researchers establish which models is the "best" forecasting model? And finally, if a model forecasts poorly, why is that, and how should researchers proceed to improve the forecasting models? In this chapter, we will answer these questions by discussing various methodologies for inference as well as estimation that have been recently proposed in the literature. We also provide an empirical analysis of the usefulness of the existing methodologies using an extensive database of macroeconomic predictors of output growth and inflation.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1934348
Our checks indicate that this address may not be valid because: 503 Service Unavailable. If this is indeed the case, please notify (Department of Economics Webmaster)
File Function: main text
Download Restriction: no

Bibliographic Info

Paper provided by Duke University, Department of Economics in its series Working Papers with number 11-20.

as in new window
Length: 138
Date of creation: 2011
Date of revision:
Handle: RePEc:duk:dukeec:11-20

Contact details of provider:
Postal: Department of Economics Duke University 213 Social Sciences Building Box 90097 Durham, NC 27708-0097
Phone: (919) 660-1800
Fax: (919) 684-8974
Web page: http://econ.duke.edu/

Related research

Keywords:

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
  2. Timmermann, Allan, 2008. "Elusive return predictability," International Journal of Forecasting, Elsevier, vol. 24(1), pages 1-18.
  3. Marquering, W.A. & Verbeek, M.J.C.M., 2001. "The Economic Value of Predicting Stock Index Returns and Volatility," ERIM Report Series Research in Management ERS-2001-75-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus Uni.
  4. Giacomini, Raffaella & Rossi, Barbara, 2008. "Forecast Comparisons in Unstable Environments," Working Papers 08-04, Duke University, Department of Economics.
  5. Jean Boivin & Marc P. Giannoni, 2006. "Has Monetary Policy Become More Effective?," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 445-462, August.
  6. Chen, Yu-chin & Rogoff, Kenneth & Rossi, Barbara, 2008. "Can Exchange Rates Forecast Commodity Prices?," Working Papers 08-03, Duke University, Department of Economics.
  7. Inoue, Atsushi & Kilian, Lutz, 2003. "On the selection of forecasting models," Working Paper Series 0214, European Central Bank.
  8. Gary Koop & Dimitris Korobilis, 2009. "Forecasting Inflation Using Dynamic Model Averaging," Working Paper Series 34_09, The Rimini Centre for Economic Analysis, revised Jan 2009.
  9. Rime, Dagfinn & Sarno, Lucio & Sojli, Elvira, 2010. "Exchange rate forecasting, order flow and macroeconomic information," Journal of International Economics, Elsevier, vol. 80(1), pages 72-88, January.
  10. Raffaella Giacomini & Halbert White, 2003. "Tests of conditional predictive ability," Boston College Working Papers in Economics 572, Boston College Department of Economics.
  11. repec:nsr:niesrd:303 is not listed on IDEAS
  12. Antonello D'Agostino & Paolo Surico, 2012. "A Century of Inflation Forecasts," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1097-1106, November.
  13. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen V.K. Rombouts, 2011. "A Comparison of Forecasting Procedures for Macroeconomic Series: the Contribution of Structural Break Models," Cahiers de recherche 1104, CIRPEE.
  14. Raffella Giacomini & Barbara Rossi, 2005. "Detecting and Predicting Forecast Breakdowns," UCLA Economics Working Papers 845, UCLA Department of Economics.
  15. Gambetti, Luca & D’Agostino, Antonello & Giannone, Domenico, 2010. "Macroeconomic forecasting and structural change," Working Paper Series 1167, European Central Bank.
  16. Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," CREATES Research Papers 2010-21, School of Economics and Management, University of Aarhus.
  17. Palm, F. & Zellner, A., 1991. "To combine or not to combine? issues of combining forecasts," CORE Discussion Papers 1991022, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  18. Elliott, Graham & Muller, Ulrich K., 2007. "Confidence sets for the date of a single break in linear time series regressions," Journal of Econometrics, Elsevier, vol. 141(2), pages 1196-1218, December.
  19. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-56, July.
  20. Anne Sofie Jore & James Mitchell & Shaun Vahey, 2008. "Combining Forecast Densities from VARs with Uncertain Instabilities," Reserve Bank of New Zealand Discussion Paper Series DP2008/18, Reserve Bank of New Zealand.
  21. Carstensen, Kai & Wohlrabe, Klaus & Ziegler, Christina, 2010. "Predictive Ability of Business Cycle Indicators under Test: A Case Study for the Euro Area Industrial Production," Discussion Papers in Economics 11442, University of Munich, Department of Economics.
  22. Andreou, Elena & Ghysels, Eric & Kourtellos, Andros, 2010. "Regression models with mixed sampling frequencies," Journal of Econometrics, Elsevier, vol. 158(2), pages 246-261, October.
  23. Perron, P. & Bai, J., 1995. "Estimating and Testing Linear Models with Multiple Structural Changes," Cahiers de recherche 9552, Universite de Montreal, Departement de sciences economiques.
  24. Barbara Rossi & Atsushi Inoue, 2011. "Out-of-Sample Forecast Tests Robust to Window Size Choice," Working Papers 11-04, Duke University, Department of Economics.
  25. Pesaran, M.H. & Timmermann, A., 2003. "Small Sample Properties of Forecasts from Autoregressive Models under Structural Breaks," Cambridge Working Papers in Economics 0331, Faculty of Economics, University of Cambridge.
  26. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
  27. Barbara Rossi, 2005. "Are Exchange Rates Really Random Walks? Some Evidence Robust to Parameter Instability," International Finance 0503006, EconWPA.
  28. Garry J. Schinasi & P.A.V.B. Swamy, 1987. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," Special Studies Papers 212, Board of Governors of the Federal Reserve System (U.S.).
  29. Fabio Busetti & Juri Marcucci & Giovanni Veronese, 2009. "Comparing forecast accuracy: A Monte Carlo investigation," Temi di discussione (Economic working papers) 723, Bank of Italy, Economic Research and International Relations Area.
  30. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
  31. Jonathan H. Wright, 2003. "Bayesian Model Averaging and exchange rate forecasts," International Finance Discussion Papers 779, Board of Governors of the Federal Reserve System (U.S.).
  32. Aaron Smith, 2005. "Forecasting in the presence of level shifts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(8), pages 557-574.
  33. Elliott, Graham & Timmermann, Allan, 2002. "Optimal Forecast Combination Under General Loss Functions and Forecast Error Distributions," University of California at San Diego, Economics Working Paper Series qt15r9t2q2, Department of Economics, UC San Diego.
  34. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29.
  35. Philippe Bacchetta & Eric van Wincoop & Toni Beutler, 2009. "Can Parameter Instability Explain the Meese-Rogoff Puzzle?," Cahiers de Recherches Economiques du Département d'Econométrie et d'Economie politique (DEEP) 09.08, Université de Lausanne, Faculté des HEC, DEEP.
  36. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
  37. Margaret M. McConnell & Gabriel Perez Quiros, 1997. "Output fluctuations in the United States: what has changed since the early 1980s?," Research Paper 9735, Federal Reserve Bank of New York.
  38. Jana Eklund & Sune Karlsson, 2007. "Forecast Combination and Model Averaging Using Predictive Measures," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 329-363.
  39. John M Maheu & Stephen Gordon, 2007. "Learning, Forecasting and Structural Breaks," Working Papers tecipa-284, University of Toronto, Department of Economics.
  40. Rossi, Barbara & Giacomini, Raffaella, 2005. "How Stable is the Forecasting Performance of the Yield Curve for Outpot Growth?," Working Papers 05-08, Duke University, Department of Economics.
  41. West, K.D. & McCracken, M.W., 1997. "Regression-Based Tests of Predictive Ability," Working papers 9710, Wisconsin Madison - Social Systems.
  42. Schrimpf, Andreas & Wang, Qingwei, 2010. "A reappraisal of the leading indicator properties of the yield curve under structural instability," International Journal of Forecasting, Elsevier, vol. 26(4), pages 836-857, October.
  43. Raffaella Giacomini & Barbara Rossi, 2009. "Model Comparisons in Unstable Environments," Working Papers 09-10, Duke University, Department of Economics.
  44. Allan Timmermann & Andrew Patton, 2004. "Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity," Working Papers wp04-05, Warwick Business School, Finance Group.
  45. Swanson, Norman R., 1998. "Money and output viewed through a rolling window," Journal of Monetary Economics, Elsevier, vol. 41(3), pages 455-474, May.
  46. M. Hashem Pesaran & Davide Pettenuzzo & Allan Timmermann, 2004. "Forecasting Time Series Subject to Multiple Structural Breaks," CESifo Working Paper Series 1237, CESifo Group Munich.
  47. Inoue, Atsushi & Kilian, Lutz, 2002. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," CEPR Discussion Papers 3671, C.E.P.R. Discussion Papers.
  48. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," Review of Financial Studies, Society for Financial Studies, vol. 12(2), pages 405-28.
  49. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
  50. Allan Timmermann & Gabriel Perez-Quiros, 1999. "Firm Size and Cyclical Variations in Stock Returns," FMG Discussion Papers dp335, Financial Markets Group.
  51. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-58, May.
  52. Manzan, Sebastiano & Zerom, Dawit, 2009. "Are Macroeconomic Variables Useful for Forecasting the Distribution of U.S. Inflation?," MPRA Paper 14387, University Library of Munich, Germany.
  53. Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
  54. Dean Croushore & Tom Stark, 1999. "A real-time data set for macroeconomists," Working Papers 99-4, Federal Reserve Bank of Philadelphia.
  55. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
  56. Francis X. Diebold & Jose A. Lopez, 1996. "Forecast Evaluation and Combination," NBER Technical Working Papers 0192, National Bureau of Economic Research, Inc.
  57. Adriana Z. Fernandez & Evan F. Koenig & Alex Nikolsko-Rzhevskyy, 2008. "The relative performance of alternative Taylor rule specifications," Staff Papers, Federal Reserve Bank of Dallas, issue Jun.
  58. Gonzalo, Jesus & Pitarakis, Jean-Yves, 2010. "Regime Specific Predictability in Predictive Regressions," MPRA Paper 29190, University Library of Munich, Germany.
  59. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
  60. Kozicki, Sharon & Tinsley, P. A., 2001. "Shifting endpoints in the term structure of interest rates," Journal of Monetary Economics, Elsevier, vol. 47(3), pages 613-652, June.
  61. Atsushi Inoue & Barbara Rossi, 2011. "Identifying the Sources of Instabilities in Macroeconomic Fluctuations," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1186-1204, November.
  62. Joscha Beckmann & Ansgar Belke & Michael Kühl, 2011. "The dollar-euro exchange rate and macroeconomic fundamentals: a time-varying coefficient approach," Review of World Economics (Weltwirtschaftliches Archiv), Springer, vol. 147(1), pages 11-40, April.
  63. Barbara Rossi & Tatevik Sekhposyan, 2010. "Understanding Models' Forecasting Performance," Working Papers 10-56, Duke University, Department of Economics.
  64. Jan J. J. Groen & Richard Paap & Francesco Ravazzolo, 2013. "Real-Time Inflation Forecasting in a Changing World," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 29-44, January.
  65. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
  66. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September.
  67. Akhter Faroque & William Veloce & Jean-Francois Lamarche, 2012. "Have structural changes eliminated the out-of-sample ability of financial variables to forecast real activity after the mid-1980s? Evidence from the Canadian economy," Applied Economics, Taylor & Francis Journals, vol. 44(30), pages 3965-3985, October.
  68. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
  69. Barbara Rossi & Tatevik Sekhposyan, 2011. "Forecast Optimality Tests in the Presence of Instabilities," Working Papers 11-18, Duke University, Department of Economics.
  70. González, Andrés & Hubrich, Kirstin & Teräsvirta, Timo, 2011. "Forecasting inflation with gradual regime shifts and exogenous information," Working Paper Series 1363, European Central Bank.
  71. Todd E. Clark & Michael W. McCracken, 2007. "Forecasting with small macroeconomic VARs in the presence of instabilities," Finance and Economics Discussion Series 2007-41, Board of Governors of the Federal Reserve System (U.S.).
  72. Rapach, David E & Wohar, Mark E, 2005. "Regime Changes in International Real Interest Rates: Are They a Monetary Phenomenon?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(5), pages 887-906, October.
  73. Pesaran, M. Hashem & Pick, Andreas, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 307-318.
  74. Rossi, Barbara, 2005. "Optimal Tests For Nested Model Selection With Underlying Parameter Instability," Econometric Theory, Cambridge University Press, vol. 21(05), pages 962-990, October.
  75. Amit Goyal & Ivo Welch, 1999. "Predicting the Equity Premium with Dividend Ratios," Yale School of Management Working Papers amz2437, Yale School of Management, revised 01 Nov 2002.
  76. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
  77. Jon Faust & Jonathan H. Wright, 2007. "Comparing Greenbook and Reduced Form Forecasts using a Large Realtime Dataset," NBER Working Papers 13397, National Bureau of Economic Research, Inc.
  78. David C. Wheelock & Mark E. Wohar, 2009. "Can the term spread predict output growth and recessions? a survey of the literature," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 419-440.
  79. David E. Rapach & Mark E. Wohar, 2006. "Structural Breaks and Predictive Regression Models of Aggregate U.S. Stock Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(2), pages 238-274.
  80. Castelnuovo, Efrem & Greco, Luciano & Raggi, Davide, 2008. "Estimating regime-switching Taylor rules with trend inflation," Research Discussion Papers 20/2008, Bank of Finland.
  81. Sarno, Lucio & Valente, Giorgio, 2008. "Exchange Rates and Fundamentals: Footloose or Evolving Relationship?," CEPR Discussion Papers 6638, C.E.P.R. Discussion Papers.
  82. Altavilla, Carlo & Ciccarelli, Matteo, 2007. "Information combination and forecast (st)ability evidence from vintages of time-series data," Working Paper Series 0846, European Central Bank.
  83. Hamilton, James D., 1988. "Rational-expectations econometric analysis of changes in regime : An investigation of the term structure of interest rates," Journal of Economic Dynamics and Control, Elsevier, vol. 12(2-3), pages 385-423.
  84. Calhoun, Gray, 2014. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers 32462, Iowa State University, Department of Economics.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. M Hashem Pesaran & Andreas Pick & Mikhail Pranovich, 2011. "Optimal Forecasts in the Presence of Structural Breaks," DNB Working Papers 327, Netherlands Central Bank, Research Department.
  2. Wolters, Maik Hendrik, 2012. "Evaluating point and density forecasts of DSGE models," IMFS Working Paper Series 59, Institute for Monetary and Financial Stability (IMFS), Goethe University Frankfurt.
  3. Wolters, Maik H., 2011. "Forecasting under Model Uncertainty," Annual Conference 2011 (Frankfurt, Main): The Order of the World Economy - Lessons from the Crisis 48723, Verein für Socialpolitik / German Economic Association.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:duk:dukeec:11-20. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Department of Economics Webmaster).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.