IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Averaging forecasts from VARs with uncertain instabilities

Listed author(s):
  • Todd E. Clark
  • Michael W. McCracken

A body of recent work suggests commonly–used VAR models of output, inflation, and interest rates may be prone to instabilities. In the face of such instabilities, a variety of estimation or forecasting methods might be used to improve the accuracy of forecasts from a VAR. These methods include using different approaches to lag selection, different observation windows for estimation, (over-) differencing, intercept correction, stochastically time–varying parameters, break dating, discounted least squares, Bayesian shrinkage, and detrending of inflation and interest rates. Although each individual method could be useful, the uncertainty inherent in any single representation of instability could mean that combining forecasts from the entire range of VAR estimates will further improve forecast accuracy. Focusing on models of U.S. output, prices, and interest rates, this paper examines the effectiveness of combination in improving VAR forecasts made with real–time data. The combinations include simple averages, medians, trimmed means, and a number of weighted combinations, based on: Bates-Granger regressions, factor model estimates, regressions involving just forecast quartiles, Bayesian model averaging, and predictive least squares–based weighting. Our goal is to identify those approaches that, in real time, yield the most accurate forecasts of these variables. We use forecasts from simple univariate time series models and the Survey of Professional Forecasters as benchmarks.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.kansascityfed.org/Publicat/Reswkpap/PDF/rwp06-12.pdf
Download Restriction: no

Paper provided by Federal Reserve Bank of Kansas City in its series Research Working Paper with number RWP 06-12.

as
in new window

Length:
Date of creation: 2006
Handle: RePEc:fip:fedkrw:rwp06-12
Contact details of provider: Postal:
1 Memorial Drive, Kansas City, MO 64198-0001

Phone: (816) 881-2254
Web page: http://www.kansascityfed.org/

More information through EDIRC

Order Information: Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Carlo A. Favero & Massimiliano Marcellino, 2005. "Modelling and Forecasting Fiscal Variables for the Euro Area," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 755-783, December.
  2. Gary Koop & Simon M. Potter & Rodney W. Strachan, 2008. "Re-Examining the Consumption-Wealth Relationship: The Role of Model Uncertainty," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(2-3), pages 341-367, 03.
  3. Todd E. Clark & Michael W. McCracken, 2007. "Combining forecasts from nested models," Finance and Economics Discussion Series 2007-43, Board of Governors of the Federal Reserve System (U.S.).
  4. Timmermann, Allan G, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, C.E.P.R. Discussion Papers.
  5. Todd E. Clark & Michael W. McCracken, 2008. "Improving forecast accuracy by combining recursive and rolling forecasts," Working Papers 2008-028, Federal Reserve Bank of St. Louis.
  6. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  7. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, EconWPA.
  8. George Kapetanios & Vincent Labhard & Simon Price, 2006. "Forecasting using Bayesian and Information Theoretic Model Averaging: An Application to UK Inflation," Working Papers 566, Queen Mary University of London, School of Economics and Finance.
  9. Cogley, Timothy, 2002. "A Simple Adaptive Measure of Core Inflation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 34(1), pages 94-113, February.
  10. Timothy Cogley & Thomas J. Sargent, 2003. "Drifts and volatilities: monetary policies and outcomes in the post WWII U.S," FRB Atlanta Working Paper 2003-25, Federal Reserve Bank of Atlanta.
  11. Tor Jacobson & Per Jansson & Anders Vredin & Anders Warne, 2001. "Monetary policy analysis and inflation targeting in a small open economy: a VAR approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(4), pages 487-520.
  12. Kozicki, Sharon & Tinsley, P. A., 2001. "Shifting endpoints in the term structure of interest rates," Journal of Monetary Economics, Elsevier, vol. 47(3), pages 613-652, June.
  13. Robertson, John C & Tallman, Ellis W, 2001. "Improving Federal-Funds Rate Forecasts in VAR Models Used for Policy Analysis," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 324-330, July.
  14. Eklund, Jana & Karlsson, Sune, 2005. "Forecast Combination and Model Averaging Using Predictive Measures," CEPR Discussion Papers 5268, C.E.P.R. Discussion Papers.
  15. Boivin, Jean, 2006. "Has U.S. Monetary Policy Changed? Evidence from Drifting Coefficients and Real-Time Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1149-1173, August.
  16. Todd E. Clark & Michael W. McCracken, 2008. "Tests of equal predictive ability with real-time data," Working Papers 2008-029, Federal Reserve Bank of St. Louis.
  17. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, 05.
  18. Robert B. Litterman, 1985. "Forecasting with Bayesian vector autoregressions five years of experience," Working Papers 274, Federal Reserve Bank of Minneapolis.
  19. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, 02.
  20. Yeung Lewis Chan & James H. Stock & Mark W. Watson, 1999. "A dynamic factor model framework for forecast combination," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 91-121.
  21. Andrew Ang & Geert Bekaert & Min Wei, 2005. "Do Macro Variables, Asset Markets or Surveys Forecast Inflation Better?," NBER Working Papers 11538, National Bureau of Economic Research, Inc.
  22. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
  23. Anthony Garratt & Gary Koop & ShaunP. Vahey, 2008. "Forecasting Substantial Data Revisions in the Presence of Model Uncertainty," Economic Journal, Royal Economic Society, vol. 118(530), pages 1128-1144, 07.
  24. Todd E. Clark & Michael W. McCracken, 2006. "Forecasting of small macroeconomic VARs in the presence of instabilities," Research Working Paper RWP 06-09, Federal Reserve Bank of Kansas City.
  25. Peter Tinsley & Sharon Kozicki, 2003. "Alternative Sources of the Lag Dynamics of Inflation," Computing in Economics and Finance 2003 92, Society for Computational Economics.
  26. Gary Koop & Simon M. Potter, 2004. "Forecasting and estimating multiple change-point models with an unknown number of change points," Staff Reports 196, Federal Reserve Bank of New York.
  27. Flint Brayton & Eileen Mauskopf & David L. Reifschneider & Peter A. Tinsley & John Williams, 1997. "The role of expectations in the FRB/US macroeconomic model," Federal Reserve Bulletin, Board of Governors of the Federal Reserve System (U.S.), issue Apr, pages 227-245.
  28. Timothy Cogley & Thomas Sargent, "undated". "Evolving Post-World War II U.S. Inflation Dynamics," Working Papers 2132872, Department of Economics, W. P. Carey School of Business, Arizona State University.
  29. Beyer, Andreas & Farmer, Roger E.A., 2007. "Natural rate doubts," Journal of Economic Dynamics and Control, Elsevier, vol. 31(3), pages 797-825, March.
  30. Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-494, Sept.-Oct.
  31. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 1-31, 06.
  32. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
  33. Phillips, Peter C B, 1996. "Econometric Model Determination," Econometrica, Econometric Society, vol. 64(4), pages 763-812, July.
  34. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
  35. Adolfson, Malin & Andersson, Michael K. & Lindé, Jesper & Villani, Mattias & Vredin, Anders, 2005. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," Working Paper Series 188, Sveriges Riksbank (Central Bank of Sweden), revised 01 Jun 2006.
  36. Dean Croushore, 1993. "Introducing: the survey of professional forecasters," Business Review, Federal Reserve Bank of Philadelphia, issue Nov, pages 3-15.
  37. Robert J. Hodrick & Edward Prescott, 1981. "Post-War U.S. Business Cycles: An Empirical Investigation," Discussion Papers 451, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
  38. Thomas Doan & Robert B. Litterman & Christopher A. Sims, 1983. "Forecasting and Conditional Projection Using Realistic Prior Distributions," NBER Working Papers 1202, National Bureau of Economic Research, Inc.
  39. Valentina Corradi & Norman Swanson, 2004. "Predictive Density Evaluation," Departmental Working Papers 200419, Rutgers University, Department of Economics.
  40. Campbell, Sean D., 2007. "Macroeconomic Volatility, Predictability, and Uncertainty in the Great Moderation: Evidence From the Survey of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 191-200, April.
  41. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, Elsevier.
  42. Gary Koop & Simon Potter, 2004. "Forecasting in dynamic factor models using Bayesian model averaging," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 550-565, December.
  43. Croushore, Dean, 2006. "Forecasting with Real-Time Macroeconomic Data," Handbook of Economic Forecasting, Elsevier.
  44. Tim W. Cogley, 2003. "Drifts and Volatilities: Monetary Policies and Outcomes in the Post War U.S," Working Papers 35, University of California, Davis, Department of Economics.
  45. Kozicki, Sharon & Hoffman, Barak, 2004. "Rounding Error: A Distorting Influence on Index Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 36(3), pages 319-338, June.
  46. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
  47. Arturo Estrella & Jeffrey C. Fuhrer, 2003. "Monetary Policy Shifts and the Stability of Monetary Policy Models," The Review of Economics and Statistics, MIT Press, vol. 85(1), pages 94-104, February.
  48. Michael W. McCracken & Todd E. Clark, 2003. "The Predictive Content of the Output Gap for Inflation: Resolving In-Sample and Out-of-Sample Evidence," Computing in Economics and Finance 2003 183, Society for Computational Economics.
  49. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
  50. Hallman, Jeffrey J & Porter, Richard D & Small, David H, 1991. "Is the Price Level Tied to the M2 Monetary Aggregate in the Long Run?," American Economic Review, American Economic Association, vol. 81(4), pages 841-858, September.
  51. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:fip:fedkrw:rwp06-12. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Lu Dayrit)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.