IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Evaluating long-horizon forecasts

  • Todd E. Clark
  • Michael W. McCracken

This paper examines the asymptotic and finite-sample properties of tests of equal forecast accuracy and encompassing applied to predictions from nested long-horizon regression models. We first derive the asymptotic distributions of a set of tests of equal forecast accuracy and encompassing, showing that the tests have non-standard distributions that depend on the parameters of the data-generating process. Using a simple parametric bootstrap for inference, we then conduct Monte Carlo simulations of a range of data-generating processes to examine the finite-sample size and power of the tests. In these simulations, the bootstrap yields tests with good finite-sample size and power properties, with the encompassing test proposed by Clark and McCracken (2001a) having superior power. The paper concludes with a reexamination of the predictive content of capacity utilization for core inflation.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Federal Reserve Bank of Kansas City in its series Research Working Paper with number RWP 01-14.

in new window

Date of creation: 2001
Date of revision:
Handle: RePEc:fip:fedkrw:rwp01-14
Contact details of provider: Postal: 1 Memorial Drive, Kansas City, MO 64198-0001
Phone: (816) 881-2254
Web page:

More information through EDIRC

Order Information: Email:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Kenneth D. West & Michael W. McCracken, 1998. "Regression-Based Tests of Predictive Ability," NBER Technical Working Papers 0226, National Bureau of Economic Research, Inc.
  2. Arturo Estrella & Anthony P. Rodrigues & Sebastian Schich, 2000. "How stable is the predictive power of the yield curve? evidence from Germany and the United States," Staff Reports 113, Federal Reserve Bank of New York.
  3. Massimiliano Marcellino, . "Instability and non-linearity in the EMU," Working Papers 211, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
  4. Kenneth D. West, 1994. "Asymptotic Inference About Predictive Ability," Macroeconomics 9410002, EconWPA.
  5. Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
  6. Clements, Michael P. & Hendry, David F., 1996. "Multi-Step Estimation for Forecasting," The Warwick Economics Research Paper Series (TWERPS) 447, University of Warwick, Department of Economics.
  7. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-86.
  8. Lutz Kilian & Mark P. Taylor, 2001. "Why is it so difficult to beat the Random Walk Forecast of Exchange Rates?," Tinbergen Institute Discussion Papers 01-031/4, Tinbergen Institute.
  9. Clive Granger & Yongil Jeon, 2004. "Forecasting Performance of Information Criteria with Many Macro Series," Journal of Applied Statistics, Taylor & Francis Journals, vol. 31(10), pages 1227-1240.
  10. Yin-Wong Cheung & Menzie D. Chinn & Antonio Garcia-Pascual, 2005. "Empirical Exchange Rate Models of the Nineties: Are Any Fit to Survive?," Working Papers 122005, Hong Kong Institute for Monetary Research.
  11. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
  12. James H. Stock & Mark W. Watson, 2001. "Forecasting output and inflation: the role of asset prices," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
  13. Stephen G. Cecchetti, 1995. "Inflation Indicators and Inflation Policy," NBER Working Papers 5161, National Bureau of Economic Research, Inc.
  14. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, Elsevier.
  15. Guillaume Chevillon & David F. Hendry, 2004. "Non-Parametric Direct Multi-step Estimation for Forecasting Economic Processes," Economics Papers 2004-W12, Economics Group, Nuffield College, University of Oxford.
  16. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
  17. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
  18. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-59, April.
  19. Estrella, Arturo & Hardouvelis, Gikas A, 1991. " The Term Structure as a Predictor of Real Economic Activity," Journal of Finance, American Finance Association, vol. 46(2), pages 555-76, June.
  20. Meese, Richard A & Rogoff, Kenneth, 1988. " Was It Real? The Exchange Rate-Interest Differential Relation over the Modern Floating-Rate Period," Journal of Finance, American Finance Association, vol. 43(4), pages 933-48, September.
  21. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-18, March.
  22. GONÇALVES, Silvia & KILIAN, Lutz, 2003. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," Cahiers de recherche 2003-01, Universite de Montreal, Departement de sciences economiques.
  23. Richard Clarida & Lucio Sarno & Mark Taylor & Giorgio Valente, 2001. "The Out-of-Sample Success of Term Structure Models as Exchange Rate Predictors: A Step Beyond," NBER Working Papers 8601, National Bureau of Economic Research, Inc.
  24. Orphanides, Athanasios & van Norden, Simon, 2005. "The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 583-601, June.
  25. Atsushi Inoue & Lutz Kilian, 2005. "In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use?," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 371-402.
  26. Jeremy Berkowitz & Lutz Kilian, 1996. "Recent developments in bootstrapping time series," Finance and Economics Discussion Series 96-45, Board of Governors of the Federal Reserve System (U.S.).
  27. Corradi, Valentina & Swanson, Norman R. & Olivetti, Claudia, 2001. "Predictive ability with cointegrated variables," Journal of Econometrics, Elsevier, vol. 104(2), pages 315-358, September.
  28. Todd E. Clark, 2000. "Can out-of-sample forecast comparisons help prevent overfitting?," Research Working Paper RWP 00-05, Federal Reserve Bank of Kansas City.
  29. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
  30. Rossi, Barbara, 2005. "Optimal Tests For Nested Model Selection With Underlying Parameter Instability," Econometric Theory, Cambridge University Press, vol. 21(05), pages 962-990, October.
  31. Norman R. Swanson, 2000. "An Out of Sample Test for Granger Causality," Econometric Society World Congress 2000 Contributed Papers 0362, Econometric Society.
  32. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
  33. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
  34. West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
  35. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-33, March.
  36. Jan J. J. Groen, 1999. "Long horizon predictability of exchange rates: Is it for real?," Empirical Economics, Springer, vol. 24(3), pages 451-469.
  37. Hansen, Bruce E., 1992. "Convergence to Stochastic Integrals for Dependent Heterogeneous Processes," Econometric Theory, Cambridge University Press, vol. 8(04), pages 489-500, December.
  38. repec:cup:macdyn:v:5:y:2001:i:4:p:598-620 is not listed on IDEAS
  39. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
  40. Schorfheide, Frank, 2005. "VAR forecasting under misspecification," Journal of Econometrics, Elsevier, vol. 128(1), pages 99-136, September.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:fip:fedkrw:rwp01-14. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Lu Dayrit)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.