IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Evaluating long-horizon forecasts

  • Todd E. Clark
  • Michael W. McCracken

This paper examines the asymptotic and finite-sample properties of tests of equal forecast accuracy and encompassing applied to predictions from nested long-horizon regression models. We first derive the asymptotic distributions of a set of tests of equal forecast accuracy and encompassing, showing that the tests have non-standard distributions that depend on the parameters of the data-generating process. Using a simple parametric bootstrap for inference, we then conduct Monte Carlo simulations of a range of data-generating processes to examine the finite-sample size and power of the tests. In these simulations, the bootstrap yields tests with good finite-sample size and power properties, with the encompassing test proposed by Clark and McCracken (2001a) having superior power. The paper concludes with a reexamination of the predictive content of capacity utilization for core inflation.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.kansascityfed.org/Publicat/Reswkpap/PDF/rwp01-14.pdf
Download Restriction: no

Paper provided by Federal Reserve Bank of Kansas City in its series Research Working Paper with number RWP 01-14.

as
in new window

Length:
Date of creation: 2001
Date of revision:
Handle: RePEc:fip:fedkrw:rwp01-14
Contact details of provider: Postal: 1 Memorial Drive, Kansas City, MO 64198-0001
Phone: (816) 881-2254
Web page: http://www.kansascityfed.org/

More information through EDIRC

Order Information: Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Mototsugu Shintani, 2010. "Nonlinear Forecasting Analysis Using Diffusion Indexes: An Application to Japan," Levine's Working Paper Archive 506439000000000168, David K. Levine.
  2. Orphanides, Athanasios & van Norden, Simon, 2005. "The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time," CEPR Discussion Papers 4830, C.E.P.R. Discussion Papers.
  3. repec:att:wimass:9710 is not listed on IDEAS
  4. Yin-Wong Cheung & Antonio Garcia Pascual & Menzie David Chinn, 2004. "Empirical Exchange Rate Models of the Nineties; Are Any Fit to Survive?," IMF Working Papers 04/73, International Monetary Fund.
  5. Norman R. Swanson, 2000. "An Out of Sample Test for Granger Causality," Econometric Society World Congress 2000 Contributed Papers 0362, Econometric Society.
  6. Todd E. Clark, 2004. "Can out-of-sample forecast comparisons help prevent overfitting?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 115-139.
  7. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-86.
  8. Lutz Kilian & Mark P. Taylor, 2001. "Why is it so difficult to beat the Random Walk Forecast of Exchange Rates?," Tinbergen Institute Discussion Papers 01-031/4, Tinbergen Institute.
  9. Inoue, Atsushi & Kilian, Lutz, 2002. "In-sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 0195, European Central Bank.
  10. Gonçalves, Sílvia & Kilian, Lutz, 2002. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Working Paper Series 0196, European Central Bank.
  11. Kenneth D. West, 1994. "Asymptotic Inference About Predictive Ability," Macroeconomics 9410002, EconWPA.
  12. Jeremy Berkowitz & Lutz Kilian, 1996. "Recent developments in bootstrapping time series," Finance and Economics Discussion Series 96-45, Board of Governors of the Federal Reserve System (U.S.).
  13. James H. Stock & Mark W. Watson, 1999. "Forecasting Inflation," NBER Working Papers 7023, National Bureau of Economic Research, Inc.
  14. David Hendry & Guillaume Chevillon, 2004. "Non-Parametric Direct Multi-step Estimation for Forecasting Economic Processes," Economics Series Working Papers 196, University of Oxford, Department of Economics.
  15. Arturo Estrella & Gikas A. Hardouvelis, 1989. "The term structure as a predictor of real economic activity," Research Paper 8907, Federal Reserve Bank of New York.
  16. Clive Granger & Yongil Jeon, 2004. "Forecasting Performance of Information Criteria with Many Macro Series," Journal of Applied Statistics, Taylor & Francis Journals, vol. 31(10), pages 1227-1240.
  17. Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
  18. Arturo Estrella & Anthony P. Rodrigues & Sebastian Schich, 2000. "How stable is the predictive power of the yield curve? evidence from Germany and the United States," Staff Reports 113, Federal Reserve Bank of New York.
  19. Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
  20. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
  21. repec:cup:macdyn:v:5:y:2001:i:4:p:598-620 is not listed on IDEAS
  22. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, Elsevier.
  23. Stephen G. Cecchetti, 1995. "Inflation Indicators and Inflation Policy," NBER Chapters, in: NBER Macroeconomics Annual 1995, Volume 10, pages 189-236 National Bureau of Economic Research, Inc.
  24. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-59, April.
  25. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
  26. West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
  27. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
  28. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
  29. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-33, March.
  30. Kenneth D. West & Michael W. McCracken, 1998. "Regression-Based Tests of Predictive Ability," NBER Technical Working Papers 0226, National Bureau of Economic Research, Inc.
  31. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
  32. Rossi, Barbara, 2002. "Optimal Tests for Nested Model Selection with Underlying Parameter Instability," Working Papers 02-05, Duke University, Department of Economics.
  33. Meese, Richard A & Rogoff, Kenneth, 1988. " Was It Real? The Exchange Rate-Interest Differential Relation over the Modern Floating-Rate Period," Journal of Finance, American Finance Association, vol. 43(4), pages 933-48, September.
  34. Hansen, Bruce E., 1992. "Convergence to Stochastic Integrals for Dependent Heterogeneous Processes," Econometric Theory, Cambridge University Press, vol. 8(04), pages 489-500, December.
  35. Richard Clarida & Lucio Sarno & Mark Taylor & Giorgio Valente, 2001. "The Out-of-Sample Success of Term Structure Models as Exchange Rate Predictors: A Step Beyond," NBER Working Papers 8601, National Bureau of Economic Research, Inc.
  36. Clements, Michael P. & Hendry, David F., 1996. "Multi-Step Estimation for Forecasting," The Warwick Economics Research Paper Series (TWERPS) 447, University of Warwick, Department of Economics.
  37. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-18, March.
  38. Schorfheide, Frank, 2005. "VAR forecasting under misspecification," Journal of Econometrics, Elsevier, vol. 128(1), pages 99-136, September.
  39. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
  40. Corradi, Valentina & Swanson, Norman R. & Olivetti, Claudia, 2001. "Predictive ability with cointegrated variables," Journal of Econometrics, Elsevier, vol. 104(2), pages 315-358, September.
  41. Jan J. J. Groen, 1999. "Long horizon predictability of exchange rates: Is it for real?," Empirical Economics, Springer, vol. 24(3), pages 451-469.
  42. Massimiliano Marcellino, . "Instability and non-linearity in the EMU," Working Papers 211, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:fip:fedkrw:rwp01-14. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Lu Dayrit)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.