This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Evaluating long-horizon forecasts

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Todd E. Clark
Michael W. McCracken

Additional information is available for the following registered author(s):

Abstract

This paper examines the asymptotic and finite-sample properties of tests of equal forecast accuracy and encompassing applied to predictions from nested long-horizon regression models. We first derive the asymptotic distributions of a set of tests of equal forecast accuracy and encompassing, showing that the tests have non-standard distributions that depend on the parameters of the data-generating process. Using a simple parametric bootstrap for inference, we then conduct Monte Carlo simulations of a range of data-generating processes to examine the finite-sample size and power of the tests. In these simulations, the bootstrap yields tests with good finite-sample size and power properties, with the encompassing test proposed by Clark and McCracken (2001a) having superior power. The paper concludes with a reexamination of the predictive content of capacity utilization for core inflation.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.kc.frb.org/Publicat/Reswkpap/PDF/rwp01-14.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by Federal Reserve Bank of Kansas City in its series Research Working Paper with number RWP 01-14.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: 2001
Date of revision:
Handle: RePEc:fip:fedkrw:rwp01-14

Contact details of provider:
Postal: 1 Memorial Drive, Kansas City, MO 64198-0001
Phone: (816) 881-2254
Email:
Web page: http://www.kansascityfed.org/
More information through EDIRC

Order Information:
Email:
Web: http://app.ny.frb.org/cfpicnic/frame1.cfm

For technical questions regarding this item, or to correct its listing, contact: (Diane Rosenberger).

Related research
Keywords: Forecasting;

Other versions of this item:

This paper has been announced in the following NEP Reports: References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November. [Downloadable!] (restricted)
    Other versions:
  2. Kilian, Lutz & Taylor, Mark P., 2003. "Why is it so difficult to beat the random walk forecast of exchange rates?," Journal of International Economics, Elsevier, vol. 60(1), pages 85-107, May. [Downloadable!] (restricted)
    Other versions:
  3. Athanasios Orphanides & Simon van Norden, 2004. "The reliability of inflation forecasts based on output gap estimates in real time," Finance and Economics Discussion Series 2004-68, Board of Governors of the Federal Reserve System (U.S.). [Downloadable!]
    Other versions:
  4. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May. [Downloadable!] (restricted)
  5. Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May. [Downloadable!] (restricted)
    Other versions:
  6. Clarida, Richard H. & Sarno, Lucio & Taylor, Mark P. & Valente, Giorgio, 2003. "The out-of-sample success of term structure models as exchange rate predictors: a step beyond," Journal of International Economics, Elsevier, vol. 60(1), pages 61-83, May. [Downloadable!] (restricted)
    Other versions:
  7. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October. [Downloadable!] (restricted)
  8. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct. [Downloadable!]
  9. Estrella, Arturo & Hardouvelis, Gikas A, 1991. " The Term Structure as a Predictor of Real Economic Activity," Journal of Finance, American Finance Association, vol. 46(2), pages 555-76, June. [Downloadable!] (restricted)
    Other versions:
  10. Schorfheide, Frank, 2005. "VAR forecasting under misspecification," Journal of Econometrics, Elsevier, vol. 128(1), pages 99-136, September. [Downloadable!] (restricted)
  11. repec:cup:macdyn:v:5:y:2001:i:4:p:598-620 is not listed on IDEAS
  12. Arturo Estrella & Anthony P. Rodrigues & Sebastian Schich, 2003. "How Stable is the Predictive Power of the Yield Curve? Evidence from Germany and the United States," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 629-644, 07. [Downloadable!] (restricted)
    Other versions:
  13. Stephen G. Cecchetti, 1995. "Inflation Indicators and Inflation Policy," NBER Chapters, in: NBER Macroeconomics Annual 1995, Volume 10, pages 189-236 National Bureau of Economic Research, Inc. [Downloadable!]
    Other versions:
  14. Todd E. Clark, 2000. "Can out-of-sample forecast comparisons help prevent overfitting?," Research Working Paper RWP 00-05, Federal Reserve Bank of Kansas City. [Downloadable!]
    Other versions:
  15. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, Elsevier. [Downloadable!] (restricted)
  16. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October. [Downloadable!] (restricted)
    Other versions:
  17. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-33, March. [Downloadable!] (restricted)
  18. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," Review of Financial Studies, Oxford University Press for Society for Financial Studies, vol. 5(3), pages 357-86. [Downloadable!] (restricted)
  19. Lutz Kilian & Atsushi Inoue, 2002. "In-Sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 195, European Central Bank. [Downloadable!]
    Other versions:
  20. Clive Granger & Yongil Jeon, 2004. "Forecasting Performance of Information Criteria with Many Macro Series," Journal of Applied Statistics, Taylor and Francis Journals, vol. 31(10), pages 1227-1240, January. [Downloadable!] (restricted)
  21. West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
  22. Mototsugu Shintani, 2003. "Nonlinear Forecasting Analysis Using Diffusion Indexes: An Application to Japan," Working Papers 0322, Department of Economics, Vanderbilt University, revised Apr 2004. [Downloadable!]
    Other versions:
  23. Jan J. J. Groen, 1999. "Long horizon predictability of exchange rates: Is it for real?," Empirical Economics, Springer, vol. 24(3), pages 451-469. [Downloadable!] (restricted)
    Other versions:
  24. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor and Francis Journals, vol. 19(1), pages 1-48. [Downloadable!] (restricted)
    Other versions:
  25. Marcellino, Massimiliano, 2002. "Instability and Non-Linearity in the EMU," CEPR Discussion Papers 3312, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
  26. Meese, Richard A & Rogoff, Kenneth, 1988. " Was It Real? The Exchange Rate-Interest Differential Relation over the Modern Floating-Rate Period," Journal of Finance, American Finance Association, vol. 43(4), pages 933-48, September. [Downloadable!] (restricted)
    Other versions:
  27. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-18, March.
  28. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-59, April.
  29. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September. [Downloadable!] (restricted)
    Other versions:
  30. James H. Stock & Mark W. Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    Other versions:
  31. Guillaume Chevillon & David Hendry, 2004. "Non-Parametric Direct Multi-step Estimation for Forecasting Economic Processes," Economics Series Working Papers 196, University of Oxford, Department of Economics. [Downloadable!]
    Other versions:
  32. Corradi, Valentina & Swanson, Norman R. & Olivetti, Claudia, 2001. "Predictive ability with cointegrated variables," Journal of Econometrics, Elsevier, vol. 104(2), pages 315-358, September. [Downloadable!] (restricted)
  33. Clements, Michael P. & Hendry, David F., 1996. "Multi-Step Estimation for Forecasting," The Warwick Economics Research Paper Series (TWERPS) 447, University of Warwick, Department of Economics.
    Other versions:
  34. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-40, November.
    Other versions:
  35. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August. [Downloadable!] (restricted)
    Other versions:
  36. Sílvia Gonçalves & Lutz Kilian, 2003. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," CIRANO Working Papers 2003s-17, CIRANO. [Downloadable!]
    Other versions:
  37. Cheung, Yin-Wong & Chinn, Menzie D. & Pascual, Antonio Garcia, 2005. "Empirical exchange rate models of the nineties: Are any fit to survive?," Journal of International Money and Finance, Elsevier, vol. 24(7), pages 1150-1175, November. [Downloadable!] (restricted)
    Other versions:
  38. Norman R. Swanson, 2000. "An Out of Sample Test for Granger Causality," Econometric Society World Congress 2000 Contributed Papers 0362, Econometric Society. [Downloadable!]
  39. Rossi, Barbara, 2002. "Optimal Tests for Nested Model Selection with Underlying Parameter Instability," Working Papers 02-05, Duke University, Department of Economics. [Downloadable!]
    Other versions:
  40. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
    Other versions:
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Marie Bessec & Othman Bouabdallah, 2005. "What causes the forecasting failure of Markov-Switching models? A Monte Carlo study," Econometrics 0503018, EconWPA. [Downloadable!]
  2. Athanasios Orphanides & Simon van Norden, 2004. "The reliability of inflation forecasts based on output gap estimates in real time," Finance and Economics Discussion Series 2004-68, Board of Governors of the Federal Reserve System (U.S.). [Downloadable!]
    Other versions:
  3. Pablo Pincheira, 2006. "Conditional Evaluation of Exchange Rate Predictive Ability in Long Run Regressions," Working Papers Central Bank of Chile 378, Central Bank of Chile. [Downloadable!]
  4. Ricardo Mestre, 2007. "Are survey-based inflation expectations in the euro area informative," Working Paper Series 721, European Central Bank. [Downloadable!]
  5. Pablo Pincheira, 2006. "Shrinkage Based Tests of the Martingale Difference Hypothesis," Working Papers Central Bank of Chile 376, Central Bank of Chile. [Downloadable!]
  6. Nelson C. Mark & Donggyu Sul, 2004. "The Use of Predictive Regressions at Alternative Horizons in Finance and Economics," Finance 0409032, EconWPA. [Downloadable!]
    Other versions:
  7. Curran, Declan & Funke, Michael, 2006. "Taking the temperature – forecasting GDP growth for mainland China," BOFIT Discussion Papers 6/2006, Bank of Finland, Institute for Economies in Transition. [Downloadable!]
    Other versions:
  8. Martin D.D. Evans & Richard K. Lyons, 2005. "Meese-Rogoff Redux: Micro-Based Exchange Rate Forecasting," NBER Working Papers 11042, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  9. Todd E. Clark & Kenneth D. West, 2005. "Using Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference," NBER Technical Working Papers 0305, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
  10. Todd E. Clark & Michael W. McCracken, 2002. "Forecast-based model selection in the presence of structural breaks," Research Working Paper RWP 02-05, Federal Reserve Bank of Kansas City. [Downloadable!]
  11. Gabriel Moser & Fabio Rumler & Johann Scharler, 2004. "Forecasting Austrian Inflation," Working Papers 91, Oesterreichische Nationalbank (Austrian Central Bank). [Downloadable!]
    Other versions:
  12. Todd E. Clark & Kenneth D. West, 2004. "Using out-of-sample mean squared prediction errors to test the Martingale difference hypothesis," Research Working Paper RWP 04-03, Federal Reserve Bank of Kansas City. [Downloadable!]
    Other versions:
  13. Todd E. Clark & Michael W. McCracken, 2003. "The predictive content of the output gap for inflation : resolving in-sample and out-of-sample evidence," Research Working Paper RWP 03-06, Federal Reserve Bank of Kansas City. [Downloadable!]
    Other versions:
  14. Norman Swanson & Valentina Corradi, 2006. "Nonparametric Bootstrap Procedures for Predictive Inference Based on Recursive Estimation Schemes," Departmental Working Papers 200618, Rutgers University, Department of Economics. [Downloadable!]
    Other versions:
Statistics
Access and download statistics

Did you know? You can create a compilation of all publications of a group of people, say alumni of a program, your students or memers of an association.

This page was last updated on 2009-11-18.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.