Advanced Search
MyIDEAS: Login to save this paper or follow this series

In-sample tests of predictive ability: a new approach

Contents:

Author Info

  • Todd E. Clark
  • Michael W. McCracken

Abstract

This paper presents analytical, Monte Carlo, and empirical evidence linking in-sample tests of predictive content and out-of-sample forecast accuracy. Our approach focuses on the negative effect that finite-sample estimation error has on forecast accuracy despite the presence of significant population-level predictive content. Specifically, we derive simple-to-use in-sample tests that test not only whether a particular variable has predictive content but also whether this content is estimated precisely enough to improve forecast accuracy. Our tests are asymptotically non-central chi-square or non-central normal. We provide a convenient bootstrap method for computing the relevant critical values. In the Monte Carlo and empirical analysis, we compare the effectiveness of our testing procedure with more common testing procedures.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.kansascityfed.org/PUBLICAT/RESWKPAP/PDF/RWP09-10.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Federal Reserve Bank of Kansas City in its series Research Working Paper with number RWP 09-10.

as in new window
Length:
Date of creation: 2009
Date of revision:
Handle: RePEc:fip:fedkrw:rwp09-10

Contact details of provider:
Postal: 1 Memorial Drive, Kansas City, MO 64198-0001
Phone: (816) 881-2254
Web page: http://www.kansascityfed.org/
More information through EDIRC

Order Information:
Email:

Related research

Keywords:

Other versions of this item:

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  2. Torous, Walter & Valkanov, Rossen, 2000. "Boundaries of Predictability: Noisy Predictive Regressions," University of California at Los Angeles, Anderson Graduate School of Management qt33p7672z, Anderson Graduate School of Management, UCLA.
  3. Campbell, John & Thompson, Samuel P., 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Scholarly Articles 2622619, Harvard University Department of Economics.
  4. de Jong, Robert M., 1997. "Central Limit Theorems for Dependent Heterogeneous Random Variables," Econometric Theory, Cambridge University Press, vol. 13(03), pages 353-367, June.
  5. Rapach, David E. & Wohar, Mark E., 2006. "In-sample vs. out-of-sample tests of stock return predictability in the context of data mining," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 231-247, March.
  6. Kirby, Chris, 1997. "Measuring the Predictable Variation in Stock and Bond Returns," Review of Financial Studies, Society for Financial Studies, vol. 10(3), pages 579-630.
  7. Silvia Goncalves & Lutz Kilian, 2007. "Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity," Econometric Reviews, Taylor & Francis Journals, vol. 26(6), pages 609-641.
  8. Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May.
  9. Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
  10. Inoue, Atsushi & Kilian, Lutz, 2003. "On the Selection of Forecasting Models," CEPR Discussion Papers 3809, C.E.P.R. Discussion Papers.
  11. Amit Goyal & Ivo Welch, 2004. "A Comprehensive Look at the Empirical Performance of Equity Premium Prediction," Yale School of Management Working Papers amz2412, Yale School of Management, revised 01 Jan 2006.
  12. Lutz Kilian & Atsushi Inoue, 2004. "Bagging Time Series Models," Econometric Society 2004 North American Summer Meetings 110, Econometric Society.
  13. Nelson, Charles R & Kim, Myung J, 1993. " Predictable Stock Returns: The Role of Small Sample Bias," Journal of Finance, American Finance Association, vol. 48(2), pages 641-61, June.
  14. Pesaran, M Hashem & Timmermann, Allan, 1995. " Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-28, September.
  15. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
  16. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-86.
  17. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-38, May.
  18. Bruce E. Hansen, 1995. "Erratum: The Likelihood ratio Test Under Nonstandard Conditions: Testing the Markov Switching Model of GNP," Boston College Working Papers in Economics 296., Boston College Department of Economics.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Manuel Lukas & Eric Hillebrand, 2014. "Bagging Weak Predictors," CREATES Research Papers 2014-01, School of Economics and Management, University of Aarhus.
  2. Lutz Kilian & Robert J. Vigfusson, 2013. "Do Oil Prices Help Forecast U.S. Real GDP? The Role of Nonlinearities and Asymmetries," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 78-93, January.
  3. Marcelle Chauvet & Zeynep Senyuz & Emre Yoldas, 2013. "What does financial volatility tell us about macroeconomic fluctuations?," Finance and Economics Discussion Series 2013-61, Board of Governors of the Federal Reserve System (U.S.).
  4. Calhoun, Gray, 2014. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers 32462, Iowa State University, Department of Economics.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:fip:fedkrw:rwp09-10. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Lu Dayrit).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.