In-sample tests of predictive ability: a new approach
Abstract
This paper presents analytical, Monte Carlo, and empirical evidence linking in-sample tests of predictive content and out-of-sample forecast accuracy. Our approach focuses on the negative effect that finite-sample estimation error has on forecast accuracy despite the presence of significant population-level predictive content. Specifically, we derive simple-to-use in-sample tests that test not only whether a particular variable has predictive content but also whether this content is estimated precisely enough to improve forecast accuracy. Our tests are asymptotically non-central chi-square or non-central normal. We provide a convenient bootstrap method for computing the relevant critical values. In the Monte Carlo and empirical analysis, we compare the effectiveness of our testing procedure with more common testing procedures.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Federal Reserve Bank of St. Louis in its series Working Papers with number 2009-051.Length:
Date of creation: 2009
Date of revision:
Handle: RePEc:fip:fedlwp:2009-051
Contact details of provider:
Postal: P.O. Box 442, St. Louis, MO 63166
Fax: (314)444-8753
Web page: http://www.stlouisfed.org/
More information through EDIRC
Order Information:
Email:
Related research
Keywords: Economic forecasting;Other versions of this item:
- Todd E. Clark & Michael W. McCracken, 2009. "In-sample tests of predictive ability: a new approach," Research Working Paper RWP 09-10, Federal Reserve Bank of Kansas City.
- NEP-ALL-2009-10-31 (All new papers)
- NEP-CBA-2009-10-31 (Central Banking)
- NEP-ECM-2009-10-31 (Econometrics)
- NEP-FOR-2009-10-31 (Forecasting)
References
No references listed on IDEASYou can help add them by filling out this form.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Calhoun, Gray, 2012. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers 32462, Iowa State University, Department of Economics.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:fip:fedlwp:2009-051For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Diane Rosenberger).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

