In-sample tests of predictive ability: a new approach
This paper presents analytical, Monte Carlo, and empirical evidence linking in-sample tests of predictive content and out-of-sample forecast accuracy. Our approach focuses on the negative effect that finite-sample estimation error has on forecast accuracy despite the presence of significant population-level predictive content. Specifically, we derive simple-to-use in-sample tests that test not only whether a particular variable has predictive content but also whether this content is estimated precisely enough to improve forecast accuracy. Our tests are asymptotically non-central chi-square or non-central normal. We provide a convenient bootstrap method for computing the relevant critical values. In the Monte Carlo and empirical analysis, we compare the effectiveness of our testing procedure with more common testing procedures.
|Date of creation:||2009|
|Contact details of provider:|| Postal: 1 Memorial Drive, Kansas City, MO 64198-0001|
Phone: (816) 881-2254
Web page: http://www.kansascityfed.org/
More information through EDIRC
|Order Information:|| Email: |
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
- Kirby, Chris, 1997. "Measuring the Predictable Variation in Stock and Bond Returns," Review of Financial Studies, Society for Financial Studies, vol. 10(3), pages 579-630.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
- Inoue, Atsushi & Kilian, Lutz, 2003.
"On the selection of forecasting models,"
Working Paper Series
0214, European Central Bank.
- John Y. Campbell & Samuel B. Thompson, 2008.
"Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?,"
Review of Financial Studies,
Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
- Campbell, John & Thompson, Samuel P., 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Scholarly Articles 2622619, Harvard University Department of Economics.
- Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
- Newey, Whitney K & West, Kenneth D, 1987.
"A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix,"
Econometric Society, vol. 55(3), pages 703-708, May.
- Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
- Whitney K. Newey & Kenneth D. West, 1986. "A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix," NBER Technical Working Papers 0055, National Bureau of Economic Research, Inc.
- Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
- Bruce E. Hansen, 1995.
"Erratum: The Likelihood ratio Test Under Nonstandard Conditions: Testing the Markov Switching Model of GNP,"
Boston College Working Papers in Economics
296., Boston College Department of Economics.
- Hansen, Bruce E, 1996. "Erratum: The Likelihood Ratio Test under Nonstandard Conditions: Testing the Markov Switching Model of GNP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(2), pages 195-198, March-Apr.
- Inoue, Atsushi & Kilian, Lutz, 2004.
"Bagging Time Series Models,"
CEPR Discussion Papers
4333, C.E.P.R. Discussion Papers.
- Lutz Kilian & Atsushi Inoue, 2004. "Bagging Time Series Models," Econometric Society 2004 North American Summer Meetings 110, Econometric Society.
- Nelson, Charles R & Kim, Myung J, 1993. " Predictable Stock Returns: The Role of Small Sample Bias," Journal of Finance, American Finance Association, vol. 48(2), pages 641-661, June.
- Hodrick, Robert J, 1992.
"Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement,"
Review of Financial Studies,
Society for Financial Studies, vol. 5(3), pages 357-386.
- Tom Doan, "undated". "OLSHODRICK: RATS procedure to compute Hodrick standard errors," Statistical Software Components RTS00147, Boston College Department of Economics.
- Torous, Walter & Valkanov, Rossen, 2000. "Boundaries of Predictability: Noisy Predictive Regressions," University of California at Los Angeles, Anderson Graduate School of Management qt33p7672z, Anderson Graduate School of Management, UCLA.
- Amit Goval & Ivo Welch, 2004.
"A Comprehensive Look at the Empirical Performance of Equity Premium Prediction,"
NBER Working Papers
10483, National Bureau of Economic Research, Inc.
- Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
- Amit Goyal & Ivo Welch, 2004. "A Comprehensive Look at the Empirical Performance of Equity Premium Prediction," Yale School of Management Working Papers amz2412, Yale School of Management, revised 01 Jan 2006.
- Pesaran, M Hashem & Timmermann, Allan, 1995. " Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
- de Jong, Robert M., 1997. "Central Limit Theorems for Dependent Heterogeneous Random Variables," Econometric Theory, Cambridge University Press, vol. 13(03), pages 353-367, June.
- Silvia Goncalves & Lutz Kilian, 2007. "Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity," Econometric Reviews, Taylor & Francis Journals, vol. 26(6), pages 609-641.
- Rapach, David E. & Wohar, Mark E., 2006. "In-sample vs. out-of-sample tests of stock return predictability in the context of data mining," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 231-247, March.
When requesting a correction, please mention this item's handle: RePEc:fip:fedkrw:rwp09-10. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Lu Dayrit)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.