In-sample tests of predictive ability: a new approach
This paper presents analytical, Monte Carlo, and empirical evidence linking in-sample tests of predictive content and out-of-sample forecast accuracy. Our approach focuses on the negative effect that finite-sample estimation error has on forecast accuracy despite the presence of significant population-level predictive content. Specifically, we derive simple-to-use in-sample tests that test not only whether a particular variable has predictive content but also whether this content is estimated precisely enough to improve forecast accuracy. Our tests are asymptotically non-central chi-square or non-central normal. We provide a convenient bootstrap method for computing the relevant critical values. In the Monte Carlo and empirical analysis, we compare the effectiveness of our testing procedure with more common testing procedures.
|Date of creation:||2009|
|Date of revision:|
|Contact details of provider:|| Postal: P.O. Box 442, St. Louis, MO 63166|
Web page: http://www.stlouisfed.org/
More information through EDIRC
|Order Information:|| Email: |
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Bruce E. Hansen, 1995.
"Erratum: The Likelihood ratio Test Under Nonstandard Conditions: Testing the Markov Switching Model of GNP,"
Boston College Working Papers in Economics
296., Boston College Department of Economics.
- Hansen, Bruce E, 1996. "Erratum: The Likelihood Ratio Test under Nonstandard Conditions: Testing the Markov Switching Model of GNP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(2), pages 195-98, March-Apr.
- Nelson, Charles R & Kim, Myung J, 1993. " Predictable Stock Returns: The Role of Small Sample Bias," Journal of Finance, American Finance Association, vol. 48(2), pages 641-61, June.
- Silvia Goncalves & Lutz Kilian, 2007. "Asymptotic and Bootstrap Inference for AR(∞) Processes with Conditional Heteroskedasticity," Econometric Reviews, Taylor & Francis Journals, vol. 26(6), pages 609-641.
- Kirby, Chris, 1997. "Measuring the Predictable Variation in Stock and Bond Returns," Review of Financial Studies, Society for Financial Studies, vol. 10(3), pages 579-630.
- Amit Goval & Ivo Welch, 2004.
"A Comprehensive Look at the Empirical Performance of Equity Premium Prediction,"
NBER Working Papers
10483, National Bureau of Economic Research, Inc.
- Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
- Amit Goyal & Ivo Welch, 2004. "A Comprehensive Look at the Empirical Performance of Equity Premium Prediction," Yale School of Management Working Papers amz2412, Yale School of Management, revised 01 Jan 2006.
- Campbell, John & Thompson, Samuel P., 2008.
"Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?,"
2622619, Harvard University Department of Economics.
- John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
- Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
- Inoue, Atsushi & Kilian, Lutz, 2004.
"Bagging Time Series Models,"
CEPR Discussion Papers
4333, C.E.P.R. Discussion Papers.
- Lutz Kilian & Atsushi Inoue, 2004. "Bagging Time Series Models," Econometric Society 2004 North American Summer Meetings 110, Econometric Society.
- Torous, Walter & Valkanov, Rossen, 2000. "Boundaries of Predictability: Noisy Predictive Regressions," University of California at Los Angeles, Anderson Graduate School of Management qt33p7672z, Anderson Graduate School of Management, UCLA.
- Inoue, Atsushi & Kilian, Lutz, 2006.
"On the selection of forecasting models,"
Journal of Econometrics,
Elsevier, vol. 130(2), pages 273-306, February.
- Newey, Whitney & West, Kenneth, 2014.
"A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix,"
Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
- Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May.
- Whitney K. Newey & Kenneth D. West, 1986. "A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix," NBER Technical Working Papers 0055, National Bureau of Economic Research, Inc.
- White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-38, May.
- Clark, Todd E. & McCracken, Michael W., 2005. "The power of tests of predictive ability in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 124(1), pages 1-31, January.
- Pesaran, M Hashem & Timmermann, Allan, 1995. " Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-28, September.
- de Jong, Robert M., 1997. "Central Limit Theorems for Dependent Heterogeneous Random Variables," Econometric Theory, Cambridge University Press, vol. 13(03), pages 353-367, June.
- Hodrick, Robert J, 1992.
"Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement,"
Review of Financial Studies,
Society for Financial Studies, vol. 5(3), pages 357-86.
- Tom Doan, . "OLSHODRICK: RATS procedure to compute Hodrick standard errors," Statistical Software Components RTS00147, Boston College Department of Economics.
- Rapach, David E. & Wohar, Mark E., 2006. "In-sample vs. out-of-sample tests of stock return predictability in the context of data mining," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 231-247, March.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
When requesting a correction, please mention this item's handle: RePEc:fip:fedlwp:2009-051. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Anna Xiao)
If references are entirely missing, you can add them using this form.