Tests of equal forecast accuracy for overlapping models
AbstractThis paper examines the asymptotic and finite-sample properties of tests of equal forecast accuracy when the models being compared are overlapping in the sense of Vuong (1989). Two models are overlapping when the true model contains just a subset of variables common to the larger sets of variables included in the competing forecasting models. We consider an out-of-sample version of the two-step testing procedure recommended by Vuong but also show that an exact one-step procedure is sometimes applicable. When the models are overlapping, we provide a simple-to-use fixed regressor wild bootstrap that can be used to conduct valid inference. Monte Carlo simulations generally support the theoretical results: the two-step procedure is conservative while the one-step procedure can be accurately sized when appropriate. We conclude with an empirical application comparing the predictive content of credit spreads to growth in real stock prices for forecasting U.S. real GDP growth.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Federal Reserve Bank of Cleveland in its series Working Paper with number 1121.
Date of creation: 2011
Date of revision:
Other versions of this item:
- Todd E. Clark & Michael W. McCracken, 2011. "Tests of equal forecast accuracy for overlapping models," Working Papers 2011-024, Federal Reserve Bank of St. Louis.
- NEP-ALL-2011-10-09 (All new papers)
- NEP-CBA-2011-10-09 (Central Banking)
- NEP-ECM-2011-10-09 (Econometrics)
- NEP-ETS-2011-10-09 (Econometric Time Series)
- NEP-FOR-2011-10-09 (Forecasting)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Todd E. Clark & Michael W. McCracken, 1999.
"Tests of equal forecast accuracy and encompassing for nested models,"
Research Working Paper
99-11, Federal Reserve Bank of Kansas City.
- Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
- Todd E. Clark & Michael W. McCracken, 2000. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Econometric Society World Congress 2000 Contributed Papers 0319, Econometric Society.
- Todd E. Clark & Michael McCracken, 1999. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Computing in Economics and Finance 1999 1241, Society for Computational Economics.
- Antonio Mele, 2009.
"Financial Volatility and Economic Activity,"
FMG Discussion Papers
dp642, Financial Markets Group.
- Fornari Fabio & Mele Antonio, 2013. "Financial Volatility and Economic Activity," Journal of Financial Management, Markets and Institutions, Società editrice il Mulino, issue 2, pages 155-198, December.
- Jon Faust & John H. Rogers & Jonathan H. Wright, 2000.
"News and noise in G-7 GDP announcements,"
International Finance Discussion Papers
690, Board of Governors of the Federal Reserve System (U.S.).
- Naes, Randi & Skjeltorp, Johannes & Odegaard, Bernt Arne, 2008.
"Liquidity and the Business Cycle,"
UiS Working Papers in Economics and Finance
2009/1, University of Stavanger.
- Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-33, March.
- Wright, Jonathan H. & Zhou, Hao, 2009. "Bond risk premia and realized jump risk," Journal of Banking & Finance, Elsevier, vol. 33(12), pages 2333-2345, December.
- Hansen, Bruce E., 1992. "Convergence to Stochastic Integrals for Dependent Heterogeneous Processes," Econometric Theory, Cambridge University Press, vol. 8(04), pages 489-500, December.
- repec:att:wimass:9417 is not listed on IDEAS
- Kenneth D. West, 1994.
"Asymptotic Inference About Predictive Ability,"
- Raffaella Giacomini & Halbert White, 2003.
"Tests of Conditional Predictive Ability,"
- Raffaella Giacomini & Halbert White, 2003. "Tests of conditional predictive ability," Boston College Working Papers in Economics 572, Boston College Department of Economics.
- Giacomini, Raffaella & White, Halbert, 2003. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series qt5jk0j5jh, Department of Economics, UC San Diego.
- Robert Rich & Jason Bram & Andrew Haughwout & James Orr & Rae Rosen & Rebecca Sela, 2005. "Using Regional Economic Indexes to Forecast Tax Bases: Evidence from New York," The Review of Economics and Statistics, MIT Press, vol. 87(4), pages 627-634, November.
- Corradi, Valentina & Swanson, Norman R. & Olivetti, Claudia, 2001. "Predictive ability with cointegrated variables," Journal of Econometrics, Elsevier, vol. 104(2), pages 315-358, September.
- Todd Clark & Michael McCracken, 2005. "Evaluating Direct Multistep Forecasts," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 369-404.
- Diebold, Francis X & Mariano, Roberto S, 2002.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 20(1), pages 134-44, January.
- Wegener, Christian & von Nitzsch, Rüdiger & Cengiz, Cetin, 2010. "An advanced perspective on the predictability in hedge fund returns," Journal of Banking & Finance, Elsevier, vol. 34(11), pages 2694-2708, November.
- McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
- Brent Meyer & Saeed Zaman, 2013. "It’s not just for inflation: The usefulness of the median CPI in BVAR forecasting," Working Paper 1303, Federal Reserve Bank of Cleveland.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Lee Faulhaber).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.