A Smooth Test for Density Forecast Evaluation
AbstractRecently financial econometricians have shifted their attention from point and interval forecasts to density forecasts mainly to address the issue of the huge loss of information that results from depicting portfolio risk by a measure of dispersion alone. One of the major problems in this area has been the evaluation of the quality of different density forecasts. In this paper I propose an analytical test for density forecast evaluation using the Smooth Test procedure for both independent and serially dependent data. Apart from indicating the acceptance or rejection of the hypothesized model, this approach provides specific sources (such as the mean, variance, skewness and kurtosis or the location, scale and shape of the distribution or types of dependence) of departure, thereby helping in deciding possible modifications of the assumed forecast model. I also address the issue of where to split the sample into in-sample (estimation sample) and out-of-sample (testing sample) observations in order to evaluate the Ã¢â‚¬Å“goodness-of-fitÃ¢â‚¬? of the forecasting model both analytically, as well as through simulation exercises. Monte Carlo studies revealed that the proposed test has good size and power properties. I also further investigate applications to value weighted S&P 500 returns that initially indicates that introduction of a conditional heteroscedasticity model significantly improve the model over one with constant conditional variance. The simplicity of the proposed Ã¢â‚¬Å“parametricÃ¢â‚¬? test based on the classical score test should also appeal the practitioners
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Econometric Society in its series Econometric Society 2004 Australasian Meetings with number 187.
Date of creation: 11 Aug 2004
Date of revision:
Contact details of provider:
Phone: 1 212 998 3820
Fax: 1 212 995 4487
Web page: http://www.econometricsociety.org/pastmeetings.asp
More information through EDIRC
Smooth test; score test; locally most powerful unbiased test; density forecast evaluation; probability integral transform; sample selection method; t-GARCH model; simulation based method; sample split;
Find related papers by JEL classification:
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
This paper has been announced in the following NEP Reports:
- NEP-ALL-2004-10-30 (All new papers)
- NEP-ECM-2004-10-30 (Econometrics)
- NEP-ETS-2004-10-30 (Econometric Time Series)
- NEP-FIN-2004-10-30 (Finance)
You can help add them by filling out this form.
reading list or among the top items on IDEAS.Access and download statisticsgeneral information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F. Baum).
If references are entirely missing, you can add them using this form.