Smooth Test Of Density Forecast Evaluation With Independent And Serially Dependent Data
AbstractRecently financial econometricians have shifted their attention from point and interval forecasts to density forecasts mainly to address the issue of the huge loss of information that results from depicting portfolio risk by a measure of dispersion alone. One of the major problems in this area has been the evaluation of the quality of different density forecasts. In this paper, we propose an analytical test for density forecast evaluation using Neyman (1937) smooth test procedure for both independent and serially dependent data. Apart from indicating the acceptance or rejection of the hypothesized model, this approach provides specific sources (such as the mean, variance, skewness and kurtosis or the location, scale and shape of the distribution or types of dependence) of departure, thereby helping in deciding possible modifications of the assumed forecast model. We also address the issue of where to split the sample into in-sample (estimation sample) and out-of-sample (testing sample) observations in order to evaluate the â€œgoodness-of-fitâ€ of the forecasting model both analytically, as well as through simulation exercises. Monte Carlo studies revealed that the proposed test has good size and power properties; finite sample properties of this test favorably compare with existing Goodness-of-Fit tests in statistics literature. We further investigate applications to value weighted S&P 500 returns that initially indicates that introduction of a conditional heteroscedasticity model significantly improve the model over one with constant conditional variance. The simplicity of the proposed test based on the classical score test will particularly appealling because it not only tests the assumed model but also directs to a better model if the assumed one is not valid.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Econometric Society in its series Econometric Society 2004 North American Summer Meetings with number 319.
Date of creation: 11 Aug 2004
Date of revision:
Contact details of provider:
Phone: 1 212 998 3820
Fax: 1 212 995 4487
Web page: http://www.econometricsociety.org/pastmeetings.asp
More information through EDIRC
Score Test; Density Forecast Evaluation; Probability Integral Transform; Goodness-of-Fit test; Serially Dependent Data; Simulation methods;
Find related papers by JEL classification:
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
This paper has been announced in the following NEP Reports:
You can help add them by filling out this form.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christopher F. Baum).
If references are entirely missing, you can add them using this form.