A statistical test for forecast evaluation under a discrete loss function
AbstractWe propose a new approach to evaluating the usefulness of a set of forecasts, based on the use of a discrete loss function de ned on the space of data and forecasts. Exist- ing procedures for such an evaluation either do not allow for formal testing, or use tests statistics based just on the frequency distribution of (data , forecasts)-pairs. They can easily lead to misleading conclusions in some reasonable situations, because of the way they formalize the underlying null hypothesis that the set of forecasts is not useful. Even though the ambiguity of the underlying null hypothesis precludes us from per- forming a standard analysis of the size and power of the tests, we get results suggesting that the proposed DISC test performs better than its competitors.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales in its series Documentos del Instituto Complutense de Análisis Económico with number 2011-07.
Length: 17 pages
Date of creation: 2011
Date of revision:
Forecasting Evaluation; Loss Function.;
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-04-23 (All new papers)
- NEP-ECM-2011-04-23 (Econometrics)
- NEP-ETS-2011-04-23 (Econometric Time Series)
- NEP-FOR-2011-04-23 (Forecasting)
You can help add them by filling out this form.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Águeda González Abad).
If references are entirely missing, you can add them using this form.