Evaluating Density Forecasts with an Application to Stock Market Returns
AbstractDensity forecasts have become quite important in economics and finance. For example, such forecasts play a central role in modern financial risk management techniques like Value at Risk. This paper suggests a regression based density forecast evaluation framework as a simple alternative to other approaches. In simulation experiments and an empirical application to in- and out-of-sample one-step-ahead density forecasts of daily returns on the S&P 500, DAX and ATX stock market indices, the regression based evaluation strategy is compared with a recently proposed methodology based on likelihood ratio tests. It is demonstrated that misspecifications of forecasting models can be detected within the proposed regression framework. It is further demonstrated that the likelihood ratio methodology without additional misspecification tests has no power in many practical situations and therefore frequently selects incorrect forecasting models. The empirical results provide some evidence that GARCH-t models provide good density forecasts. The results further suggest that extensions of statistical models with fat-tailed conditional distributions to models that incorporate higher order conditional moments beyond the conditional variance might be appropriate to capture the empirical regularities in financial time series in some cases.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Oesterreichische Nationalbank (Austrian Central Bank) in its series Working Papers with number 59.
Date of creation: 18 Feb 2002
Date of revision:
Postal: Oesterreichische Nationalbank, Economic Studies Division, c/o Beate Hofbauer-Berlakovich, POB 61, A-1011 Vienna, Austria
Find related papers by JEL classification:
- G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
This paper has been announced in the following NEP Reports:
- NEP-ALL-2002-04-15 (All new papers)
- NEP-ECM-2002-04-22 (Econometrics)
- NEP-ETS-2002-04-15 (Econometric Time Series)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
- Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, .
"Evaluating Density Forecasts,"
CARESS Working Papres
97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, 1997. "Evaluating density forecasts," Working Papers 97-6, Federal Reserve Bank of Philadelphia.
- Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, 1997. "Evaluating Density Forecasts," Center for Financial Institutions Working Papers 97-37, Wharton School Center for Financial Institutions, University of Pennsylvania.
- Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, 1997. "Evaluating Density Forecasts," NBER Technical Working Papers 0215, National Bureau of Economic Research, Inc.
- Bollerslev, Tim, 1986.
"Generalized autoregressive conditional heteroskedasticity,"
Journal of Econometrics,
Elsevier, vol. 31(3), pages 307-327, April.
- Tim Bollerslev, 1986. "Generalized autoregressive conditional heteroskedasticity," EERI Research Paper Series EERI RP 1986/01, Economics and Econometrics Research Institute (EERI), Brussels.
- Hansen, Bruce E, 1994.
"Autoregressive Conditional Density Estimation,"
International Economic Review,
Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-30, August.
- Hansen, B.E., 1992. "Autoregressive Conditional Density Estimation," RCER Working Papers 322, University of Rochester - Center for Economic Research (RCER).
- Tom Doan, . "RATS programs to replicate Hansen's GARCH models with time-varying t-densities," Statistical Software Components RTZ00086, Boston College Department of Economics.
- Francis X. Diebold & Anthony S. Tay & Kenneth F. Wallis, 1998.
"Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters,"
98-15, New York University, Leonard N. Stern School of Business, Department of Economics.
- Francis X. Diebold & Anthony S. Tay & Kenneth F. Wallis, 1997. "Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters," NBER Working Papers 6228, National Bureau of Economic Research, Inc.
- Lumsdaine, Robin L, 1996. "Consistency and Asymptotic Normality of the Quasi-maximum Likelihood Estimator in IGARCH(1,1) and Covariance Stationary GARCH(1,1) Models," Econometrica, Econometric Society, vol. 64(3), pages 575-96, May.
- Clements, M.P. & Smith J., 1998. "Evaluating The Forecast of Densities of Linear and Non-Linear Models: Applications to Output Growth and Unemployment," The Warwick Economics Research Paper Series (TWERPS) 509, University of Warwick, Department of Economics.
- Lawrence R. Glosten & Ravi Jagannathan & David E. Runkle, 1993.
"On the relation between the expected value and the volatility of the nominal excess return on stocks,"
157, Federal Reserve Bank of Minneapolis.
- Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. " On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
- repec:cup:cbooks:9780521424080 is not listed on IDEAS
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Markus Knell and Helmut Stix).
If references are entirely missing, you can add them using this form.