IDEAS home Printed from https://ideas.repec.org/p/onb/oenbwp/59.html
   My bibliography  Save this paper

Evaluating Density Forecasts with an Application to Stock Market Returns

Author

Abstract

Density forecasts have become quite important in economics and finance. For example, such forecasts play a central role in modern financial risk management techniques like Value at Risk. This paper suggests a regression based density forecast evaluation framework as a simple alternative to other approaches. In simulation experiments and an empirical application to in- and out-of-sample one-step-ahead density forecasts of daily returns on the S&P 500, DAX and ATX stock market indices, the regression based evaluation strategy is compared with a recently proposed methodology based on likelihood ratio tests. It is demonstrated that misspecifications of forecasting models can be detected within the proposed regression framework. It is further demonstrated that the likelihood ratio methodology without additional misspecification tests has no power in many practical situations and therefore frequently selects incorrect forecasting models. The empirical results provide some evidence that GARCH-t models provide good density forecasts. The results further suggest that extensions of statistical models with fat-tailed conditional distributions to models that incorporate higher order conditional moments beyond the conditional variance might be appropriate to capture the empirical regularities in financial time series in some cases.

Suggested Citation

  • Gabriela de Raaij & Burkhard Raunig, 2002. "Evaluating Density Forecasts with an Application to Stock Market Returns," Working Papers 59, Oesterreichische Nationalbank (Austrian Central Bank).
  • Handle: RePEc:onb:oenbwp:59
    as

    Download full text from publisher

    File URL: https://www.oenb.at/dam/jcr:a937b701-6e68-403e-944f-43e08c759957/wp59_tcm16-6147.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. M. Boldt-Christmas & S. F. Jacobsen & A. Tschoegl, 2001. "The International Expansion of the Norwegian Banks," Business History, Taylor & Francis Journals, pages 79-104.
    2. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
    3. Clements, M.P. & Smith J., 1998. "Evaluating The Forecast of Densities of Linear and Non-Linear Models: Applications to Output Growth and Unemployment," The Warwick Economics Research Paper Series (TWERPS) 509, University of Warwick, Department of Economics.
    4. Spanos,Aris, 1999. "Probability Theory and Statistical Inference," Cambridge Books, Cambridge University Press, number 9780521424080, December.
    5. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, "undated". "Evaluating Density Forecasts," CARESS Working Papres 97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
    6. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, pages 307-327.
    7. Francis X. Diebold & Anthony S. Tay & Kenneth F. Wallis, 1997. "Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters," NBER Working Papers 6228, National Bureau of Economic Research, Inc.
    8. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. " On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    9. Lumsdaine, Robin L, 1996. "Consistency and Asymptotic Normality of the Quasi-maximum Likelihood Estimator in IGARCH(1,1) and Covariance Stationary GARCH(1,1) Models," Econometrica, Econometric Society, vol. 64(3), pages 575-596, May.
    10. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, pages 661-673.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    Density forecasting; Forecast evaluation; Risk management; GARCH-models;

    JEL classification:

    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:onb:oenbwp:59. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Markus Knell and Helmut Stix). General contact details of provider: http://edirc.repec.org/data/oenbbat.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.