IDEAS home Printed from https://ideas.repec.org/a/taf/eurjfi/v11y2005i2p151-166.html
   My bibliography  Save this article

Evaluating density forecasts from models of stock market returns

Author

Listed:
  • Gabriela De Raaij
  • Burkhard Raunig

Abstract

Density forecasts have become important in finance and play a key role in modern risk management. Using a flexible density forecast evaluation framework that extends the Berkowitz likelihood ratio test this paper evaluates in- and out-of-sample density forecasts of daily returns on the DAX, ATX and S&P 500 stock market indices from models of financial returns that are currently widely used in the financial industry. The results indicate that GARCH-t models produce good in-sample forecasts. No model considered in this study delivers fully acceptable out-of-sample forecasts. The empirical findings emphasize that proper distributional assumptions combined with an adequate specification of relevant conditional higher moments are necessary to obtain good density forecasts.

Suggested Citation

  • Gabriela De Raaij & Burkhard Raunig, 2005. "Evaluating density forecasts from models of stock market returns," The European Journal of Finance, Taylor & Francis Journals, vol. 11(2), pages 151-166.
  • Handle: RePEc:taf:eurjfi:v:11:y:2005:i:2:p:151-166
    DOI: 10.1080/1351847042000255652
    as

    Download full text from publisher

    File URL: http://www.tandfonline.com/doi/abs/10.1080/1351847042000255652
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/1351847042000255652?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Clements, Michael P. & Smith, Jeremy, 1998. "Evaluating The Forecast Densities Of Linear And Non-Linear Models: Applications To Output Growth And Unemployment," Economic Research Papers 268791, University of Warwick - Department of Economics.
    2. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    3. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    4. Harvey, Campbell R. & Siddique, Akhtar, 1999. "Autoregressive Conditional Skewness," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 34(4), pages 465-487, December.
    5. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    6. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    7. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    8. Keller, Joachim G. & Craig, Ben R., 2002. "The Empirical Performance of Option Based Densities of Foreign Exchange," Discussion Paper Series 1: Economic Studies 2002,07, Deutsche Bundesbank.
    9. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    10. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, "undated". "Evaluating Density Forecasts," CARESS Working Papres 97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
    11. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
    12. Brailsford, Timothy J. & Faff, Robert W., 1996. "An evaluation of volatility forecasting techniques," Journal of Banking & Finance, Elsevier, vol. 20(3), pages 419-438, April.
    13. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    14. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
    15. Tim Bollerslev & Jeffrey M. Wooldridge, 1988. "Quasi-Maximum Likelihood Estimation of Dynamic Models with Time-Varying Covariances," Working papers 505, Massachusetts Institute of Technology (MIT), Department of Economics.
    16. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    17. repec:onb:oenbwp:y::i:60:b:1 is not listed on IDEAS
    18. Lumsdaine, Robin L, 1996. "Consistency and Asymptotic Normality of the Quasi-maximum Likelihood Estimator in IGARCH(1,1) and Covariance Stationary GARCH(1,1) Models," Econometrica, Econometric Society, vol. 64(3), pages 575-596, May.
    19. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
    20. Ben R. Craig & Joachim G. Keller, 2002. "The Empirical Performance of Option Based Densities of Foreign Exchange," Working Papers 60, Oesterreichische Nationalbank (Austrian Central Bank).
    21. Geoffrey F. Loudon & Wing H. Watt & Pradeep K. Yadav, 2000. "An empirical analysis of alternative parametric ARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 117-136.
    22. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kuang-Liang Chang, 2011. "The optimal value-at-risk hedging strategy under bivariate regime switching ARCH framework," Applied Economics, Taylor & Francis Journals, vol. 43(21), pages 2627-2640.
    2. Xiao-Ming Li & Qing Xu, 2007. "Evaluating density forecasts of the model with a conditional skewed-t distribution for China's stock markets," Applied Financial Economics, Taylor & Francis Journals, vol. 18(3), pages 213-227.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    2. Gabriela de Raaij & Burkhard Raunig, 2002. "Evaluating Density Forecasts with an Application to Stock Market Returns," Working Papers 59, Oesterreichische Nationalbank (Austrian Central Bank).
    3. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    4. M. Hashem Pesaran & Paolo Zaffaroni, 2004. "Model Averaging and Value-at-Risk Based Evaluation of Large Multi Asset Volatility Models for Risk Management," CESifo Working Paper Series 1358, CESifo.
    5. Raunig, Burkhard, 2006. "The longer-horizon predictability of German stock market volatility," International Journal of Forecasting, Elsevier, vol. 22(2), pages 363-372.
    6. Bontemps, Christian & Meddahi, Nour, 2005. "Testing normality: a GMM approach," Journal of Econometrics, Elsevier, vol. 124(1), pages 149-186, January.
    7. Pesaran, M. Hashem & Schleicher, Christoph & Zaffaroni, Paolo, 2009. "Model averaging in risk management with an application to futures markets," Journal of Empirical Finance, Elsevier, vol. 16(2), pages 280-305, March.
    8. Chen, Yi-Ting, 2012. "A simple approach to standardized-residuals-based higher-moment tests," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 427-453.
    9. González-Rivera, Gloria & Yoldas, Emre, 2012. "Autocontour-based evaluation of multivariate predictive densities," International Journal of Forecasting, Elsevier, vol. 28(2), pages 328-342.
    10. Corradi, Valentina & Swanson, Norman R., 2006. "Predictive density and conditional confidence interval accuracy tests," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 187-228.
    11. Clements, Michael P., 2006. "Internal consistency of survey respondentsíforecasts: Evidence based on the Survey of Professional Forecasters," Economic Research Papers 269742, University of Warwick - Department of Economics.
    12. Lucio Sarno, 2003. "Nonlinear Exchange Rate Models: A Selective Overview," Rivista di Politica Economica, SIPI Spa, vol. 93(4), pages 3-46, July-Augu.
    13. Markus Haas, 2004. "Mixed Normal Conditional Heteroskedasticity," Journal of Financial Econometrics, Oxford University Press, vol. 2(2), pages 211-250.
    14. Jonas Dovern & Hans Manner, 2020. "Order‐invariant tests for proper calibration of multivariate density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 440-456, June.
    15. Trino-Manuel Niguez & Javier Perote, 2004. "Forecasting the density of asset returns," STICERD - Econometrics Paper Series 479, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    16. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
    17. Corradi, Valentina & Swanson, Norman R., 2006. "Bootstrap conditional distribution tests in the presence of dynamic misspecification," Journal of Econometrics, Elsevier, vol. 133(2), pages 779-806, August.
    18. Sean D. Campbell & Francis X. Diebold, 2005. "Weather Forecasting for Weather Derivatives," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 6-16, March.
    19. Xiao-Ming Li & Qing Xu, 2007. "Evaluating density forecasts of the model with a conditional skewed-t distribution for China's stock markets," Applied Financial Economics, Taylor & Francis Journals, vol. 18(3), pages 213-227.
    20. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:eurjfi:v:11:y:2005:i:2:p:151-166. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/REJF20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.