Advanced Search
MyIDEAS: Login to save this paper or follow this series

Ranking of VaR and ES Models: Performance in Developed and Emerging Markets

Contents:

Author Info

  • Sasa Zikovic
  • Randall Filer

Abstract

An inherent problem with comparing and ranking competing Value at Risk (VaR) and Expected shortfall (ES) models is that they measure only a single realization of the underlying data generation process. The question is whether there is any significant statistical difference in the performance of different models. Is it only a matter of chance that in a particular market and in particular time period a certain model performs better than some other? It all comes down to a question whether something that we subjectively perceive as different is actually statistically different. We introduce a new methodology for ranking and comparing the performance of VaR and ES models based on a nonparametric ANOVA test. The relative performance of VaR and ES models is analysed using daily returns for sixteen stock market indices (eight each from developed and emerging markets) prior to and during the global financial crisis. Results show that for a large number of different models there is no statistically significant difference in their performance. The top performers are conditional extreme value GARCH model, models based on volatility updating and nonparametric mirrored historical simulation. ES backtesting results are similar to VaR results with the models being even more closely matched. The same models that were the top performers in VaR comparison also perform significantly better in ES estimation.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.cesifo-group.de/portal/page/portal/DocBase_Content/WP/WP-CESifo_Working_Papers/wp-cesifo-2012/wp-cesifo-2012-10/cesifo1_wp3980.pdf
Download Restriction: no

Bibliographic Info

Paper provided by CESifo Group Munich in its series CESifo Working Paper Series with number 3980.

as in new window
Length:
Date of creation: 2012
Date of revision:
Handle: RePEc:ces:ceswps:_3980

Contact details of provider:
Postal: Poschingerstrasse 5, 81679 Munich
Phone: +49 (89) 9224-0
Fax: +49 (89) 985369
Email:
Web page: http://www.cesifo.de
More information through EDIRC

Related research

Keywords: ranking; Value at Risk; Expected Shortfall; extreme value theory;

Other versions of this item:

Find related papers by JEL classification:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
  2. Gencay, Ramazan & Selcuk, Faruk, 2004. "Extreme value theory and Value-at-Risk: Relative performance in emerging markets," International Journal of Forecasting, Elsevier, vol. 20(2), pages 287-303.
  3. Timotheos Angelidis & Stavros Degiannakis, 2007. "Backtesting VaR Models: An Expected Shortfall Approach," Working Papers 0701, University of Crete, Department of Economics.
  4. Sullivan, Ryan & Timmermann, Allan & White, Halbert, 2003. "Forecast evaluation with shared data sets," International Journal of Forecasting, Elsevier, vol. 19(2), pages 217-227.
  5. Gencay, Ramazan & Selcuk, Faruk & Ulugulyagci, Abdurrahman, 2003. "High volatility, thick tails and extreme value theory in value-at-risk estimation," Insurance: Mathematics and Economics, Elsevier, vol. 33(2), pages 337-356, October.
  6. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
  7. Philippe Artzner & Freddy Delbaen & Jean-Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228.
  8. Aktham I. Maghyereh & Haitham A. Al-Zoubi, 2006. "Value-at-risk under extreme values: the relative performance in MENA emerging stock markets," International Journal of Managerial Finance, Emerald Group Publishing, vol. 2(2), pages 154-172, July.
  9. Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
  10. Cotter, John, 2007. "Extreme risk in Asian equity markets," MPRA Paper 3536, University Library of Munich, Germany.
  11. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  12. Zikovic, Sasa & Aktan, Bora, 2011. "Decay factor optimisation in time weighted simulation -- Evaluating VaR performance," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1147-1159, October.
  13. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-59, April.
  14. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
  15. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September.
  16. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  17. West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
  18. Cotter, John, 2004. "Downside Risk for European Equity Markets," MPRA Paper 3537, University Library of Munich, Germany.
  19. Song Xi Chen, 2005. "Nonparametric Inference of Value-at-Risk for Dependent Financial Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 3(2), pages 227-255.
  20. Yamai, Yasuhiro & Yoshiba, Toshinao, 2005. "Value-at-risk versus expected shortfall: A practical perspective," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 997-1015, April.
  21. Inui, Koji & Kijima, Masaaki, 2005. "On the significance of expected shortfall as a coherent risk measure," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 853-864, April.
  22. Song Xi Chen, 2008. "Nonparametric Estimation of Expected Shortfall," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 6(1), pages 87-107, Winter.
  23. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-40, November.
  24. David Harvey & Paul Newbold, 2000. "Tests for multiple forecast encompassing," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 471-482.
  25. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
Full references (including those not matched with items on IDEAS)

Citations

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_3980. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Julio Saavedra).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.