Ranking of VaR and ES Models: Performance in Developed and Emerging Markets
There is an inherent problem with comparing and ranking competing Value at Risk (VaR) and Expected shortfall (ES) models since we are measuring only a single realization of the underlying data generation process. The question is whether there is any significant statistical difference in the performance of different models. It all comes down to whether something that we subjectively perceive as different is actually statistically different. We introduce a new methodology for ranking the performance of VaR and ES models based on a nonparametric test. The relative performance of models is analysed using returns for sixteen stock market indices (eight each from developed and emerging markets) prior to and during the global financial crisis. Results show that for a large number of models there is no statistically significant difference. The top performers are conditional extreme value GARCH model and models based on volatility updating. ES results are similar to VaR results with the models being even more closely matched. The same models that were the top performers in VaR comparison also perform significantly better in ES estimation.
Volume (Year): 63 (2013)
Issue (Month): 4 (August)
|Contact details of provider:|| Postal: |
Phone: +420 2 222112330
Fax: +420 2 22112304
Web page: http://ies.fsv.cuni.cz/Email:
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-59, April.
- David Harvey & Paul Newbold, 2000. "Tests for multiple forecast encompassing," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 471-482.
- Song Xi Chen, 2005. "Nonparametric Inference of Value-at-Risk for Dependent Financial Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 3(2), pages 227-255.
- Clark, Todd E. & McCracken, Michael W., 2001.
"Tests of equal forecast accuracy and encompassing for nested models,"
Journal of Econometrics,
Elsevier, vol. 105(1), pages 85-110, November.
- Todd E. Clark & Michael W. McCracken, 2000. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Econometric Society World Congress 2000 Contributed Papers 0319, Econometric Society.
- Todd E. Clark & Michael McCracken, 1999. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Computing in Economics and Finance 1999 1241, Society for Computational Economics.
- Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
- Kenneth D. West & Michael W. McCracken, 1998.
"Regression-Based Tests of Predictive Ability,"
NBER Technical Working Papers
0226, National Bureau of Economic Research, Inc.
- Sullivan, Ryan & Timmermann, Allan & White, Halbert, 2003.
"Forecast evaluation with shared data sets,"
International Journal of Forecasting,
Elsevier, vol. 19(2), pages 217-227.
- Imre Kondor & Istvan Varga-Haszonits, 2008. "Feasibility of Portfolio Optimization under Coherent Risk Measures," Papers 0803.2283, arXiv.org, revised Apr 2008.
- Diebold, Francis X & Mariano, Roberto S, 1995.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 13(3), pages 253-63, July.
- Tom Doan, . "DMARIANO: RATS procedure to compute Diebold-Mariano Forecast Comparison Test," Statistical Software Components RTS00055, Boston College Department of Economics.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Gencay, Ramazan & Selcuk, Faruk, 2004. "Extreme value theory and Value-at-Risk: Relative performance in emerging markets," International Journal of Forecasting, Elsevier, vol. 20(2), pages 287-303.
- repec:att:wimass:9417 is not listed on IDEAS
- Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
- Philippe Artzner & Freddy Delbaen & Jean-Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228.
- Inui, Koji & Kijima, Masaaki, 2005. "On the significance of expected shortfall as a coherent risk measure," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 853-864, April.
- McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
- West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
- Zikovic, Sasa & Aktan, Bora, 2011. "Decay factor optimisation in time weighted simulation -- Evaluating VaR performance," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1147-1159, October.
- West, Kenneth D, 1996.
"Asymptotic Inference about Predictive Ability,"
Econometric Society, vol. 64(5), pages 1067-84, September.
- Song Xi Chen, 2008. "Nonparametric Estimation of Expected Shortfall," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 6(1), pages 87-107, Winter.
- Cotter, John, 2007. "Extreme risk in Asian equity markets," MPRA Paper 3536, University Library of Munich, Germany.
- Timotheos Angelidis & Stavros Degiannakis, 2007. "Backtesting VaR Models: An Expected Shortfall Approach," Working Papers 0701, University of Crete, Department of Economics.
- Gencay, Ramazan & Selcuk, Faruk & Ulugulyagci, Abdurrahman, 2003. "High volatility, thick tails and extreme value theory in value-at-risk estimation," Insurance: Mathematics and Economics, Elsevier, vol. 33(2), pages 337-356, October.
- Aktham I. Maghyereh & Haitham A. Al-Zoubi, 2006. "Value-at-risk under extreme values: the relative performance in MENA emerging stock markets," International Journal of Managerial Finance, Emerald Group Publishing, vol. 2(2), pages 154-172, July.
- John Cotter, 2004.
"Downside risk for European equity markets,"
Applied Financial Economics,
Taylor & Francis Journals, vol. 14(10), pages 707-716.
- Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
- Yamai, Yasuhiro & Yoshiba, Toshinao, 2005. "Value-at-risk versus expected shortfall: A practical perspective," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 997-1015, April.
- Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
When requesting a correction, please mention this item's handle: RePEc:fau:fauart:v:63:y:2013:i:4:p:327-359. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Lenka Herrmannova)
If references are entirely missing, you can add them using this form.