IDEAS home Printed from https://ideas.repec.org/p/inu/caeprp/2015001.html
   My bibliography  Save this paper

Backtesting Expected Shortfall: Accounting for Tail Risk

Author

Listed:
  • Juan Carlos Escanciano

    (Indiana University)

  • Zaichao Du

    (Southwestern University of Financeand Economics China)

Abstract

The Basel Committee on Banking Supervision (BIS) has recently sanctioned Expected Shortfall (ES) as the market risk measure to be used for banking regulatory purposes, replacing the well-known Value-at-Risk (VaR). This change is motivated by the appealing theoretical properties of ES as a measure of risk and the poor ones of VaR. In particular, VaR fails to control for tail risk. In this transition, the major challenge faced by financial institutions is the unavailability of simple tools for evaluation of ES forecasts (i.e. backtesting ES). The main purpose of this article is to propose such tools. Specifically, we propose a conditional backtest for ES based on cumulative violations, which is the natural analogue of the commonly used conditional backtest for VaR . We establish the asymptotic properties of the test, and investigate its finite sample performance through some Monte Carlo simulations. An empirical application to three major stock indexes shows that VaR is generally unresponsive to extreme events such as those experienced during the recent financial crisis, while ES provides a more accurate description of the risk involved.

Suggested Citation

  • Juan Carlos Escanciano & Zaichao Du, 2015. "Backtesting Expected Shortfall: Accounting for Tail Risk," CAEPR Working Papers 2015-001, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
  • Handle: RePEc:inu:caeprp:2015001
    as

    Download full text from publisher

    File URL: https://caepr.indiana.edu/RePEc/inu/caeprp/caepr2015-001.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Escanciano, Juan Carlos & Pei, Pei, 2012. "Pitfalls in backtesting Historical Simulation VaR models," Journal of Banking & Finance, Elsevier, vol. 36(8), pages 2233-2244.
    2. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    3. Yongmiao Hong, 2005. "Nonparametric Specification Testing for Continuous-Time Models with Applications to Term Structure of Interest Rates," The Review of Financial Studies, Society for Financial Studies, vol. 18(1), pages 37-84.
    4. Yamai, Yasuhiro & Yoshiba, Toshinao, 2005. "Value-at-risk versus expected shortfall: A practical perspective," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 997-1015, April.
    5. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    6. Basak, Suleyman & Shapiro, Alexander, 2001. "Value-at-Risk-Based Risk Management: Optimal Policies and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 14(2), pages 371-405.
    7. Acerbi, Carlo & Tasche, Dirk, 2002. "On the coherence of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1487-1503, July.
    8. Yamai, Yasuhiro & Yoshiba, Toshinao, 2002. "Comparative Analyses of Expected Shortfall and Value-at-Risk (3): Their Validity under Market Stress," Monetary and Economic Studies, Institute for Monetary and Economic Studies, Bank of Japan, vol. 20(3), pages 181-237, October.
    9. Escanciano, J. Carlos & Olmo, Jose, 2010. "Backtesting Parametric Value-at-Risk With Estimation Risk," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(1), pages 36-51.
    10. Escanciano, J. Carlos, 2007. "Weak convergence of non-stationary multivariate marked processes with applications to martingale testing," Journal of Multivariate Analysis, Elsevier, vol. 98(7), pages 1321-1336, August.
    11. Susanne Emmer & Marie Kratz & Dirk Tasche, 2013. "What is the best risk measure in practice? A comparison of standard measures," Papers 1312.1645, arXiv.org, revised Apr 2015.
    12. Yamai, Yasuhiro & Yoshiba, Toshinao, 2002. "Comparative Analyses of Expected Shortfall and Value-at-Risk: Their Estimation Error, Decomposition, and Optimization," Monetary and Economic Studies, Institute for Monetary and Economic Studies, Bank of Japan, vol. 20(1), pages 87-121, January.
    13. Wong, Woon K., 2010. "Backtesting value-at-risk based on tail losses," Journal of Empirical Finance, Elsevier, vol. 17(3), pages 526-538, June.
    14. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    15. L. Kourouma & Denis Dupré & G. Sanfilippo & O. Taramasco, 2011. "Extreme Value at Risk and Expected Shortfall during Financial Crisis," Post-Print halshs-00658495, HAL.
    16. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
    17. L. Kourouma & Denis Dupré & O. Taramasco & G. Sanfilippo, 2011. "Extreme Value at Risk and Expected Shortfall during Financial Crisis," Post-Print halshs-00650913, HAL.
    18. Kerkhof, Jeroen & Melenberg, Bertrand, 2004. "Backtesting for risk-based regulatory capital," Journal of Banking & Finance, Elsevier, vol. 28(8), pages 1845-1865, August.
    19. Wong, Woon K., 2008. "Backtesting trading risk of commercial banks using expected shortfall," Journal of Banking & Finance, Elsevier, vol. 32(7), pages 1404-1415, July.
    20. Escanciano, Juan Carlos & Pei, Pei, 2012. "Pitfalls in backtesting Historical Simulation VaR models," Journal of Banking & Finance, Elsevier, vol. 36(8), pages 2233-2244.
    21. Jushan Bai, 2003. "Testing Parametric Conditional Distributions of Dynamic Models," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 531-549, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fontanari, Andrea & Cirillo, Pasquale & Oosterlee, Cornelis W., 2018. "From Concentration Profiles to Concentration Maps. New tools for the study of loss distributions," Insurance: Mathematics and Economics, Elsevier, vol. 78(C), pages 13-29.
    2. Fortin, Alain-Philippe & Simonato, Jean-Guy & Dionne, Georges, 2023. "Forecasting expected shortfall: Should we use a multivariate model for stock market factors?," International Journal of Forecasting, Elsevier, vol. 39(1), pages 314-331.
    3. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    4. Nick Costanzino & Michael Curran, 2018. "A Simple Traffic Light Approach to Backtesting Expected Shortfall," Risks, MDPI, vol. 6(1), pages 1-7, January.
    5. An Chen & Mitja Stadje & Fangyuan Zhang, 2020. "On the equivalence between Value-at-Risk- and Expected Shortfall-based risk measures in non-concave optimization," Papers 2002.02229, arXiv.org, revised Jun 2022.
    6. Patton, Andrew J. & Ziegel, Johanna F. & Chen, Rui, 2019. "Dynamic semiparametric models for expected shortfall (and Value-at-Risk)," Journal of Econometrics, Elsevier, vol. 211(2), pages 388-413.
    7. Ophélie Couperier & Jérémy Leymarie, 2020. "Backtesting Expected Shortfall via Multi-Quantile Regression," Working Papers halshs-01909375, HAL.
    8. Kratz, Marie & Lok, Yen H. & McNeil, Alexander J., 2018. "Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall," Journal of Banking & Finance, Elsevier, vol. 88(C), pages 393-407.
    9. Aleš Kresta & Tomáš Tichý & Mehdi Toloo, 2017. "Posouzení modelů odhadu tržního rizika s využitím DEA přístupu [Examination of Market Risk Estimation Models via DEA Approach Modelling]," Politická ekonomie, Prague University of Economics and Business, vol. 2017(2), pages 161-178.
    10. Hamed Tabasi & Vahidreza Yousefi & Jolanta Tamošaitienė & Foroogh Ghasemi, 2019. "Estimating Conditional Value at Risk in the Tehran Stock Exchange Based on the Extreme Value Theory Using GARCH Models," Administrative Sciences, MDPI, vol. 9(2), pages 1-17, May.
    11. Richard Gerlach & Declan Walpole & Chao Wang, 2017. "Semi-parametric Bayesian tail risk forecasting incorporating realized measures of volatility," Quantitative Finance, Taylor & Francis Journals, vol. 17(2), pages 199-215, February.
    12. James Ming Chen, 2018. "On Exactitude in Financial Regulation: Value-at-Risk, Expected Shortfall, and Expectiles," Risks, MDPI, vol. 6(2), pages 1-28, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zaichao Du & Juan Carlos Escanciano, 2017. "Backtesting Expected Shortfall: Accounting for Tail Risk," Management Science, INFORMS, vol. 63(4), pages 940-958, April.
    2. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    3. Alfonso Novales & Laura Garcia-Jorcano, 2019. "Backtesting Extreme Value Theory models of expected shortfall," Documentos de Trabajo del ICAE 2019-24, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico.
    4. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    5. James Ming Chen, 2018. "On Exactitude in Financial Regulation: Value-at-Risk, Expected Shortfall, and Expectiles," Risks, MDPI, vol. 6(2), pages 1-28, June.
    6. Sander Barendse & Erik Kole & Dick van Dijk, 2023. "Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error," Journal of Financial Econometrics, Oxford University Press, vol. 21(2), pages 528-568.
    7. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    8. Benjamin R. Auer & Benjamin Mögel, 2016. "How Accurate are Modern Value-at-Risk Estimators Derived from Extreme Value Theory?," CESifo Working Paper Series 6288, CESifo.
    9. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    10. Radu Tunaru, 2015. "Model Risk in Financial Markets:From Financial Engineering to Risk Management," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 9524.
    11. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    12. Jean-Paul Laurent & Hassan Omidi Firouzi, 2022. "Market Risk and Volatility Weighted Historical Simulation After Basel III," Working Papers hal-03679434, HAL.
    13. James M. O'Brien & Pawel J. Szerszen, 2014. "An Evaluation of Bank VaR Measures for Market Risk During and Before the Financial Crisis," Finance and Economics Discussion Series 2014-21, Board of Governors of the Federal Reserve System (U.S.).
    14. Marie Kratz & Yen H Lok & Alexander J Mcneil, 2016. "Multinomial var backtests: A simple implicit approach to backtesting expected shortfall," Working Papers hal-01424279, HAL.
    15. O’Brien, James & Szerszeń, Paweł J., 2017. "An evaluation of bank measures for market risk before, during and after the financial crisis," Journal of Banking & Finance, Elsevier, vol. 80(C), pages 215-234.
    16. Chang, Chia-Lin & Jimenez-Martin, Juan-Angel & Maasoumi, Esfandiar & McAleer, Michael & Pérez-Amaral, Teodosio, 2019. "Choosing expected shortfall over VaR in Basel III using stochastic dominance," International Review of Economics & Finance, Elsevier, vol. 60(C), pages 95-113.
    17. Chen, Qian & Gerlach, Richard & Lu, Zudi, 2012. "Bayesian Value-at-Risk and expected shortfall forecasting via the asymmetric Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3498-3516.
    18. Argyropoulos, Christos & Panopoulou, Ekaterini, 2019. "Backtesting VaR and ES under the magnifying glass," International Review of Financial Analysis, Elsevier, vol. 64(C), pages 22-37.
    19. Ziggel, Daniel & Berens, Tobias & Weiß, Gregor N.F. & Wied, Dominik, 2014. "A new set of improved Value-at-Risk backtests," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 29-41.
    20. Kratz, Marie & Lok, Y-H & McNeil, Alexander J., 2016. "Multinomial VaR Backtests: A simple implicit approach to backtesting expected shortfall," ESSEC Working Papers WP1617, ESSEC Research Center, ESSEC Business School.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inu:caeprp:2015001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Center for Applied Economics and Policy Research (email available below). General contact details of provider: https://edirc.repec.org/data/caeprus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.