IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1709.01337.html
   My bibliography  Save this paper

Backtesting Expected Shortfall: a simple recipe?

Author

Listed:
  • Felix Moldenhauer
  • Marcin Pitera

Abstract

We propose a new backtesting framework for Expected Shortfall that could be used by the regulator. Instead of looking at the estimated capital reserve and the realised cash-flow separately, one could bind them into the secured position, for which risk measurement is much easier. Using this simple concept combined with monotonicity of Expected Shortfall with respect to its target confidence level we introduce a natural and efficient backtesting framework. Our test statistics is given by the biggest number of worst realisations for the secured position that add up to a negative total. Surprisingly, this simple quantity could be used to construct an efficient backtesting framework for unconditional coverage of Expected Shortfall in a natural extension of the regulatory traffic-light approach for Value-at-Risk. While being easy to calculate, the test statistic is based on the underlying duality between coherent risk measures and scale-invariant performance measures.

Suggested Citation

  • Felix Moldenhauer & Marcin Pitera, 2017. "Backtesting Expected Shortfall: a simple recipe?," Papers 1709.01337, arXiv.org, revised Aug 2018.
  • Handle: RePEc:arx:papers:1709.01337
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1709.01337
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wong, Woon K., 2008. "Backtesting trading risk of commercial banks using expected shortfall," Journal of Banking & Finance, Elsevier, vol. 32(7), pages 1404-1415, July.
    2. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    3. Tobias Fissler & Johanna F. Ziegel & Tilmann Gneiting, 2015. "Expected Shortfall is jointly elicitable with Value at Risk - Implications for backtesting," Papers 1507.00244, arXiv.org, revised Jul 2015.
    4. Susanne Emmer & Marie Kratz & Dirk Tasche, 2013. "What is the best risk measure in practice? A comparison of standard measures," Papers 1312.1645, arXiv.org, revised Apr 2015.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    2. Ophélie Couperier & Jérémy Leymarie, 2020. "Backtesting Expected Shortfall via Multi-Quantile Regression," Working Papers halshs-01909375, HAL.
    3. Jiménez, Inés & Mora-Valencia, Andrés & Perote, Javier, 2022. "Semi-nonparametric risk assessment with cryptocurrencies," Research in International Business and Finance, Elsevier, vol. 59(C).
    4. Alfonso Novales & Laura Garcia-Jorcano, 2019. "Backtesting Extreme Value Theory models of expected shortfall," Documentos de Trabajo del ICAE 2019-24, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico.
    5. Chang, Chia-Lin & Jimenez-Martin, Juan-Angel & Maasoumi, Esfandiar & McAleer, Michael & Pérez-Amaral, Teodosio, 2019. "Choosing expected shortfall over VaR in Basel III using stochastic dominance," International Review of Economics & Finance, Elsevier, vol. 60(C), pages 95-113.
    6. Sander Barendse & Erik Kole & Dick van Dijk, 2023. "Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error," Journal of Financial Econometrics, Oxford University Press, vol. 21(2), pages 528-568.
    7. Sebastian Bayer & Timo Dimitriadis, 2018. "Regression Based Expected Shortfall Backtesting," Papers 1801.04112, arXiv.org, revised Sep 2019.
    8. Juan Carlos Escanciano & Zaichao Du, 2015. "Backtesting Expected Shortfall: Accounting for Tail Risk," CAEPR Working Papers 2015-001, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    9. Julia S. Mehlitz & Benjamin R. Auer, 2021. "Time‐varying dynamics of expected shortfall in commodity futures markets," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(6), pages 895-925, June.
    10. Natalia Nolde & Johanna F. Ziegel, 2016. "Elicitability and backtesting: Perspectives for banking regulation," Papers 1608.05498, arXiv.org, revised Feb 2017.
    11. Dingshi Tian & Zongwu Cai & Ying Fang, 2018. "Econometric Modeling of Risk Measures: A Selective Review of the Recent Literature," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201807, University of Kansas, Department of Economics, revised Oct 2018.
    12. Sobreira, Nuno & Louro, Rui, 2020. "Evaluation of volatility models for forecasting Value-at-Risk and Expected Shortfall in the Portuguese stock market," Finance Research Letters, Elsevier, vol. 32(C).
    13. Peña, Juan Ignacio & Rodríguez, Rosa & Mayoral, Silvia, 2020. "Tail risk of electricity futures," Energy Economics, Elsevier, vol. 91(C).
    14. Pitera, Marcin & Schmidt, Thorsten, 2018. "Unbiased estimation of risk," Journal of Banking & Finance, Elsevier, vol. 91(C), pages 133-145.
    15. Weronika Ormaniec & Marcin Pitera & Sajad Safarveisi & Thorsten Schmidt, 2022. "Estimating value at risk: LSTM vs. GARCH," Papers 2207.10539, arXiv.org.
    16. Steven Kou & Xianhua Peng, 2016. "On the Measurement of Economic Tail Risk," Operations Research, INFORMS, vol. 64(5), pages 1056-1072, October.
    17. Ning Zhang & Yujing Gong & Xiaohan Xue, 2023. "Less disagreement, better forecasts: Adjusted risk measures in the energy futures market," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 43(10), pages 1332-1372, October.
    18. Abdul-Aziz Ibn Musah & Jianguo Du & Hira Salah Ud din Khan & Alhassan Alolo Abdul-Rasheed Akeji, 2018. "The Asymptotic Decision Scenarios of an Emerging Stock Exchange Market: Extreme Value Theory and Artificial Neural Network," Risks, MDPI, vol. 6(4), pages 1-24, November.
    19. repec:dau:papers:123456789/15232 is not listed on IDEAS
    20. Richard Gerlach & Declan Walpole & Chao Wang, 2017. "Semi-parametric Bayesian tail risk forecasting incorporating realized measures of volatility," Quantitative Finance, Taylor & Francis Journals, vol. 17(2), pages 199-215, February.
    21. Juan Ignacio Pe~na & Rosa Rodriguez & Silvia Mayoral, 2022. "Tail Risk of Electricity Futures," Papers 2202.01732, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1709.01337. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.