IDEAS home Printed from https://ideas.repec.org/p/ucm/doicae/1924.html
   My bibliography  Save this paper

Backtesting Extreme Value Theory models of expected shortfall

Author

Listed:
  • Alfonso Novales

    (Instituto Complutense de Análisis Económico (ICAE), and Department of Economic Analysis, Facultad de Ciencias Económicas y Empresariales, Universidad Complutense, 28223 Madrid, Spain.)

  • Laura Garcia-Jorcano

    (Department of Economic Analysis and Finance (Area of Financial Economics), Facultad de Ciencias Jurídicas y Sociales Universidad de Castilla-La Mancha, Toledo, Spain.)

Abstract

We use stock market data to analyze the quality of alternative models and procedures for fore- casting expected shortfall (ES) at different significance levels. We compute ES forecasts from conditional models applied to the full distribution of returns as well as from models that focus on tail events using extreme value theory (EVT). We also apply the semiparametric filtered historical simulation (FHS) approach to ES forecasting to obtain 10-day ES forecasts. At the 10-day hori- zon we also combine FHS with EVT. The performance of the different models is assessed using six different ES backtests recently proposed in the literature. Our results suggest that conditional EVT-based models produce more accurate 1-day and 10-day ES forecasts than do non-EVT based models. Under either approach, asymmetric probability distributions for return innovations tend to produce better forecasts. Incorporating EVT in parametric or semiparametric approaches also improves ES forecasting performance. These qualitative results are also valid for the recent crisis period, even though all models then underestimate the level of risk. FHS narrows the range of numerical forecasts obtained from alternative models, thereby reducing model risk. Combining EVT and FHS seems to be best approach for obtaining accurate ES forecasts.

Suggested Citation

  • Alfonso Novales & Laura Garcia-Jorcano, 2019. "Backtesting Extreme Value Theory models of expected shortfall," Documentos de Trabajo del ICAE 2019-24, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico.
  • Handle: RePEc:ucm:doicae:1924
    as

    Download full text from publisher

    File URL: https://eprints.ucm.es/id/eprint/57130/1/1924.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Herrera, Rodrigo, 2013. "Energy risk management through self-exciting marked point process," Energy Economics, Elsevier, vol. 38(C), pages 64-76.
    2. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    3. Esther Ruiz & Lorenzo Pascual, 2002. "Bootstrapping Financial Time Series," Journal of Economic Surveys, Wiley Blackwell, vol. 16(3), pages 271-300, July.
    4. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    5. Panayiotis Theodossiou, 1998. "Financial Data and the Skewed Generalized T Distribution," Management Science, INFORMS, vol. 44(12-Part-1), pages 1650-1661, December.
    6. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    7. Jalal, Amine & Rockinger, Michael, 2008. "Predicting tail-related risk measures: The consequences of using GARCH filters for non-GARCH data," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 868-877, December.
    8. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    9. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    10. Mike K. P. So & Chi-Ming Wong, 2012. "Estimation of multiple period expected shortfall and median shortfall for risk management," Quantitative Finance, Taylor & Francis Journals, vol. 12(5), pages 739-754, March.
    11. Yamai, Yasuhiro & Yoshiba, Toshinao, 2005. "Value-at-risk versus expected shortfall: A practical perspective," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 997-1015, April.
    12. Fong Chan, Kam & Gray, Philip, 2006. "Using extreme value theory to measure value-at-risk for daily electricity spot prices," International Journal of Forecasting, Elsevier, vol. 22(2), pages 283-300.
    13. Righi, Marcelo Brutti & Ceretta, Paulo Sergio, 2015. "A comparison of Expected Shortfall estimation models," Journal of Economics and Business, Elsevier, vol. 78(C), pages 14-47.
    14. L. Kourouma & Denis Dupré & G. Sanfilippo & O. Taramasco, 2011. "Extreme Value at Risk and Expected Shortfall during Financial Crisis," Post-Print halshs-00658495, HAL.
    15. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    16. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    17. Stavros Degiannakis & Pamela Dent & Christos Floros, 2014. "A Monte Carlo Simulation Approach to Forecasting Multi-period Value-at-Risk and Expected Shortfall Using the FIGARCH-skT Specification," Manchester School, University of Manchester, vol. 82(1), pages 71-102, January.
    18. René Garcia & Éric Renault & Georges Tsafack, 2007. "Proper Conditioning for Coherent VaR in Portfolio Management," Management Science, INFORMS, vol. 53(3), pages 483-494, March.
    19. Chavez-Demoulin, V. & McGill, J.A., 2012. "High-frequency financial data modeling using Hawkes processes," Journal of Banking & Finance, Elsevier, vol. 36(12), pages 3415-3426.
    20. Jian Zhou, 2012. "Extreme risk measures for REITs: a comparison among alternative methods," Applied Financial Economics, Taylor & Francis Journals, vol. 22(2), pages 113-126, January.
    21. Jesus Gonzalo, 2004. "Which Extreme Values Are Really Extreme?," Journal of Financial Econometrics, Oxford University Press, vol. 2(3), pages 349-369.
    22. Adelchi Azzalini & Antonella Capitanio, 2003. "Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t‐distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 367-389, May.
    23. Giot, Pierre & Laurent, Sebastien, 2003. "Market risk in commodity markets: a VaR approach," Energy Economics, Elsevier, vol. 25(5), pages 435-457, September.
    24. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
    25. Kjersti Aas & Ingrid Hobaek Haff, 2006. "The Generalized Hyperbolic Skew Student's t-Distribution," Journal of Financial Econometrics, Oxford University Press, vol. 4(2), pages 275-309.
    26. Acerbi, Carlo & Tasche, Dirk, 2002. "On the coherence of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1487-1503, July.
    27. L. Kourouma & Denis Dupré & O. Taramasco & G. Sanfilippo, 2011. "Extreme Value at Risk and Expected Shortfall during Financial Crisis," Post-Print halshs-00650913, HAL.
    28. Longin, Francois, 2005. "The choice of the distribution of asset returns: How extreme value theory can help?," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 1017-1035, April.
    29. Francis X. Diebold & Til Schuermann & John D. Stroughair, 2000. "Pitfalls and Opportunities in the Use of Extreme Value Theory in Risk Management," Journal of Risk Finance, Emerald Group Publishing Limited, vol. 1(2), pages 30-35, January.
    30. Giovanni Barone‐Adesi & Kostas Giannopoulos & Les Vosper, 1999. "VaR without correlations for portfolios of derivative securities," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 19(5), pages 583-602, August.
    31. Kerkhof, Jeroen & Melenberg, Bertrand, 2004. "Backtesting for risk-based regulatory capital," Journal of Banking & Finance, Elsevier, vol. 28(8), pages 1845-1865, August.
    32. Rama Cont & Romain Deguest & Giacomo Scandolo, 2010. "Robustness and sensitivity analysis of risk measurement procedures," Quantitative Finance, Taylor & Francis Journals, vol. 10(6), pages 593-606.
    33. Tolikas, Konstantinos, 2014. "Unexpected tails in risk measurement: Some international evidence," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 476-493.
    34. Wong, Woon K., 2008. "Backtesting trading risk of commercial banks using expected shortfall," Journal of Banking & Finance, Elsevier, vol. 32(7), pages 1404-1415, July.
    35. Ibrahim Ergen, 2015. "Two-step methods in VaR prediction and the importance of fat tails," Quantitative Finance, Taylor & Francis Journals, vol. 15(6), pages 1013-1030, June.
    36. Tobias Fissler & Johanna F. Ziegel & Tilmann Gneiting, 2015. "Expected Shortfall is jointly elicitable with Value at Risk - Implications for backtesting," Papers 1507.00244, arXiv.org, revised Jul 2015.
    37. Susanne Emmer & Marie Kratz & Dirk Tasche, 2013. "What is the best risk measure in practice? A comparison of standard measures," Papers 1312.1645, arXiv.org, revised Apr 2015.
    38. Alan E. H. Speight & David G. McMillan, 2004. "Daily volatility forecasts: reassessing the performance of GARCH models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 449-460.
    39. Giovanni Barone‐Adesi & Kostas Giannopoulos & Les Vosper, 2002. "Backtesting Derivative Portfolios with Filtered Historical Simulation (FHS)," European Financial Management, European Financial Management Association, vol. 8(1), pages 31-58, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Juan Carlos Escanciano & Zaichao Du, 2015. "Backtesting Expected Shortfall: Accounting for Tail Risk," CAEPR Working Papers 2015-001, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    3. Laura Garcia‐Jorcano & Alfonso Novales, 2021. "Volatility specifications versus probability distributions in VaR forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(2), pages 189-212, March.
    4. Steven Kou & Xianhua Peng, 2016. "On the Measurement of Economic Tail Risk," Operations Research, INFORMS, vol. 64(5), pages 1056-1072, October.
    5. Marie Kratz & Yen H Lok & Alexander J Mcneil, 2016. "Multinomial var backtests: A simple implicit approach to backtesting expected shortfall," Working Papers hal-01424279, HAL.
    6. Sander Barendse & Erik Kole & Dick van Dijk, 2023. "Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error," Journal of Financial Econometrics, Oxford University Press, vol. 21(2), pages 528-568.
    7. Righi, Marcelo Brutti & Ceretta, Paulo Sergio, 2015. "A comparison of Expected Shortfall estimation models," Journal of Economics and Business, Elsevier, vol. 78(C), pages 14-47.
    8. Chen, Qian & Gerlach, Richard & Lu, Zudi, 2012. "Bayesian Value-at-Risk and expected shortfall forecasting via the asymmetric Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3498-3516.
    9. Zaichao Du & Juan Carlos Escanciano, 2017. "Backtesting Expected Shortfall: Accounting for Tail Risk," Management Science, INFORMS, vol. 63(4), pages 940-958, April.
    10. Kratz, Marie & Lok, Y-H & McNeil, Alexander J., 2016. "Multinomial VaR Backtests: A simple implicit approach to backtesting expected shortfall," ESSEC Working Papers WP1617, ESSEC Research Center, ESSEC Business School.
    11. Kratz, Marie & Lok, Yen H. & McNeil, Alexander J., 2018. "Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall," Journal of Banking & Finance, Elsevier, vol. 88(C), pages 393-407.
    12. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    13. James Ming Chen, 2018. "On Exactitude in Financial Regulation: Value-at-Risk, Expected Shortfall, and Expectiles," Risks, MDPI, vol. 6(2), pages 1-28, June.
    14. Sebastian Bayer & Timo Dimitriadis, 2018. "Regression Based Expected Shortfall Backtesting," Papers 1801.04112, arXiv.org, revised Sep 2019.
    15. Enrique Molina‐Muñoz & Andrés Mora‐Valencia & Javier Perote, 2021. "Backtesting expected shortfall for world stock index ETFs with extreme value theory and Gram–Charlier mixtures," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 4163-4189, July.
    16. David Happersberger & Harald Lohre & Ingmar Nolte, 2020. "Estimating portfolio risk for tail risk protection strategies," European Financial Management, European Financial Management Association, vol. 26(4), pages 1107-1146, September.
    17. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    18. Vijverberg, Chu-Ping C. & Vijverberg, Wim P.M. & Taşpınar, Süleyman, 2016. "Linking Tukey’s legacy to financial risk measurement," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 595-615.
    19. Chang, Chia-Lin & Jimenez-Martin, Juan-Angel & Maasoumi, Esfandiar & McAleer, Michael & Pérez-Amaral, Teodosio, 2019. "Choosing expected shortfall over VaR in Basel III using stochastic dominance," International Review of Economics & Finance, Elsevier, vol. 60(C), pages 95-113.
    20. Julia S. Mehlitz & Benjamin R. Auer, 2021. "Time‐varying dynamics of expected shortfall in commodity futures markets," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(6), pages 895-925, June.

    More about this item

    Keywords

    Extreme value theory; Skewed distributions; Expected shortfall; Backtesting; Filtered historical simulation.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucm:doicae:1924. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Águeda González Abad (email available below). General contact details of provider: https://edirc.repec.org/data/feucmes.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.