IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/59299.html
   My bibliography  Save this paper

Risk models–at–risk

Author

Listed:
  • Boucher, Christophe M.
  • Danielsson, Jon
  • Kouontchou, Patrick S.
  • Maillet, Bertrand B.

Abstract

The experience from the global financial crisis has raised serious concerns about the accuracy of standard risk measures as tools for the quantification of extreme downward risk. A key reason for this is that risk measures are subject to model risk due, e.g., to specification and estimation uncertainty. While the authorities would like financial institutions to assess model risk, there is no accepted approach for such computations. We propose a remedy for this by a general framework for the computation of risk measures robust to model risk by empirically adjusting imperfect risk forecasts by outcomes from backtesting, considering the desirable quality of VaR models such as the frequency, independence and magnitude of violations. We also provide a fair comparison between the main risk models using the same metric that corresponds to model risk required corrections.

Suggested Citation

  • Boucher, Christophe M. & Danielsson, Jon & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models–at–risk," LSE Research Online Documents on Economics 59299, London School of Economics and Political Science, LSE Library.
  • Handle: RePEc:ehl:lserod:59299
    as

    Download full text from publisher

    File URL: http://eprints.lse.ac.uk/59299/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Nieto, María Rosa & Ruiz Ortega, Esther, 2008. "Measuring financial risk : comparison of alternative procedures to estimate VaR and ES," DES - Working Papers. Statistics and Econometrics. WS ws087326, Universidad Carlos III de Madrid. Departamento de Estadística.
    2. Bertrand Candelon & Gilbert Colletaz & Christophe Hurlin & Sessi Tokpavi, 2011. "Backtesting Value-at-Risk: A GMM Duration-Based Test," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 9(2), pages 314-343, Spring.
    3. Escanciano, Juan Carlos & Pei, Pei, 2012. "Pitfalls in backtesting Historical Simulation VaR models," Journal of Banking & Finance, Elsevier, vol. 36(8), pages 2233-2244.
    4. Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel R., 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 150-160.
    5. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    6. Tarun Chordia & Richard Roll & Avanidhar Subrahmanyam, 2001. "Market Liquidity and Trading Activity," Journal of Finance, American Finance Association, vol. 56(2), pages 501-530, April.
    7. Lennart F. Hoogerheide & Francesco Ravazzolo & Herman K. van Dijk, 2011. "Backtesting Value-at-Risk using Forecasts for Multiple Horizons, a Comment on the Forecast Rationality Tests of A.J. Patton and A. Timmermann," Tinbergen Institute Discussion Papers 11-131/4, Tinbergen Institute.
    8. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    9. Breuer, Thomas & Csiszár, Imre, 2013. "Systematic stress tests with entropic plausibility constraints," Journal of Banking & Finance, Elsevier, vol. 37(5), pages 1552-1559.
    10. Luc Bauwens & Arie Preminger & Jeroen V. K. Rombouts, 2010. "Theory and inference for a Markov switching GARCH model," Econometrics Journal, Royal Economic Society, vol. 13(2), pages 218-244, July.
    11. Cheridito, Patrick & Stadje, Mitja, 2009. "Time-inconsistency of VaR and time-consistent alternatives," Finance Research Letters, Elsevier, vol. 6(1), pages 40-46, March.
    12. Elena-Ivona Dumitrescu & Christophe Hurlin & Vinson Pham, 2012. "Backtesting Value-at-Risk: From Dynamic Quantile to Dynamic Binary Tests," Finance, Presses universitaires de Grenoble, vol. 33(1), pages 79-112.
    13. Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    14. Philippe Jorion, 2009. "Risk Management Lessons from the Credit Crisis," European Financial Management, European Financial Management Association, vol. 15(5), pages 923-933, November.
    15. Danielsson, Jon & James, Kevin R. & Valenzuela, Marcela & Zer, Ilknur, 2016. "Model risk of risk models," Journal of Financial Stability, Elsevier, vol. 23(C), pages 79-91.
    16. Franc Klaassen, 2002. "Improving GARCH volatility forecasts with regime-switching GARCH," Empirical Economics, Springer, vol. 27(2), pages 363-394.
    17. Jose A. Lopez, 1999. "Methods for evaluating value-at-risk estimates," Economic Review, Federal Reserve Bank of San Francisco, pages 3-17.
    18. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    19. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(1), pages 84-108.
    20. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    21. Markus Haas, 2004. "A New Approach to Markov-Switching GARCH Models," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(4), pages 493-530.
    22. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    23. Gordy, Michael B., 2003. "A risk-factor model foundation for ratings-based bank capital rules," Journal of Financial Intermediation, Elsevier, vol. 12(3), pages 199-232, July.
    24. Pérignon, Christophe & Smith, Daniel R., 2010. "The level and quality of Value-at-Risk disclosure by commercial banks," Journal of Banking & Finance, Elsevier, vol. 34(2), pages 362-377, February.
    25. Michael McAleer & Juan‐Ángel Jiménez‐Martín & Teodosio Pérez‐Amaral, 2013. "International Evidence on GFC‐Robust Forecasts for Risk Management under the Basel Accord," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 32(3), pages 267-288, April.
    26. Hartz, Christoph & Mittnik, Stefan & Paolella, Marc, 2006. "Accurate value-at-risk forecasting based on the normal-GARCH model," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2295-2312, December.
    27. Hang Chan, Ngai & Deng, Shi-Jie & Peng, Liang & Xia, Zhendong, 2007. "Interval estimation of value-at-risk based on GARCH models with heavy-tailed innovations," Journal of Econometrics, Elsevier, vol. 137(2), pages 556-576, April.
    28. Billio, Monica & Casarin, Roberto & Osuntuyi, Anthony, 2016. "Efficient Gibbs sampling for Markov switching GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 37-57.
    29. Christophe Hurlin & Sessi Tokpavi, 2006. "Backtesting Value at Risk Accuracy : A New Simple Test," Post-Print halshs-00257520, HAL.
    30. Matthew Pritsker, 1997. "Evaluating Value at Risk Methodologies: Accuracy versus Computational Time," Journal of Financial Services Research, Springer;Western Finance Association, vol. 12(2), pages 201-242, October.
    31. Engle, Robert F. & Manganelli, Simone, 2001. "Value at risk models in finance," Working Paper Series 75, European Central Bank.
    32. Belkacem Abdous & Bruno Remillard, 1995. "Relating quantiles and expectiles under weighted-symmetry," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 47(2), pages 371-384, June.
    33. Kyle, Albert S, 1985. "Continuous Auctions and Insider Trading," Econometrica, Econometric Society, vol. 53(6), pages 1315-1335, November.
    34. Escanciano, J. Carlos & Olmo, Jose, 2010. "Backtesting Parametric Value-at-Risk With Estimation Risk," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(1), pages 36-51.
    35. Angelidis, Timotheos & Degiannakis, Stavros, 2007. "Backtesting VaR Models: A Τwo-Stage Procedure," MPRA Paper 96327, University Library of Munich, Germany.
    36. Sylvain Benoît & Gilbert Colletaz & Christophe Hurlin & Christophe Pérignon, 2013. "A Theoretical and Empirical Comparison of Systemic Risk Measures," Working Papers halshs-00746272, HAL.
    37. Christophe Pérignon & R.D. Smith, 2008. "A New Approach to Comparing VaR Estimation Methods," Post-Print hal-00854087, HAL.
    38. Getmansky, Mila & Lo, Andrew W. & Makarov, Igor, 2004. "An econometric model of serial correlation and illiquidity in hedge fund returns," Journal of Financial Economics, Elsevier, vol. 74(3), pages 529-609, December.
    39. Jeremy Berkowitz & James O'Brien, 2002. "How Accurate Are Value‐at‐Risk Models at Commercial Banks?," Journal of Finance, American Finance Association, vol. 57(3), pages 1093-1111, June.
    40. Wong, Woon K., 2010. "Backtesting value-at-risk based on tail losses," Journal of Empirical Finance, Elsevier, vol. 17(3), pages 526-538, June.
    41. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    42. Löffler, Gunter & Raupach, Peter, 2013. "Robustness and informativeness of systemic risk measures," Discussion Papers 04/2013, Deutsche Bundesbank.
    43. Frésard, Laurent & Pérignon, Christophe & Wilhelmsson, Anders, 2011. "The pernicious effects of contaminated data in risk management," Journal of Banking & Finance, Elsevier, vol. 35(10), pages 2569-2583, October.
    44. Silber, William L., 2005. "What happened to liquidity when world war I shut the NYSE?," Journal of Financial Economics, Elsevier, vol. 78(3), pages 685-701, December.
    45. Bao, Yong & Ullah, Aman, 2004. "Bias of a Value-at-Risk estimator," Finance Research Letters, Elsevier, vol. 1(4), pages 241-249, December.
    46. Leccadito, Arturo & Boffelli, Simona & Urga, Giovanni, 2014. "Evaluating the accuracy of value-at-risk forecasts: New multilevel tests," International Journal of Forecasting, Elsevier, vol. 30(2), pages 206-216.
    47. Kerkhof, Jeroen & Melenberg, Bertrand & Schumacher, Hans, 2010. "Model risk and capital reserves," Journal of Banking & Finance, Elsevier, vol. 34(1), pages 267-279, January.
    48. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
    49. Denis Talay & Ziyu Zheng, 2002. "Worst case model risk management," Finance and Stochastics, Springer, vol. 6(4), pages 517-537.
    50. Wong, Woon K., 2008. "Backtesting trading risk of commercial banks using expected shortfall," Journal of Banking & Finance, Elsevier, vol. 32(7), pages 1404-1415, July.
    51. Inui, Koji & Kijima, Masaaki, 2005. "On the significance of expected shortfall as a coherent risk measure," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 853-864, April.
    52. Escanciano, Juan Carlos & Pei, Pei, 2012. "Pitfalls in backtesting Historical Simulation VaR models," Journal of Banking & Finance, Elsevier, vol. 36(8), pages 2233-2244.
    53. Breuer, Thomas & Jandačka, Martin & Mencía, Javier & Summer, Martin, 2012. "A systematic approach to multi-period stress testing of portfolio credit risk," Journal of Banking & Finance, Elsevier, vol. 36(2), pages 332-340.
    54. Christophe HURLIN & Sessi TOKPAVI, 2006. "Backtesting VaR Accuracy: A Simple and Powerful Test," LEO Working Papers / DR LEO 268, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    55. Hamilton, James D. & Susmel, Raul, 1994. "Autoregressive conditional heteroskedasticity and changes in regime," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 307-333.
    56. J. Carlos Escanciano & Jose Olmo, 2011. "Robust Backtesting Tests for Value-at-risk Models," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 9(1), pages 132-161, Winter.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Emese Lazar & Ning Zhang, 2017. "Model Risk of Expected Shortfall," ICMA Centre Discussion Papers in Finance icma-dp2017-10, Henley Business School, University of Reading.
    3. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    4. Radu Tunaru, 2015. "Model Risk in Financial Markets:From Financial Engineering to Risk Management," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 9524, December.
    5. Argyropoulos, Christos & Panopoulou, Ekaterini, 2019. "Backtesting VaR and ES under the magnifying glass," International Review of Financial Analysis, Elsevier, vol. 64(C), pages 22-37.
    6. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    7. Benjamin R. Auer & Benjamin Mögel, 2016. "How Accurate are Modern Value-at-Risk Estimators Derived from Extreme Value Theory?," CESifo Working Paper Series 6288, CESifo.
    8. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    9. Zaichao Du & Juan Carlos Escanciano, 2017. "Backtesting Expected Shortfall: Accounting for Tail Risk," Management Science, INFORMS, vol. 63(4), pages 940-958, April.
    10. Denisa Banulescu-Radu & Christophe Hurlin & Jérémy Leymarie & Olivier Scaillet, 2021. "Backtesting Marginal Expected Shortfall and Related Systemic Risk Measures," Management Science, INFORMS, vol. 67(9), pages 5730-5754, September.
    11. Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    12. Farkas, Walter & Fringuellotti, Fulvia & Tunaru, Radu, 2020. "A cost-benefit analysis of capital requirements adjusted for model risk," Journal of Corporate Finance, Elsevier, vol. 65(C).
    13. Escanciano, Juan Carlos & Pei, Pei, 2012. "Pitfalls in backtesting Historical Simulation VaR models," Journal of Banking & Finance, Elsevier, vol. 36(8), pages 2233-2244.
    14. Ziggel, Daniel & Berens, Tobias & Weiß, Gregor N.F. & Wied, Dominik, 2014. "A new set of improved Value-at-Risk backtests," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 29-41.
    15. Jean-Paul Laurent & Hassan Omidi Firouzi, 2022. "Market Risk and Volatility Weighted Historical Simulation After Basel III," Working Papers hal-03679434, HAL.
    16. Thiele, Stephen, 2019. "Detecting underestimates of risk in VaR models," Journal of Banking & Finance, Elsevier, vol. 101(C), pages 12-20.
    17. James Ming Chen, 2018. "On Exactitude in Financial Regulation: Value-at-Risk, Expected Shortfall, and Expectiles," Risks, MDPI, vol. 6(2), pages 1-28, June.
    18. Sander Barendse & Erik Kole & Dick van Dijk, 2023. "Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 21(2), pages 528-568.
    19. Wied, Dominik & Weiß, Gregor N.F. & Ziggel, Daniel, 2016. "Evaluating Value-at-Risk forecasts: A new set of multivariate backtests," Journal of Banking & Finance, Elsevier, vol. 72(C), pages 121-132.
    20. Marta Małecka, 2021. "Testing for a serial correlation in VaR failures through the exponential autoregressive conditional duration model," Statistics in Transition New Series, Polish Statistical Association, vol. 22(1), pages 145-162, March.

    More about this item

    Keywords

    model risk; value–at–risk; backtesting;
    All these keywords.

    JEL classification:

    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:59299. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.