IDEAS home Printed from https://ideas.repec.org/a/eee/jbfina/v37y2013i10p3843-3854.html
   My bibliography  Save this article

The Risk Map: A new tool for validating risk models

Author

Listed:
  • Colletaz, Gilbert
  • Hurlin, Christophe
  • Pérignon, Christophe

Abstract

This paper presents a new method to validate risk models: the Risk Map. This method jointly accounts for the number and the magnitude of extreme losses and graphically summarizes all information about the performance of a risk model. It relies on the concept of a super exception, which is defined as a situation in which the loss exceeds both the standard Value-at-Risk (VaR) and a VaR defined at an extremely low probability. We then formally test whether the sequences of exceptions and super exceptions are rejected by standard model validation tests. We show that the Risk Map can be used to validate market, credit, operational, or systemic risk estimates (VaR, stressed VaR, expected shortfall, and CoVaR) or to assess the performance of the margin system of a clearing house.

Suggested Citation

  • Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    • Handle: RePEc:eee:jbfina:v:37:y:2013:i:10:p:3843-3854
    DOI: 10.1016/j.jbankfin.2013.06.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378426613002628
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbankfin.2013.06.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel R., 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 150-160.
    2. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    3. Viral V. Acharya & Lasse H. Pedersen & Thomas Philippon & Matthew Richardson, 2017. "Measuring Systemic Risk," Review of Financial Studies, Society for Financial Studies, vol. 30(1), pages 2-47.
    4. Luc Bauwens & Arie Preminger & Jeroen V. K. Rombouts, 2010. "Theory and inference for a Markov switching GARCH model," Econometrics Journal, Royal Economic Society, vol. 13(2), pages 218-244, July.
    5. René M. Stulz, 2008. "Risk Management Failures: What Are They and When Do They Happen?," Journal of Applied Corporate Finance, Morgan Stanley, vol. 20(4), pages 39-48, September.
    6. Christophe Hurlin & Christophe Pérignon, 2012. "Margin Backtesting," Working Papers halshs-00746274, HAL.
    7. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    8. Dahen, Hela & Dionne, Georges, 2010. "Scaling models for the severity and frequency of external operational loss data," Journal of Banking & Finance, Elsevier, vol. 34(7), pages 1484-1496, July.
    9. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    10. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    11. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    12. Markus K. Brunnermeier & Lasse Heje Pedersen, 2009. "Market Liquidity and Funding Liquidity," The Review of Financial Studies, Society for Financial Studies, vol. 22(6), pages 2201-2238, June.
    13. Zhu, Dongming & Galbraith, John W., 2010. "A generalized asymmetric Student-t distribution with application to financial econometrics," Journal of Econometrics, Elsevier, vol. 157(2), pages 297-305, August.
    14. Mark Broadie & Yiping Du & Ciamac C. Moallemi, 2011. "Efficient Risk Estimation via Nested Sequential Simulation," Management Science, INFORMS, vol. 57(6), pages 1172-1194, June.
    15. James W. Taylor, 2005. "Generating Volatility Forecasts from Value at Risk Estimates," Management Science, INFORMS, vol. 51(5), pages 712-725, May.
    16. Basak, Suleyman & Shapiro, Alexander, 2001. "Value-at-Risk-Based Risk Management: Optimal Policies and Asset Prices," Review of Financial Studies, Society for Financial Studies, vol. 14(2), pages 371-405.
    17. Christophe Pérignon & R.D. Smith, 2008. "A New Approach to Comparing VaR Estimation Methods," Post-Print hal-00854087, HAL.
    18. Jeremy Berkowitz & James O'Brien, 2002. "How Accurate Are Value‐at‐Risk Models at Commercial Banks?," Journal of Finance, American Finance Association, vol. 57(3), pages 1093-1111, June.
    19. repec:fip:fedhpr:y:2010:i:may:p:65-71 is not listed on IDEAS
    20. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    21. Frésard, Laurent & Pérignon, Christophe & Wilhelmsson, Anders, 2011. "The pernicious effects of contaminated data in risk management," Journal of Banking & Finance, Elsevier, vol. 35(10), pages 2569-2583, October.
    22. Bali, Turan G. & Demirtas, K. Ozgur & Levy, Haim, 2009. "Is There an Intertemporal Relation between Downside Risk and Expected Returns?," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 44(4), pages 883-909, August.
    23. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.
    24. Larry Eisenberg & Thomas H. Noe, 2001. "Systemic Risk in Financial Systems," Management Science, INFORMS, vol. 47(2), pages 236-249, February.
    25. Christophe Pérignon & J.-A. Cruz Lopez & J. H. Harris, 2011. "Clearing house, margin requirements, and systemic risk," Post-Print hal-00578316, HAL.
    26. G. Geoffrey Booth & John Paul Broussard & Teppo Martikainen & Vesa Puttonen, 1997. "Prudent Margin Levels in the Finnish Stock Index Futures Market," Management Science, INFORMS, vol. 43(8), pages 1177-1188, August.
    27. Cotter, John, 2001. "Margin exceedences for European stock index futures using extreme value theory," Journal of Banking & Finance, Elsevier, vol. 25(8), pages 1475-1502, August.
    28. Darrell Duffie & Haoxiang Zhu, 2011. "Does a Central Clearing Counterparty Reduce Counterparty Risk?," The Review of Asset Pricing Studies, Society for Financial Studies, vol. 1(1), pages 74-95.
    29. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    30. Lopez, Jose A. & Saidenberg, Marc R., 2000. "Evaluating credit risk models," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 151-165, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. G. Rigatos & N. Zervos, 2017. "Detection of Mispricing in the Black–Scholes PDE Using the Derivative-Free Nonlinear Kalman Filter," Computational Economics, Springer;Society for Computational Economics, vol. 50(1), pages 1-20, June.
    2. Sharif Mozumder & Arafatur Rahman, 2016. "Market Risk Of Investment In Us Subprime Crisis: Comparison Of A Pure Diffusion And A Pure Jump Model," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 11(03), pages 1-17, September.
    3. Farkas, Walter & Fringuellotti, Fulvia & Tunaru, Radu, 2020. "A cost-benefit analysis of capital requirements adjusted for model risk," Journal of Corporate Finance, Elsevier, vol. 65(C).
    4. Denisa Banulescu-Radu & Christophe Hurlin & Jérémy Leymarie & Olivier Scaillet, 2021. "Backtesting Marginal Expected Shortfall and Related Systemic Risk Measures," Management Science, INFORMS, vol. 67(9), pages 5730-5754, September.
    5. Tafakori, Laleh & Pourkhanali, Armin & Fard, Farzad Alavi, 2018. "Forecasting spikes in electricity return innovations," Energy, Elsevier, vol. 150(C), pages 508-526.
    6. Jean-Edouard Colliard, 2019. "Strategic Selection of Risk Models and Bank Capital Regulation," Management Science, INFORMS, vol. 67(6), pages 2591-2606, June.
    7. Zaichao Du & Juan Carlos Escanciano, 2017. "Backtesting Expected Shortfall: Accounting for Tail Risk," Management Science, INFORMS, vol. 63(4), pages 940-958, April.
    8. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    9. Hamid, Alain & Heiden, Moritz, 2015. "Forecasting volatility with empirical similarity and Google Trends," Journal of Economic Behavior & Organization, Elsevier, vol. 117(C), pages 62-81.
    10. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    11. Marta Małecka, 2021. "Testing for a serial correlation in VaR failures through the exponential autoregressive conditional duration model," Statistics in Transition New Series, Polish Statistical Association, vol. 22(1), pages 145-162, March.
    12. Bujaki, Merridee & Lento, Camillo & Sayed, Naqi, 2019. "Utilizing professional accounting concepts to understand and respond to academic dishonesty in accounting programs," Journal of Accounting Education, Elsevier, vol. 47(C), pages 28-47.
    13. Sylvain Benoît & Gilbert Colletaz & Christophe Hurlin & Christophe Pérignon, 2013. "A Theoretical and Empirical Comparison of Systemic Risk Measures," Working Papers halshs-00746272, HAL.
    14. Kratz, Marie & Lok, Yen H. & McNeil, Alexander J., 2018. "Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall," Journal of Banking & Finance, Elsevier, vol. 88(C), pages 393-407.
    15. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    16. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    17. Manner, Hans & Alavi Fard, Farzad & Pourkhanali, Armin & Tafakori, Laleh, 2019. "Forecasting the joint distribution of Australian electricity prices using dynamic vine copulae," Energy Economics, Elsevier, vol. 78(C), pages 143-164.
    18. Laura Garcia-Jorcano & Lidia Sanchis-Marco, 2023. "Measuring Systemic Risk Using Multivariate Quantile-Located ES Models," Journal of Financial Econometrics, Oxford University Press, vol. 21(1), pages 1-72.
    19. Jean-Paul Laurent & Hassan Omidi Firouzi, 2022. "Market Risk and Volatility Weighted Historical Simulation After Basel III," Working Papers hal-03679434, HAL.
    20. Tsukahara, Fábio Yasuhiro & Kimura, Herbert & Sobreiro, Vinicius Amorim & Zambrano, Juan Carlos Arismendi, 2016. "Validation of default probability models: A stress testing approach," International Review of Financial Analysis, Elsevier, vol. 47(C), pages 70-85.
    21. Laura Garcia-Jorcano & Alfonso Novales, 2020. "A dominance approach for comparing the performance of VaR forecasting models," Computational Statistics, Springer, vol. 35(3), pages 1411-1448, September.
    22. Argyropoulos, Christos & Panopoulou, Ekaterini, 2019. "Backtesting VaR and ES under the magnifying glass," International Review of Financial Analysis, Elsevier, vol. 64(C), pages 22-37.
    23. Małecka Marta, 2021. "Testing for a serial correlation in VaR failures through the exponential autoregressive conditional duration model," Statistics in Transition New Series, Polish Statistical Association, vol. 22(1), pages 145-162, March.
    24. Slim, Skander & Koubaa, Yosra & BenSaïda, Ahmed, 2017. "Value-at-Risk under Lévy GARCH models: Evidence from global stock markets," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 46(C), pages 30-53.
    25. Hammadi Zouari, 2022. "On the Effectiveness of Stock Index Futures for Tail Risk Protection," International Journal of Economics and Financial Issues, Econjournals, vol. 12(3), pages 38-52, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    3. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    4. Escanciano, Juan Carlos & Pei, Pei, 2012. "Pitfalls in backtesting Historical Simulation VaR models," Journal of Banking & Finance, Elsevier, vol. 36(8), pages 2233-2244.
    5. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    6. Steven Kou & Xianhua Peng, 2016. "On the Measurement of Economic Tail Risk," Operations Research, INFORMS, vol. 64(5), pages 1056-1072, October.
    7. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    8. Benjamin R. Auer & Benjamin Mögel, 2016. "How Accurate are Modern Value-at-Risk Estimators Derived from Extreme Value Theory?," CESifo Working Paper Series 6288, CESifo.
    9. Leccadito, Arturo & Boffelli, Simona & Urga, Giovanni, 2014. "Evaluating the accuracy of value-at-risk forecasts: New multilevel tests," International Journal of Forecasting, Elsevier, vol. 30(2), pages 206-216.
    10. Gaglianone, Wagner Piazza & Marins, Jaqueline Terra Moura, 2017. "Evaluation of exchange rate point and density forecasts: An application to Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 707-728.
    11. Argyropoulos, Christos & Panopoulou, Ekaterini, 2019. "Backtesting VaR and ES under the magnifying glass," International Review of Financial Analysis, Elsevier, vol. 64(C), pages 22-37.
    12. Selma Chaker & Nour Meddahi, 2013. "CoMargin," Staff Working Papers 13-47, Bank of Canada.
    13. Ziggel, Daniel & Berens, Tobias & Weiß, Gregor N.F. & Wied, Dominik, 2014. "A new set of improved Value-at-Risk backtests," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 29-41.
    14. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    15. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    16. James M. O'Brien & Pawel J. Szerszen, 2014. "An Evaluation of Bank VaR Measures for Market Risk During and Before the Financial Crisis," Finance and Economics Discussion Series 2014-21, Board of Governors of the Federal Reserve System (U.S.).
    17. O’Brien, James & Szerszeń, Paweł J., 2017. "An evaluation of bank measures for market risk before, during and after the financial crisis," Journal of Banking & Finance, Elsevier, vol. 80(C), pages 215-234.
    18. Frésard, Laurent & Pérignon, Christophe & Wilhelmsson, Anders, 2011. "The pernicious effects of contaminated data in risk management," Journal of Banking & Finance, Elsevier, vol. 35(10), pages 2569-2583, October.
    19. Farkas, Walter & Fringuellotti, Fulvia & Tunaru, Radu, 2020. "A cost-benefit analysis of capital requirements adjusted for model risk," Journal of Corporate Finance, Elsevier, vol. 65(C).
    20. Elena-Ivona Dumitrescu & Christophe Hurlin & Vinson Pham, 2012. "Backtesting Value-at-Risk: From Dynamic Quantile to Dynamic Binary Tests," Finance, Presses universitaires de Grenoble, vol. 33(1), pages 79-112.

    More about this item

    Keywords

    Financial risk management; Tail risk; Basel III;
    All these keywords.

    JEL classification:

    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbfina:v:37:y:2013:i:10:p:3843-3854. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbf .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.