IDEAS home Printed from
MyIDEAS: Login to save this article or follow this journal

The Risk Map: A new tool for validating risk models

  • Colletaz, Gilbert
  • Hurlin, Christophe
  • Pérignon, Christophe

This paper presents a new method to validate risk models: the Risk Map. This method jointly accounts for the number and the magnitude of extreme losses and graphically summarizes all information about the performance of a risk model. It relies on the concept of a super exception, which is defined as a situation in which the loss exceeds both the standard Value-at-Risk (VaR) and a VaR defined at an extremely low probability. We then formally test whether the sequences of exceptions and super exceptions are rejected by standard model validation tests. We show that the Risk Map can be used to validate market, credit, operational, or systemic risk estimates (VaR, stressed VaR, expected shortfall, and CoVaR) or to assess the performance of the margin system of a clearing house.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: Full text for ScienceDirect subscribers only

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Article provided by Elsevier in its journal Journal of Banking & Finance.

Volume (Year): 37 (2013)
Issue (Month): 10 ()
Pages: 3843-3854

in new window

Handle: RePEc:eee:jbfina:v:37:y:2013:i:10:p:3843-3854
Contact details of provider: Web page:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Stulz, Rene M., 2008. "Risk Management Failures: What Are They and When Do They Happen?," Working Paper Series 2008-18, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
  2. Jeremy Berkowitz & James O'Brien, 2002. "How Accurate Are Value-at-Risk Models at Commercial Banks?," Journal of Finance, American Finance Association, vol. 57(3), pages 1093-1111, 06.
  3. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-74, October.
  4. Markus K. Brunnermeier & Lasse Heje Pedersen, 2009. "Market Liquidity and Funding Liquidity," Review of Financial Studies, Society for Financial Studies, vol. 22(6), pages 2201-2238, June.
  5. Dongming Zhu & John Galbraith, 2009. "A Generalized Asymmetric Student-t Distribution with Application to Financial Econometrics," CIRANO Working Papers 2009s-13, CIRANO.
  6. Luc Bauwens & Arie Preminger & Jeroen V.K. Rombouts, 2007. "Theory and inference for a Markov switching Garch model," Cahiers de recherche 07-09, HEC Montréal, Institut d'économie appliquée.
  7. Cotter, John, 2000. "Margin Exceedences for European Stock Index Futures using Extreme Value Theory," MPRA Paper 3534, University Library of Munich, Germany, revised 2001.
  8. James W. Taylor, 2005. "Generating Volatility Forecasts from Value at Risk Estimates," Management Science, INFORMS, vol. 51(5), pages 712-725, May.
  9. Engle, Robert F & Manganelli, Simone, 1999. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," University of California at San Diego, Economics Working Paper Series qt06m3d6nv, Department of Economics, UC San Diego.
  10. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
  11. Acharya, Viral V & Pedersen, Lasse H & Philippon, Thomas & Richardson, Matthew P, 2012. "Measuring Systemic Risk," CEPR Discussion Papers 8824, C.E.P.R. Discussion Papers.
  12. Wagner Piazza Gaglianone & Luiz Renato Lima & Oliver Linton & Daniel Smith, 2009. "Evaluating Value-at-Risk models via Quantile Regression," Economics Working Papers we094625, Universidad Carlos III, Departamento de Economía.
  13. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
  14. Philippe Artzner & Freddy Delbaen & Jean-Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228.
  15. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.
  16. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  17. Christophe Pérignon & J.-A. Cruz Lopez & J. H. Harris, 2011. "Clearing house, margin requirements, and systemic risk," Post-Print hal-00578316, HAL.
  18. G. Geoffrey Booth & John Paul Broussard & Teppo Martikainen & Vesa Puttonen, 1997. "Prudent Margin Levels in the Finnish Stock Index Futures Market," Management Science, INFORMS, vol. 43(8), pages 1177-1188, August.
  19. Lopez, Jose A. & Saidenberg, Marc R., 2000. "Evaluating credit risk models," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 151-165, January.
  20. Bali, Turan G. & Demirtas, K. Ozgur & Levy, Haim, 2009. "Is There an Intertemporal Relation between Downside Risk and Expected Returns?," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 44(04), pages 883-909, August.
  21. Mark Broadie & Yiping Du & Ciamac C. Moallemi, 2011. "Efficient Risk Estimation via Nested Sequential Simulation," Management Science, INFORMS, vol. 57(6), pages 1172-1194, June.
  22. Hela Dahen & Georges Dionne, 2007. "Scaling Models for the Severity and Frequency of External Operational Loss Data," Cahiers de recherche 0702, CIRPEE.
  23. Christophe Hurlin & Christophe Pérignon, 2012. "Margin Backtesting," Working Papers halshs-00746274, HAL.
  24. repec:fip:fedhpr:y:2010:i:may:p:65-71 is not listed on IDEAS
  25. Suleyman Basak & Alex Shapiro, . "Value-at-Risk Based Risk Management: Optimal Policies and Asset Prices," Rodney L. White Center for Financial Research Working Papers 06-99, Wharton School Rodney L. White Center for Financial Research.
  26. Peter Christoffersen & Denis Pelletier, 2003. "Backtesting Value-at-Risk: A Duration-Based Approach," CIRANO Working Papers 2003s-05, CIRANO.
  27. Frésard, Laurent & Pérignon, Christophe & Wilhelmsson, Anders, 2011. "The pernicious effects of contaminated data in risk management," Journal of Banking & Finance, Elsevier, vol. 35(10), pages 2569-2583, October.
  28. Viral V. Acharya, 2010. "Measuring systemic risk," Proceedings 1140, Federal Reserve Bank of Chicago.
  29. Larry Eisenberg & Thomas H. Noe, 2001. "Systemic Risk in Financial Systems," Management Science, INFORMS, vol. 47(2), pages 236-249, February.
  30. Christophe Pérignon & R.D. Smith, 2008. "A New Approach to Comparing VaR Estimation Methods," Post-Print hal-00854087, HAL.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:eee:jbfina:v:37:y:2013:i:10:p:3843-3854. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.