Advanced Search
MyIDEAS: Login to save this paper or follow this series

Backtesting Value-at-Risk: A Duration-Based Approach

Contents:

Author Info

  • Peter Christoffersen

    ()

  • Denis Pelletier

Abstract

Financial risk model evaluation or backtesting is a key part of the internal model's approach to market risk management as laid out by the Basle Commitee on Banking Supervision (1996). However, existing backtesting methods such as those developed in Christoffersen (1998), have relatively small power in realistic small sample settings. Methods suggested in Berkowitz (2001) fare better, but rely on information such as the shape of the left tail of the portfolio return distribution, which is often not available. By far the most common risk measure is Value-at-Risk (VaR), which is defined as a conditional quantile of the return distribution, and it says nothing about the shape of the tail to the left of the quantile. Our contribution is the exploration of a new tool for backtesting based on the duration of days between the violations of the VaR. The chief insight is that if the VaR model is correctly specified for coverage rate, p, then the conditional expected duration between violations should be a constant 1/p days. We suggest various ways of testing this null hypothesis and we conduct a Monte Carlo analysis which compares the new tests to those currently available. Our results show that in realistic situations, the duration based tests have better power properties than the previously suggested tests. The size of the tests is easily controlled using the Monte Carlo technique of Dufour (2000). L'évaluation des modèles de risque financier, ou test inversé, est une partie importante de l'approche avec modèle interne pour la gestion de risque tel qu'établie par le Comité de Basle pour la supervision bancaire (1996). Toutefois, les procédures existantes de tests inversés telles que celles développées dans Christoffersen (1998), ont une puissance relativement faible pour des tailles d'échantillon réalistes. Les méthodes suggérées dans Berkowitz (2001) performe mieux mais sont basées sur de l'information, telle que la forme de la queue gauche de la distribution des rendements du portefeuille, qui n'est pas toujours disponible. La mesure de risque de loin la plus courante est la Valeur-à-Risque (VaR), qui est définie comme un quantile de la distribution conditionnelle du rendement, et elle ne dit rien à-propos de la forme de la distribution à gauche du quantile. Notre contribution est l'exploration d'un nouvel outil pour les tests inversés basé sur la durée en jours entre les violations de la VaR. L'intuition est que si le modèle de VaR est correctement spécifié pour un taux de couverture p, alors la durée espérée conditionnelle entre les violations devrait être une constante 1/p jours. Nous proposons diverses façons de tester cette hypothèse nulle et nous effectuons une analyse Monte Carlo où l'on compare ces nouveaux tests à ceux présentement disponibles. Nos résultats montrent que pour des situations réalistes, les tests basés sur les durées ont de meilleures propriétés en termes de puissance que ceux précédemment proposés. La taille des tests est facilement contrôlée en utilisant la technique Monte Carlo de Dufour (2000).

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.cirano.qc.ca/pdf/publication/2003s-05.pdf
Download Restriction: no

Bibliographic Info

Paper provided by CIRANO in its series CIRANO Working Papers with number 2003s-05.

as in new window
Length:
Date of creation: 01 Feb 2003
Date of revision:
Handle: RePEc:cir:cirwor:2003s-05

Contact details of provider:
Postal: 2020 rue University, 25e étage, Montréal, Quéc, H3A 2A5
Phone: (514) 985-4000
Fax: (514) 985-4039
Email:
Web page: http://www.cirano.qc.ca/
More information through EDIRC

Related research

Keywords: Risk Model Evaluation; Historical Simulation; Density Forecasting; Monte Carlo Testing; Évaluation de modèle de risque; simulation historique; prévision de densité; test Monte Carlo;

Other versions of this item:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. James D. Hamilton & Oscar Jorda, 2002. "A Model of the Federal Funds Rate Target," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 1135-1167, October.
  2. Suleyman Basak & Alexander Shapiro, 1999. "Value-at-Risk Based Risk Management: Optimal Policies and Asset Prices," New York University, Leonard N. Stern School Finance Department Working Paper Seires 99-032, New York University, Leonard N. Stern School of Business-.
  3. Christoffersen, Peter & Hahn, Jinyong & Inoue, Atsushi, 2001. "Testing and comparing Value-at-Risk measures," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 325-342, July.
  4. M.J.B. Hall, 1996. "The amendment to the capital accord to incorporate market risk," BNL Quarterly Review, Banca Nazionale del Lavoro, vol. 49(197), pages 271-277.
  5. Philippe Artzner & Freddy Delbaen & Jean-Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228.
  6. Robert F. Engle & Jeffrey R. Russell, 1998. "Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data," Econometrica, Econometric Society, vol. 66(5), pages 1127-1162, September.
  7. Gourieroux,Christian, 2000. "Econometrics of Qualitative Dependent Variables," Cambridge Books, Cambridge University Press, number 9780521331494.
  8. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
  9. Dale J. Poirier, 1995. "Intermediate Statistics and Econometrics: A Comparative Approach," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262161494, December.
  10. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, 1997. "Evaluating Density Forecasts," Center for Financial Institutions Working Papers 97-37, Wharton School Center for Financial Institutions, University of Pennsylvania.
  11. Matthew Pritsker, 2001. "The hidden dangers of historical simulation," Finance and Economics Discussion Series 2001-27, Board of Governors of the Federal Reserve System (U.S.).
  12. Darryll Hendricks, 1996. "Evaluation of value-at-risk models using historical data," Economic Policy Review, Federal Reserve Bank of New York, issue Apr, pages 39-69.
  13. Jeremy Berkowitz & James O'Brien, 2002. "How Accurate Are Value-at-Risk Models at Commercial Banks?," Journal of Finance, American Finance Association, vol. 57(3), pages 1093-1111, 06.
  14. Kiefer, Nicholas M, 1988. "Economic Duration Data and Hazard Functions," Journal of Economic Literature, American Economic Association, vol. 26(2), pages 646-79, June.
  15. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
  16. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  17. Gourieroux,Christian, 2000. "Econometrics of Qualitative Dependent Variables," Cambridge Books, Cambridge University Press, number 9780521589857.
  18. Matthew Pritsker, 1997. "Evaluating Value at Risk Methodologies: Accuracy versus Computational Time," Journal of Financial Services Research, Springer, vol. 12(2), pages 201-242, October.
  19. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-30, August.
  20. M.J.B. Hall, 1996. "The amendment to the capital accord to incorporate market risk," Banca Nazionale del Lavoro Quarterly Review, Banca Nazionale del Lavoro, vol. 49(197), pages 271-277.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2003s-05. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Webmaster).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.