IDEAS home Printed from https://ideas.repec.org/p/hal/wpaper/halshs-00159846.html
   My bibliography  Save this paper

Une Evaluation des Procédures de Backtesting

Author

Listed:
  • Christophe Hurlin

    (LEO - Laboratoire d'économie d'Orleans [2008-2011] - UO - Université d'Orléans - CNRS - Centre National de la Recherche Scientifique)

  • Sessi Tokpavi

    (LEO - Laboratoire d'économie d'Orleans [2008-2011] - UO - Université d'Orléans - CNRS - Centre National de la Recherche Scientifique)

Abstract

This paper proposes an evaluation of backtests that examine the accuracy of Value-at-Risk (VaR) forecasts. It is well known that VaR backtesting procedures outlined by the Basel Committee for Banking Supervision have limited power to control the probability of accepting an incorrect VaR forecast. In this study, we propose an original approach based on the replication of these tests on six different VaR forecasts (parametric or non parametric) for a given asset. We show that backtests generally lead to not reject the accuracy of all (or most of) these different forecasts. In other words, most of VaR forecasts are likely to be considered as valid.

Suggested Citation

  • Christophe Hurlin & Sessi Tokpavi, 2007. "Une Evaluation des Procédures de Backtesting," Working Papers halshs-00159846, HAL.
    • Handle: RePEc:hal:wpaper:halshs-00159846
    Note: View the original document on HAL open archive server: https://shs.hal.science/halshs-00159846
    as

    Download full text from publisher

    File URL: https://shs.hal.science/halshs-00159846/document
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    2. Darryll Hendricks, 1996. "Evaluation of value-at-risk models using historical data," Proceedings 512, Federal Reserve Bank of Chicago.
    3. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    4. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    5. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    6. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    7. Jeremy Berkowitz & James O'Brien, 2002. "How Accurate Are Value‐at‐Risk Models at Commercial Banks?," Journal of Finance, American Finance Association, vol. 57(3), pages 1093-1111, June.
    8. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    9. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    10. Darryll Hendricks, 1996. "Evaluation of value-at-risk models using historical data," Economic Policy Review, Federal Reserve Bank of New York, vol. 2(Apr), pages 39-69.
    11. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    12. Matthew Pritsker, 2001. "The hidden dangers of historical simulation," Finance and Economics Discussion Series 2001-27, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Elena-Ivona DUMITRESCU, 2011. "Backesting Value-at-Risk: From DQ (Dynamic Quantile) to DB (Dynamic Binary) Tests," LEO Working Papers / DR LEO 262, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    2. Jean-Francois Carpantier, 2010. "Commodities inventory effect," Working Papers hal-01821158, HAL.
    3. Elena-Ivona Dumitrescu & Christophe Hurlin & Vinson Pham, 2012. "Backtesting Value-at-Risk: From Dynamic Quantile to Dynamic Binary Tests," Finance, Presses universitaires de Grenoble, vol. 33(1), pages 79-112.
    4. CARPANTIER, Jean-François & DUFAYS, Arnaud, 2012. "Commodities volatility and the theory of storage," LIDAM Discussion Papers CORE 2012037, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    5. El Bouhadi, Abdelhamid & Achibane, Khalid, 2009. "The Predictive Power of Conditional Models: What Lessons to Draw with Financial Crisis in the Case of Pre-Emerging Capital Markets?," MPRA Paper 19482, University Library of Munich, Germany.
    6. repec:dau:papers:123456789/15232 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.
    2. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    3. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    4. Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel R., 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 150-160.
    5. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    6. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2011. "Are realized volatility models good candidates for alternative Value at Risk prediction strategies?," MPRA Paper 30364, University Library of Munich, Germany.
    7. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    8. Gaglianone, Wagner Piazza & Marins, Jaqueline Terra Moura, 2017. "Evaluation of exchange rate point and density forecasts: An application to Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 707-728.
    9. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    10. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    11. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    12. Ryohei Kawata & Masaaki Kijima, 2007. "Value-at-risk in a market subject to regime switching," Quantitative Finance, Taylor & Francis Journals, vol. 7(6), pages 609-619.
    13. Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    14. Stavroyiannis, S. & Makris, I. & Nikolaidis, V. & Zarangas, L., 2012. "Econometric modeling and value-at-risk using the Pearson type-IV distribution," International Review of Financial Analysis, Elsevier, vol. 22(C), pages 10-17.
    15. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    16. Christophe HURLIN & Sessi TOKPAVI, 2006. "Backtesting VaR Accuracy: A Simple and Powerful Test," LEO Working Papers / DR LEO 268, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    17. František Čech & Jozef Baruník, 2019. "Panel quantile regressions for estimating and predicting the value‐at‐risk of commodities," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 39(9), pages 1167-1189, September.
    18. Vasiliki D. Skintzi & Spyros Xanthopoulos-Sisinis, 2007. "Evaluation of correlation forecasting models for risk management," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(7), pages 497-526.
    19. Sean D. Campbell, 2005. "A review of backtesting and backtesting procedures," Finance and Economics Discussion Series 2005-21, Board of Governors of the Federal Reserve System (U.S.).
    20. Nieto, María Rosa, 2008. "Measuring financial risk : comparison of alternative procedures to estimate VaR and ES," DES - Working Papers. Statistics and Econometrics. WS ws087326, Universidad Carlos III de Madrid. Departamento de Estadística.

    More about this item

    Keywords

    Value-at-Risk; Backtesting;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:wpaper:halshs-00159846. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.