IDEAS home Printed from https://ideas.repec.org/a/oup/jfinec/v9y2011i1p132-161.html
   My bibliography  Save this article

Robust Backtesting Tests for Value-at-risk Models

Author

Listed:
  • J. Carlos Escanciano
  • Jose Olmo

Abstract

Backtesting methods are statistical tests designed to uncover value-at-risk (VaR) models not capable of reporting the correct unconditional coverage probability or filtering the serial dependence in the data. We show in this paper that these methods are subject to the presence of model risk produced by the incorrect specification of the conditional VaR model and derive its effect in the asymptotic distribution of the relevant out-of-sample tests. We also show that in the absence of estimation risk, the unconditional backtest is affected by model misspecification but the independence test is not. We propose using resampling methods to implement robust backtests. Our experiments suggest that block-bootstrap outperforms subsampling methods in size accuracy. We carry out a Monte Carlo study to see the importance of model risk in finite samples for location-scale models that are incorrectly specified but correct on "average ". An application to Dow--Jones Index shows the impact of correcting for model risk on backtesting procedures for different dynamic VaR models measuring risk exposure. C52, C53, G32 Copyright The Author 2010. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oxfordjournals.org, Oxford University Press.

Suggested Citation

  • J. Carlos Escanciano & Jose Olmo, 2011. "Robust Backtesting Tests for Value-at-risk Models," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 9(1), pages 132-161, Winter.
  • Handle: RePEc:oup:jfinec:v:9:y:2011:i:1:p:132-161
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/jjfinec/nbq021
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olmo Jose & Pouliot William, 2011. "Early Detection Techniques for Market Risk Failure," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 15(4), pages 1-55, September.
    2. Olivier de Bandt & Jean-Cyprien Héam & Claire Labonne & Santiago Tavolaro, 2015. "La mesure du risque systémique après la crise financière," Revue économique, Presses de Sciences-Po, vol. 66(3), pages 481-500.
    3. Evers, Corinna & Rohde, Johannes, 2014. "Model Risk in Backtesting Risk Measures," Hannover Economic Papers (HEP) dp-529, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    4. Gourieroux, Christian & Zakoïan, Jean-Michel, 2013. "Estimation-Adjusted Var," Econometric Theory, Cambridge University Press, vol. 29(04), pages 735-770, August.
    5. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    6. Igor L. Kheifets, 2015. "Specification tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 18(1), pages 67-94, February.
    7. Francq, Christian & Zakoian, Jean-Michel, 2015. "Joint inference on market and estimation risks in dynamic portfolios," MPRA Paper 68100, University Library of Munich, Germany.
    8. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    9. Köksal, Bülent & Orhan, Mehmet, 2012. "Market risk of developed and developing countries during the global financial crisis," MPRA Paper 37523, University Library of Munich, Germany.
    10. repec:sgm:pzwzuw:v:15:i:66:y:2017:p:107-124 is not listed on IDEAS
    11. Escanciano, Juan Carlos & Pei, Pei, 2012. "Pitfalls in backtesting Historical Simulation VaR models," Journal of Banking & Finance, Elsevier, vol. 36(8), pages 2233-2244.
    12. Curti, Filippo & Migueis, Marco, 2016. "Predicting Operational Loss Exposure Using Past Losses," Finance and Economics Discussion Series 2016-2, Board of Governors of the Federal Reserve System (U.S.), revised 12 Oct 2016.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:jfinec:v:9:y:2011:i:1:p:132-161. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Oxford University Press) or (Christopher F. Baum). General contact details of provider: http://edirc.repec.org/data/sofieea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.