IDEAS home Printed from https://ideas.repec.org/a/brf/journl/v4y2006i1p97-118.html
   My bibliography  Save this article

Internal Model Validation in Brazil: Analysis of VaR Backtesting Methodologies

Author

Listed:
  • Alan Cosme Rodrigues da Silva

    (Central Bank of Brazil)

  • Claudio Henrique da Silveira Barbedo

    (Central Bank of Brazil)

  • Gustavo Silva Araújo

    (Central Bank of Brazil)

  • Myrian Beatriz Eiras das Neves

    (Central Bank of Brazil)

Abstract

The purpose of this paper is to analyze backtesting methodologies of VaR, focusing on aspects as suitability to volatile markets and limited data set. We verify, from regulatory standpoint, tests to complement the Basel traffic light results, using simulated and real data. The results indicate that tests based on failures proportion are not adequate for small samples even fro 1,000 observations. The Basel criterion is conservative and has low power, which does not invalidate its application, as the criterion is only one of the procedures adopted in internal model validation process. Thus, it is suggested using tests that capture the shape of returns distribution, as the Kuiper test, in addition to the Basel criterion.

Suggested Citation

  • Alan Cosme Rodrigues da Silva & Claudio Henrique da Silveira Barbedo & Gustavo Silva Araújo & Myrian Beatriz Eiras das Neves, 2006. "Internal Model Validation in Brazil: Analysis of VaR Backtesting Methodologies," Brazilian Review of Finance, Brazilian Society of Finance, vol. 4(1), pages 97-118.
    • Handle: RePEc:brf:journl:v:4:y:2006:i:1:p:97-118
    as

    Download full text from publisher

    File URL: http://bibliotecadigital.fgv.br/ojs/index.php/rbfin/article/download/1157/369
    Download Restriction: no
    File URL: http://bibliotecadigital.fgv.br/ojs/index.php/rbfin/article/view/1157
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    2. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    3. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(1), pages 84-108.
    4. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    5. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emese Lazar & Ning Zhang, 2017. "Model Risk of Expected Shortfall," ICMA Centre Discussion Papers in Finance icma-dp2017-10, Henley Business School, University of Reading.
    2. Steven Kou & Xianhua Peng, 2016. "On the Measurement of Economic Tail Risk," Operations Research, INFORMS, vol. 64(5), pages 1056-1072, October.
    3. Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    4. Marie Kratz & Yen H Lok & Alexander J Mcneil, 2016. "Multinomial var backtests: A simple implicit approach to backtesting expected shortfall," Working Papers hal-01424279, HAL.
    5. Farkas, Walter & Fringuellotti, Fulvia & Tunaru, Radu, 2020. "A cost-benefit analysis of capital requirements adjusted for model risk," Journal of Corporate Finance, Elsevier, vol. 65(C).
    6. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    7. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.
    8. Wied, Dominik & Weiß, Gregor N.F. & Ziggel, Daniel, 2016. "Evaluating Value-at-Risk forecasts: A new set of multivariate backtests," Journal of Banking & Finance, Elsevier, vol. 72(C), pages 121-132.
    9. Soren Bettels & Sojung Kim & Stefan Weber, 2022. "Multinomial Backtesting of Distortion Risk Measures," Papers 2201.06319, arXiv.org, revised Jan 2024.
    10. Leccadito, Arturo & Boffelli, Simona & Urga, Giovanni, 2014. "Evaluating the accuracy of value-at-risk forecasts: New multilevel tests," International Journal of Forecasting, Elsevier, vol. 30(2), pages 206-216.
    11. Fabio Bellini & Ilia Negri & Mariya Pyatkova, 2019. "Backtesting VaR and expectiles with realized scores," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(1), pages 119-142, March.
    12. Gaglianone, Wagner Piazza & Marins, Jaqueline Terra Moura, 2017. "Evaluation of exchange rate point and density forecasts: An application to Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 707-728.
    13. Ziggel, Daniel & Berens, Tobias & Weiß, Gregor N.F. & Wied, Dominik, 2014. "A new set of improved Value-at-Risk backtests," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 29-41.
    14. Kratz, Marie & Lok, Y-H & McNeil, Alexander J., 2016. "Multinomial VaR Backtests: A simple implicit approach to backtesting expected shortfall," ESSEC Working Papers WP1617, ESSEC Research Center, ESSEC Business School.
    15. Kratz, Marie & Lok, Yen H. & McNeil, Alexander J., 2018. "Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall," Journal of Banking & Finance, Elsevier, vol. 88(C), pages 393-407.
    16. Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel R., 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 150-160.
    17. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    18. Baum, Christopher F. & Zerilli, Paola & Chen, Liyuan, 2021. "Stochastic volatility, jumps and leverage in energy and stock markets: Evidence from high frequency data," Energy Economics, Elsevier, vol. 93(C).
    19. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    20. Stavroyiannis, S. & Makris, I. & Nikolaidis, V. & Zarangas, L., 2012. "Econometric modeling and value-at-risk using the Pearson type-IV distribution," International Review of Financial Analysis, Elsevier, vol. 22(C), pages 10-17.

    More about this item

    Keywords

    Backtest; VaR tests; simulation; market risk;
    All these keywords.

    JEL classification:

    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:brf:journl:v:4:y:2006:i:1:p:97-118. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marcio Laurini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.