IDEAS home Printed from https://ideas.repec.org/p/kud/kuiedp/1518.html
   My bibliography  Save this paper

Backtesting Value-at-Risk: A Generalized Markov Framework

Author

Listed:
  • Thor Pajhede

    (Department of Economics, University of Copenhagen)

Abstract

Testing the validity of Value-at-Risk (VaR) forecasts, or backtesting, is an integral part of modern market risk management and regulation. This is often done by applying independence and coverage tests developed in Christoffersen (1998) to so-called hit-sequences derived from VaR forecasts and realized losses. However, as pointed out in the literature, see Christoffersen (2004), these aforementioned tests suffer from low rejection frequencies, or (empirical) power, when applied to hit-sequences derived from simulations matching empirical stylized characteristics of return data. One key observation of the studies is that non-Markovian behavior in the hit-sequences may cause the observed lower power performance. To allow for non-Markovian behavior, we propose to generalize the backtest framework for Value-at-Risk forecasts, by extending the original first order dependence of Christoffersen (1998) to allow for a higher, or k’th, order dependence. We provide closed form expressions for the tests as well as asymptotic theory. Not only do the generalized tests have power against k’th order dependence by definition, but also included simulations indicate improved power performance when replicating the aforementioned studies.

Suggested Citation

  • Thor Pajhede, 2015. "Backtesting Value-at-Risk: A Generalized Markov Framework," Discussion Papers 15-18, University of Copenhagen. Department of Economics.
  • Handle: RePEc:kud:kuiedp:1518
    as

    Download full text from publisher

    File URL: http://www.econ.ku.dk/english/research/publications/wp/dp_2015/1518.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bertrand Candelon & Gilbert Colletaz & Christophe Hurlin & Sessi Tokpavi, 2011. "Backtesting Value-at-Risk: A GMM Duration-Based Test," Journal of Financial Econometrics, Oxford University Press, vol. 9(2), pages 314-343, Spring.
    2. Jensen, Søren Tolver & Rahbek, Anders, 2004. "Asymptotic Inference For Nonstationary Garch," Econometric Theory, Cambridge University Press, vol. 20(6), pages 1203-1226, December.
    3. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
    4. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    5. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    6. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    7. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.
    8. Pérignon, Christophe & Smith, Daniel R., 2010. "The level and quality of Value-at-Risk disclosure by commercial banks," Journal of Banking & Finance, Elsevier, vol. 34(2), pages 362-377, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. D. Th. Vezeris & C. J. Schinas & Th. S. Kyrgos & V. A. Bizergianidou & I. P. Karkanis, 2020. "Optimization of Backtesting Techniques in Automated High Frequency Trading Systems Using the d-Backtest PS Method," Computational Economics, Springer;Society for Computational Economics, vol. 56(4), pages 975-1054, December.
    2. S. M. Masrur Ahmed, 2023. "Sizing Strategies for Algorithmic Trading in Volatile Markets: A Study of Backtesting and Risk Mitigation Analysis," Papers 2309.09094, arXiv.org, revised Sep 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Fries, Christian P. & Nigbur, Tobias & Seeger, Norman, 2017. "Displaced relative changes in historical simulation: Application to risk measures of interest rates with phases of negative rates," Journal of Empirical Finance, Elsevier, vol. 42(C), pages 175-198.
    3. James M. O'Brien & Pawel J. Szerszen, 2014. "An Evaluation of Bank VaR Measures for Market Risk During and Before the Financial Crisis," Finance and Economics Discussion Series 2014-21, Board of Governors of the Federal Reserve System (U.S.).
    4. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    5. Thiele, Stephen, 2019. "Detecting underestimates of risk in VaR models," Journal of Banking & Finance, Elsevier, vol. 101(C), pages 12-20.
    6. Nikola Radivojevic & Milena Cvjetkovic & Saša Stepanov, 2016. "The new hybrid value at risk approach based on the extreme value theory," Estudios de Economia, University of Chile, Department of Economics, vol. 43(1 Year 20), pages 29-52, June.
    7. O’Brien, James & Szerszeń, Paweł J., 2017. "An evaluation of bank measures for market risk before, during and after the financial crisis," Journal of Banking & Finance, Elsevier, vol. 80(C), pages 215-234.
    8. Benjamin R. Auer & Benjamin Mögel, 2016. "How Accurate are Modern Value-at-Risk Estimators Derived from Extreme Value Theory?," CESifo Working Paper Series 6288, CESifo.
    9. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    10. Leccadito, Arturo & Boffelli, Simona & Urga, Giovanni, 2014. "Evaluating the accuracy of value-at-risk forecasts: New multilevel tests," International Journal of Forecasting, Elsevier, vol. 30(2), pages 206-216.
    11. Escanciano, Juan Carlos & Pei, Pei, 2012. "Pitfalls in backtesting Historical Simulation VaR models," Journal of Banking & Finance, Elsevier, vol. 36(8), pages 2233-2244.
    12. Marta Małecka, 2021. "Testing for a serial correlation in VaR failures through the exponential autoregressive conditional duration model," Statistics in Transition New Series, Polish Statistical Association, vol. 22(1), pages 145-162, March.
    13. Ziggel, Daniel & Berens, Tobias & Weiß, Gregor N.F. & Wied, Dominik, 2014. "A new set of improved Value-at-Risk backtests," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 29-41.
    14. Jean-Paul Laurent & Hassan Omidi Firouzi, 2022. "Market Risk and Volatility Weighted Historical Simulation After Basel III," Working Papers hal-03679434, HAL.
    15. Christophe Hurlin & Christophe Pérignon, 2012. "Margin Backtesting," Working Papers halshs-00746274, HAL.
    16. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    17. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    18. Bertrand Candelon & Marc Joëts & Sessi Tokpavi, 2012. "Testing for crude oil markets globalization during extreme price movements," Post-Print hal-01411687, HAL.
    19. Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    20. Aramonte, Sirio & Giudice Rodriguez, Marius del & Wu, Jason, 2013. "Dynamic factor Value-at-Risk for large heteroskedastic portfolios," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4299-4309.

    More about this item

    Keywords

    Value-at-Risk; Backtesting; Risk Management; Markov Chain; Duration-based test; quantile; likelihood ratio; maximum likelihood.;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kud:kuiedp:1518. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thomas Hoffmann (email available below). General contact details of provider: https://edirc.repec.org/data/okokudk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.