IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20110131.html
   My bibliography  Save this paper

Backtesting Value-at-Risk using Forecasts for Multiple Horizons, a Comment on the Forecast Rationality Tests of A.J. Patton and A. Timmermann

Author

Listed:
  • Lennart F. Hoogerheide

    (VU University Amsterdam)

  • Francesco Ravazzolo

    (Norges Bank)

  • Herman K. van Dijk

    (Erasmus University Rotterdam, VU University Amsterdam.)

Abstract

Patton and Timmermann (2011, “Forecast Rationality Tests Based on Multi-Horizon Bounds”, Journal of Business & Economic Statistics , 30(1), 1-17) propose a set of useful tests for forecast rationality or optimality under squared error loss, including an easily implemented test based on a regression that only involves (long-horizon and short-horizon) forecasts and no observations on the target variable. We propose an extension, a simulation-based procedure that takes into account the presence of errors in parameter estimates. This procedure can also be applied in the field of 'backtesting' models for Value-at-Risk. Applications to simple AR and ARCH time series models show that its power in detecting certain misspecifications is larger than the power of well-known tests for correct Unconditional Coverage and Conditional Coverage.

Suggested Citation

  • Lennart F. Hoogerheide & Francesco Ravazzolo & Herman K. van Dijk, 2011. "Backtesting Value-at-Risk using Forecasts for Multiple Horizons, a Comment on the Forecast Rationality Tests of A.J. Patton and A. Timmermann," Tinbergen Institute Discussion Papers 11-131/4, Tinbergen Institute.
    • Handle: RePEc:tin:wpaper:20110131
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/11131.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hoogerheide, Lennart & van Dijk, Herman K., 2010. "Bayesian forecasting of Value at Risk and Expected Shortfall using adaptive importance sampling," International Journal of Forecasting, Elsevier, vol. 26(2), pages 231-247, April.
    2. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    3. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    4. Andrew Patton & Allan Timmermann, 2012. "Forecast Rationality Tests Based on Multi-Horizon Bounds," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 1-17.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    2. Billio, Monica & Casarin, Roberto & Ravazzolo, Francesco & van Dijk, Herman K., 2013. "Time-varying combinations of predictive densities using nonlinear filtering," Journal of Econometrics, Elsevier, vol. 177(2), pages 213-232.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Chen, Qian & Gerlach, Richard & Lu, Zudi, 2012. "Bayesian Value-at-Risk and expected shortfall forecasting via the asymmetric Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3498-3516.
    3. Lukasz Gatarek & Lennart Hoogerheide & Koen Hooning & Herman K. van Dijk, 2013. "Censored Posterior and Predictive Likelihood in Left-Tail Prediction for Accurate Value at Risk Estimation," Tinbergen Institute Discussion Papers 13-060/III, Tinbergen Institute, revised 06 Mar 2014.
    4. Lennart Hoogerheide & Anne Opschoor & Herman K. van Dijk, 2011. "A Class of Adaptive EM-based Importance Sampling Algorithms for Efficient and Robust Posterior and Predictive Simulation," Tinbergen Institute Discussion Papers 11-004/4, Tinbergen Institute.
    5. Lennart F. Hoogerheide & David Ardia & Nienke Corre, 2011. "Stock Index Returns' Density Prediction using GARCH Models: Frequentist or Bayesian Estimation?," Tinbergen Institute Discussion Papers 11-020/4, Tinbergen Institute.
    6. Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2012. "A class of adaptive importance sampling weighted EM algorithms for efficient and robust posterior and predictive simulation," Journal of Econometrics, Elsevier, vol. 171(2), pages 101-120.
    7. Chen, Qian & Gerlach, Richard H., 2013. "The two-sided Weibull distribution and forecasting financial tail risk," International Journal of Forecasting, Elsevier, vol. 29(4), pages 527-540.
    8. Qiang Xia & Heung Wong & Jinshan Liu & Rubing Liang, 2017. "Bayesian Analysis of Power-Transformed and Threshold GARCH Models: A Griddy-Gibbs Sampler Approach," Computational Economics, Springer;Society for Computational Economics, vol. 50(3), pages 353-372, October.
    9. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    10. Ardia, David & Hoogerheide, Lennart F., 2014. "GARCH models for daily stock returns: Impact of estimation frequency on Value-at-Risk and Expected Shortfall forecasts," Economics Letters, Elsevier, vol. 123(2), pages 187-190.
    11. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    12. Fu, Jin-Yu & Lin, Jin-Guan & Hao, Hong-Xia, 2023. "Volatility analysis for the GARCH–Itô–Jumps model based on high-frequency and low-frequency financial data," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1698-1712.
    13. Chen, Cathy W.S. & Gerlach, Richard & Lin, Edward M.H., 2014. "Bayesian estimation of smoothly mixing time-varying parameter GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 194-209.
    14. Stavros Degiannakis & Pamela Dent & Christos Floros, 2014. "A Monte Carlo Simulation Approach to Forecasting Multi-period Value-at-Risk and Expected Shortfall Using the FIGARCH-skT Specification," Manchester School, University of Manchester, vol. 82(1), pages 71-102, January.
    15. Agnieszka Borowska & Lennart Hoogerheide & Siem Jan Koopman, 2019. "Bayesian Risk Forecasting for Long Horizons," Tinbergen Institute Discussion Papers 19-018/III, Tinbergen Institute.
    16. Hoogerheide, Lennart F. & Ardia, David & Corré, Nienke, 2012. "Density prediction of stock index returns using GARCH models: Frequentist or Bayesian estimation?," Economics Letters, Elsevier, vol. 116(3), pages 322-325.
    17. Gerlach, Richard & Abeywardana, Sachin, 2016. "Variational Bayes for assessment of dynamic quantile forecasts," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1385-1402.
    18. Stan Hurn & Jing Tian & Lina Xu, 2021. "Assessing the Informational Content of Official Australian Bureau of Meteorology Forecasts of Wind Speed," The Economic Record, The Economic Society of Australia, vol. 97(319), pages 525-547, December.
    19. Demiralay, Sercan & Ulusoy, Veysel, 2014. "Value-at-risk Predictions of Precious Metals with Long Memory Volatility Models," MPRA Paper 53229, University Library of Munich, Germany.
    20. Takahashi, Makoto & Watanabe, Toshiaki & Omori, Yasuhiro, 2016. "Volatility and quantile forecasts by realized stochastic volatility models with generalized hyperbolic distribution," International Journal of Forecasting, Elsevier, vol. 32(2), pages 437-457.

    More about this item

    Keywords

    Value-at-Risk; backtest; optimal revision; forecast rationality;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20110131. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.