IDEAS home Printed from https://ideas.repec.org/p/bcb/wpaper/161.html
   My bibliography  Save this paper

Evaluating Value-at-Risk Models via Quantile Regressions

Author

Listed:
  • Wagner P. Gaglianone
  • Luiz Renato Lima
  • Oliver Linton

Abstract

We propose an alternative backtest to evaluate the performance of Value-at-Risk (VaR) models. The presented methodology allows us to directly test the performance of many competing VaR models, as well as identify periods of an increased risk exposure based on a quantile regression model (Koenker & Xiao, 2002). Quantile regressions provide us an appropriate environment to investigate VaR models, since they can naturally be viewed as a conditional quantile function of a given return series. A Monte Carlo simulation is presented, revealing that our proposed test might exhibit more power in comparison to other backtests presented in the literature. Finally, an empirical exercise is conducted for daily S&P500 return series in order to explore the practical relevance of our methodology by evaluating five competing VaRs through four different backtests.

Suggested Citation

  • Wagner P. Gaglianone & Luiz Renato Lima & Oliver Linton, 2008. "Evaluating Value-at-Risk Models via Quantile Regressions," Working Papers Series 161, Central Bank of Brazil, Research Department.
  • Handle: RePEc:bcb:wpaper:161
    as

    Download full text from publisher

    File URL: https://www.bcb.gov.br/content/publicacoes/WorkingPaperSeries/wps161.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christoffersen, Peter & Hahn, Jinyong & Inoue, Atsushi, 2001. "Testing and comparing Value-at-Risk measures," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 325-342, July.
    2. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    3. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    4. Casper G. de Vries & Gennady Samorodnitsky & Bjørn N. Jorgensen & Sarma Mandira & Jon Danielsson, 2005. "Subadditivity Re–Examined: the Case for Value-at-Risk," FMG Discussion Papers dp549, Financial Markets Group.
    5. Issler, João Victor & Lima, Luiz Renato, 2009. "A panel data approach to economic forecasting: The bias-corrected average forecast," Journal of Econometrics, Elsevier, vol. 152(2), pages 153-164, October.
    6. Jeremy Berkowitz & James O'Brien, 2002. "How Accurate Are Value‐at‐Risk Models at Commercial Banks?," Journal of Finance, American Finance Association, vol. 57(3), pages 1093-1111, June.
    7. Peter Christoffersen & Silvia Gonçalves, 2004. "Estimation Risk in Financial Risk Management," CIRANO Working Papers 2004s-15, CIRANO.
    8. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    9. José A. F. Machado & José Mata, 2001. "Earning functions in Portugal 1982-1994: Evidence from quantile regressions," Empirical Economics, Springer, vol. 26(1), pages 115-134.
    10. Sean D. Campbell, 2005. "A review of backtesting and backtesting procedures," Finance and Economics Discussion Series 2005-21, Board of Governors of the Federal Reserve System (U.S.).
    11. Lima, Luiz Renato & Néri, Breno Pinheiro, 2007. "Comparing Value-at-Risk Methodologies," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 27(1), May.
    12. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    13. Keith Kuester & Stefan Mittnik & Marc S. Paolella, 2006. "Value-at-Risk Prediction: A Comparison of Alternative Strategies," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 53-89.
    14. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    15. M.J.B. Hall, 1996. "The amendment to the capital accord to incorporate market risk," BNL Quarterly Review, Banca Nazionale del Lavoro, vol. 49(197), pages 271-277.
    16. Jon Danielsson & Casper G. De Vries, 2000. "Value-at-Risk and Extreme Returns," Annals of Economics and Statistics, GENES, issue 60, pages 239-270.
    17. Koenker, Roger & Bassett, Gilbert, Jr, 1982. "Robust Tests for Heteroscedasticity Based on Regression Quantiles," Econometrica, Econometric Society, vol. 50(1), pages 43-61, January.
    18. Len Umantsev & Victor Chernozhukov, 2001. "Conditional value-at-risk: Aspects of modeling and estimation," Empirical Economics, Springer, vol. 26(1), pages 271-292.
    19. Moshe Buchinsky, 1998. "Recent Advances in Quantile Regression Models: A Practical Guideline for Empirical Research," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 88-126.
    20. Paul Embrechts & Sidney Resnick & Gennady Samorodnitsky, 1999. "Extreme Value Theory as a Risk Management Tool," North American Actuarial Journal, Taylor & Francis Journals, vol. 3(2), pages 30-41.
    21. Jon Danielsson & Casper G. De Vries, 2000. "Value-at-Risk and Extreme Returns," Annals of Economics and Statistics, GENES, issue 60, pages 239-270.
    22. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    23. Danielsson, Jon & Zigrand, Jean-Pierre, 2006. "On time-scaling of risk and the square-root-of-time rule," Journal of Banking & Finance, Elsevier, vol. 30(10), pages 2701-2713, October.
    24. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    25. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    26. Jose A. Lopez, 1999. "Methods for evaluating value-at-risk estimates," Economic Review, Federal Reserve Bank of San Francisco, pages 3-17.
    27. Pascual, Lorenzo & Romo, Juan & Ruiz, Esther, 2006. "Bootstrap prediction for returns and volatilities in GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 50(9), pages 2293-2312, May.
    28. Huisman, Ronald, et al, 2001. "Tail-Index Estimates in Small Samples," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(2), pages 208-216, April.
    29. Koenker, Roger & Zhao, Quanshui, 1996. "Conditional Quantile Estimation and Inference for Arch Models," Econometric Theory, Cambridge University Press, vol. 12(5), pages 793-813, December.
    30. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    31. Linton, O. & Whang, Yoon-Jae, 2007. "The quantilogram: With an application to evaluating directional predictability," Journal of Econometrics, Elsevier, vol. 141(1), pages 250-282, November.
    32. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    33. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    34. Roger Koenker & Zhijie Xiao, 2002. "Inference on the Quantile Regression Process," Econometrica, Econometric Society, vol. 70(4), pages 1583-1612, July.
    35. Powell, James L., 1984. "Least absolute deviations estimation for the censored regression model," Journal of Econometrics, Elsevier, vol. 25(3), pages 303-325, July.
    36. Franses, Philip Hans & Ghijsels, Hendrik, 1999. "Additive outliers, GARCH and forecasting volatility," International Journal of Forecasting, Elsevier, vol. 15(1), pages 1-9, February.
    37. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    38. Charles, Amelie & Darne, Olivier, 2005. "Outliers and GARCH models in financial data," Economics Letters, Elsevier, vol. 86(3), pages 347-352, March.
    39. R. F. Engle & A. J. Patton, 2001. "What good is a volatility model?," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 237-245.
    40. Hartz, Christoph & Mittnik, Stefan & Paolella, Marc, 2006. "Accurate value-at-risk forecasting based on the normal-GARCH model," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2295-2312, December.
    41. Matthew Pritsker, 2001. "The hidden dangers of historical simulation," Finance and Economics Discussion Series 2001-27, Board of Governors of the Federal Reserve System (U.S.).
    42. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    3. Nieto, María Rosa & Ruiz Ortega, Esther, 2008. "Measuring financial risk : comparison of alternative procedures to estimate VaR and ES," DES - Working Papers. Statistics and Econometrics. WS ws087326, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    5. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    6. Benjamin R. Auer & Benjamin Mögel, 2016. "How Accurate are Modern Value-at-Risk Estimators Derived from Extreme Value Theory?," CESifo Working Paper Series 6288, CESifo.
    7. Lima, Luiz Renato & Néri, Breno Pinheiro, 2007. "Comparing Value-at-Risk Methodologies," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 27(1), May.
    8. Şener, Emrah & Baronyan, Sayad & Ali Mengütürk, Levent, 2012. "Ranking the predictive performances of value-at-risk estimation methods," International Journal of Forecasting, Elsevier, vol. 28(4), pages 849-873.
    9. Bakshi, Gurdip & Panayotov, George, 2010. "First-passage probability, jump models, and intra-horizon risk," Journal of Financial Economics, Elsevier, vol. 95(1), pages 20-40, January.
    10. George Kouretas & Leonidas Zarangas, 2005. "Conditional autoregressive valu at risk by regression quantile: Estimatingmarket risk for major stock markets," Working Papers 0521, University of Crete, Department of Economics.
    11. Chebbi, Ali & Hedhli, Amel, 2022. "Revisiting the accuracy of standard VaR methods for risk assessment: Using the Copula–EVT multidimensional approach for stock markets in the MENA region," The Quarterly Review of Economics and Finance, Elsevier, vol. 84(C), pages 430-445.
    12. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    13. Gaglianone, Wagner Piazza & Marins, Jaqueline Terra Moura, 2017. "Evaluation of exchange rate point and density forecasts: An application to Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 707-728.
    14. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    15. Hartz, Christoph & Mittnik, Stefan & Paolella, Marc, 2006. "Accurate value-at-risk forecasting based on the normal-GARCH model," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2295-2312, December.
    16. Escanciano, J. C. & Olmo, J., 2007. "Estimation risk effects on backtesting for parametric value-at-risk models," Working Papers 07/11, Department of Economics, City University London.
    17. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.
    18. Jimenez-Martin, Juan-Angel & McAleer, Michael & Pérez-Amaral, Teodosio & Santos, Paulo Araújo, 2013. "GFC-robust risk management under the Basel Accord using extreme value methodologies," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 94(C), pages 223-237.
    19. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2011. "Are realized volatility models good candidates for alternative Value at Risk prediction strategies?," MPRA Paper 30364, University Library of Munich, Germany.
    20. Vica Tendenan & Richard Gerlach & Chao Wang, 2020. "Tail risk forecasting using Bayesian realized EGARCH models," Papers 2008.05147, arXiv.org, revised Aug 2020.

    More about this item

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bcb:wpaper:161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rodrigo Barbone Gonzalez (email available below). General contact details of provider: https://www.bcb.gov.br/en .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.