IDEAS home Printed from https://ideas.repec.org/a/taf/quantf/v16y2016i5p695-709.html
   My bibliography  Save this article

Evaluation of volatility predictions in a VaR framework

Author

Listed:
  • A. Amendola
  • V. Candila

Abstract

The evaluation of volatility forecasts is not straightforward and some issues can arise. A standard approach relies on statistical loss functions. Another approach bases the evaluation of the volatility predictions on utility functions or Value at Risk (VaR) measures. This work aims to combine the two approaches, using the VaR measures within the loss functions. By means of this method, the VaR measures obtained from a set of competing models are plugged into two loss functions, the magnitude loss function and a proposed new one. This latter loss function more heavily penalizes the models with a number of VaR violations greater than the expected one. The loss function values are evaluated against a benchmark obtained from the inclusion of a consistent estimate of the VaR measures in the loss function. In order to investigate the performance of the proposed method and the new loss function, a Monte Carlo experiment and an empirical analysis of a stock listed on the New York Stock Exchange are provided. The proposed strategy helps with the selection of a superior model, in terms of forecast accuracy, when the cited approaches do not clearly and uniquely identify it. Moreover, the new asymmetric loss function allows a greater discrimination with regard to models, helping to find the best volatility model.

Suggested Citation

  • A. Amendola & V. Candila, 2016. "Evaluation of volatility predictions in a VaR framework," Quantitative Finance, Taylor & Francis Journals, vol. 16(5), pages 695-709, May.
  • Handle: RePEc:taf:quantf:v:16:y:2016:i:5:p:695-709
    DOI: 10.1080/14697688.2015.1062122
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/14697688.2015.1062122
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/14697688.2015.1062122?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    2. Mauro Bernardi & Leopoldo Catania, 2014. "The Model Confidence Set package for R," Papers 1410.8504, arXiv.org.
    3. Gencay, Ramazan & Selcuk, Faruk, 2004. "Extreme value theory and Value-at-Risk: Relative performance in emerging markets," International Journal of Forecasting, Elsevier, vol. 20(2), pages 287-303.
    4. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    5. Zhang, Lan & Mykland, Per A. & Ait-Sahalia, Yacine, 2005. "A Tale of Two Time Scales: Determining Integrated Volatility With Noisy High-Frequency Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1394-1411, December.
    6. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    7. Lima, Luiz Renato & Néri, Breno Pinheiro, 2007. "Comparing Value-at-Risk Methodologies," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 27(1), May.
    8. Jose A. Lopez, 1999. "Methods for evaluating value-at-risk estimates," Economic Review, Federal Reserve Bank of San Francisco, pages 3-17.
    9. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    10. Gonçalves, Sílvia & White, Halbert, 2002. "The Bootstrap Of The Mean For Dependent Heterogeneous Arrays," Econometric Theory, Cambridge University Press, vol. 18(6), pages 1367-1384, December.
    11. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    12. Stephen J. Taylor, 1994. "Modeling Stochastic Volatility: A Review And Comparative Study," Mathematical Finance, Wiley Blackwell, vol. 4(2), pages 183-204, April.
    13. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    14. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    15. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    16. F. M. Bandi & J. R. Russell, 2008. "Microstructure Noise, Realized Variance, and Optimal Sampling," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(2), pages 339-369.
    17. Engle, Robert F. & White (the late), Halbert (ed.), 1999. "Cointegration, Causality, and Forecasting: Festschrift in Honour of Clive W. J. Granger," OUP Catalogue, Oxford University Press, number 9780198296836.
    18. Ledoit, Oliver & Wolf, Michael, 2008. "Robust performance hypothesis testing with the Sharpe ratio," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 850-859, December.
    19. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    20. Engle, Robert F. & Manganelli, Simone, 2001. "Value at risk models in finance," Working Paper Series 75, European Central Bank.
    21. Goncalves, Silvia & de Jong, Robert, 2003. "Consistency of the stationary bootstrap under weak moment conditions," Economics Letters, Elsevier, vol. 81(2), pages 273-278, November.
    22. I.-Yuan Chuang & Jin-Ray Lu & Pei-Hsuan Lee, 2007. "Forecasting volatility in the financial markets: a comparison of alternative distributional assumptions," Applied Financial Economics, Taylor & Francis Journals, vol. 17(13), pages 1051-1060.
    23. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    24. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    25. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    26. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    27. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    28. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    29. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    30. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    31. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    32. Andrew Patton & Dimitris Politis & Halbert White, 2009. "Correction to “Automatic Block-Length Selection for the Dependent Bootstrap” by D. Politis and H. White," Econometric Reviews, Taylor & Francis Journals, vol. 28(4), pages 372-375.
    33. Cheng-Few Lee & Jung-Bin Su, 2012. "Alternative statistical distributions for estimating value-at-risk: theory and evidence," Review of Quantitative Finance and Accounting, Springer, vol. 39(3), pages 309-331, October.
    34. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    35. Hayfield, Tristen & Racine, Jeffrey S., 2008. "Nonparametric Econometrics: The np Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i05).
    36. Giot, Pierre & Laurent, Sebastien, 2003. "Market risk in commodity markets: a VaR approach," Energy Economics, Elsevier, vol. 25(5), pages 435-457, September.
    37. Christopher Adcock & Martin Eling & Nicola Loperfido, 2015. "Skewed distributions in finance and actuarial science: a review," The European Journal of Finance, Taylor & Francis Journals, vol. 21(13-14), pages 1253-1281, November.
    38. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    39. Huisman, R. & Koedijik, K.G. & Pownall, R.A.J., 1998. "VaR-x: Fat Tails in Financial Risk Management," Papers 98-54, Southern California - School of Business Administration.
    40. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    41. Fleming, Jeff & Kirby, Chris & Ostdiek, Barbara, 2003. "The economic value of volatility timing using "realized" volatility," Journal of Financial Economics, Elsevier, vol. 67(3), pages 473-509, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kejin Wu & Sayar Karmakar, 2023. "A model-free approach to do long-term volatility forecasting and its variants," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-38, December.
    2. Michele Leonardo Bianchi & Giovanni De Luca & Giorgia Rivieccio, 2020. "CoVaR with volatility clustering, heavy tails and non-linear dependence," Papers 2009.10764, arXiv.org.
    3. Vincenzo Candila & Giampiero M. Gallo & Lea Petrella, 2020. "Mixed--frequency quantile regressions to forecast Value--at--Risk and Expected Shortfall," Papers 2011.00552, arXiv.org, revised Mar 2023.
    4. María de la O González & Francisco Jareño & Camalea El Haddouti, 2019. "Sector Portfolio Performance Comparison between Islamic and Conventional Stock Markets," Sustainability, MDPI, vol. 11(17), pages 1-23, August.
    5. Mateusz Buczyński & Marcin Chlebus, 2019. "Old-fashioned parametric models are still the best. A comparison of Value-at-Risk approaches in several volatility states," Working Papers 2019-12, Faculty of Economic Sciences, University of Warsaw.
    6. Georges Tsafack & James Cataldo, 2021. "Backtesting and estimation error: value-at-risk overviolation rate," Empirical Economics, Springer, vol. 61(3), pages 1351-1396, September.
    7. Marchese, Malvina & Kyriakou, Ioannis & Tamvakis, Michael & Di Iorio, Francesca, 2020. "Forecasting crude oil and refined products volatilities and correlations: New evidence from fractionally integrated multivariate GARCH models," Energy Economics, Elsevier, vol. 88(C).
    8. Bianchi, Michele Leonardo & De Luca, Giovanni & Rivieccio, Giorgia, 2023. "Non-Gaussian models for CoVaR estimation," International Journal of Forecasting, Elsevier, vol. 39(1), pages 391-404.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Jia & Patton, Andrew J., 2018. "Asymptotic inference about predictive accuracy using high frequency data," Journal of Econometrics, Elsevier, vol. 203(2), pages 223-240.
    2. Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012. "On the forecasting accuracy of multivariate GARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, September.
    3. Mauro Bernardi & Leopoldo Catania, 2016. "Comparison of Value-at-Risk models using the MCS approach," Computational Statistics, Springer, vol. 31(2), pages 579-608, June.
    4. Owusu Junior, Peterson & Tiwari, Aviral Kumar & Tweneboah, George & Asafo-Adjei, Emmanuel, 2022. "GAS and GARCH based value-at-risk modeling of precious metals," Resources Policy, Elsevier, vol. 75(C).
    5. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    6. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    7. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2005. "Volatility forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies (CFS).
    8. Timotheos Angelidis & Stavros Degiannakis, 2007. "Backtesting VaR Models: An Expected Shortfall Approach," Working Papers 0701, University of Crete, Department of Economics.
    9. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2011. "Are realized volatility models good candidates for alternative Value at Risk prediction strategies?," MPRA Paper 30364, University Library of Munich, Germany.
    10. Andrea BUCCI, 2017. "Forecasting Realized Volatility A Review," Journal of Advanced Studies in Finance, ASERS Publishing, vol. 8(2), pages 94-138.
    11. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    12. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2014. "Realized volatility models and alternative Value-at-Risk prediction strategies," Economic Modelling, Elsevier, vol. 40(C), pages 101-116.
    13. Wei, Yu & Wang, Yudong & Huang, Dengshi, 2010. "Forecasting crude oil market volatility: Further evidence using GARCH-class models," Energy Economics, Elsevier, vol. 32(6), pages 1477-1484, November.
    14. David E. Rapach & Jack K. Strauss, 2008. "Structural breaks and GARCH models of exchange rate volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(1), pages 65-90.
    15. Patton, Andrew J., 2011. "Data-based ranking of realised volatility estimators," Journal of Econometrics, Elsevier, vol. 161(2), pages 284-303, April.
    16. Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.
    17. Herrera, Ana María & Hu, Liang & Pastor, Daniel, 2018. "Forecasting crude oil price volatility," International Journal of Forecasting, Elsevier, vol. 34(4), pages 622-635.
    18. Scharth, Marcel & Medeiros, Marcelo C., 2009. "Asymmetric effects and long memory in the volatility of Dow Jones stocks," International Journal of Forecasting, Elsevier, vol. 25(2), pages 304-327.
    19. Ma, Feng & Wei, Yu & Huang, Dengshi & Chen, Yixiang, 2014. "Which is the better forecasting model? A comparison between HAR-RV and multifractality volatility," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 405(C), pages 171-180.
    20. Vica Tendenan & Richard Gerlach & Chao Wang, 2020. "Tail risk forecasting using Bayesian realized EGARCH models," Papers 2008.05147, arXiv.org, revised Aug 2020.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:quantf:v:16:y:2016:i:5:p:695-709. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RQUF20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.