IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v31y2016i2d10.1007_s00180-016-0646-6.html
   My bibliography  Save this article

Comparison of Value-at-Risk models using the MCS approach

Author

Listed:
  • Mauro Bernardi

    (University of Padua)

  • Leopoldo Catania

    (University of Rome Tor Vergata)

Abstract

This paper compares the Value-at-Risk (VaR) forecasts delivered by alternative model specifications using the Model Confidence Set (MCS) procedure recently developed by Hansen et al. (Econometrica 79(2):453–497, 2011). The direct VaR estimate provided by the Conditional Autoregressive Value-at-Risk (CAViaR) models of Engle and Manganelli (J Bus Econ Stat 22(4):367–381, 2004) are compared to those obtained by the popular Autoregressive Conditional Heteroskedasticity (ARCH) models of Engle (Econometrica 50(4):987–1007, 1982) and to the Generalised Autoregressive Score (GAS) models recently introduced by Creal et al. (J Appl Econom 28(5):777–795, 2013) and Harvey (Dynamic models for volatility and heavy tails: with applications to financial and economic time series. Cambridge University Press, Cambridge, 2013). The MCS procedure consists in a sequence of tests which permits to construct a set of “superior” models, where the null hypothesis of Equal Predictive Ability (EPA) is not rejected at a certain confidence level. Our empirical results, suggest that, during the European Sovereign Debt crisis of 2009–2010, highly non-linear volatility models deliver better VaR forecasts for the European countries as opposed to other regional indexes. Model comparisons have been performed using the $$\textsf {R}$$ R package MCS developed by the authors and freely available at the CRAN website.

Suggested Citation

  • Mauro Bernardi & Leopoldo Catania, 2016. "Comparison of Value-at-Risk models using the MCS approach," Computational Statistics, Springer, vol. 31(2), pages 579-608, June.
  • Handle: RePEc:spr:compst:v:31:y:2016:i:2:d:10.1007_s00180-016-0646-6
    DOI: 10.1007/s00180-016-0646-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-016-0646-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00180-016-0646-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    2. Davide Delle Monache & Ivan Petrella, 2014. "Adaptive Models and Heavy Tails," Working Papers 720, Queen Mary University of London, School of Economics and Finance.
    3. Caporin, Massimiliano & McAleer, Michael, 2014. "Robust ranking of multivariate GARCH models by problem dimension," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 172-185.
    4. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    5. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107630024, January.
    6. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    7. Chen, Qian & Gerlach, Richard & Lu, Zudi, 2012. "Bayesian Value-at-Risk and expected shortfall forecasting via the asymmetric Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3498-3516.
    8. Stephen J. Taylor, 1994. "Modeling Stochastic Volatility: A Review And Comparative Study," Mathematical Finance, Wiley Blackwell, vol. 4(2), pages 183-204, April.
    9. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    10. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    11. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    12. Lucas, André & Zhang, Xin, 2016. "Score-driven exponentially weighted moving averages and Value-at-Risk forecasting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 293-302.
    13. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    14. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    15. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    16. Peter Reinhard Hansen & Asger Lunde & James M. Nason, 2003. "Choosing the Best Volatility Models: The Model Confidence Set Approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 839-861, December.
    17. Schwert, G William, 1990. "Stock Volatility and the Crash of '87," Review of Financial Studies, Society for Financial Studies, vol. 3(1), pages 77-102.
    18. Higgins, Matthew L & Bera, Anil K, 1992. "A Class of Nonlinear ARCH Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 33(1), pages 137-158, February.
    19. Robert F. Engle & Jeffrey R. Russell, 1998. "Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data," Econometrica, Econometric Society, vol. 66(5), pages 1127-1162, September.
    20. Engle, Robert F. & Gallo, Giampiero M., 2006. "A multiple indicators model for volatility using intra-daily data," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 3-27.
    21. Gallant, A. Ronald & Hsieh, David & Tauchen, George, 1997. "Estimation of stochastic volatility models with diagnostics," Journal of Econometrics, Elsevier, vol. 81(1), pages 159-192, November.
    22. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    23. Mauro Bernardi & Leopoldo Catania & Lea Petrella, 2014. "Are news important to predict large losses?," Papers 1410.6898, arXiv.org, revised Oct 2014.
    24. Chen, Qian & Gerlach, Richard H., 2013. "The two-sided Weibull distribution and forecasting financial tail risk," International Journal of Forecasting, Elsevier, vol. 29(4), pages 527-540.
    25. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    26. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    27. Yu, Keming & Moyeed, Rana A., 2001. "Bayesian quantile regression," Statistics & Probability Letters, Elsevier, vol. 54(4), pages 437-447, October.
    28. Jon D. Samuels & Rodrigo Sekkel, 2013. "Forecasting with Many Models: Model Confidence Sets and Forecast Combination," Staff Working Papers 13-11, Bank of Canada.
    29. Davide Delle Monache & Ivan Petrella, 2014. "Adaptive Models and Heavy Tails," Working Papers 720, Queen Mary University of London, School of Economics and Finance.
    30. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    31. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct.
    32. Koenker, Roger & Xiao, Zhijie, 2006. "Quantile Autoregression," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 980-990, September.
    33. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    34. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    35. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    36. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    37. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    38. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    39. Robert Engle, 2002. "New frontiers for arch models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 425-446.
    40. Luc Bauwens & Sébastien Laurent & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109, January.
    41. Michael McAleer & Bernardo da Veiga, 2008. "Single-index and portfolio models for forecasting value-at-risk thresholds," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(3), pages 217-235.
    42. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    43. Harvey, Andrew C & Shephard, Neil, 1996. "Estimation of an Asymmetric Stochastic Volatility Model for Asset Returns," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(4), pages 429-434, October.
    44. Zakoian, Jean-Michel, 1994. "Threshold heteroskedastic models," Journal of Economic Dynamics and Control, Elsevier, vol. 18(5), pages 931-955, September.
    45. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    46. Harvey, Andrew & Sucarrat, Genaro, 2014. "EGARCH models with fat tails, skewness and leverage," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 320-338.
    47. Mauro Bernardi & Leopoldo Catania & Lea Petrella, 2017. "Are news important to predict the Value-at-Risk?," The European Journal of Finance, Taylor & Francis Journals, vol. 23(6), pages 535-572, May.
    48. Kowalski, Tadeusz & Shachmurove, Yochanan, 2014. "The reaction of the U.S. and the European Monetary Union to recent global financial crises," Global Finance Journal, Elsevier, vol. 25(1), pages 27-47.
    49. Andres, Philipp, 2014. "Maximum likelihood estimates for positive valued dynamic score models; The DySco package," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 34-42.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leopoldo Catania & Nima Nonejad, 2016. "Density Forecasts and the Leverage Effect: Some Evidence from Observation and Parameter-Driven Volatility Models," Papers 1605.00230, arXiv.org, revised Nov 2016.
    2. Lyócsa, Štefan & Todorova, Neda, 2020. "Trading and non-trading period realized market volatility: Does it matter for forecasting the volatility of US stocks?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 628-645.
    3. Peng, Wei, 2023. "The impact of oil and natural gas prices on overnight risk in exchange rates based on the MVMQ-CAViaR models," International Review of Economics & Finance, Elsevier, vol. 86(C), pages 616-625.
    4. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    5. Hasanov, Akram Shavkatovich & Shaiban, Mohammed Sharaf & Al-Freedi, Ajab, 2020. "Forecasting volatility in the petroleum futures markets: A re-examination and extension," Energy Economics, Elsevier, vol. 86(C).
    6. Liu, Min, 2022. "The driving forces of green bond market volatility and the response of the market to the COVID-19 pandemic," Economic Analysis and Policy, Elsevier, vol. 75(C), pages 288-309.
    7. Jiménez, Inés & Mora-Valencia, Andrés & Perote, Javier, 2022. "Semi-nonparametric risk assessment with cryptocurrencies," Research in International Business and Finance, Elsevier, vol. 59(C).
    8. Bei, Shuhua & Yang, Aijun & Pei, Haotian & Si, Xiaoli, 2023. "Price Risk Analysis using GARCH Family Models: Evidence from Shanghai Crude Oil Futures Market," Economic Modelling, Elsevier, vol. 125(C).
    9. Lis Szymon & Chlebus Marcin, 2023. "Combining forecasts? Keep it simple," Central European Economic Journal, Sciendo, vol. 10(57), pages 343-370, January.
    10. Owusu Junior, Peterson & Tiwari, Aviral Kumar & Tweneboah, George & Asafo-Adjei, Emmanuel, 2022. "GAS and GARCH based value-at-risk modeling of precious metals," Resources Policy, Elsevier, vol. 75(C).
    11. Laporta, Alessandro G. & Merlo, Luca & Petrella, Lea, 2018. "Selection of Value at Risk Models for Energy Commodities," Energy Economics, Elsevier, vol. 74(C), pages 628-643.
    12. Catania, Leopoldo & Grassi, Stefano, 2022. "Forecasting cryptocurrency volatility," International Journal of Forecasting, Elsevier, vol. 38(3), pages 878-894.
    13. Yanqiong Liu & Zhenghui Li & Yanyan Yao & Hao Dong, 2021. "Asymmetry of Risk Evolution in Crude Oil Market: From the Perspective of Dual Attributes of Oil," Energies, MDPI, vol. 14(13), pages 1-22, July.
    14. Jiang, Wei & Ruan, Qingsong & Li, Jianfeng & Li, Ye, 2018. "Modeling returns volatility: Realized GARCH incorporating realized risk measure," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 500(C), pages 249-258.
    15. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.
    16. Yannick Hoga & Matei Demetrescu, 2023. "Monitoring Value-at-Risk and Expected Shortfall Forecasts," Management Science, INFORMS, vol. 69(5), pages 2954-2971, May.
    17. Rehman, Mobeen Ur & Owusu Junior, Peterson & Ahmad, Nasir & Vo, Xuan Vinh, 2022. "Time-varying risk analysis for commodity futures," Resources Policy, Elsevier, vol. 78(C).
    18. Szymon Lis & Marcin Chlebus, 2021. "Comparison of the accuracy in VaR forecasting for commodities using different methods of combining forecasts," Working Papers 2021-11, Faculty of Economic Sciences, University of Warsaw.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mauro Bernardi & Leopoldo Catania, 2014. "The Model Confidence Set package for R," Papers 1410.8504, arXiv.org.
    2. Owusu Junior, Peterson & Tiwari, Aviral Kumar & Tweneboah, George & Asafo-Adjei, Emmanuel, 2022. "GAS and GARCH based value-at-risk modeling of precious metals," Resources Policy, Elsevier, vol. 75(C).
    3. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    6. Nader Trabelsi & Aviral Kumar Tiwari, 2023. "CO2 Emission Allowances Risk Prediction with GAS and GARCH Models," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 775-805, February.
    7. Trucíos, Carlos, 2019. "Forecasting Bitcoin risk measures: A robust approach," International Journal of Forecasting, Elsevier, vol. 35(3), pages 836-847.
    8. A. Amendola & V. Candila, 2016. "Evaluation of volatility predictions in a VaR framework," Quantitative Finance, Taylor & Francis Journals, vol. 16(5), pages 695-709, May.
    9. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    10. Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012. "On the forecasting accuracy of multivariate GARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, September.
    11. Laura Garcia‐Jorcano & Alfonso Novales, 2021. "Volatility specifications versus probability distributions in VaR forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(2), pages 189-212, March.
    12. Nikolaos A. Kyriazis, 2021. "A Survey on Volatility Fluctuations in the Decentralized Cryptocurrency Financial Assets," JRFM, MDPI, vol. 14(7), pages 1-46, June.
    13. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.
    14. Laporta, Alessandro G. & Merlo, Luca & Petrella, Lea, 2018. "Selection of Value at Risk Models for Energy Commodities," Energy Economics, Elsevier, vol. 74(C), pages 628-643.
    15. Peter Reinhard Hansen & Asger Lunde & James M. Nason, 2003. "Choosing the Best Volatility Models: The Model Confidence Set Approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 839-861, December.
    16. Gloria González-Rivera & Tae-Hwy Lee, 2007. "Nonlinear Time Series in Financial Forecasting," Working Papers 200803, University of California at Riverside, Department of Economics, revised Feb 2008.
    17. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2011. "Are realized volatility models good candidates for alternative Value at Risk prediction strategies?," MPRA Paper 30364, University Library of Munich, Germany.
    18. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    19. Catania, Leopoldo & Proietti, Tommaso, 2020. "Forecasting volatility with time-varying leverage and volatility of volatility effects," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1301-1317.
    20. Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:31:y:2016:i:2:d:10.1007_s00180-016-0646-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.