IDEAS home Printed from https://ideas.repec.org/p/war/wpaper/2021-11.html
   My bibliography  Save this paper

Comparison of the accuracy in VaR forecasting for commodities using different methods of combining forecasts

Author

Listed:
  • Szymon Lis

    (Faculty of Economic Sciences, University of Warsaw)

  • Marcin Chlebus

    (Faculty of Economic Sciences, University of Warsaw)

Abstract

No model dominates existing VaR forecasting comparisons. This problem may be solved by combine forecasts. This study investigates the daily volatility forecasting for commodities (gold, silver, oil, gas, copper) from 2000-2020 and identifies the source of performance improvements between individual GARCH models and combining forecasts methods (mean, the lowest, the highest, CQOM, quantile regression with the elastic net or LASSO regularization, random forests, gradient boosting, neural network) through the MCS. Results indicate that individual models achieve more accurate VaR forecasts for the confidence level of 0.975, but combined forecasts are more precise for 0.99. In most cases simple combining methods (mean or the lowest VaR) are the best. Such evidence demonstrates that combining forecasts is important to get better results from the existing models. The study shows that combining the forecasts allows for more accurate VaR forecasting, although it’s difficult to find accurate, complex methods.

Suggested Citation

  • Szymon Lis & Marcin Chlebus, 2021. "Comparison of the accuracy in VaR forecasting for commodities using different methods of combining forecasts," Working Papers 2021-11, Faculty of Economic Sciences, University of Warsaw.
  • Handle: RePEc:war:wpaper:2021-11
    as

    Download full text from publisher

    File URL: https://www.wne.uw.edu.pl/index.php/download_file/6513/
    File Function: First version, 2021
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012. "On the forecasting accuracy of multivariate GARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, September.
    2. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    3. Terui, Nobuhiko & van Dijk, Herman K., 2002. "Combined forecasts from linear and nonlinear time series models," International Journal of Forecasting, Elsevier, vol. 18(3), pages 421-438.
    4. Chiu, Yen-Chen & Chuang, I-Yuan & Lai, Jing-Yi, 2010. "The performance of composite forecast models of value-at-risk in the energy market," Energy Economics, Elsevier, vol. 32(2), pages 423-431, March.
    5. Armstrong, J. Scott, 1989. "Combining forecasts: The end of the beginning or the beginning of the end?," International Journal of Forecasting, Elsevier, vol. 5(4), pages 585-588.
    6. Mensi, Walid & Sensoy, Ahmet & Vo, Xuan Vinh & Kang, Sang Hoon, 2020. "Impact of COVID-19 outbreak on asymmetric multifractality of gold and oil prices," Resources Policy, Elsevier, vol. 69(C).
    7. Peter C. B. Phillips & Jun Yu, 2011. "Dating the timeline of financial bubbles during the subprime crisis," Quantitative Economics, Econometric Society, vol. 2(3), pages 455-491, November.
    8. Keith Kuester & Stefan Mittnik & Marc S. Paolella, 2006. "Value-at-Risk Prediction: A Comparison of Alternative Strategies," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 53-89.
    9. Jooyoung Jeon & James W. Taylor, 2013. "Using CAViaR Models with Implied Volatility for Value‐at‐Risk Estimation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 32(1), pages 62-74, January.
    10. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    11. Marimoutou, Velayoudoum & Raggad, Bechir & Trabelsi, Abdelwahed, 2009. "Extreme Value Theory and Value at Risk: Application to oil market," Energy Economics, Elsevier, vol. 31(4), pages 519-530, July.
    12. Danielsson, Jon & Morimoto, Yuji, 2000. "Forecasting Extreme Financial Risk: A Critical Analysis of Practical Methods for the Japanese Market," Monetary and Economic Studies, Institute for Monetary and Economic Studies, Bank of Japan, vol. 18(2), pages 25-48, December.
    13. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    14. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    15. Mateusz Buczyński & Marcin Chlebus, 2019. "Old-fashioned parametric models are still the best. A comparison of Value-at-Risk approaches in several volatility states," Working Papers 2019-12, Faculty of Economic Sciences, University of Warsaw.
    16. Michael McAleer & Juan‐Ángel Jiménez‐Martín & Teodosio Pérez‐Amaral, 2013. "International Evidence on GFC‐Robust Forecasts for Risk Management under the Basel Accord," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 32(3), pages 267-288, April.
    17. Huiyu Huang & Tae-Hwy Lee, 2013. "Forecasting Value-at-Risk Using High-Frequency Information," Econometrics, MDPI, vol. 1(1), pages 1-14, June.
    18. Szakmary, Andrew C. & Shen, Qian & Sharma, Subhash C., 2010. "Trend-following trading strategies in commodity futures: A re-examination," Journal of Banking & Finance, Elsevier, vol. 34(2), pages 409-426, February.
    19. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    20. Taylor, James W., 2020. "Forecast combinations for value at risk and expected shortfall," International Journal of Forecasting, Elsevier, vol. 36(2), pages 428-441.
    21. Rossignolo, Adrián F. & Fethi, Meryem Duygun & Shaban, Mohamed, 2013. "Market crises and Basel capital requirements: Could Basel III have been different? Evidence from Portugal, Ireland, Greece and Spain (PIGS)," Journal of Banking & Finance, Elsevier, vol. 37(5), pages 1323-1339.
    22. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    23. Rossignolo, Adrian F. & Fethi, Meryem Duygun & Shaban, Mohamed, 2012. "Value-at-Risk models and Basel capital charges," Journal of Financial Stability, Elsevier, vol. 8(4), pages 303-319.
    24. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    25. Robert F. Engle & Simone Manganelli, 1999. "CAViaR: Conditional Value at Risk by Quantile Regression," NBER Working Papers 7341, National Bureau of Economic Research, Inc.
    26. Clemon, Robert T & Winkler, Robert L, 1986. "Combining Economic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 39-46, January.
    27. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    28. Goodhart,Charles, 2011. "The Basel Committee on Banking Supervision," Cambridge Books, Cambridge University Press, number 9781107007239.
    29. David Cabedo, J. & Moya, Ismael, 2003. "Estimating oil price 'Value at Risk' using the historical simulation approach," Energy Economics, Elsevier, vol. 25(3), pages 239-253, May.
    30. Spyros Makridakis & Robert L. Winkler, 1983. "Averages of Forecasts: Some Empirical Results," Management Science, INFORMS, vol. 29(9), pages 987-996, September.
    31. Hibon, Michele & Evgeniou, Theodoros, 2005. "To combine or not to combine: selecting among forecasts and their combinations," International Journal of Forecasting, Elsevier, vol. 21(1), pages 15-24.
    32. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    33. Yiuman Tse, 2016. "Asymmetric Volatility, Skewness, and Downside Risk in Different Asset Classes: Evidence from Futures Markets," The Financial Review, Eastern Finance Association, vol. 51(1), pages 83-111, February.
    34. Halbleib, Roxana & Pohlmeier, Winfried, 2012. "Improving the value at risk forecasts: Theory and evidence from the financial crisis," Journal of Economic Dynamics and Control, Elsevier, vol. 36(8), pages 1212-1228.
    35. Youssef, Manel & Belkacem, Lotfi & Mokni, Khaled, 2015. "Value-at-Risk estimation of energy commodities: A long-memory GARCH–EVT approach," Energy Economics, Elsevier, vol. 51(C), pages 99-110.
    36. Ichev, Riste & Marinč, Matej, 2018. "Stock prices and geographic proximity of information: Evidence from the Ebola outbreak," International Review of Financial Analysis, Elsevier, vol. 56(C), pages 153-166.
    37. Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-547, August.
    38. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    39. Buczyński Mateusz & Chlebus Marcin, 2018. "Comparison of Semi-Parametric and Benchmark Value-At-Risk Models in Several Time Periods with Different Volatility Levels," Financial Internet Quarterly (formerly e-Finanse), Sciendo, vol. 14(2), pages 67-82, June.
    40. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    41. Mauro Bernardi & Leopoldo Catania, 2016. "Comparison of Value-at-Risk models using the MCS approach," Computational Statistics, Springer, vol. 31(2), pages 579-608, June.
    42. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    2. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    3. Laporta, Alessandro G. & Merlo, Luca & Petrella, Lea, 2018. "Selection of Value at Risk Models for Energy Commodities," Energy Economics, Elsevier, vol. 74(C), pages 628-643.
    4. Carlos Trucíos & James W. Taylor, 2023. "A comparison of methods for forecasting value at risk and expected shortfall of cryptocurrencies," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 989-1007, July.
    5. Wei Kuang, 2022. "Oil tail-risk forecasts: from financial crisis to COVID-19," Risk Management, Palgrave Macmillan, vol. 24(4), pages 420-460, December.
    6. Timo Dimitriadis & Xiaochun Liu & Julie Schnaitmann, 2020. "Encompassing Tests for Value at Risk and Expected Shortfall Multi-Step Forecasts based on Inference on the Boundary," Papers 2009.07341, arXiv.org.
    7. Jimenez-Martin, Juan-Angel & McAleer, Michael & Pérez-Amaral, Teodosio & Santos, Paulo Araújo, 2013. "GFC-robust risk management under the Basel Accord using extreme value methodologies," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 94(C), pages 223-237.
    8. Mauro Bernardi & Leopoldo Catania & Lea Petrella, 2014. "Are news important to predict large losses?," Papers 1410.6898, arXiv.org, revised Oct 2014.
    9. Erik Kole & Thijs Markwat & Anne Opschoor & Dick van Dijk, 2017. "Forecasting Value-at-Risk under Temporal and Portfolio Aggregation," Journal of Financial Econometrics, Oxford University Press, vol. 15(4), pages 649-677.
    10. Caporale, Guglielmo Maria & Zekokh, Timur, 2019. "Modelling volatility of cryptocurrencies using Markov-Switching GARCH models," Research in International Business and Finance, Elsevier, vol. 48(C), pages 143-155.
    11. Vica Tendenan & Richard Gerlach & Chao Wang, 2020. "Tail risk forecasting using Bayesian realized EGARCH models," Papers 2008.05147, arXiv.org, revised Aug 2020.
    12. Stavroula P. Fameliti & Vasiliki D. Skintzi, 2020. "Predictive ability and economic gains from volatility forecast combinations," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 200-219, March.
    13. Leopoldo Catania & Nima Nonejad, 2016. "Density Forecasts and the Leverage Effect: Some Evidence from Observation and Parameter-Driven Volatility Models," Papers 1605.00230, arXiv.org, revised Nov 2016.
    14. Marc Hallin & Carlos Trucíos, 2020. "Forecasting Value-at-Risk and Expected Shortfall in Large Portfolios: a General Dynamic Factor Approach," Working Papers ECARES 2020-50, ULB -- Universite Libre de Bruxelles.
    15. Hallin, Marc & Trucíos, Carlos, 2023. "Forecasting value-at-risk and expected shortfall in large portfolios: A general dynamic factor model approach," Econometrics and Statistics, Elsevier, vol. 27(C), pages 1-15.
    16. Stavroyiannis, S. & Makris, I. & Nikolaidis, V. & Zarangas, L., 2012. "Econometric modeling and value-at-risk using the Pearson type-IV distribution," International Review of Financial Analysis, Elsevier, vol. 22(C), pages 10-17.
    17. Vincenzo Candila & Giampiero M. Gallo & Lea Petrella, 2020. "Mixed--frequency quantile regressions to forecast Value--at--Risk and Expected Shortfall," Papers 2011.00552, arXiv.org, revised Mar 2023.
    18. František Čech & Jozef Baruník, 2019. "Panel quantile regressions for estimating and predicting the value‐at‐risk of commodities," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 39(9), pages 1167-1189, September.
    19. Xiaochun Liu, 2017. "An integrated macro‐financial risk‐based approach to the stressed capital requirement," Review of Financial Economics, John Wiley & Sons, vol. 34(1), pages 86-98, September.
    20. Bei, Shuhua & Yang, Aijun & Pei, Haotian & Si, Xiaoli, 2023. "Price Risk Analysis using GARCH Family Models: Evidence from Shanghai Crude Oil Futures Market," Economic Modelling, Elsevier, vol. 125(C).

    More about this item

    Keywords

    Combining forecasts; Econometric models; Finance; Financial markets; GARCH models; Neural networks; Regression; Time series; Risk; Value-at-Risk; Machine learning; Model Confidence Set;
    All these keywords.

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill
    • Q01 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - General - - - Sustainable Development

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:war:wpaper:2021-11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marcin Bąba (email available below). General contact details of provider: https://edirc.repec.org/data/fesuwpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.