IDEAS home Printed from https://ideas.repec.org/a/wly/jforec/v42y2023i4p989-1007.html
   My bibliography  Save this article

A comparison of methods for forecasting value at risk and expected shortfall of cryptocurrencies

Author

Listed:
  • Carlos Trucíos
  • James W. Taylor

Abstract

Several procedures to forecast daily risk measures in cryptocurrency markets have been recently implemented in the literature. Among them, long‐memory processes, procedures taking into account the presence of extreme observations, procedures that include more than a single regime, and quantile regression‐based models have performed substantially better than standard methods in terms of forecasting risk measures. Those procedures are revisited in this paper, and their value at risk and expected shortfall forecasting performance are evaluated using recent Bitcoin and Ethereum data that include periods of turbulence due to the COVID‐19 pandemic, the third halving of Bitcoin, and the Lexia class action. Additionally, in order to mitigate the influence of model misspecification and enhance the forecasting performance obtained by individual models, we evaluate the use of several forecast combining strategies. Our results, based on a comprehensive backtesting exercise, reveal that, for Bitcoin, there is no single procedure outperforming all other models, but for Ethereum, there is evidence showing that the GAS model is a suitable alternative for forecasting both risk measures. We found that the combining methods were not able to outperform the better of the individual models.

Suggested Citation

  • Carlos Trucíos & James W. Taylor, 2023. "A comparison of methods for forecasting value at risk and expected shortfall of cryptocurrencies," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 989-1007, July.
  • Handle: RePEc:wly:jforec:v:42:y:2023:i:4:p:989-1007
    DOI: 10.1002/for.2929
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/for.2929
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.2929?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hoogerheide, Lennart & van Dijk, Herman K., 2010. "Bayesian forecasting of Value at Risk and Expected Shortfall using adaptive importance sampling," International Journal of Forecasting, Elsevier, vol. 26(2), pages 231-247, April.
    2. Natalia Nolde & Johanna F. Ziegel, 2016. "Elicitability and backtesting: Perspectives for banking regulation," Papers 1608.05498, arXiv.org, revised Feb 2017.
    3. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    4. Boudt, Kris & Daníelsson, Jón & Laurent, Sébastien, 2013. "Robust forecasting of dynamic conditional correlation GARCH models," International Journal of Forecasting, Elsevier, vol. 29(2), pages 244-257.
    5. Christian Francq & Jean‐Michel Zakoïan, 2009. "Bartlett's formula for a general class of nonlinear processes," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(4), pages 449-465, July.
    6. Luc Bauwens & Arie Preminger & Jeroen V. K. Rombouts, 2010. "Theory and inference for a Markov switching GARCH model," Econometrics Journal, Royal Economic Society, vol. 13(2), pages 218-244, July.
    7. Thomson, Mary E. & Pollock, Andrew C. & Önkal, Dilek & Gönül, M. Sinan, 2019. "Combining forecasts: Performance and coherence," International Journal of Forecasting, Elsevier, vol. 35(2), pages 474-484.
    8. Ardia, David & Bluteau, Keven & Rüede, Maxime, 2019. "Regime changes in Bitcoin GARCH volatility dynamics," Finance Research Letters, Elsevier, vol. 29(C), pages 266-271.
    9. Righi, Marcelo Brutti & Ceretta, Paulo Sergio, 2015. "A comparison of Expected Shortfall estimation models," Journal of Economics and Business, Elsevier, vol. 78(C), pages 14-47.
    10. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    11. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    12. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    13. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    14. Markus Haas, 2004. "A New Approach to Markov-Switching GARCH Models," Journal of Financial Econometrics, Oxford University Press, vol. 2(4), pages 493-530.
    15. Carnero, M. Angeles & Peña, Daniel & Ruiz, Esther, 2012. "Estimating GARCH volatility in the presence of outliers," Economics Letters, Elsevier, vol. 114(1), pages 86-90.
    16. Taylor, James W., 2020. "Forecast combinations for value at risk and expected shortfall," International Journal of Forecasting, Elsevier, vol. 36(2), pages 428-441.
    17. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    18. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    19. Acereda, Beatriz & Leon, Angel & Mora, Juan, 2020. "Estimating the expected shortfall of cryptocurrencies: An evaluation based on backtesting," Finance Research Letters, Elsevier, vol. 33(C).
    20. Pınar Kaya Soylu & Mustafa Okur & Özgür Çatıkkaş & Z. Ayca Altintig, 2020. "Long Memory in the Volatility of Selected Cryptocurrencies: Bitcoin, Ethereum and Ripple," JRFM, MDPI, vol. 13(6), pages 1-21, May.
    21. James W. Taylor, 2019. "Forecasting Value at Risk and Expected Shortfall Using a Semiparametric Approach Based on the Asymmetric Laplace Distribution," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 121-133, January.
    22. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    23. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    24. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    25. Dyhrberg, Anne Haubo, 2016. "Bitcoin, gold and the dollar – A GARCH volatility analysis," Finance Research Letters, Elsevier, vol. 16(C), pages 85-92.
    26. Baillie, Richard T. & Bollerslev, Tim & Mikkelsen, Hans Ole, 1996. "Fractionally integrated generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 74(1), pages 3-30, September.
    27. David Happersberger & Harald Lohre & Ingmar Nolte, 2020. "Estimating portfolio risk for tail risk protection strategies," European Financial Management, European Financial Management Association, vol. 26(4), pages 1107-1146, September.
    28. C. Alexander & M. Dakos, 2020. "A critical investigation of cryptocurrency data and analysis," Quantitative Finance, Taylor & Francis Journals, vol. 20(2), pages 173-188, February.
    29. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
    30. Trucíos, Carlos, 2019. "Forecasting Bitcoin risk measures: A robust approach," International Journal of Forecasting, Elsevier, vol. 35(3), pages 836-847.
    31. Luther, William J. & Salter, Alexander W., 2017. "Bitcoin and the bailout," The Quarterly Review of Economics and Finance, Elsevier, vol. 66(C), pages 50-56.
    32. Trucíos, Carlos & Hotta, Luiz K., 2016. "Bootstrap prediction in univariate volatility models with leverage effect," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 120(C), pages 91-103.
    33. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.
    34. Hillebrand, Eric, 2005. "Neglecting parameter changes in GARCH models," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 121-138.
    35. Halbleib, Roxana & Pohlmeier, Winfried, 2012. "Improving the value at risk forecasts: Theory and evidence from the financial crisis," Journal of Economic Dynamics and Control, Elsevier, vol. 36(8), pages 1212-1228.
    36. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    37. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    38. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    39. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    40. Troster, Victor & Tiwari, Aviral Kumar & Shahbaz, Muhammad & Macedo, Demian Nicolás, 2019. "Bitcoin returns and risk: A general GARCH and GAS analysis," Finance Research Letters, Elsevier, vol. 30(C), pages 187-193.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hotta, Luiz Koodi & Trucíos Maza, Carlos César & Pereira, Pedro L. Valls & Zevallos Herencia, Mauricio Henrique, 2024. "Forecasting VaR and ES through Markov-switching GARCH models: does the specication matter?," Textos para discussão 567, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Trucíos, Carlos, 2019. "Forecasting Bitcoin risk measures: A robust approach," International Journal of Forecasting, Elsevier, vol. 35(3), pages 836-847.
    2. Dimitriadis, Timo & Schnaitmann, Julie, 2021. "Forecast encompassing tests for the expected shortfall," International Journal of Forecasting, Elsevier, vol. 37(2), pages 604-621.
    3. Caporale, Guglielmo Maria & Zekokh, Timur, 2019. "Modelling volatility of cryptocurrencies using Markov-Switching GARCH models," Research in International Business and Finance, Elsevier, vol. 48(C), pages 143-155.
    4. Hotta, Luiz Koodi & Trucíos Maza, Carlos César & Pereira, Pedro L. Valls & Zevallos Herencia, Mauricio Henrique, 2024. "Forecasting VaR and ES through Markov-switching GARCH models: does the specication matter?," Textos para discussão 567, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    5. Timo Dimitriadis & Xiaochun Liu & Julie Schnaitmann, 2020. "Encompassing Tests for Value at Risk and Expected Shortfall Multi-Step Forecasts based on Inference on the Boundary," Papers 2009.07341, arXiv.org.
    6. Marc Hallin & Carlos Trucíos, 2020. "Forecasting Value-at-Risk and Expected Shortfall in Large Portfolios: a General Dynamic Factor Approach," Working Papers ECARES 2020-50, ULB -- Universite Libre de Bruxelles.
    7. Hallin, Marc & Trucíos, Carlos, 2023. "Forecasting value-at-risk and expected shortfall in large portfolios: A general dynamic factor model approach," Econometrics and Statistics, Elsevier, vol. 27(C), pages 1-15.
    8. David Happersberger & Harald Lohre & Ingmar Nolte, 2020. "Estimating portfolio risk for tail risk protection strategies," European Financial Management, European Financial Management Association, vol. 26(4), pages 1107-1146, September.
    9. Szymon Lis & Marcin Chlebus, 2021. "Comparison of the accuracy in VaR forecasting for commodities using different methods of combining forecasts," Working Papers 2021-11, Faculty of Economic Sciences, University of Warsaw.
    10. Cristina Chinazzo & Vahidin Jeleskovic, 2024. "Forecasting Bitcoin Volatility: A Comparative Analysis of Volatility Approaches," Papers 2401.02049, arXiv.org.
    11. Nikolaos A. Kyriazis, 2021. "A Survey on Volatility Fluctuations in the Decentralized Cryptocurrency Financial Assets," JRFM, MDPI, vol. 14(7), pages 1-46, June.
    12. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    13. Stavroula P. Fameliti & Vasiliki D. Skintzi, 2020. "Predictive ability and economic gains from volatility forecast combinations," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 200-219, March.
    14. Ke, Rui & Yang, Luyao & Tan, Changchun, 2022. "Forecasting tail risk for Bitcoin: A dynamic peak over threshold approach," Finance Research Letters, Elsevier, vol. 49(C).
    15. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.
    16. Storti, Giuseppe & Wang, Chao, 2022. "Nonparametric expected shortfall forecasting incorporating weighted quantiles," International Journal of Forecasting, Elsevier, vol. 38(1), pages 224-239.
    17. Halkos, George & Tzirivis, Apostolos, 2018. "Effective energy commodities’ risk management: Econometric modeling of price volatility," MPRA Paper 90781, University Library of Munich, Germany.
    18. Catania, Leopoldo & Grassi, Stefano, 2022. "Forecasting cryptocurrency volatility," International Journal of Forecasting, Elsevier, vol. 38(3), pages 878-894.
    19. Taylor, James W., 2020. "Forecast combinations for value at risk and expected shortfall," International Journal of Forecasting, Elsevier, vol. 36(2), pages 428-441.
    20. Tan, Chia-Yen & Koh, You-Beng & Ng, Kok-Haur & Ng, Kooi-Huat, 2021. "Dynamic volatility modelling of Bitcoin using time-varying transition probability Markov-switching GARCH model," The North American Journal of Economics and Finance, Elsevier, vol. 56(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jforec:v:42:y:2023:i:4:p:989-1007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.