IDEAS home Printed from https://ideas.repec.org/a/wly/jforec/v42y2023i4p989-1007.html

A comparison of methods for forecasting value at risk and expected shortfall of cryptocurrencies

Author

Listed:
  • Carlos Trucíos
  • James W. Taylor

Abstract

Several procedures to forecast daily risk measures in cryptocurrency markets have been recently implemented in the literature. Among them, long‐memory processes, procedures taking into account the presence of extreme observations, procedures that include more than a single regime, and quantile regression‐based models have performed substantially better than standard methods in terms of forecasting risk measures. Those procedures are revisited in this paper, and their value at risk and expected shortfall forecasting performance are evaluated using recent Bitcoin and Ethereum data that include periods of turbulence due to the COVID‐19 pandemic, the third halving of Bitcoin, and the Lexia class action. Additionally, in order to mitigate the influence of model misspecification and enhance the forecasting performance obtained by individual models, we evaluate the use of several forecast combining strategies. Our results, based on a comprehensive backtesting exercise, reveal that, for Bitcoin, there is no single procedure outperforming all other models, but for Ethereum, there is evidence showing that the GAS model is a suitable alternative for forecasting both risk measures. We found that the combining methods were not able to outperform the better of the individual models.

Suggested Citation

  • Carlos Trucíos & James W. Taylor, 2023. "A comparison of methods for forecasting value at risk and expected shortfall of cryptocurrencies," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 989-1007, July.
  • Handle: RePEc:wly:jforec:v:42:y:2023:i:4:p:989-1007
    DOI: 10.1002/for.2929
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/for.2929
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.2929?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Trucíos, Carlos, 2019. "Forecasting Bitcoin risk measures: A robust approach," International Journal of Forecasting, Elsevier, vol. 35(3), pages 836-847.
    2. Christian Francq & Jean‐Michel Zakoïan, 2009. "Bartlett's formula for a general class of nonlinear processes," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(4), pages 449-465, July.
    3. Hoogerheide, Lennart & van Dijk, Herman K., 2010. "Bayesian forecasting of Value at Risk and Expected Shortfall using adaptive importance sampling," International Journal of Forecasting, Elsevier, vol. 26(2), pages 231-247, April.
    4. Hillebrand, Eric, 2005. "Neglecting parameter changes in GARCH models," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 121-138.
    5. Thomson, Mary E. & Pollock, Andrew C. & Önkal, Dilek & Gönül, M. Sinan, 2019. "Combining forecasts: Performance and coherence," International Journal of Forecasting, Elsevier, vol. 35(2), pages 474-484.
    6. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    7. Natalia Nolde & Johanna F. Ziegel, 2016. "Elicitability and backtesting: Perspectives for banking regulation," Papers 1608.05498, arXiv.org, revised Feb 2017.
    8. Acereda, Beatriz & Leon, Angel & Mora, Juan, 2020. "Estimating the expected shortfall of cryptocurrencies: An evaluation based on backtesting," Finance Research Letters, Elsevier, vol. 33(C).
    9. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    10. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    11. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    12. Halbleib, Roxana & Pohlmeier, Winfried, 2012. "Improving the value at risk forecasts: Theory and evidence from the financial crisis," Journal of Economic Dynamics and Control, Elsevier, vol. 36(8), pages 1212-1228.
    13. Pınar Kaya Soylu & Mustafa Okur & Özgür Çatıkkaş & Z. Ayca Altintig, 2020. "Long Memory in the Volatility of Selected Cryptocurrencies: Bitcoin, Ethereum and Ripple," JRFM, MDPI, vol. 13(6), pages 1-21, May.
    14. Luther, William J. & Salter, Alexander W., 2017. "Bitcoin and the bailout," The Quarterly Review of Economics and Finance, Elsevier, vol. 66(C), pages 50-56.
    15. Boudt, Kris & Daníelsson, Jón & Laurent, Sébastien, 2013. "Robust forecasting of dynamic conditional correlation GARCH models," International Journal of Forecasting, Elsevier, vol. 29(2), pages 244-257.
    16. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    17. James W. Taylor, 2019. "Forecasting Value at Risk and Expected Shortfall Using a Semiparametric Approach Based on the Asymmetric Laplace Distribution," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 121-133, January.
    18. Dyhrberg, Anne Haubo, 2016. "Bitcoin, gold and the dollar – A GARCH volatility analysis," Finance Research Letters, Elsevier, vol. 16(C), pages 85-92.
    19. Ardia, David & Bluteau, Keven & Rüede, Maxime, 2019. "Regime changes in Bitcoin GARCH volatility dynamics," Finance Research Letters, Elsevier, vol. 29(C), pages 266-271.
    20. Trucíos, Carlos & Hotta, Luiz K., 2016. "Bootstrap prediction in univariate volatility models with leverage effect," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 120(C), pages 91-103.
    21. Righi, Marcelo Brutti & Ceretta, Paulo Sergio, 2015. "A comparison of Expected Shortfall estimation models," Journal of Economics and Business, Elsevier, vol. 78(C), pages 14-47.
    22. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
    23. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    24. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    25. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.
    26. Baillie, Richard T. & Bollerslev, Tim & Mikkelsen, Hans Ole, 1996. "Fractionally integrated generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 74(1), pages 3-30, September.
    27. David Happersberger & Harald Lohre & Ingmar Nolte, 2020. "Estimating portfolio risk for tail risk protection strategies," European Financial Management, European Financial Management Association, vol. 26(4), pages 1107-1146, September.
    28. Hotta, Luiz & Trucíos, Carlos & Ruiz Ortega, Esther, 2015. "Robust bootstrap forecast densities for GARCH models: returns, volatilities and value-at-risk," DES - Working Papers. Statistics and Econometrics. WS ws1523, Universidad Carlos III de Madrid. Departamento de Estadística.
    29. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    30. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    31. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    32. Luc Bauwens & Arie Preminger & Jeroen V. K. Rombouts, 2010. "Theory and inference for a Markov switching GARCH model," Econometrics Journal, Royal Economic Society, vol. 13(2), pages 218-244, July.
    33. Markus Haas, 2004. "A New Approach to Markov-Switching GARCH Models," Journal of Financial Econometrics, Oxford University Press, vol. 2(4), pages 493-530.
    34. Carnero, M. Angeles & Peña, Daniel & Ruiz, Esther, 2012. "Estimating GARCH volatility in the presence of outliers," Economics Letters, Elsevier, vol. 114(1), pages 86-90.
    35. Troster, Victor & Tiwari, Aviral Kumar & Shahbaz, Muhammad & Macedo, Demian Nicolás, 2019. "Bitcoin returns and risk: A general GARCH and GAS analysis," Finance Research Letters, Elsevier, vol. 30(C), pages 187-193.
    36. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    37. Taylor, James W., 2020. "Forecast combinations for value at risk and expected shortfall," International Journal of Forecasting, Elsevier, vol. 36(2), pages 428-441.
    38. C. Alexander & M. Dakos, 2020. "A critical investigation of cryptocurrency data and analysis," Quantitative Finance, Taylor & Francis Journals, vol. 20(2), pages 173-188, February.
    39. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    40. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    41. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jie Wang & Yongqiao Wang, 2025. "Forecasting Expected Shortfall and Value‐at‐Risk With Cross‐Sectional Aggregation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 44(2), pages 391-423, March.
    2. Dean Fantazzini, 2024. "Adaptive Conformal Inference for Computing Market Risk Measures: An Analysis with Four Thousand Crypto-Assets," JRFM, MDPI, vol. 17(6), pages 1-44, June.
    3. Rehan Arain & Stephen Snudden, 2026. "When Are Statistical Forecast Gains Economically Relevant? Evidence From Bitcoin Returns," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 45(3), pages 1245-1260, April.
    4. Hotta, Luiz Koodi & Trucíos Maza, Carlos César & Pereira, Pedro L. Valls & Zevallos Herencia, Mauricio Henrique, 2024. "Forecasting VaR and ES through Markov-switching GARCH models: does the specication matter?," Textos para discussão 567, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    5. James W. Taylor & Chao Wang, 2025. "Combining a Large Pool of Forecasts of Value-at-Risk and Expected Shortfall," Papers 2508.16919, arXiv.org, revised May 2026.
    6. Yuhee Kwon & Youngsoo Choi, 2026. "Combined Effects of Fat‐Tail and Spread Forecasting on Pairs Trading: A Hybrid Model Based on Integrating VAR With GRU Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 45(3), pages 1110-1128, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Trucíos, Carlos, 2019. "Forecasting Bitcoin risk measures: A robust approach," International Journal of Forecasting, Elsevier, vol. 35(3), pages 836-847.
    2. Dimitriadis, Timo & Schnaitmann, Julie, 2021. "Forecast encompassing tests for the expected shortfall," International Journal of Forecasting, Elsevier, vol. 37(2), pages 604-621.
    3. Hotta, Luiz Koodi & Trucíos Maza, Carlos César & Pereira, Pedro L. Valls & Zevallos Herencia, Mauricio Henrique, 2024. "Forecasting VaR and ES through Markov-switching GARCH models: does the specication matter?," Textos para discussão 567, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    4. Hallin, Marc & Trucíos, Carlos, 2023. "Forecasting value-at-risk and expected shortfall in large portfolios: A general dynamic factor model approach," Econometrics and Statistics, Elsevier, vol. 27(C), pages 1-15.
    5. David Happersberger & Harald Lohre & Ingmar Nolte, 2020. "Estimating portfolio risk for tail risk protection strategies," European Financial Management, European Financial Management Association, vol. 26(4), pages 1107-1146, September.
    6. Caporale, Guglielmo Maria & Zekokh, Timur, 2019. "Modelling volatility of cryptocurrencies using Markov-Switching GARCH models," Research in International Business and Finance, Elsevier, vol. 48(C), pages 143-155.
    7. Timo Dimitriadis & iaochun Liu & Julie Schnaitmann, 2023. "Encompassing Tests for Value at Risk and Expected Shortfall Multistep Forecasts Based on Inference on the Boundary," Journal of Financial Econometrics, Oxford University Press, vol. 21(2), pages 412-444.
    8. Marc Hallin & Carlos Trucíos, 2020. "Forecasting Value-at-Risk and Expected Shortfall in Large Portfolios: a General Dynamic Factor Approach," Working Papers ECARES 2020-50, ULB -- Universite Libre de Bruxelles.
    9. Alessandra Amendola & Vincenzo Candila & Antonio Naimoli & Giuseppe Storti, 2024. "Combining Value-at-Risk and Expected Shortfall forecasts via the Model Confidence Set," Papers 2406.06235, arXiv.org, revised Feb 2026.
    10. Cristina Chinazzo & Vahidin Jeleskovic, 2024. "Forecasting Bitcoin Volatility: A Comparative Analysis of Volatility Approaches," Papers 2401.02049, arXiv.org.
    11. Szymon Lis & Marcin Chlebus, 2021. "Comparison of the accuracy in VaR forecasting for commodities using different methods of combining forecasts," Working Papers 2021-11, Faculty of Economic Sciences, University of Warsaw.
    12. Nikolaos A. Kyriazis, 2021. "A Survey on Volatility Fluctuations in the Decentralized Cryptocurrency Financial Assets," JRFM, MDPI, vol. 14(7), pages 1-46, June.
    13. Stavroula P. Fameliti & Vasiliki D. Skintzi, 2020. "Predictive ability and economic gains from volatility forecast combinations," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 200-219, March.
    14. Ke, Rui & Yang, Luyao & Tan, Changchun, 2022. "Forecasting tail risk for Bitcoin: A dynamic peak over threshold approach," Finance Research Letters, Elsevier, vol. 49(C).
    15. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    16. Fiszeder, Piotr & Małecka, Marta & Molnár, Peter, 2024. "Robust estimation of the range-based GARCH model: Forecasting volatility, value at risk and expected shortfall of cryptocurrencies," Economic Modelling, Elsevier, vol. 141(C).
    17. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    18. Wei Kuang, 2025. "Tailoring tail risk models for clean energy investments: a dual approach to long and short position forecasting," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-20, December.
    19. Thomas Adjei Kuffour & Peterson Owusu Junior & Patrick Kwashie Akorsu, 2025. "Modeling value-at-risk for green bonds and clean energy investments," Risk Management, Palgrave Macmillan, vol. 27(4), pages 1-26, December.
    20. Huang, Yirong & Luo, Yi, 2024. "Forecasting conditional volatility based on hybrid GARCH-type models with long memory, regime switching, leverage effect and heavy-tail: Further evidence from equity market," The North American Journal of Economics and Finance, Elsevier, vol. 72(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jforec:v:42:y:2023:i:4:p:989-1007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.