IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this paper

On the forecasting accuracy of multivariate GARCH models

  • LAURENT, Sébastien

    (Maastricht University, The Netherlands; Université catholique de Louvain, CORE, B-1348 Louvain-la-Neuve, Belgium)

  • ROMBOUTS, Jeroen V. K.

    (HEC Montréal, CIRANO, CIRPEE; Université catholique de Louvain, CORE, B-1348 Louvain-la-Neuve, Belgium)

  • VIOLANTE, Francesco

    (Université de Namur, CeReFim, B-5000 Namur, Belgium; Université catholique de Louvain, CORE, B-1348 Louvain-la-Neuve, Belgium)

This paper addresses the question of the selection of multivariate GARCH models in terms of variance matrix forecasting accuracy with a particular focus on relatively large scale problems. We consider 10 assets from NYSE and NASDAQ and compare 125 model based one-step-ahead conditional variance forecasts over a period of 10 years using the model confidence set (MCS) and the Superior Predicitive Ability (SPA) tests. Model per- formances are evaluated using four statistical loss functions which account for different types and degrees of asymmetry with respect to over/under predictions. When consid- ering the full sample, MCS results are strongly driven by short periods of high market instability during which multivariate GARCH models appear to be inaccurate. Over rel- atively unstable periods, i.e. dot-com bubble, the set of superior models is composed of more sophisticated specifications such as orthogonal and dynamic conditional correlation (DCC), both with leverage effect in the conditional variances. However, unlike the DCC models, our results show that the orthogonal specifications tend to underestimate the conditional variance. Over calm periods, a simple assumption like constant conditional correlation and symmetry in the conditional variances cannot be rejected. Finally, during the 2007-2008 financial crisis, accounting for non-stationarity in the conditional variance process generates superior forecasts. The SPA test suggests that, independently from the period, the best models do not provide significantly better forecasts than the DCC model of Engle (2002) with leverage in the conditional variances of the returns.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Université catholique de Louvain, Center for Operations Research and Econometrics (CORE) in its series CORE Discussion Papers with number 2010025.

in new window

Date of creation: 01 May 2010
Date of revision:
Handle: RePEc:cor:louvco:2010025
Contact details of provider: Postal:
Voie du Roman Pays 34, 1348 Louvain-la-Neuve (Belgium)

Phone: 32(10)474321
Fax: +32 10474304
Web page:

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Karolyi, G Andrew, 1995. "A Multivariate GARCH Model of International Transmissions of Stock Returns and Volatility: The Case of the United States and Canada," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(1), pages 11-25, January.
  2. Ole E. Barndorff-Nielsen & Peter Reinhard Hansen & Asger Lunde & Neil Shephard, 2008. "Multivariate realised kernels: consistent positive semi-definite estimators of the covariation of equity prices with noise and non-synchronous trading," Economics Papers 2008-W10, Economics Group, Nuffield College, University of Oxford.
  3. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
  4. Kenneth D. West, 1994. "Asymptotic Inference About Predictive Ability," Macroeconomics 9410002, EconWPA.
  5. Asger Lunde & Peter Reinhard Hansen, 2001. "A Forecast Comparison of Volatility Models: Does Anything Beat a GARCH(1,1)?," Working Papers 2001-04, Brown University, Department of Economics.
  6. Todd E. Clark & Kenneth D. West, 2004. "Using out-of-sample mean squared prediction errors to test the Martingale difference hypothesis," Research Working Paper RWP 04-03, Federal Reserve Bank of Kansas City.
  7. Caporin, M. & McAleer, M.J., 2010. "Ranking multivariate GARCH models by problem dimension," Econometric Institute Research Papers EI 2010-34, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  8. Per Aslak Mykland & Lan Zhang, 2006. "ANOVA for diffusions and It\^{o} processes," Papers math/0611274,
  9. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
  10. Engle, Robert F. & Kroner, Kenneth F., 1995. "Multivariate Simultaneous Generalized ARCH," Econometric Theory, Cambridge University Press, vol. 11(01), pages 122-150, February.
  11. Lanne, Markku & Saikkonen, Pentti, 2007. "A Multivariate Generalized Orthogonal Factor GARCH Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 61-75, January.
  12. Anderson, Torben G. & Bollerslev, Tim & Diebold, Francis X. & Labys, Paul, 2002. "Modeling and Forecasting Realized Volatility," Working Papers 02-12, Duke University, Department of Economics.
  13. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  14. Jianqing Fan & Mingjin Wang & Qiwei Yao, 2008. "Modelling multivariate volatilities via conditionally uncorrelated components," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(4), pages 679-702.
  15. Sébastien Laurent & Luc Bauwens & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109.
  16. Robert F. Engle & Victor Ng & Michael Rothschild, 1988. "Asset Pricing with a Factor Arch Covariance Structure: Empirical Estimates for Treasury Bills," NBER Technical Working Papers 0065, National Bureau of Economic Research, Inc.
  17. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
  18. Becker, Ralf & Clements, Adam E., 2008. "Are combination forecasts of S&P 500 volatility statistically superior?," International Journal of Forecasting, Elsevier, vol. 24(1), pages 122-133.
  19. Bollerslev, Tim, 1990. "Modelling the Coherence in Short-run Nominal Exchange Rates: A Multivariate Generalized ARCH Model," The Review of Economics and Statistics, MIT Press, vol. 72(3), pages 498-505, August.
  20. Neil Shephard & Ole E. Barndorff-Nielsen, 2006. "Designing realised kernels to measure the ex-post variation of equity prices in the presence of noise," Economics Series Working Papers 2006-W03, University of Oxford, Department of Economics.
  21. Andrew Patton, 2006. "Volatility Forecast Comparison using Imperfect Volatility Proxies," Research Paper Series 175, Quantitative Finance Research Centre, University of Technology, Sydney.
  22. Jianqing Fan & Mingjin Wang & Qiwei Yao, 2008. "Modelling multivariate volatilities via conditionally uncorrelated components," LSE Research Online Documents on Economics 22875, London School of Economics and Political Science, LSE Library.
  23. Sébastien Laurent & Jeroen V.K. Rombouts & Francesco Violante, 2009. "On Loss Functions and Ranking Forecasting Performances of Multivariate Volatility Models," Cahiers de recherche 0948, CIRPEE.
  24. Lan Zhang & Per A. Mykland & Yacine Ait-Sahalia, 2003. "A Tale of Two Time Scales: Determining Integrated Volatility with Noisy High Frequency Data," NBER Working Papers 10111, National Bureau of Economic Research, Inc.
  25. Davidson, James, 2004. "Moment and Memory Properties of Linear Conditional Heteroscedasticity Models, and a New Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 22(1), pages 16-29, January.
  26. Giacomini, Raffaella & White, Halbert, 2003. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series qt5jk0j5jh, Department of Economics, UC San Diego.
  27. Kenneth D. West & Todd Clark, 2006. "Approximately Normal Tests for Equal Predictive Accuracy in Nested Models," NBER Technical Working Papers 0326, National Bureau of Economic Research, Inc.
  28. Gourieroux, C. & Jasiak, J. & Sufana, R., 2009. "The Wishart Autoregressive process of multivariate stochastic volatility," Journal of Econometrics, Elsevier, vol. 150(2), pages 167-181, June.
  29. Michiel de Pooter & Martin Martens & Dick van Dijk, 2008. "Predicting the Daily Covariance Matrix for S&P 100 Stocks Using Intraday Data—But Which Frequency to Use?," Econometric Reviews, Taylor & Francis Journals, vol. 27(1-3), pages 199-229.
  30. Lorenzo Cappiello & Robert F. Engle & Kevin Sheppard, 2006. "Asymmetric Dynamics in the Correlations of Global Equity and Bond Returns," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(4), pages 537-572.
  31. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-70, March.
  32. Tim Bollerslev, 1986. "Generalized autoregressive conditional heteroskedasticity," EERI Research Paper Series EERI RP 1986/01, Economics and Econometrics Research Institute (EERI), Brussels.
  33. Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
  34. I. D. Vrontos & P. Dellaportas & D. N. Politis, 2003. "A full-factor multivariate GARCH model," Econometrics Journal, Royal Economic Society, vol. 6(2), pages 312-334, December.
  35. Bali, Turan G., 2008. "The intertemporal relation between expected returns and risk," Journal of Financial Economics, Elsevier, vol. 87(1), pages 101-131, January.
  36. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
  37. Adam Clements & Mark Doolan & Stan Hurn & Ralf Becker, 2009. "Evaluating multivariate volatility forecasts," NCER Working Paper Series 41, National Centre for Econometric Research, revised 25 Nov 2009.
  38. Palandri, Alessandro, 2009. "Sequential conditional correlations: Inference and evaluation," Journal of Econometrics, Elsevier, vol. 153(2), pages 122-132, December.
  39. Peter Hansen & Jeremy Large & Asger Lunde, 2008. "Moving Average-Based Estimators of Integrated Variance," Econometric Reviews, Taylor & Francis Journals, vol. 27(1-3), pages 79-111.
  40. Peter Reinhard Hansen & Zhuo (Albert) Huang & Howard Howan Shek, . "Realized GARCH: A Complete Model of Returns and Realized Measures of Volatility," CREATES Research Papers 2010-13, Department of Economics and Business Economics, Aarhus University.
  41. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
  42. Baillie, Richard T. & Bollerslev, Tim & Mikkelsen, Hans Ole, 1996. "Fractionally integrated generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 74(1), pages 3-30, September.
  43. Torben G. Andersen & Tim Bollerslev & Per Frederiksen & Morten Ørregaard Nielsen, 2010. "Continuous-time models, realized volatilities, and testable distributional implications for daily stock returns," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 233-261.
  44. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 7(2), pages 174-196, Spring.
  45. Zhou, Bin, 1996. "High-Frequency Data and Volatility in Foreign-Exchange Rates," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 45-52, January.
  46. Roy van der Weide, 2002. "GO-GARCH: a multivariate generalized orthogonal GARCH model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 549-564.
  47. repec:oxf:wpaper:264 is not listed on IDEAS
  48. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:cor:louvco:2010025. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Alain GILLIS)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.