IDEAS home Printed from https://ideas.repec.org/a/wly/japmet/v27y2012i6p934-955.html
   My bibliography  Save this article

On the forecasting accuracy of multivariate GARCH models

Author

Listed:
  • Sébastien Laurent
  • Jeroen V. K. Rombouts
  • Francesco Violante

Abstract

This paper addresses the question of the selection of multivariate GARCH models in terms of variance matrix forecasting accuracy with a particular focus on relatively large scale problems. We consider 10 assets from NYSE and NASDAQ and compare 125 model based one-step-ahead conditional variance forecasts over a period of 10 years using the model confidence set (MCS) and the Superior Predicitive Ability (SPA) tests. Model per- formances are evaluated using four statistical loss functions which account for different types and degrees of asymmetry with respect to over/under predictions. When consid- ering the full sample, MCS results are strongly driven by short periods of high market instability during which multivariate GARCH models appear to be inaccurate. Over rel- atively unstable periods, i.e. dot-com bubble, the set of superior models is composed of more sophisticated specifications such as orthogonal and dynamic conditional correlation (DCC), both with leverage effect in the conditional variances. However, unlike the DCC models, our results show that the orthogonal specifications tend to underestimate the conditional variance. Over calm periods, a simple assumption like constant conditional correlation and symmetry in the conditional variances cannot be rejected. Finally, during the 2007-2008 financial crisis, accounting for non-stationarity in the conditional variance process generates superior forecasts. The SPA test suggests that, independently from the period, the best models do not provide significantly better forecasts than the DCC model of Engle (2002) with leverage in the conditional variances of the returns.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012. "On the forecasting accuracy of multivariate GARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, September.
  • Handle: RePEc:wly:japmet:v:27:y:2012:i:6:p:934-955
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Engle, Robert F. & Kroner, Kenneth F., 1995. "Multivariate Simultaneous Generalized ARCH," Econometric Theory, Cambridge University Press, vol. 11(1), pages 122-150, February.
    2. Weide, R. van der, 2002. "Generalized Orthogonal GARCH. A Multivariate GARCH model," CeNDEF Working Papers 02-02, Universiteit van Amsterdam, Center for Nonlinear Dynamics in Economics and Finance.
    3. Pierre-Philippe Combes & Thierry Mayer & Jacques-François Thisse, 2008. "Economic Geography: The Integration of Regions and Nations," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-00311000, HAL.
    4. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    5. Becker, Ralf & Clements, Adam E., 2008. "Are combination forecasts of S&P 500 volatility statistically superior?," International Journal of Forecasting, Elsevier, vol. 24(1), pages 122-133.
    6. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    7. Lorenzo Cappiello & Robert F. Engle & Kevin Sheppard, 2006. "Asymmetric Dynamics in the Correlations of Global Equity and Bond Returns," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(4), pages 537-572.
    8. Zhang, Lan & Mykland, Per A. & Ait-Sahalia, Yacine, 2005. "A Tale of Two Time Scales: Determining Integrated Volatility With Noisy High-Frequency Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1394-1411, December.
    9. Christian Francq & Lajos Horváth, 2011. "Merits and Drawbacks of Variance Targeting in GARCH Models," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 9(4), pages 619-656.
    10. Ole E. Barndorff-Nielsen & Peter Reinhard Hansen & Asger Lunde & Neil Shephard, 2008. "Designing Realized Kernels to Measure the ex post Variation of Equity Prices in the Presence of Noise," Econometrica, Econometric Society, vol. 76(6), pages 1481-1536, November.
    11. Jianqing Fan & Mingjin Wang & Qiwei Yao, 2008. "Modelling multivariate volatilities via conditionally uncorrelated components," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(4), pages 679-702, September.
    12. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 7(2), pages 174-196, Spring.
    13. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    14. Barndorff-Nielsen, Ole E. & Hansen, Peter Reinhard & Lunde, Asger & Shephard, Neil, 2011. "Multivariate realised kernels: Consistent positive semi-definite estimators of the covariation of equity prices with noise and non-synchronous trading," Journal of Econometrics, Elsevier, vol. 162(2), pages 149-169, June.
    15. Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.
    16. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    17. Peter Reinhard Hansen & Asger Lunde & James M. Nason, 2003. "Choosing the Best Volatility Models: The Model Confidence Set Approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 839-861, December.
    18. Massimiliano Caporin & Michael McAleer, 2010. "Ranking Multivariate GARCH Models by Problem Dimension," CARF F-Series CARF-F-219, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    19. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    20. Carol Alexander, 2000. "Orthogonal Methods for Generating Large Positive Semi-Definite Covariance Matrices," ICMA Centre Discussion Papers in Finance icma-dp2000-06, Henley Business School, University of Reading.
    21. Baillie, Richard T. & Bollerslev, Tim & Mikkelsen, Hans Ole, 1996. "Fractionally integrated generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 74(1), pages 3-30, September.
    22. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    23. repec:oxf:wpaper:264 is not listed on IDEAS
    24. Palandri, Alessandro, 2009. "Sequential conditional correlations: Inference and evaluation," Journal of Econometrics, Elsevier, vol. 153(2), pages 122-132, December.
    25. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    26. Huriot,Jean-Marie & Thisse,Jacques-François (ed.), 2009. "Economics of Cities," Cambridge Books, Cambridge University Press, number 9780521118279, October.
    27. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    28. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    29. Davidson, James, 2004. "Moment and Memory Properties of Linear Conditional Heteroscedasticity Models, and a New Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 22(1), pages 16-29, January.
    30. Peter Hansen & Jeremy Large & Asger Lunde, 2008. "Moving Average-Based Estimators of Integrated Variance," Econometric Reviews, Taylor & Francis Journals, vol. 27(1-3), pages 79-111.
    31. Michiel de Pooter & Martin Martens & Dick van Dijk, 2008. "Predicting the Daily Covariance Matrix for S&P 100 Stocks Using Intraday Data—But Which Frequency to Use?," Econometric Reviews, Taylor & Francis Journals, vol. 27(1-3), pages 199-229.
    32. Engle, Robert F. & Ng, Victor K. & Rothschild, Michael, 1990. "Asset pricing with a factor-arch covariance structure : Empirical estimates for treasury bills," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 213-237.
    33. Bollerslev, Tim, 1990. "Modelling the Coherence in Short-run Nominal Exchange Rates: A Multivariate Generalized ARCH Model," The Review of Economics and Statistics, MIT Press, vol. 72(3), pages 498-505, August.
    34. Adam Clements & Mark Doolan & Stan Hurn & Ralf Becker, 2009. "Evaluating multivariate volatility forecasts," NCER Working Paper Series 41, National Centre for Econometric Research, revised 25 Nov 2009.
    35. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    36. Karolyi, G Andrew, 1995. "A Multivariate GARCH Model of International Transmissions of Stock Returns and Volatility: The Case of the United States and Canada," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(1), pages 11-25, January.
    37. Torben G. Andersen & Tim Bollerslev & Per Frederiksen & Morten Ørregaard Nielsen, 2010. "Continuous-time models, realized volatilities, and testable distributional implications for daily stock returns," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 233-261.
    38. Lanne, Markku & Saikkonen, Pentti, 2007. "A Multivariate Generalized Orthogonal Factor GARCH Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 61-75, January.
    39. Per Aslak Mykland & Lan Zhang, 2006. "ANOVA for diffusions and It\^{o} processes," Papers math/0611274, arXiv.org.
    40. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    41. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    42. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    43. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    44. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    45. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    46. Luc Bauwens & Sébastien Laurent & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109, January.
    47. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    48. Peter Reinhard Hansen & Zhuo (Albert) Huang & Howard Howan Shek, "undated". "Realized GARCH: A Complete Model of Returns and Realized Measures of Volatility," CREATES Research Papers 2010-13, Department of Economics and Business Economics, Aarhus University.
    49. Zhou, Bin, 1996. "High-Frequency Data and Volatility in Foreign-Exchange Rates," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 45-52, January.
    50. Gourieroux, C. & Jasiak, J. & Sufana, R., 2009. "The Wishart Autoregressive process of multivariate stochastic volatility," Journal of Econometrics, Elsevier, vol. 150(2), pages 167-181, June.
    51. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 1999. "(Understanding, Optimizing, Using and Forecasting) Realized Volatility and Correlation," New York University, Leonard N. Stern School Finance Department Working Paper Seires 99-061, New York University, Leonard N. Stern School of Business-.
    52. I. D. Vrontos & P. Dellaportas & D. N. Politis, 2003. "A full-factor multivariate GARCH model," Econometrics Journal, Royal Economic Society, vol. 6(2), pages 312-334, December.
    53. Roy van der Weide, 2002. "GO-GARCH: a multivariate generalized orthogonal GARCH model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 549-564.
    54. Jeffrey R. Russell & Federico M. Bandi, 2004. "Microstructure noise, realized volatility, and optimal sampling," Econometric Society 2004 Latin American Meetings 220, Econometric Society.
    55. Bali, Turan G., 2008. "The intertemporal relation between expected returns and risk," Journal of Financial Economics, Elsevier, vol. 87(1), pages 101-131, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laurent, Sébastien & Rombouts, Jeroen V.K. & Violante, Francesco, 2013. "On loss functions and ranking forecasting performances of multivariate volatility models," Journal of Econometrics, Elsevier, vol. 173(1), pages 1-10.
    2. Caporin, Massimiliano & McAleer, Michael, 2014. "Robust ranking of multivariate GARCH models by problem dimension," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 172-185.
    3. Caporin, M. & McAleer, M.J., 2011. "Ranking Multivariate GARCH Models by Problem Dimension: An Empirical Evaluation," Econometric Institute Research Papers EI 2011-18, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    4. Andrea BUCCI, 2017. "Forecasting Realized Volatility A Review," Journal of Advanced Studies in Finance, ASERS Publishing, vol. 8(2), pages 94-138.
    5. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    6. de Almeida, Daniel & Hotta, Luiz K. & Ruiz, Esther, 2018. "MGARCH models: Trade-off between feasibility and flexibility," International Journal of Forecasting, Elsevier, vol. 34(1), pages 45-63.
    7. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    8. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2013. "Financial Risk Measurement for Financial Risk Management," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1127-1220, Elsevier.
    9. Li, Jia & Patton, Andrew J., 2018. "Asymptotic inference about predictive accuracy using high frequency data," Journal of Econometrics, Elsevier, vol. 203(2), pages 223-240.
    10. BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," LIDAM Discussion Papers CORE 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
      • Bauwens, L. & Hafner C. & Laurent, S., 2011. "Volatility Models," LIDAM Discussion Papers ISBA 2011044, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
      • Bauwens, L. & Hafner, C. & Laurent, S., 2012. "Volatility Models," LIDAM Reprints ISBA 2012028, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    11. Patton, Andrew J., 2011. "Data-based ranking of realised volatility estimators," Journal of Econometrics, Elsevier, vol. 161(2), pages 284-303, April.
    12. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    13. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    14. Asai, Manabu & McAleer, Michael, 2015. "Forecasting co-volatilities via factor models with asymmetry and long memory in realized covariance," Journal of Econometrics, Elsevier, vol. 189(2), pages 251-262.
    15. Luc Bauwens & Sébastien Laurent & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109, January.
    16. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    17. Rombouts, Jeroen & Stentoft, Lars & Violante, Franceso, 2014. "The value of multivariate model sophistication: An application to pricing Dow Jones Industrial Average options," International Journal of Forecasting, Elsevier, vol. 30(1), pages 78-98.
    18. Francesco Audrino & Yujia Hu, 2016. "Volatility Forecasting: Downside Risk, Jumps and Leverage Effect," Econometrics, MDPI, vol. 4(1), pages 1-24, February.
    19. Wang Pu & Yixiang Chen & Feng Ma, 2016. "Forecasting the realized volatility in the Chinese stock market: further evidence," Applied Economics, Taylor & Francis Journals, vol. 48(33), pages 3116-3130, July.
    20. LAURENT, Sébastien & VIOLANTE, Francesco, 2012. "Volatility forecasts evaluation and comparison," LIDAM Reprints CORE 2414, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).

    More about this item

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:japmet:v:27:y:2012:i:6:p:934-955. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.