Are RiskMetrics forecasts good enough? Evidence from 31 stock markets
Academic research has highlighted the inherent flaws within the RiskMetrics model and demonstrated the superiority of the GARCH approach in-sample. However, these results do not necessarily extend to forecasting performance. This paper seeks answer to the question of whether RiskMetrics volatility forecasts are adequate in comparison to those obtained from GARCH models. To answer the question stock index data is taken from 31 international markets and subjected to two exercises, a straightforward volatility forecasting exercise and a Value-at-Risk exceptions forecasting competition. Our results provide some simple answers to the above question. When forecasting volatility of the G7 stock markets the APARCH model, in particular, provides superior forecasts that are significantly different from the RiskMetrics models in over half the cases. This result also extends to the European markets with the APARCH model typically preferred. For the Asian markets the RiskMetrics model performs well, and is only significantly dominated by the GARCH models for one market, although there is evidence that the APARCH model provides a better forecast for the larger Asian markets. Regarding the Value-at-Risk exercise, when forecasting the 1% VaR the RiskMetrics model does a poor job and is typically the worst performing model, again the APARCH model does well. However, forecasting the 5% VaR then the RiskMetrics model does provide an adequate performance. In short, the RiskMetrics model only performs well in forecasting the volatility of small emerging markets and for broader VaR measures.
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Schwert, G William, 1990.
"Stock Volatility and the Crash of '87,"
Review of Financial Studies,
Society for Financial Studies, vol. 3(1), pages 77-102.
- Schwert, G.W., 1989. "Stock Volatility And The Crash Of '87," Papers 89-01, Rochester, Business - General.
- G. William Schwert, 1989. "Stock Volatility and the Crash of '87," NBER Working Papers 2954, National Bureau of Economic Research, Inc.
- David McMillan & Alan Speight & Owain Apgwilym, 2000. "Forecasting UK stock market volatility," Applied Financial Economics, Taylor & Francis Journals, vol. 10(4), pages 435-448.
- Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters,in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46 National Bureau of Economic Research, Inc.
- Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
- Asger Lunde & Peter Reinhard Hansen, 2001. "A Forecast Comparison of Volatility Models: Does Anything Beat a GARCH(1,1)?," Working Papers 2001-04, Brown University, Department of Economics.
- So, Mike K.P. & Yu, Philip L.H., 2006. "Empirical analysis of GARCH models in value at risk estimation," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 16(2), pages 180-197, April.
- Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
- Baillie, Richard T. & Bollerslev, Tim & Mikkelsen, Hans Ole, 1996. "Fractionally integrated generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 74(1), pages 3-30, September.
- Tom Doan, "undated". "RATS programs to replicate Baillie, Bollerslev, Mikkelson FIGARCH results," Statistical Software Components RTZ00009, Boston College Department of Economics.
- Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
- Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
- Andersen, Torben G. & Bollerslev, Tim & Lange, Steve, 1999. "Forecasting financial market volatility: Sample frequency vis-a-vis forecast horizon," Journal of Empirical Finance, Elsevier, vol. 6(5), pages 457-477, December.
- Brailsford, Timothy J. & Faff, Robert W., 1996. "An evaluation of volatility forecasting techniques," Journal of Banking & Finance, Elsevier, vol. 20(3), pages 419-438, April.
- Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290.
- Adrian R. Pagan & G. William Schwert, 1989. "Alternative Models For Conditional Stock Volatility," NBER Working Papers 2955, National Bureau of Economic Research, Inc.
- Pagan, A.R. & Schwert, G.W., 1989. "Alternative Models For Conditional Stock Volatility," Papers 89-02, Rochester, Business - General.
- Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," Review of Economic Studies, Oxford University Press, vol. 53(4), pages 671-690.
- Davidson, James, 2004. "Moment and Memory Properties of Linear Conditional Heteroscedasticity Models, and a New Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 22(1), pages 16-29, January.
- Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
- Engle, Robert F & Manganelli, Simone, 1999. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," University of California at San Diego, Economics Working Paper Series qt06m3d6nv, Department of Economics, UC San Diego.
- Robert Engle & Simone Manganelli, 2000. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Econometric Society World Congress 2000 Contributed Papers 0841, Econometric Society.
- Jorion, Philippe, 1995. " Predicting Volatility in the Foreign Exchange Market," Journal of Finance, American Finance Association, vol. 50(2), pages 507-528, June.
- Bera, Anil K & Higgins, Matthew L, 1993. " ARCH Models: Properties, Estimation and Testing," Journal of Economic Surveys, Wiley Blackwell, vol. 7(4), pages 305-366, December.
- Bollerslev, Tim & Chou, Ray Y. & Kroner, Kenneth F., 1992. "ARCH modeling in finance : A review of the theory and empirical evidence," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 5-59.
- Akgiray, Vedat, 1989. "Conditional Heteroscedasticity in Time Series of Stock Returns: Evidence and Forecasts," The Journal of Business, University of Chicago Press, vol. 62(1), pages 55-80, January.
- Philippe Jorion, 1996. "Risk and Turnover in the Foreign Exchange Market," NBER Chapters,in: The Microstructure of Foreign Exchange Markets, pages 19-40 National Bureau of Economic Research, Inc.
- Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
- Alan E. H. Speight & David G. McMillan, 2004. "Daily volatility forecasts: reassessing the performance of GARCH models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 449-460. Full references (including those not matched with items on IDEAS)