IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this article

Evaluating predictive performance of value-at-risk models in emerging markets: a reality check

Listed author(s):
  • Tae-Hwy Lee

    (University of California, Riverside, USA)

  • Yong Bao

    (University of Texas, San Antonio, USA)

  • Burak Saltoglu

    (Marmara University, Turkey)

We investigate the predictive performance of various classes of value-at-risk (VaR) models in several dimensions-unfiltered versus filtered VaR models, parametric versus nonparametric distributions, conventional versus extreme value distributions, and quantile regression versus inverting the conditional distribution function. By using the reality check test of White (2000), we compare the predictive power of alternative VaR models in terms of the empirical coverage probability and the predictive quantile loss for the stock markets of five Asian economies that suffered from the 1997-1998 financial crisis. The results based on these two criteria are largely compatible and indicate some empirical regularities of risk forecasts. The Riskmetrics model behaves reasonably well in tranquil periods, while some extreme value theory (EVT)-based models do better in the crisis period. Filtering often appears to be useful for some models, particularly for the EVT models, though it could be harmful for some other models. The CaViaR quantile regression models of Engle and Manganelli (2004) have shown some success in predicting the VaR risk measure for various periods, generally more stable than those that invert a distribution function. Overall, the forecasting performance of the VaR models considered varies over the three periods before, during and after the crisis. Copyright © 2006 John Wiley & Sons, Ltd.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://hdl.handle.net/10.1002/for.977
File Function: Link to full text; subscription required
Download Restriction: no

Article provided by John Wiley & Sons, Ltd. in its journal Journal of Forecasting.

Volume (Year): 25 (2006)
Issue (Month): 2 ()
Pages: 101-128

as
in new window

Handle: RePEc:jof:jforec:v:25:y:2006:i:2:p:101-128
DOI: 10.1002/for.977
Contact details of provider: Web page: http://www3.interscience.wiley.com/cgi-bin/jhome/2966

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as
in new window


  1. Kai-Li Wang & Christopher Fawson & Christopher B. Barrett & James B. McDonald, 2001. "A flexible parametric GARCH model with an application to exchange rates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(4), pages 521-536.
  2. Giovanni Barone-Adesi & Kostas Giannopoulos & Les Vosper, 2002. "Backtesting Derivative Portfolios with Filtered Historical Simulation (FHS)," European Financial Management, European Financial Management Association, vol. 8(1), pages 31-58.
  3. Campbell R. Harvey & Akhtar Siddique, 2000. "Conditional Skewness in Asset Pricing Tests," Journal of Finance, American Finance Association, vol. 55(3), pages 1263-1295, 06.
  4. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
  5. Cai, Zongwu, 2002. "Regression Quantiles For Time Series," Econometric Theory, Cambridge University Press, vol. 18(01), pages 169-192, February.
  6. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-263, July.
  7. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
  8. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
  9. Clive W. J. Granger, 2002. "Some comments on risk," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 447-456.
  10. Longin, Francois M., 2000. "From value at risk to stress testing: The extreme value approach," Journal of Banking & Finance, Elsevier, vol. 24(7), pages 1097-1130, July.
  11. Subu Venkataraman, 1997. "Value at risk for a mixture of normal distributions: the use of quasi- Bayesian estimation techniques," Economic Perspectives, Federal Reserve Bank of Chicago, issue Mar, pages 2-13.
  12. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
  13. Lakonishok, Josef & Shleifer, Andrei & Vishny, Robert W, 1994. " Contrarian Investment, Extrapolation, and Risk," Journal of Finance, American Finance Association, vol. 49(5), pages 1541-1578, December.
  14. Hansen, B.E., 1992. "Autoregressive Conditional Density Estimation," RCER Working Papers 322, University of Rochester - Center for Economic Research (RCER).
  15. Tim Bollerslev, 1986. "Generalized autoregressive conditional heteroskedasticity," EERI Research Paper Series EERI RP 1986/01, Economics and Econometrics Research Institute (EERI), Brussels.
  16. Jesus Gonzalo, 2004. "Which Extreme Values Are Really Extreme?," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(3), pages 349-369.
  17. Longin, Francois M, 1996. "The Asymptotic Distribution of Extreme Stock Market Returns," The Journal of Business, University of Chicago Press, vol. 69(3), pages 383-408, July.
  18. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
  19. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
  20. Peter Reinhard Hansen, 2001. "An Unbiased and Powerful Test for Superior Predictive Ability," Working Papers 2001-06, Brown University, Department of Economics.
  21. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  22. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
  23. Peter Hall & Rodney C. L. Wolff & Qiwei Yao, 1999. "Methods for estimating a conditional distribution function," LSE Research Online Documents on Economics 6631, London School of Economics and Political Science, LSE Library.
  24. repec:hrv:faseco:30721347 is not listed on IDEAS
  25. Ming-Yuan Leon Li & Hsiou-wei William Lin, 2004. "Estimating value-at-risk via Markov switching ARCH models - an empirical study on stock index returns," Applied Economics Letters, Taylor & Francis Journals, vol. 11(11), pages 679-691.
  26. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
  27. Robert Engle & Simone Manganelli, 2000. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Econometric Society World Congress 2000 Contributed Papers 0841, Econometric Society.
  28. Zheng, John Xu, 1998. "A Consistent Nonparametric Test Of Parametric Regression Models Under Conditional Quantile Restrictions," Econometric Theory, Cambridge University Press, vol. 14(01), pages 123-138, February.
  29. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
  30. Pownall, Rachel A. J. & Koedijk, Kees G., 1999. "Capturing downside risk in financial markets: the case of the Asian Crisis," Journal of International Money and Finance, Elsevier, vol. 18(6), pages 853-870, December.
  31. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
  32. Herman J. Bierens & Donna K. Ginther, 2001. "Integrated Conditional Moment testing of quantile regression models," Empirical Economics, Springer, vol. 26(1), pages 307-324.
  33. Mittnik, Stefan & Paolella, Marc S. & Rachev, Svetlozar T., 2002. "Stationarity of stable power-GARCH processes," Journal of Econometrics, Elsevier, vol. 106(1), pages 97-107, January.
  34. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
  35. Peter Hansen, 2003. "Asymptotic Tests of Composite Hypotheses," Working Papers 2003-09, Brown University, Department of Economics.
  36. Harvey, Campbell R. & Siddique, Akhtar, 1999. "Autoregressive Conditional Skewness," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 34(04), pages 465-487, December.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:25:y:2006:i:2:p:101-128. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing)

or (Christopher F. Baum)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.