IDEAS home Printed from
   My bibliography  Save this article

Evaluating predictive performance of value-at-risk models in emerging markets: a reality check


  • Tae-Hwy Lee

    (University of California, Riverside, USA)

  • Yong Bao

    (University of Texas, San Antonio, USA)

  • Burak Saltoglu

    (Marmara University, Turkey)


We investigate the predictive performance of various classes of value-at-risk (VaR) models in several dimensions-unfiltered versus filtered VaR models, parametric versus nonparametric distributions, conventional versus extreme value distributions, and quantile regression versus inverting the conditional distribution function. By using the reality check test of White (2000), we compare the predictive power of alternative VaR models in terms of the empirical coverage probability and the predictive quantile loss for the stock markets of five Asian economies that suffered from the 1997-1998 financial crisis. The results based on these two criteria are largely compatible and indicate some empirical regularities of risk forecasts. The Riskmetrics model behaves reasonably well in tranquil periods, while some extreme value theory (EVT)-based models do better in the crisis period. Filtering often appears to be useful for some models, particularly for the EVT models, though it could be harmful for some other models. The CaViaR quantile regression models of Engle and Manganelli (2004) have shown some success in predicting the VaR risk measure for various periods, generally more stable than those that invert a distribution function. Overall, the forecasting performance of the VaR models considered varies over the three periods before, during and after the crisis. Copyright © 2006 John Wiley & Sons, Ltd.

Suggested Citation

  • Tae-Hwy Lee & Yong Bao & Burak Saltoglu, 2006. "Evaluating predictive performance of value-at-risk models in emerging markets: a reality check," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(2), pages 101-128.
  • Handle: RePEc:jof:jforec:v:25:y:2006:i:2:p:101-128 DOI: 10.1002/for.977

    Download full text from publisher

    File URL:
    File Function: Link to full text; subscription required
    Download Restriction: no

    References listed on IDEAS

    1. Lakonishok, Josef & Shleifer, Andrei & Vishny, Robert W, 1994. " Contrarian Investment, Extrapolation, and Risk," Journal of Finance, American Finance Association, vol. 49(5), pages 1541-1578, December.
    2. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    3. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    4. Kai-Li Wang & Christopher Fawson & Christopher B. Barrett & James B. McDonald, 2001. "A flexible parametric GARCH model with an application to exchange rates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(4), pages 521-536.
    5. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    6. Mittnik, Stefan & Paolella, Marc S. & Rachev, Svetlozar T., 2002. "Stationarity of stable power-GARCH processes," Journal of Econometrics, Elsevier, vol. 106(1), pages 97-107, January.
    7. Herman J. Bierens & Donna K. Ginther, 2001. "Integrated Conditional Moment testing of quantile regression models," Empirical Economics, Springer, vol. 26(1), pages 307-324.
    8. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    9. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    10. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    11. Peter Hansen, 2003. "Asymptotic Tests of Composite Hypotheses," Working Papers 2003-09, Brown University, Department of Economics.
    12. Harvey, Campbell R. & Siddique, Akhtar, 1999. "Autoregressive Conditional Skewness," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 34(04), pages 465-487, December.
    13. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    14. Subu Venkataraman, 1997. "Value at risk for a mixture of normal distributions: the use of quasi- Bayesian estimation techniques," Economic Perspectives, Federal Reserve Bank of Chicago, issue Mar, pages 2-13.
    15. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    16. Longin, Francois M., 2000. "From value at risk to stress testing: The extreme value approach," Journal of Banking & Finance, Elsevier, vol. 24(7), pages 1097-1130, July.
    17. Jesus Gonzalo, 2004. "Which Extreme Values Are Really Extreme?," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(3), pages 349-369.
    18. Pownall, Rachel A. J. & Koedijk, Kees G., 1999. "Capturing downside risk in financial markets: the case of the Asian Crisis," Journal of International Money and Finance, Elsevier, vol. 18(6), pages 853-870, December.
    19. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
    20. Hall, Peter & Wolff, Rodney C. L. & Yao, Qiwei, 1999. "Methods for estimating a conditional distribution function," LSE Research Online Documents on Economics 6631, London School of Economics and Political Science, LSE Library.
    21. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    22. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
    23. Peter Reinhard Hansen, 2001. "An Unbiased and Powerful Test for Superior Predictive Ability," Working Papers 2001-06, Brown University, Department of Economics.
    24. Longin, Francois M, 1996. "The Asymptotic Distribution of Extreme Stock Market Returns," The Journal of Business, University of Chicago Press, vol. 69(3), pages 383-408, July.
    25. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    26. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
    27. Zheng, John Xu, 1998. "A Consistent Nonparametric Test Of Parametric Regression Models Under Conditional Quantile Restrictions," Econometric Theory, Cambridge University Press, vol. 14(01), pages 123-138, February.
    28. Cai, Zongwu, 2002. "Regression Quantiles For Time Series," Econometric Theory, Cambridge University Press, vol. 18(01), pages 169-192, February.
    29. Ming-Yuan Leon Li & Hsiou-wei William Lin, 2004. "Estimating value-at-risk via Markov switching ARCH models - an empirical study on stock index returns," Applied Economics Letters, Taylor & Francis Journals, vol. 11(11), pages 679-691.
    30. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
    31. Clive W. J. Granger, 2002. "Some comments on risk," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 447-456.
    32. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    33. Campbell R. Harvey & Akhtar Siddique, 2000. "Conditional Skewness in Asset Pricing Tests," Journal of Finance, American Finance Association, vol. 55(3), pages 1263-1295, June.
    34. repec:hrv:faseco:30721347 is not listed on IDEAS
    35. Giovanni Barone-Adesi & Kostas Giannopoulos & Les Vosper, 2002. "Backtesting Derivative Portfolios with Filtered Historical Simulation (FHS)," European Financial Management, European Financial Management Association, vol. 8(1), pages 31-58.
    36. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    More about this item


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:25:y:2006:i:2:p:101-128. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.