IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this article

Evaluating predictive performance of value-at-risk models in emerging markets: a reality check

  • Tae-Hwy Lee

    (University of California, Riverside, USA)

  • Yong Bao

    (University of Texas, San Antonio, USA)

  • Burak Saltoglu

    (Marmara University, Turkey)

We investigate the predictive performance of various classes of value-at-risk (VaR) models in several dimensions-unfiltered versus filtered VaR models, parametric versus nonparametric distributions, conventional versus extreme value distributions, and quantile regression versus inverting the conditional distribution function. By using the reality check test of White (2000), we compare the predictive power of alternative VaR models in terms of the empirical coverage probability and the predictive quantile loss for the stock markets of five Asian economies that suffered from the 1997-1998 financial crisis. The results based on these two criteria are largely compatible and indicate some empirical regularities of risk forecasts. The Riskmetrics model behaves reasonably well in tranquil periods, while some extreme value theory (EVT)-based models do better in the crisis period. Filtering often appears to be useful for some models, particularly for the EVT models, though it could be harmful for some other models. The CaViaR quantile regression models of Engle and Manganelli (2004) have shown some success in predicting the VaR risk measure for various periods, generally more stable than those that invert a distribution function. Overall, the forecasting performance of the VaR models considered varies over the three periods before, during and after the crisis. Copyright © 2006 John Wiley & Sons, Ltd.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://hdl.handle.net/10.1002/for.977
File Function: Link to full text; subscription required
Download Restriction: no

Article provided by John Wiley & Sons, Ltd. in its journal Journal of Forecasting.

Volume (Year): 25 (2006)
Issue (Month): 2 ()
Pages: 101-128

as
in new window

Handle: RePEc:jof:jforec:v:25:y:2006:i:2:p:101-128
DOI: 10.1002/for.977
Contact details of provider: Web page: http://www3.interscience.wiley.com/cgi-bin/jhome/2966

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
  2. Raffaella Giacomini & Halbert White, 2003. "Tests of Conditional Predictive Ability," Econometrics 0308001, EconWPA.
  3. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
  4. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-263, July.
  5. Lakonishok, Josef & Shleifer, Andrei & Vishny, Robert W, 1994. " Contrarian Investment, Extrapolation, and Risk," Journal of Finance, American Finance Association, vol. 49(5), pages 1541-1578, December.
  6. Longin, Francois M., 2000. "From value at risk to stress testing: The extreme value approach," Journal of Banking & Finance, Elsevier, vol. 24(7), pages 1097-1130, July.
  7. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
  8. Herman J. Bierens & Donna K. Ginther, 2001. "Integrated Conditional Moment testing of quantile regression models," Empirical Economics, Springer, vol. 26(1), pages 307-324.
  9. Ming-Yuan Leon Li & Hsiou-wei William Lin, 2004. "Estimating value-at-risk via Markov switching ARCH models - an empirical study on stock index returns," Applied Economics Letters, Taylor & Francis Journals, vol. 11(11), pages 679-691.
  10. Jose Olmo & Jesus Gonzalo, 2004. "Which Extreme Values are Really Extremes?," Econometric Society 2004 North American Winter Meetings 144, Econometric Society.
  11. Clive W. J. Granger, 2002. "Some comments on risk," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 447-456.
  12. Giovanni Barone-Adesi & Kostas Giannopoulos & Les Vosper, 2002. "Backtesting Derivative Portfolios with Filtered Historical Simulation (FHS)," European Financial Management, European Financial Management Association, vol. 8(1), pages 31-58.
  13. Kenneth D. West, 1994. "Asymptotic Inference About Predictive Ability," Macroeconomics 9410002, EconWPA.
  14. Mittnik, Stefan & Paolella, Marc S. & Rachev, Svetlozar T., 2002. "Stationarity of stable power-GARCH processes," Journal of Econometrics, Elsevier, vol. 106(1), pages 97-107, January.
  15. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
  16. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
  17. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
  18. Peter Hansen, 2003. "Asymptotic Tests of Composite Hypotheses," Working Papers 2003-09, Brown University, Department of Economics.
  19. Wang, Kai-Li & Fawson, Christopher B. & Barrett, Christopher B. & McDonald, James B., 1998. "A Flexible Parametric Garch Model With An Application To Exchange Rates," Economics Research Institute, ERI Study Papers 28355, Utah State University, Economics Department.
  20. Tim Bollerslev, 1986. "Generalized autoregressive conditional heteroskedasticity," EERI Research Paper Series EERI RP 1986/01, Economics and Econometrics Research Institute (EERI), Brussels.
  21. Peter Reinhard Hansen, 2001. "An Unbiased and Powerful Test for Superior Predictive Ability," Working Papers 2001-06, Brown University, Department of Economics.
  22. Zheng, John Xu, 1998. "A Consistent Nonparametric Test Of Parametric Regression Models Under Conditional Quantile Restrictions," Econometric Theory, Cambridge University Press, vol. 14(01), pages 123-138, February.
  23. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
  24. Harvey, Campbell R. & Siddique, Akhtar, 1999. "Autoregressive Conditional Skewness," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 34(04), pages 465-487, December.
  25. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
  26. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
  27. Peter Hall & Rodney C. L. Wolff & Qiwei Yao, 1999. "Methods for estimating a conditional distribution function," LSE Research Online Documents on Economics 6631, London School of Economics and Political Science, LSE Library.
  28. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
  29. Subu Venkataraman, 1997. "Value at risk for a mixture of normal distributions: the use of quasi- Bayesian estimation techniques," Economic Perspectives, Federal Reserve Bank of Chicago, issue Mar, pages 2-13.
  30. Campbell R. Harvey & Akhtar Siddique, 2000. "Conditional Skewness in Asset Pricing Tests," Journal of Finance, American Finance Association, vol. 55(3), pages 1263-1295, 06.
  31. Cai, Zongwu, 2002. "Regression Quantiles For Time Series," Econometric Theory, Cambridge University Press, vol. 18(01), pages 169-192, February.
  32. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  33. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
  34. Longin, Francois M, 1996. "The Asymptotic Distribution of Extreme Stock Market Returns," The Journal of Business, University of Chicago Press, vol. 69(3), pages 383-408, July.
  35. Pownall, Rachel A. J. & Koedijk, Kees G., 1999. "Capturing downside risk in financial markets: the case of the Asian Crisis," Journal of International Money and Finance, Elsevier, vol. 18(6), pages 853-870, December.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:25:y:2006:i:2:p:101-128. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing)

or (Christopher F. Baum)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.