IDEAS home Printed from https://ideas.repec.org/a/jof/jforec/v25y2006i2p101-128.html
   My bibliography  Save this article

Evaluating predictive performance of value-at-risk models in emerging markets: a reality check

Author

Listed:
  • Tae-Hwy Lee

    (University of California, Riverside, USA)

  • Yong Bao

    (University of Texas, San Antonio, USA)

  • Burak Saltoglu

    (Marmara University, Turkey)

Abstract

We investigate the predictive performance of various classes of value-at-risk (VaR) models in several dimensions-unfiltered versus filtered VaR models, parametric versus nonparametric distributions, conventional versus extreme value distributions, and quantile regression versus inverting the conditional distribution function. By using the reality check test of White (2000), we compare the predictive power of alternative VaR models in terms of the empirical coverage probability and the predictive quantile loss for the stock markets of five Asian economies that suffered from the 1997-1998 financial crisis. The results based on these two criteria are largely compatible and indicate some empirical regularities of risk forecasts. The Riskmetrics model behaves reasonably well in tranquil periods, while some extreme value theory (EVT)-based models do better in the crisis period. Filtering often appears to be useful for some models, particularly for the EVT models, though it could be harmful for some other models. The CaViaR quantile regression models of Engle and Manganelli (2004) have shown some success in predicting the VaR risk measure for various periods, generally more stable than those that invert a distribution function. Overall, the forecasting performance of the VaR models considered varies over the three periods before, during and after the crisis. Copyright © 2006 John Wiley & Sons, Ltd.

Suggested Citation

  • Tae-Hwy Lee & Yong Bao & Burak Saltoglu, 2006. "Evaluating predictive performance of value-at-risk models in emerging markets: a reality check," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(2), pages 101-128.
  • Handle: RePEc:jof:jforec:v:25:y:2006:i:2:p:101-128
    DOI: 10.1002/for.977
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/for.977
    File Function: Link to full text; subscription required
    Download Restriction: no

    File URL: https://libkey.io/10.1002/for.977?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lakonishok, Josef & Shleifer, Andrei & Vishny, Robert W, 1994. "Contrarian Investment, Extrapolation, and Risk," Journal of Finance, American Finance Association, vol. 49(5), pages 1541-1578, December.
    2. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    3. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    4. Kai-Li Wang & Christopher Fawson & Christopher B. Barrett & James B. McDonald, 2001. "A flexible parametric GARCH model with an application to exchange rates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(4), pages 521-536.
    5. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    6. Mittnik, Stefan & Paolella, Marc S. & Rachev, Svetlozar T., 2002. "Stationarity of stable power-GARCH processes," Journal of Econometrics, Elsevier, vol. 106(1), pages 97-107, January.
    7. Herman J. Bierens & Donna K. Ginther, 2001. "Integrated Conditional Moment testing of quantile regression models," Empirical Economics, Springer, vol. 26(1), pages 307-324.
    8. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    9. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    10. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    11. Peter Hansen, 2003. "Asymptotic Tests of Composite Hypotheses," Working Papers 2003-09, Brown University, Department of Economics.
    12. Harvey, Campbell R. & Siddique, Akhtar, 1999. "Autoregressive Conditional Skewness," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 34(4), pages 465-487, December.
    13. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    14. Subu Venkataraman, 1997. "Value at risk for a mixture of normal distributions: the use of quasi- Bayesian estimation techniques," Economic Perspectives, Federal Reserve Bank of Chicago, vol. 21(Mar), pages 2-13.
    15. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    16. Jesus Gonzalo, 2004. "Which Extreme Values Are Really Extreme?," Journal of Financial Econometrics, Oxford University Press, vol. 2(3), pages 349-369.
    17. Longin, Francois M., 2000. "From value at risk to stress testing: The extreme value approach," Journal of Banking & Finance, Elsevier, vol. 24(7), pages 1097-1130, July.
    18. Pownall, Rachel A. J. & Koedijk, Kees G., 1999. "Capturing downside risk in financial markets: the case of the Asian Crisis," Journal of International Money and Finance, Elsevier, vol. 18(6), pages 853-870, December.
    19. Hansen, Bruce E, 1994. "Autoregressive Conditional Density Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 35(3), pages 705-730, August.
    20. Hall, Peter & Wolff, Rodney C. L. & Yao, Qiwei, 1999. "Methods for estimating a conditional distribution function," LSE Research Online Documents on Economics 6631, London School of Economics and Political Science, LSE Library.
    21. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    22. George Soros, 1999. "The International Financial Crisis," Challenge, Taylor & Francis Journals, vol. 42(2), pages 58-76, March.
    23. Ser-Huang Poon & Clive W.J. Granger, 2003. "Forecasting Volatility in Financial Markets: A Review," Journal of Economic Literature, American Economic Association, vol. 41(2), pages 478-539, June.
    24. Peter Reinhard Hansen, 2001. "An Unbiased and Powerful Test for Superior Predictive Ability," Working Papers 2001-06, Brown University, Department of Economics.
    25. Longin, Francois M, 1996. "The Asymptotic Distribution of Extreme Stock Market Returns," The Journal of Business, University of Chicago Press, vol. 69(3), pages 383-408, July.
    26. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    27. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
    28. Zheng, John Xu, 1998. "A Consistent Nonparametric Test Of Parametric Regression Models Under Conditional Quantile Restrictions," Econometric Theory, Cambridge University Press, vol. 14(1), pages 123-138, February.
    29. Cai, Zongwu, 2002. "Regression Quantiles For Time Series," Econometric Theory, Cambridge University Press, vol. 18(1), pages 169-192, February.
    30. Ming-Yuan Leon Li & Hsiou-wei William Lin, 2004. "Estimating value-at-risk via Markov switching ARCH models - an empirical study on stock index returns," Applied Economics Letters, Taylor & Francis Journals, vol. 11(11), pages 679-691.
    31. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
    32. Clive W. J. Granger, 2002. "Some comments on risk," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 447-456.
    33. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    34. Campbell R. Harvey & Akhtar Siddique, 2000. "Conditional Skewness in Asset Pricing Tests," Journal of Finance, American Finance Association, vol. 55(3), pages 1263-1295, June.
    35. Giovanni Barone‐Adesi & Kostas Giannopoulos & Les Vosper, 2002. "Backtesting Derivative Portfolios with Filtered Historical Simulation (FHS)," European Financial Management, European Financial Management Association, vol. 8(1), pages 31-58, March.
    36. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Nieto, María Rosa & Ruiz Ortega, Esther, 2008. "Measuring financial risk : comparison of alternative procedures to estimate VaR and ES," DES - Working Papers. Statistics and Econometrics. WS ws087326, Universidad Carlos III de Madrid. Departamento de Estadística.
    3. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    4. Şener, Emrah & Baronyan, Sayad & Ali Mengütürk, Levent, 2012. "Ranking the predictive performances of value-at-risk estimation methods," International Journal of Forecasting, Elsevier, vol. 28(4), pages 849-873.
    5. Tae-Hwy Lee & Yong Bao & Burak Saltoğlu, 2007. "Comparing density forecast models Previous versions of this paper have been circulated with the title, 'A Test for Density Forecast Comparison with Applications to Risk Management' since October 2003;," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(3), pages 203-225.
    6. esposito, francesco paolo & cummins, mark, 2015. "Multiple hypothesis testing of market risk forecasting models," MPRA Paper 64986, University Library of Munich, Germany.
    7. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    8. Mauro Bernardi & Leopoldo Catania, 2016. "Comparison of Value-at-Risk models using the MCS approach," Computational Statistics, Springer, vol. 31(2), pages 579-608, June.
    9. Laura Garcia‐Jorcano & Alfonso Novales, 2021. "Volatility specifications versus probability distributions in VaR forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(2), pages 189-212, March.
    10. Gloria González-Rivera & Tae-Hwy Lee, 2007. "Nonlinear Time Series in Financial Forecasting," Working Papers 200803, University of California at Riverside, Department of Economics, revised Feb 2008.
    11. Lee, Tae-Hwy & Saltoglu, Burak, 2002. "Assessing the risk forecasts for Japanese stock market," Japan and the World Economy, Elsevier, vol. 14(1), pages 63-85, January.
    12. Chen, Qian & Gerlach, Richard & Lu, Zudi, 2012. "Bayesian Value-at-Risk and expected shortfall forecasting via the asymmetric Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3498-3516.
    13. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    14. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    15. Alex Huang, 2013. "Value at risk estimation by quantile regression and kernel estimator," Review of Quantitative Finance and Accounting, Springer, vol. 41(2), pages 225-251, August.
    16. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    17. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    18. Hartz, Christoph & Mittnik, Stefan & Paolella, Marc, 2006. "Accurate value-at-risk forecasting based on the normal-GARCH model," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2295-2312, December.
    19. Allen, Linda & Bali, Turan G., 2007. "Cyclicality in catastrophic and operational risk measurements," Journal of Banking & Finance, Elsevier, vol. 31(4), pages 1191-1235, April.
    20. Bali, Turan G. & Mo, Hengyong & Tang, Yi, 2008. "The role of autoregressive conditional skewness and kurtosis in the estimation of conditional VaR," Journal of Banking & Finance, Elsevier, vol. 32(2), pages 269-282, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jof:jforec:v:25:y:2006:i:2:p:101-128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/2966 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.