IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v56y2012i11p3366-3380.html
   My bibliography  Save this article

A new class of independence tests for interval forecasts evaluation

Author

Listed:
  • Araújo Santos, P.
  • Fraga Alves, M.I.

Abstract

Interval forecasts evaluation can be reduced to examining the unconditional coverage and independence properties of the hit sequence. A new class of exact independence tests for the hit sequence and a definition for tendency to clustering of violations are proposed. The tests are suitable for detecting models with a tendency to generate clusters of violations and are based on an exact distribution that does not depend on an unknown parameter. The asymptotic distribution is also derived. The choice of one test within the class is studied. Moreover, a simulation study provides evidence that, in order to test the independence hypothesis, the suggested tests perform better than other tests presented in the literature. An empirical application is given for a period that includes the 2008 financial crisis.

Suggested Citation

  • Araújo Santos, P. & Fraga Alves, M.I., 2012. "A new class of independence tests for interval forecasts evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3366-3380.
    • Handle: RePEc:eee:csdana:v:56:y:2012:i:11:p:3366-3380
    DOI: 10.1016/j.csda.2010.10.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947310003762
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2010.10.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bertrand Candelon & Gilbert Colletaz & Christophe Hurlin & Sessi Tokpavi, 2011. "Backtesting Value-at-Risk: A GMM Duration-Based Test," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 9(2), pages 314-343, Spring.
    2. Danielsson, Jon & Morimoto, Yuji, 2000. "Forecasting Extreme Financial Risk: A Critical Analysis of Practical Methods for the Japanese Market," Monetary and Economic Studies, Institute for Monetary and Economic Studies, Bank of Japan, vol. 18(2), pages 25-48, December.
    3. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
    4. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(1), pages 84-108.
    5. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    6. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    7. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    8. Keith Kuester & Stefan Mittnik & Marc S. Paolella, 2006. "Value-at-Risk Prediction: A Comparison of Alternative Strategies," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 53-89.
    9. Kiefer, Nicholas M, 1988. "Economic Duration Data and Hazard Functions," Journal of Economic Literature, American Economic Association, vol. 26(2), pages 646-679, June.
    10. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    11. Granger, C. W. J. & White, Halbert & Kamstra, Mark, 1989. "Interval forecasting : An analysis based upon ARCH-quantile estimators," Journal of Econometrics, Elsevier, vol. 40(1), pages 87-96, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Argyropoulos, Christos & Panopoulou, Ekaterini, 2019. "Backtesting VaR and ES under the magnifying glass," International Review of Financial Analysis, Elsevier, vol. 64(C), pages 22-37.
    2. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    3. Araújo Santos, Paulo & Fraga Alves, Isabel & Hammoudeh, Shawkat, 2013. "High quantiles estimation with Quasi-PORT and DPOT: An application to value-at-risk for financial variables," The North American Journal of Economics and Finance, Elsevier, vol. 26(C), pages 487-496.
    4. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    5. Liu, Tengdong & Hammoudeh, Shawkat & Santos, Paulo Araújo, 2014. "Downside risk and portfolio diversification in the euro-zone equity markets with special consideration of the crisis period," Journal of International Money and Finance, Elsevier, vol. 44(C), pages 47-68.
    6. Sarafrazi, Soodabeh & Hammoudeh, Shawkat & AraújoSantos, Paulo, 2014. "Downside risk, portfolio diversification and the financial crisis in the euro-zone," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 32(C), pages 368-396.
    7. Araújo Santos, P. & Fraga Alves, M.I., 2013. "Forecasting Value-at-Risk with a duration-based POT method," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 94(C), pages 295-309.
    8. Marius Galabe Sampid & Haslifah M Hasim & Hongsheng Dai, 2018. "Refining value-at-risk estimates using a Bayesian Markov-switching GJR-GARCH copula-EVT model," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-33, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Slim, Skander & Koubaa, Yosra & BenSaïda, Ahmed, 2017. "Value-at-Risk under Lévy GARCH models: Evidence from global stock markets," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 46(C), pages 30-53.
    3. Benjamin R. Auer & Benjamin Mögel, 2016. "How Accurate are Modern Value-at-Risk Estimators Derived from Extreme Value Theory?," CESifo Working Paper Series 6288, CESifo.
    4. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    5. Manuela Braione & Nicolas K. Scholtes, 2016. "Forecasting Value-at-Risk under Different Distributional Assumptions," Econometrics, MDPI, vol. 4(1), pages 1-27, January.
    6. Fries, Christian P. & Nigbur, Tobias & Seeger, Norman, 2017. "Displaced relative changes in historical simulation: Application to risk measures of interest rates with phases of negative rates," Journal of Empirical Finance, Elsevier, vol. 42(C), pages 175-198.
    7. Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel R., 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 150-160.
    8. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    9. Laura Garcia‐Jorcano & Alfonso Novales, 2021. "Volatility specifications versus probability distributions in VaR forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(2), pages 189-212, March.
    10. Haas, Markus & Mittnik, Stefan & Paolella, Marc S., 2009. "Asymmetric multivariate normal mixture GARCH," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2129-2154, April.
    11. Thiele, Stephen, 2019. "Detecting underestimates of risk in VaR models," Journal of Banking & Finance, Elsevier, vol. 101(C), pages 12-20.
    12. Stavroyiannis, S. & Makris, I. & Nikolaidis, V. & Zarangas, L., 2012. "Econometric modeling and value-at-risk using the Pearson type-IV distribution," International Review of Financial Analysis, Elsevier, vol. 22(C), pages 10-17.
    13. Szymon Lis & Marcin Chlebus, 2021. "Comparison of the accuracy in VaR forecasting for commodities using different methods of combining forecasts," Working Papers 2021-11, Faculty of Economic Sciences, University of Warsaw.
    14. Krzysztof Echaust & Małgorzata Just, 2020. "Value at Risk Estimation Using the GARCH-EVT Approach with Optimal Tail Selection," Mathematics, MDPI, vol. 8(1), pages 1-24, January.
    15. Araújo Santos, P. & Fraga Alves, M.I., 2013. "Forecasting Value-at-Risk with a duration-based POT method," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 94(C), pages 295-309.
    16. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    17. Nico Katzke & Chris Garbers, 2015. "Do Long Memory and Asymmetries Matter When Assessing Downside Return Risk?," Working Papers 06/2015, Stellenbosch University, Department of Economics.
    18. d’Addona, Stefano & Khanom, Najrin, 2022. "Estimating tail-risk using semiparametric conditional variance with an application to meme stocks," International Review of Economics & Finance, Elsevier, vol. 82(C), pages 241-260.
    19. Elena-Ivona Dumitrescu & Christophe Hurlin & Vinson Pham, 2012. "Backtesting Value-at-Risk: From Dynamic Quantile to Dynamic Binary Tests," Finance, Presses universitaires de Grenoble, vol. 33(1), pages 79-112.
    20. Haas Markus, 2010. "Skew-Normal Mixture and Markov-Switching GARCH Processes," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 14(4), pages 1-56, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:56:y:2012:i:11:p:3366-3380. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.