IDEAS home Printed from https://ideas.repec.org/a/eee/quaeco/v51y2011i2p173-188.html
   My bibliography  Save this article

Are Copula-GoF-tests of any practical use? Empirical evidence for stocks, commodities and FX futures

Author

Listed:
  • Weiß, Gregor N.F.

Abstract

In this paper, the optimality of bivariate copula-VaR models and the usefulness of several goodness-of-fit tests for copulas are analysed in a comprehensive empirical study using data for stocks, commodities and FX futures. In particular, I try to answer two questions: (1) which parametric copula is optimal for estimating the VaR and Expected Shortfall (ES) of a given portfolio consisting of linear assets? (2) How can the VaR- or ES-optimal parametric copula be identified in-sample? To answer these questions, the VaR and ES for a total of 12,000 bivariate portfolios are estimated from 435 linear assets over eight different time windows. The results show that although copula-models with GARCH-margins yield considerably better VaR-estimates than correlation-based models, the identification of the optimal parametric copula form is a serious unsolved problem. The analysis of three state-of-the-art approaches for testing a copula-model's goodness-of-fit showed that none of the tests is able to identify the optimal parametric form unequivocally. In addition to this result, for more than 80% of all portfolios considered, all five parametric copula models yielded worse ES-estimates than the correlation-based benchmark or underestimated actual portfolio risk. Moreover, the backtesting results show that the optimal parametric copula is both dependent on the risk measure and time-variant.

Suggested Citation

  • Weiß, Gregor N.F., 2011. "Are Copula-GoF-tests of any practical use? Empirical evidence for stocks, commodities and FX futures," The Quarterly Review of Economics and Finance, Elsevier, vol. 51(2), pages 173-188, May.
  • Handle: RePEc:eee:quaeco:v:51:y:2011:i:2:p:173-188
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1062976910000748
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Matthias Fischer & Christian Kock & Stephan Schluter & Florian Weigert, 2009. "An empirical analysis of multivariate copula models," Quantitative Finance, Taylor & Francis Journals, vol. 9(7), pages 839-854.
    2. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2010. "Out-of-sample comparison of copula specifications in multivariate density forecasts," Journal of Economic Dynamics and Control, Elsevier, vol. 34(9), pages 1596-1609, September.
    3. W. Breymann & A. Dias & P. Embrechts, 2003. "Dependence structures for multivariate high-frequency data in finance," Quantitative Finance, Taylor & Francis Journals, vol. 3(1), pages 1-14.
    4. Yamai, Yasuhiro & Yoshiba, Toshinao, 2005. "Value-at-risk versus expected shortfall: A practical perspective," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 997-1015, April.
    5. Lorenzo Cappiello & Robert F. Engle & Kevin Sheppard, 2006. "Asymmetric Dynamics in the Correlations of Global Equity and Bond Returns," Journal of Financial Econometrics, Oxford University Press, vol. 4(4), pages 537-572.
    6. Y. Malevergne & D. Sornette, 2003. "Testing the Gaussian copula hypothesis for financial assets dependences," Quantitative Finance, Taylor & Francis Journals, vol. 3(4), pages 231-250.
    7. Daniel Berg, 2009. "Copula goodness-of-fit testing: an overview and power comparison," The European Journal of Finance, Taylor & Francis Journals, vol. 15(7-8), pages 675-701.
    8. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    9. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    10. Alexander, Carol & Sheedy, Elizabeth, 2008. "Developing a stress testing framework based on market risk models," Journal of Banking & Finance, Elsevier, vol. 32(10), pages 2220-2236, October.
    11. Lorán Chollete & Andréas Heinen & Alfonso Valdesogo, 2009. "Modeling International Financial Returns with a Multivariate Regime-switching Copula," Journal of Financial Econometrics, Oxford University Press, vol. 7(4), pages 437-480, Fall.
    12. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    13. Genest, Christian & Rémillard, Bruno & Beaudoin, David, 2009. "Goodness-of-fit tests for copulas: A review and a power study," Insurance: Mathematics and Economics, Elsevier, vol. 44(2), pages 199-213, April.
    14. Claudio Romano & Annalisa Di Clemente, 2005. "Measuring Portfolio value-at-risk by a copula-evt based approach," STUDI ECONOMICI, FrancoAngeli Editore, vol. 2005(85).
    15. Acerbi, Carlo & Tasche, Dirk, 2002. "On the coherence of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1487-1503, July.
    16. Christoffersen, Peter, 2011. "Elements of Financial Risk Management," Elsevier Monographs, Elsevier, edition 2, number 9780123744487.
    17. Cornelia Savu & Mark Trede, 2008. "Goodness-of-fit tests for parametric families of Archimedean copulas," Quantitative Finance, Taylor & Francis Journals, vol. 8(2), pages 109-116.
    18. Isabelle Huault & V. Perret & S. Charreire-Petit, 2007. "Management," Post-Print halshs-00337676, HAL.
    19. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    20. Rodriguez, Juan Carlos, 2007. "Measuring financial contagion: A Copula approach," Journal of Empirical Finance, Elsevier, vol. 14(3), pages 401-423, June.
    21. Kim, Gunky & Silvapulle, Mervyn J. & Silvapulle, Paramsothy, 2007. "Comparison of semiparametric and parametric methods for estimating copulas," Computational Statistics & Data Analysis, Elsevier, vol. 51(6), pages 2836-2850, March.
    22. Markwat, T.D. & Kole, H.J.W.G. & van Dijk, D.J.C., 2009. "Time Variation in Asset Return Dependence: Strength or Structure?," ERIM Report Series Research in Management ERS-2009-052-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    23. Christian Genest & Jean‐François Quessy & Bruno Rémillard, 2006. "Goodness‐of‐fit Procedures for Copula Models Based on the Probability Integral Transformation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(2), pages 337-366, June.
    24. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    25. Kjersti Aas & Daniel Berg, 2009. "Models for construction of multivariate dependence - a comparison study," The European Journal of Finance, Taylor & Francis Journals, vol. 15(7-8), pages 639-659.
    26. Kole, Erik & Koedijk, Kees & Verbeek, Marno, 2007. "Selecting copulas for risk management," Journal of Banking & Finance, Elsevier, vol. 31(8), pages 2405-2423, August.
    27. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.
    28. Engle, Robert, 2002. "Dynamic Conditional Correlation: A Simple Class of Multivariate Generalized Autoregressive Conditional Heteroskedasticity Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 339-350, July.
    29. Okimoto, Tatsuyoshi, 2008. "New Evidence of Asymmetric Dependence Structures in International Equity Markets," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 43(3), pages 787-815, September.
    30. Andrew J. Patton, 2006. "Modelling Asymmetric Exchange Rate Dependence," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(2), pages 527-556, May.
    31. Fantazzini, Dean, 2009. "The effects of misspecified marginals and copulas on computing the value at risk: A Monte Carlo study," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2168-2188, April.
    32. Chen, Xiaohong & Fan, Yanqin, 2006. "Estimation and model selection of semiparametric copula-based multivariate dynamic models under copula misspecification," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 125-154.
    33. Wong, Woon K., 2008. "Backtesting trading risk of commercial banks using expected shortfall," Journal of Banking & Finance, Elsevier, vol. 32(7), pages 1404-1415, July.
    34. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    35. Bartram, Sohnke M. & Taylor, Stephen J. & Wang, Yaw-Huei, 2007. "The Euro and European financial market dependence," Journal of Banking & Finance, Elsevier, vol. 31(5), pages 1461-1481, May.
    36. Markus Junker & Angelika May, 2005. "Measurement of aggregate risk with copulas," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 428-454, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Aloui, Riadh & Hammoudeh, Shawkat & Nguyen, Duc Khuong, 2013. "A time-varying copula approach to oil and stock market dependence: The case of transition economies," Energy Economics, Elsevier, vol. 39(C), pages 208-221.
    2. Grundke, Peter & Polle, Simone, 2012. "Crisis and risk dependencies," European Journal of Operational Research, Elsevier, vol. 223(2), pages 518-528.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gregor Weiß, 2013. "Copula-GARCH versus dynamic conditional correlation: an empirical study on VaR and ES forecasting accuracy," Review of Quantitative Finance and Accounting, Springer, vol. 41(2), pages 179-202, August.
    2. Siburg, Karl Friedrich & Stoimenov, Pavel & Weiß, Gregor N.F., 2015. "Forecasting portfolio-Value-at-Risk with nonparametric lower tail dependence estimates," Journal of Banking & Finance, Elsevier, vol. 54(C), pages 129-140.
    3. Weiß, Gregor N.F. & Scheffer, Marcus, 2015. "Mixture pair-copula-constructions," Journal of Banking & Finance, Elsevier, vol. 54(C), pages 175-191.
    4. Patton, Andrew, 2013. "Copula Methods for Forecasting Multivariate Time Series," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 899-960, Elsevier.
    5. Patton, Andrew J., 2012. "A review of copula models for economic time series," Journal of Multivariate Analysis, Elsevier, vol. 110(C), pages 4-18.
    6. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2010. "Out-of-sample comparison of copula specifications in multivariate density forecasts," Journal of Economic Dynamics and Control, Elsevier, vol. 34(9), pages 1596-1609, September.
    7. Jean-David Fermanian, 2012. "An overview of the goodness-of-fit test problem for copulas," Papers 1211.4416, arXiv.org.
    8. Grundke, Peter & Polle, Simone, 2012. "Crisis and risk dependencies," European Journal of Operational Research, Elsevier, vol. 223(2), pages 518-528.
    9. Gregor Weiß, 2011. "Copula parameter estimation by maximum-likelihood and minimum-distance estimators: a simulation study," Computational Statistics, Springer, vol. 26(1), pages 31-54, March.
    10. Fantazzini, Dean, 2011. "Analysis of multidimensional probability distributions with copula functions. III," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 24(4), pages 100-130.
    11. Koliai, Lyes, 2016. "Extreme risk modeling: An EVT–pair-copulas approach for financial stress tests," Journal of Banking & Finance, Elsevier, vol. 70(C), pages 1-22.
    12. Anna CZAPKIEWICZ & Pawel MAJDOSZ, 2014. "Grouping Stock Markets with Time-Varying Copula-GARCH Model," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 64(2), pages 144-159, March.
    13. Fernanda Maria Müller & Marcelo Brutti Righi, 2018. "Numerical comparison of multivariate models to forecasting risk measures," Risk Management, Palgrave Macmillan, vol. 20(1), pages 29-50, February.
    14. Gregor Wei{ss} & Marcus Scheffer, 2012. "Smooth Nonparametric Bernstein Vine Copulas," Papers 1210.2043, arXiv.org.
    15. Małgorzata Doman & Ryszard Doman, 2013. "Dynamic linkages between stock markets: the effects of crises and globalization," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 12(2), pages 87-112, August.
    16. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    17. Mauro Bernardi & Leopoldo Catania, 2015. "Switching-GAS Copula Models With Application to Systemic Risk," Papers 1504.03733, arXiv.org, revised Jan 2016.
    18. Rossi, Eduardo & Santucci de Magistris, Paolo, 2013. "Long memory and tail dependence in trading volume and volatility," Journal of Empirical Finance, Elsevier, vol. 22(C), pages 94-112.
    19. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2013. "Financial Risk Measurement for Financial Risk Management," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1127-1220, Elsevier.
    20. Lourme, Alexandre & Maurer, Frantz, 2017. "Testing the Gaussian and Student's t copulas in a risk management framework," Economic Modelling, Elsevier, vol. 67(C), pages 203-214.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:quaeco:v:51:y:2011:i:2:p:173-188. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620167 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.