IDEAS home Printed from https://ideas.repec.org/p/swe/wpaper/2008-23.html
   My bibliography  Save this paper

Out-of-sample comparison of copula specifications in multivariate density forecasts

Author

Listed:
  • Cees Diks

    (University of Amsterdam)

  • Valentyn Panchenko

    (School of Economics, University of New South Wales)

  • Dick van Dijk

    (Econometric Institute, Erasmus University Rotterdam)

Abstract

We introduce a statistical test for comparing the predictive accuracy of competing copula specifications in multivariate density forecasts, based on the Kullback-Leibler Information Criterion (KLIC). The test is valid under general conditions: in particular it allows for parameter estimation uncertainty and for the copulas to be nested or nonnested. Monte Carlo simulations demonstrate that the proposed test has satisfactory size and power properties in finite samples. Applying the test to daily exchange rate returns of several major currencies against the US dollar we find that the Student’s t copula is favored over Gaussian, Gumbel and Clayton copulas. This suggests that these exchange rate returns are characterized by symmetric tail dependence.

Suggested Citation

  • Cees Diks & Valentyn Panchenko & Dick van Dijk, 2008. "Out-of-sample comparison of copula specifications in multivariate density forecasts," Discussion Papers 2008-23, School of Economics, The University of New South Wales.
    • Handle: RePEc:swe:wpaper:2008-23
    as

    Download full text from publisher

    File URL: http://wwwdocs.fce.unsw.edu.au/economics/Research/WorkingPapers/2008_23.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Y. Malevergne & D. Sornette, 2003. "Testing the Gaussian copula hypothesis for financial assets dependences," Quantitative Finance, Taylor & Francis Journals, vol. 3(4), pages 231-250.
    2. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    3. Tae-Hwy Lee & Yong Bao & Burak Saltoğlu, 2007. "Comparing density forecast models Previous versions of this paper have been circulated with the title, 'A Test for Density Forecast Comparison with Applications to Risk Management' since October 2003;," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(3), pages 203-225.
    4. W. Breymann & A. Dias & P. Embrechts, 2003. "Dependence structures for multivariate high-frequency data in finance," Quantitative Finance, Taylor & Francis Journals, vol. 3(1), pages 1-14.
    5. Chen, Xiaohong & Fan, Yanqin & Tsyrennikov, Viktor, 2006. "Efficient Estimation of Semiparametric Multivariate Copula Models," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1228-1240, September.
    6. Christian Genest & Jean‐François Quessy & Bruno Rémillard, 2006. "Goodness‐of‐fit Procedures for Copula Models Based on the Probability Integral Transformation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(2), pages 337-366, June.
    7. Panchenko, Valentyn, 2005. "Goodness-of-fit test for copulas," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 355(1), pages 176-182.
    8. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    9. Fermanian, Jean-David & Scaillet, Olivier, 2003. "Nonparametric estimation of copulas for time series," Working Papers unige:41797, University of Geneva, Geneva School of Economics and Management.
    10. Kole, Erik & Koedijk, Kees & Verbeek, Marno, 2007. "Selecting copulas for risk management," Journal of Banking & Finance, Elsevier, vol. 31(8), pages 2405-2423, August.
    11. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    12. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    13. Andrew J. Patton, 2008. "Copula-Based Models for Financial Time Series," Economics Series Working Papers 2008fe21, University of Oxford, Department of Economics.
    14. Daniel Berg, 2009. "Copula goodness-of-fit testing: an overview and power comparison," The European Journal of Finance, Taylor & Francis Journals, vol. 15(7-8), pages 675-701.
    15. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    16. James Mitchell & Stephen G. Hall, 2005. "Evaluating, Comparing and Combining Density Forecasts Using the KLIC with an Application to the Bank of England and NIESR ‘Fan’ Charts of Inflation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 995-1033, December.
    17. Shen, Xiaojing & Zhu, Yunmin & Song, Lixin, 2008. "Linear B-spline copulas with applications to nonparametric estimation of copulas," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3806-3819, March.
    18. Okimoto, Tatsuyoshi, 2008. "New Evidence of Asymmetric Dependence Structures in International Equity Markets," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 43(3), pages 787-815, September.
    19. Andrew J. Patton, 2006. "Modelling Asymmetric Exchange Rate Dependence," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(2), pages 527-556, May.
    20. Joshua D. Coval & Jakub W. Jurek & Erik Stafford, 2009. "Economic Catastrophe Bonds," American Economic Review, American Economic Association, vol. 99(3), pages 628-666, June.
    21. Isabelle Huault & V. Perret & S. Charreire-Petit, 2007. "Management," Post-Print halshs-00337676, HAL.
    22. Chen, Xiaohong & Fan, Yanqin, 2006. "Estimation and model selection of semiparametric copula-based multivariate dynamic models under copula misspecification," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 125-154.
    23. Jondeau, Eric & Rockinger, Michael, 2006. "The Copula-GARCH model of conditional dependencies: An international stock market application," Journal of International Money and Finance, Elsevier, vol. 25(5), pages 827-853, August.
    24. Christian Genest & Michel Gendron & Michaël Bourdeau-Brien, 2009. "The Advent of Copulas in Finance," The European Journal of Finance, Taylor & Francis Journals, vol. 15(7-8), pages 609-618.
    25. Sancetta, Alessio & Satchell, Stephen, 2004. "The Bernstein Copula And Its Applications To Modeling And Approximations Of Multivariate Distributions," Econometric Theory, Cambridge University Press, vol. 20(3), pages 535-562, June.
    26. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    27. Fermanian, Jean-David, 2005. "Goodness-of-fit tests for copulas," Journal of Multivariate Analysis, Elsevier, vol. 95(1), pages 119-152, July.
    28. Rodriguez, Juan Carlos, 2007. "Measuring financial contagion: A Copula approach," Journal of Empirical Finance, Elsevier, vol. 14(3), pages 401-423, June.
    29. Dimitrova, Dimitrina S. & Kaishev, Vladimir K. & Penev, Spiridon I., 2008. "GeD spline estimation of multivariate Archimedean copulas," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3570-3582, March.
    30. Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Patton, Andrew, 2013. "Copula Methods for Forecasting Multivariate Time Series," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 899-960, Elsevier.
    2. Diks, Cees & Panchenko, Valentyn & Sokolinskiy, Oleg & van Dijk, Dick, 2014. "Comparing the accuracy of multivariate density forecasts in selected regions of the copula support," Journal of Economic Dynamics and Control, Elsevier, vol. 48(C), pages 79-94.
    3. Weiß, Gregor N.F., 2011. "Are Copula-GoF-tests of any practical use? Empirical evidence for stocks, commodities and FX futures," The Quarterly Review of Economics and Finance, Elsevier, vol. 51(2), pages 173-188, May.
    4. Cees Diks & Valentyn Panchenko & Oleg Sokolinskiy, & Dick van Dijk, 2013. "Comparing the Accuracy of Copula-Based Multivariate Density Forecasts in Selected Regions of Support," Tinbergen Institute Discussion Papers 13-061/III, Tinbergen Institute.
    5. Patton, Andrew J., 2012. "A review of copula models for economic time series," Journal of Multivariate Analysis, Elsevier, vol. 110(C), pages 4-18.
    6. Fantazzini, Dean, 2011. "Analysis of multidimensional probability distributions with copula functions. III," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 24(4), pages 100-130.
    7. Jean-David Fermanian, 2012. "An overview of the goodness-of-fit test problem for copulas," Papers 1211.4416, arXiv.org.
    8. Cees Diks & Valentyn Panchenko & Dick van Dijk, 2008. "Partial Likelihood-Based Scoring Rules for Evaluating Density Forecasts in Tails," Tinbergen Institute Discussion Papers 08-050/4, Tinbergen Institute.
    9. Grundke, Peter & Polle, Simone, 2012. "Crisis and risk dependencies," European Journal of Operational Research, Elsevier, vol. 223(2), pages 518-528.
    10. Gregor Weiß, 2013. "Copula-GARCH versus dynamic conditional correlation: an empirical study on VaR and ES forecasting accuracy," Review of Quantitative Finance and Accounting, Springer, vol. 41(2), pages 179-202, August.
    11. Matthias Pelster & Johannes Vilsmeier, 2018. "The determinants of CDS spreads: evidence from the model space," Review of Derivatives Research, Springer, vol. 21(1), pages 63-118, April.
    12. Pelster, Matthias & Vilsmeier, Johannes, 2016. "The determinants of CDS spreads: Evidence from the model space," Discussion Papers 43/2016, Deutsche Bundesbank.
    13. Dr. James Mitchell, 2009. "Measuring Output Gap Uncertainty," National Institute of Economic and Social Research (NIESR) Discussion Papers 342, National Institute of Economic and Social Research.
    14. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.
    15. Chollete, Loran & Ning, Cathy, 2009. "The Dependence Structure of Macroeconomic Variables in the US," UiS Working Papers in Economics and Finance 2009/31, University of Stavanger.
    16. Romera, Rosario & Molanes, Elisa M., 2008. "Copulas in finance and insurance," DES - Working Papers. Statistics and Econometrics. WS ws086321, Universidad Carlos III de Madrid. Departamento de Estadística.
    17. Daniel Buncic, 2012. "Understanding forecast failure of ESTAR models of real exchange rates," Empirical Economics, Springer, vol. 43(1), pages 399-426, August.
    18. Marc Gronwald & Janina Ketterer & Stefan Trück, 2011. "The Dependence Structure between Carbon Emission Allowances and Financial Markets - A Copula Analysis," CESifo Working Paper Series 3418, CESifo.
    19. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    20. Manzan, Sebastiano & Zerom, Dawit, 2009. "Are Macroeconomic Variables Useful for Forecasting the Distribution of U.S. Inflation?," MPRA Paper 14387, University Library of Munich, Germany.

    More about this item

    Keywords

    Copula-based density forecast; semiparametric statistics; out-of-sample forecast evaluation; Kullback-Leibler Information Criterion; empirical copula;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:swe:wpaper:2008-23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Hongyi Li (email available below). General contact details of provider: https://edirc.repec.org/data/senswau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.