This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Evaluation and Combination of Conditional Quantile Forecasts

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Raffaella Giacomini (UCLA)
Ivana Komunjer (University of California - San Diego)

Additional information is available for the following registered author(s):

Abstract

This paper proposes a method for comparing and combining conditional quantile forecasts based on the principle of 'encompassing'. Our test for conditional quantile forecast encompassing (CQFE) is a test of superior predictive ability, constructed as a Wald-type test on the coefficients of an optimal combination of alternative forecasts. The CQFE test is a 'model free' test that can be used to compare any given number of alternative forecasts, and is relatively easy to implement by GMM techniques appropriately modified to accommodate non-differentiable criterion functions. Further, our theoretical framework provides a basis for combining quantile forecasts, when neither forecast has superior predictive ability. A central feature of our method is the focus on conditional, rather than unconditional expected loss in the formulation of the encompassing test, which links our approach to Christoffersen's (1998) 'conditional coverage' test for evaluation of quantile forecasts. An empirical application to the problem of Value at Risk evaluation illustrates the usefulness of the proposed techniques.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://repositories.cdlib.org/cgi/viewcontent.cgi?article=1104&context=ucsdecon
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by Department of Economics, UC San Diego in its series University of California at San Diego, Economics Working Paper Series with number 2002-11.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: 01 Jun 2002
Date of revision:
Handle: RePEc:cdl:ucsdec:2002-11

Note: oai:cdlib1:
Contact details of provider:
Postal: 9500 Gilman Drive, La Jolla, CA 92093-0508
Phone: (858) 534-3383
Fax: (858) 534-7040
Web page: http://repositories.cdlib.org/ucsdecon/
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Christopher F. Baum).

Related research
Keywords: encompassing; forcast combination; loss function; value at risk; GMM;

Other versions of this item:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Robert Engle & Simone Manganelli, 1999. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," University of California at San Diego, Economics Working Paper Series 1999-20, Department of Economics, UC San Diego. [Downloadable!]
    Other versions:
  2. Peter F. Christoffersen & Francis X. Diebold, 1997. "Optimal prediction under asymmetric loss," Working Papers 97-11, Federal Reserve Bank of Philadelphia. [Downloadable!]
    Other versions:
  3. James W. Taylor Derek W. Bunn, 1998. "Combining forecast quantiles using quantile regression: Investigating the derived weights, estimator bias and imposing constraints," Journal of Applied Statistics, Taylor and Francis Journals, vol. 25(2), pages 193-206, April. [Downloadable!] (restricted)
  4. Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May. [Downloadable!] (restricted)
    Other versions:
  5. Donald W. K. Andrews, 1997. "A Stopping Rule for the Computation of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 65(4), pages 913-932, July.
    Other versions:
  6. repec:cup:etheor:v:12:y:1996:i:5:p:793-813 is not listed on IDEAS
  7. Christoffersen, Peter & Hahn, Jinyong & Inoue, Atsushi, 2001. "Testing and comparing Value-at-Risk measures," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 325-342, July. [Downloadable!] (restricted)
    Other versions:
  8. de Menezes, Lilian M. & W. Bunn, Derek & Taylor, James W., 2000. "Review of guidelines for the use of combined forecasts," European Journal of Operational Research, Elsevier, vol. 120(1), pages 190-204, January. [Downloadable!] (restricted)
  9. Vries, Caspar de & Danielsson, Jon, 1996. "Tail Index and Quantile Estimation with Very High Frequency Data," CESifo Working Paper Series CESifo Working Paper No. , CESifo Group Munich.
  10. Herman J. Bierens & Donna K. Ginther, 2001. "Integrated Conditional Moment testing of quantile regression models," Empirical Economics, Springer, vol. 26(1), pages 307-324. [Downloadable!] (restricted)
  11. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-54, July. [Downloadable!] (restricted)
  12. Diebold, Francis X., 1989. "Forecast combination and encompassing: Reconciling two divergent literatures," International Journal of Forecasting, Elsevier, vol. 5(4), pages 589-592. [Downloadable!] (restricted)
    Other versions:
  13. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September. [Downloadable!] (restricted)
    Other versions:
  14. Len Umantsev & Victor Chernozhukov, 2001. "Conditional value-at-risk: Aspects of modeling and estimation," Empirical Economics, Springer, vol. 26(1), pages 271-292. [Downloadable!] (restricted)
  15. Koenker, Roger & Zhao, Quanshui, 1996. "Conditional Quantile Estimation and Inference for Arch Models," Econometric Theory, Cambridge University Press, vol. 12(05), pages 793-813, December. [Downloadable!]
  16. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
  17. Mizon, Grayham E & Richard, Jean-Francois, 1986. "The Encompassing Principle and Its Application to Testing Non-nested Hypotheses," Econometrica, Econometric Society, vol. 54(3), pages 657-78, May. [Downloadable!] (restricted)
  18. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  19. Zheng, John Xu, 1998. "A Consistent Nonparametric Test Of Parametric Regression Models Under Conditional Quantile Restrictions," Econometric Theory, Cambridge University Press, vol. 14(01), pages 123-138, February. [Downloadable!]
  20. Raffaella Giacomini & Halbert White, 2003. "Tests of Conditional Predictive Ability," Econometrics 0308001, EconWPA. [Downloadable!]
    Other versions:
  21. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
  22. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583. [Downloadable!] (restricted)
  23. James H. Stock & Mark W. Watson, 2001. "Forecasting Output and Inflation: The Role of Asset Prices," NBER Working Papers 8180, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  24. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November. [Downloadable!] (restricted)
  25. Weiss, Andrew A, 1996. "Estimating Time Series Models Using the Relevant Cost Function," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 539-60, Sept.-Oct. [Downloadable!] (restricted)
  26. Elliott, Graham & Timmermann, Allan, 2004. "Optimal forecast combinations under general loss functions and forecast error distributions," Journal of Econometrics, Elsevier, vol. 122(1), pages 47-79, September. [Downloadable!] (restricted)
    Other versions:
  27. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October. [Downloadable!] (restricted)
  28. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
    Other versions:
  29. repec:cup:etheor:v:13:y:1997:i:6:p:808-17 is not listed on IDEAS
  30. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January. [Downloadable!] (restricted)
  31. Komunjer, Ivana, 2002. "Quasi-Maximum Likelihood Estimation for Conditional Quantiles," Working Papers 1139, California Institute of Technology, Division of the Humanities and Social Sciences. [Downloadable!]
    Other versions:
  32. West, Kenneth D., 2001. "Encompassing tests when no model is encompassing," Journal of Econometrics, Elsevier, vol. 105(1), pages 287-308, November. [Downloadable!] (restricted)
    Other versions:
  33. James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
  34. Goffe, William L. & Ferrier, Gary D. & Rogers, John, 1994. "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 65-99. [Downloadable!] (restricted)
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Christian T. Brownlees & Giampiero Gallo, 2008. "Comparison of Volatility Measures: a Risk Management Perspective," Econometrics Working Papers Archive wp2008_03, Universita' degli Studi di Firenze, Dipartimento di Statistica "G. Parenti". [Downloadable!]
  2. Raffaella Giacomini & Halbert White, 2004. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series 2003-09, Department of Economics, UC San Diego. [Downloadable!]
    Other versions:
  3. Maria Rosa Nieto & Esther Ruiz, 2008. "Measuring financial risk : comparison of alternative procedures to estimate VaR and ES," Statistics and Econometrics Working Papers ws087326, Universidad Carlos III, Departamento de Estadística y Econometría. [Downloadable!]
  4. Gael M. Martin & Andrew Reidy & Jill Wright, 2009. "Does the option market produce superior forecasts of noise-corrected volatility measures?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(1), pages 77-104. [Downloadable!]
    Other versions:
  5. Gaglianone, Wagner Piazza & Linton, Oliver & Lima, Luiz Renato Regis de Oliveira, 2008. "Evaluating Value-at-Risk models via Quantile regressions," Economics Working Papers (Ensaios Economicos da EPGE) 679, Graduate School of Economics, Getulio Vargas Foundation (Brazil). [Downloadable!]
    Other versions:
  6. Clements, Michael P., 2008. "Explanations of the inconsistencies in survey respondents'forecasts," The Warwick Economics Research Paper Series (TWERPS) 870, University of Warwick, Department of Economics. [Downloadable!]
  7. Huiyu Huang & Tae-Hwy Lee, 2006. "To Combine Forecasts or to Combine Information?," Working Papers 200806, University of California at Riverside, Department of Economics, revised Feb 2009. [Downloadable!]
  8. J. Carlos Escanciano & Jose Olmo, 2007. "Estimation risk effects on backtesting for parametric value-at-risk models," City University Economics Discussion Papers 07/11, Department of Economics, City University, London. [Downloadable!]
  9. Zhijie Xiao, 2009. "Quantile Cointegrating Regression," Boston College Working Papers in Economics 708, Boston College Department of Economics. [Downloadable!]
  10. Juan Carlos Escanciano & Jose Olmo, 2007. "Backtesting Parametric Value-at-Risk with Estimation Risk," Caepr Working Papers 2007-005_updated, Center for Applied Economics and Policy Research, Economics Department, Indiana University Bloomington. [Downloadable!]
  11. Timmermann, Allan G, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
  12. Joshua Angrist & Victor Chernozhukov & Ivan Fernandez-Val, 2004. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," NBER Working Papers 10428, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
Statistics
Access and download statistics

Did you know? There are NEP reports in over 80 fields that deliver new research to your email.

This page was last updated on 2009-11-17.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.