This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Predective Density and Conditional Confidence Interval Accuracy Tests

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Valentina Corradi () (Queen Mary, University of London)
Norman Swanson () (Rutgers University)

Additional information is available for the following registered author(s):

Abstract

This paper outlines testing procedures for assessing the relative out-of-sample predictive accuracy of multiple conditional distribution models. The tests that are discussed are based on either the comparison of entire conditional distributions or the comparison of predictive confidence intervals. We also briefly survey existing related methods in the area of predictive density evaluation, including methods based on the probability integral transform and the Kullback-Leibler Information Criterion. The procedures proposed in this paper are similar in many ways to Andrews' (1997) conditional Kolmogorov test and to White's (2000) reality check. In particular, a predictive density test is outlined that involves comparing square (approximation) errors associated with models I, i=1,...,n, by constructing weighted averages over U of E[( F_{i}(u|Z^{t},theta _{i}^\dagger )-F_{0}(u|Z^{t}, theta _{0})) ^{2}] , where F_{0}(. |. ) and F_{i}(.|.)$ are true and model-i distributions, u belongs to U, and U is a possibly unbounded set on the real line. A conditional confidence interval version of this test is also outlined, and appropriate bootstrap procedures for obtaining critical values when predictions used in the formation of the test statistics are obtained via rolling and recursive estimation schemes are developed. An empirical illustration comparing alternative predictive models for U.S. inflation is given for the predictive confidence interval test.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help file. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: ftp://snde.rutgers.edu/Rutgers/wp/2004-23.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by Rutgers University, Department of Economics in its series Departmental Working Papers with number 200423.

Download reference. The following formats are available: HTML, plain text, BibTeX, RIS (EndNote), ReDIF
Length: 20 pages
Date of creation: 17 Sep 2004
Date of revision:
Handle: RePEc:rut:rutres:200423

Contact details of provider:
Postal: New Jersey Hall - 75 Hamilton Street, New Brunswick, NJ 08901-1248
Phone: (732) 932-7482
Fax: (732) 932-7416
Web page: http://snde.rutgers.edu/Rutgers/wp/rutgers-wplist.html
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: ().

Related research
Keywords: block bootstrap recursive estimation scheme reality check nonlinear causality parameter estimation error

Other versions of this item:

Find related papers by JEL classification:
C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models
C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

This paper has been announced in the following NEP Reports:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Atsushi Inoue & Mototsugu Shintani, 2001. "Bootstrapping GMM Estimators for Time Series," Working Papers 0129, Department of Economics, Vanderbilt University, revised Aug 2003. [Downloadable!]
    Other versions:
  2. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November. [Downloadable!] (restricted)
    Other versions:
  3. Valentina Corradi & Norman Swanson, 2004. "Bootstrap Procedures for Recursive Estimation Schemes With Applications to Forecast Model Selection," Departmental Working Papers 200418, Rutgers University, Department of Economics. [Downloadable!]
  4. Yongsung Chang & Joao Gomes & Frank Schorfheide, 2002. "Learning by Doing as a Propagation Mechanism," Macroeconomics 0204002, EconWPA. [Downloadable!]
    Other versions:
  5. Christoffersen, Peter & Hahn, Jinyong & Inoue, Atsushi, 2001. "Testing and comparing Value-at-Risk measures," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 325-342, July. [Downloadable!] (restricted)
    Other versions:
  6. Todd E. Clark & Michael W. McCracken, 2002. "Forecast-based model selection in the presence of structural breaks," Research Working Paper RWP 02-05, Federal Reserve Bank of Kansas City. [Downloadable!]
  7. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  8. Donald W.K. Andrews, 2002. "The Block-block Bootstrap: Improved Asymptotic Refinements," Cowles Foundation Discussion Papers 1370, Cowles Foundation, Yale University. [Downloadable!]
    Other versions:
  9. McCracken, Michael W & Sapp, Stephen G, 2005. "Evaluating the Predictability of Exchange Rates Using Long-Horizon Regressions: Mind Your p's and q's!," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 473-94, June.
  10. Donald W. K. Andrews, 1997. "A Conditional Kolmogorov Test," Econometrica, Econometric Society, vol. 65(5), pages 1097-1128, September.
    Other versions:
  11. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July. [Downloadable!] (restricted)
  12. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November. [Downloadable!] (restricted)
  13. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-74, October.
  14. Raffaella Giacomini, 2002. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap Methods," Boston College Working Papers in Economics 583, Boston College Department of Economics. [Downloadable!]
    Other versions:
  15. Pesaran, M. Hashem & Timmermann, Allan, 2004. "How costly is it to ignore breaks when forecasting the direction of a time series?," International Journal of Forecasting, Elsevier, vol. 20(3), pages 411-425. [Downloadable!] (restricted)
    Other versions:
  16. Jushan Bai, 2003. "Testing Parametric Conditional Distributions of Dynamic Models," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 531-549, 06. [Downloadable!] (restricted)
  17. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September. [Downloadable!] (restricted)
    Other versions:
  18. Peter Reinhard Hansen, 2001. "An Unbiased and Powerful Test for Superior Predictive Ability," Working Papers 2001-06, Brown University, Department of Economics. [Downloadable!]
  19. repec:att:wimass:199710 is not listed on IDEAS
  20. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, 1997. "Evaluating Density Forecasts," NBER Technical Working Papers 0215, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  21. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  22. Valentina Corradi & Norman R. Swanson, 2003. "Bootstrap Conditional Distribution Tests In the Presence of Dynamic Misspecification," Departmental Working Papers 200311, Rutgers University, Department of Economics. [Downloadable!]
    Other versions:
  23. Donald W. K. Andrews, 2002. "Higher-Order Improvements of a Computationally Attractive "k"-Step Bootstrap for Extremum Estimators," Econometrica, Econometric Society, vol. 70(1), pages 119-162, January. [Downloadable!] (restricted)
    Other versions:
  24. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
    Other versions:
  25. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Whang, 2005. "Consistent Testing for Stochastic Dominance under General Sampling Schemes," Review of Economic Studies, Blackwell Publishing, vol. 72(3), pages 735-765, 07. [Downloadable!] (restricted)
  26. N. Meddahi & C. Bontemps, 2004. "Testing Distributional Assumptions: A GMM Approach," Econometric Society 2004 North American Winter Meetings 487, Econometric Society.
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Cees Diks & Valentyn Panchenko & Dick van Dijk, 2008. "Partial Likelihood-Based Scoring Rules for Evaluating Density Forecasts in Tails," Discussion Papers 2008-10, School of Economics, The University of New South Wales. [Downloadable!]
    Other versions:
  2. Norman Swanson & Oleg Korenok, 2006. "How Sticky Is Sticky Enough? A Distributional and Impulse Response Analysis of New Keynesian DSGE Models. Extended Working Paper Version," Departmental Working Papers 200612, Rutgers University, Department of Economics. [Downloadable!]
  3. Lucia Alessi & Matteo Barigozzi & Marco Capasso, 2006. "Generalized Dynamic Factor Model + GARCH
    Exploiting Multivariate Information for Univariate Prediction    ," LEM Papers Series 2006/13, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy. [Downloadable!]
  4. Gianni Amisano & Raffaella Giacomini, 2005. "Comparing Density Forecsts via Weighted Likelihood Ratio Tests," Working Papers ubs0504, University of Brescia, Department of Economics. [Downloadable!]
  5. Norman Swanson & Oleg Korenok, 2006. "The Incremental Predictive Information Associated with Using Theoretical New Keynesian DSGE Models Versus Simple Linear Alternatives," Departmental Working Papers 200615, Rutgers University, Department of Economics. [Downloadable!]
  6. Ali Dib & Mohamed Gammoudi & Kevin Moran, 2006. "Forecasting Canadian Time Series With the New-Keynesian Model," Working Papers Central Bank of Chile 382, Central Bank of Chile. [Downloadable!]
    Other versions:
Statistics
Access and download statistics

Did you know? All top Economics journals are listed on RePEc.

This page was last updated on 2008-8-20.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.