IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper

A Test for Comparing Multiple Misspecified Conditional Distributions

  • Valentina Corradi

    ()

    (Queen Mary, University of London)

  • Norman R. Swanson

    ()

    (Rutgers University)

This paper introduces a conditional Kolmogorov test, in the spirit of Andrews (1997), that allows for comparison of multiple misspecifed conditional distribution models, for the case of dependent observations. A conditional confidence interval version of the test is also discussed. Model accuracy is measured using a distributional analog of mean square error, in which the squared (approximation) error associated with a given model, say model i; is measured in terms of the average over U of E((Fi(u|Zt,Theta-t-plus)-Fo(u|Zt,Theta-o)))^2; where U is a possibly unbounded set on the real line, Zt is the conditioning information set, Fi is the distribution function of a particular candidate model, and F0 is the true (unkown) distribution function. When comparing more than two models, a “benchmark” model is specified, and the test is constructed along the lines of the “reality check” of White (2000). Valid asymptotic critical values are obtained via a version of the block bootstrap which properly captures the e®ect of parameter estimation error. The results of a small Monte Carlo experiment indicate that the conditional confidence interval version of the test has reasonable finite sample properties even for samples with as few as 60 observations.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.sas.rutgers.edu/virtual/snde/wp/2003-14.pdf
Download Restriction: no

Paper provided by Rutgers University, Department of Economics in its series Departmental Working Papers with number 200314.

as
in new window

Length:
Date of creation: 21 Oct 2003
Date of revision:
Handle: RePEc:rut:rutres:200314
Contact details of provider: Postal:
New Jersey Hall - 75 Hamilton Street, New Brunswick, NJ 08901-1248

Phone: (732) 932-7363
Fax: (732) 932-7416
Web page: http://economics.rutgers.edu/

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-33, March.
  2. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  3. Peter F. Christoffersen & Francis X. Diebold, 1998. "How Relevant is Volatility Forecasting for Financial Risk Management?," NBER Working Papers 6844, National Bureau of Economic Research, Inc.
  4. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, 1997. "Evaluating Density Forecasts," NBER Technical Working Papers 0215, National Bureau of Economic Research, Inc.
  5. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-58, May.
  6. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Whang, 2002. "Consistent Testing for Stochastic Dominance: A Subsampling Approach," FMG Discussion Papers dp407, Financial Markets Group.
  7. Goncalves, Silvia & White, Halbert, 2004. "Maximum likelihood and the bootstrap for nonlinear dynamic models," Journal of Econometrics, Elsevier, vol. 119(1), pages 199-219, March.
  8. Fernandez-Villaverde, Jesus & Francisco Rubio-Ramirez, Juan, 2004. "Comparing dynamic equilibrium models to data: a Bayesian approach," Journal of Econometrics, Elsevier, vol. 123(1), pages 153-187, November.
  9. Chang, Yongsung & Gomes, Joao F & Schorfheide, Frank, 2002. "Learning by Doing as a Propagation Mechanism," CEPR Discussion Papers 3599, C.E.P.R. Discussion Papers.
  10. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
  11. Sílvia Gonçalves & Halbert White, 2001. "The Bootstrap of the Mean for Dependent Heterogeneous Arrays," CIRANO Working Papers 2001s-19, CIRANO.
  12. Donald W. K. Andrews, 1997. "A Conditional Kolmogorov Test," Econometrica, Econometric Society, vol. 65(5), pages 1097-1128, September.
  13. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
  14. Li, Fuchun & Tkacz, Greg, 2006. "A consistent bootstrap test for conditional density functions with time-series data," Journal of Econometrics, Elsevier, vol. 133(2), pages 863-886, August.
  15. Clements, Michael P. & Taylor, Nick, 2001. "Bootstrapping prediction intervals for autoregressive models," International Journal of Forecasting, Elsevier, vol. 17(2), pages 247-267.
  16. Chatfield, Chris, 1993. "Calculating Interval Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 121-35, April.
  17. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
  18. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
  19. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  20. Raffaella Giacomini, 2002. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap Methods," Boston College Working Papers in Economics 583, Boston College Department of Economics.
  21. Whang, Yoon-Jae, 2001. "Consistent specification testing for conditional moment restrictions," Economics Letters, Elsevier, vol. 71(3), pages 299-306, June.
  22. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
  23. Granger, C. W. J. & White, Halbert & Kamstra, Mark, 1989. "Interval forecasting : An analysis based upon ARCH-quantile estimators," Journal of Econometrics, Elsevier, vol. 40(1), pages 87-96, January.
  24. Valentina Corradi & Norman R. Swanson, 2003. "Bootstrap Conditional Distribution Tests In the Presence of Dynamic Misspecification," Departmental Working Papers 200311, Rutgers University, Department of Economics.
  25. Fuchun Li & Greg Tkacz, 2001. "A Consistent Bootstrap Test for Conditional Density Functions with Time-Dependent Data," Staff Working Papers 01-21, Bank of Canada.
  26. Whang, Yoon-Jae, 2000. "Consistent bootstrap tests of parametric regression functions," Journal of Econometrics, Elsevier, vol. 98(1), pages 27-46, September.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:rut:rutres:200314. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ()

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.