Comparing Probability Forecasts in Markov Regime Switching Business Cycle Models
We evaluate techniques for comparing the ability of Markov regime switching (MRS) models to fit underlying regimes of a series of interest. This is particularly important in the business cycle literature where one may be interested in determining whether using leading indicators to allow transition probabilities to vary improves the ability of MRS models to fit the NBER business cycle chronology. This is typically done using the quadratic probability score, or QPS (Diebold and Rudebusch, 1989). Although it is possible to statistically compare the QPS statistics for two MRS models using the Diebold and Mariano (1995) (DM) test statistic for comparing forecasts, we find using a Monte Carlo experiment that the DM statistic tends to under-reject (the null of "no difference in forecast accuracy") when comparing MRS models. This we believe is because of the strong non-normality of the forecast errors of such models. Furthermore, using simulation-based inference we demonstrate that leading indicators improve the fit of an MRS model of the US business cycle chronology by 24 percent, such improvement having a p-value of 0.001.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Volume (Year): 2007 (2007)
Issue (Month): 1 ()
|Contact details of provider:|| Postal: 2 rue Andre Pascal, 75775 Paris Cedex 16|
Phone: 33-(0)-1-45 24 82 00
Fax: 33-(0)-1-45 24 85 00
Web page: http://www.oecd.org
More information through EDIRC