Assessing the Accuracy of Event Forecasts
AbstractEvent forecasts, often generated from estimated econometric models, comprise a binary time series. In empirical finance, the market timing test proposed by Henricksson and Merton (1981) is probably the most popular method to assess the accuracy of these forecasts. Unfortunately, event forecasts and/or realizations are serially correlated, violating the independent identical distributed (IID) assumption. Consequently, the market timing test has an inflated size that can lead to doubtful empirical results. We find that the heteroskedasticity- autocorrelation (HAC) robust t-test with fixed-b asymptotics in Kiefer and Vogelsang (2005) and with the empirical distribution obtained using the naive block bootstrap can overcome this problem. As compared to several extant testing methods, simulation results reveal that the empirical size of these two testing procedures is quite close to the nominal size in finite samples. An empirical study is performed to demonstrate the usefulness of the naive block bootstrap.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by College of Business, Feng Chia University, Taiwan in its journal Journal of Economics and Management.
Volume (Year): 5 (2009)
Issue (Month): 2 (July)
naive block bootstrap; HAC robust test; market timing test;
Find related papers by JEL classification:
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Andrews, Donald W K, 1991.
"Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation,"
Econometric Society, vol. 59(3), pages 817-58, May.
- Donald W.K. Andrews, 1988. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Cowles Foundation Discussion Papers 877R, Cowles Foundation for Research in Economics, Yale University, revised Jul 1989.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2002. "Heteroskedasticity-Autocorrelation Robust Testing Using Bandwidth Equal To Sample Size," Econometric Theory, Cambridge University Press, vol. 18(06), pages 1350-1366, December.
- Engel, Charles, 1994.
"Can the Markov switching model forecast exchange rates?,"
Journal of International Economics,
Elsevier, vol. 36(1-2), pages 151-165, February.
- Charles Engel, 1994. "Can the Markov Switching Model Forecast Exchange Rates?," NBER Working Papers 4210, National Bureau of Economic Research, Inc.
- Charles Engel, 1991. "Can the Markov switching model forecast exchange rates?," Research Working Paper 91-04, Federal Reserve Bank of Kansas City.
- Whitney K. Newey & Kenneth D. West, 1986.
"A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix,"
NBER Technical Working Papers
0055, National Bureau of Economic Research, Inc.
- Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May.
- Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-33, October.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005.
"A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests,"
Cambridge University Press, vol. 21(06), pages 1130-1164, December.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory for Heteroskedasticity-Autocorrelation Robust Tests," Working Papers 05-08, Cornell University, Center for Analytic Economics.
- Lahiri, Soumendra Nath, 1996. "On Edgeworth Expansion and Moving Block Bootstrap for StudentizedM-Estimators in Multiple Linear Regression Models," Journal of Multivariate Analysis, Elsevier, vol. 56(1), pages 42-59, January.
- Park, Joon, 2002.
"Bootstrap Unit Root Tests,"
2003-04, Rice University, Department of Economics.
- Joon Y. Park, 2000. "Bootstrap Unit Root Tests," Econometric Society World Congress 2000 Contributed Papers 1587, Econometric Society.
- Breen, William & Glosten, Lawrence R & Jagannathan, Ravi, 1989. " Economic Significance of Predictable Variations in Stock Index Returns," Journal of Finance, American Finance Association, vol. 44(5), pages 1177-89, December.
- Dimitris Politis & Halbert White, 2004. "Automatic Block-Length Selection for the Dependent Bootstrap," Econometric Reviews, Taylor and Francis Journals, vol. 23(1), pages 53-70.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jui-Fen Lin).
If references are entirely missing, you can add them using this form.