Assessing the Accuracy of Event Forecasts
AbstractEvent forecasts, often generated from estimated econometric models, comprise a binary time series. In empirical finance, the market timing test proposed by Henricksson and Merton (1981) is probably the most popular method to assess the accuracy of these forecasts. Unfortunately, event forecasts and/or realizations are serially correlated, violating the independent identical distributed (IID) assumption. Consequently, the market timing test has an inflated size that can lead to doubtful empirical results. We find that the heteroskedasticity- autocorrelation (HAC) robust t-test with fixed-b asymptotics in Kiefer and Vogelsang (2005) and with the empirical distribution obtained using the naive block bootstrap can overcome this problem. As compared to several extant testing methods, simulation results reveal that the empirical size of these two testing procedures is quite close to the nominal size in finite samples. An empirical study is performed to demonstrate the usefulness of the naive block bootstrap.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by College of Business, Feng Chia University, Taiwan in its journal Journal of Economics and Management.
Volume (Year): 5 (2009)
Issue (Month): 2 (July)
naive block bootstrap; HAC robust test; market timing test;
Find related papers by JEL classification:
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2002. "Heteroskedasticity-Autocorrelation Robust Testing Using Bandwidth Equal To Sample Size," Econometric Theory, Cambridge University Press, vol. 18(06), pages 1350-1366, December.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005.
"A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests,"
Cambridge University Press, vol. 21(06), pages 1130-1164, December.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory for Heteroskedasticity-Autocorrelation Robust Tests," Working Papers 05-08, Cornell University, Center for Analytic Economics.
- Whitney K. Newey & Kenneth D. West, 1986.
"A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix,"
NBER Technical Working Papers
0055, National Bureau of Economic Research, Inc.
- Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May.
- Joon Y. Park, 2003.
"Bootstrap Unit Root Tests,"
Econometric Society, vol. 71(6), pages 1845-1895, November.
- Joon Y. Park, 2000. "Bootstrap Unit Root Tests," Econometric Society World Congress 2000 Contributed Papers 1587, Econometric Society.
- Park, Joon, 2002. "Bootstrap Unit Root Tests," Working Papers 2003-04, Rice University, Department of Economics.
- Andrews, Donald W K, 1991.
"Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation,"
Econometric Society, vol. 59(3), pages 817-58, May.
- Donald W.K. Andrews, 1988. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Cowles Foundation Discussion Papers 877R, Cowles Foundation for Research in Economics, Yale University, revised Jul 1989.
- Dimitris Politis & Halbert White, 2004. "Automatic Block-Length Selection for the Dependent Bootstrap," Econometric Reviews, Taylor & Francis Journals, vol. 23(1), pages 53-70.
- Breen, William & Glosten, Lawrence R & Jagannathan, Ravi, 1989. " Economic Significance of Predictable Variations in Stock Index Returns," Journal of Finance, American Finance Association, vol. 44(5), pages 1177-89, December.
- Lahiri, Soumendra Nath, 1996. "On Edgeworth Expansion and Moving Block Bootstrap for StudentizedM-Estimators in Multiple Linear Regression Models," Journal of Multivariate Analysis, Elsevier, vol. 56(1), pages 42-59, January.
- Charles Engel, 1991.
"Can the Markov switching model forecast exchange rates?,"
Research Working Paper
91-04, Federal Reserve Bank of Kansas City.
- Engel, Charles, 1994. "Can the Markov switching model forecast exchange rates?," Journal of International Economics, Elsevier, vol. 36(1-2), pages 151-165, February.
- Charles Engel, 1994. "Can the Markov Switching Model Forecast Exchange Rates?," NBER Working Papers 4210, National Bureau of Economic Research, Inc.
- Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-33, October.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jui-Fen Lin).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.