IDEAS home Printed from https://ideas.repec.org/a/jec/journl/v5y2009i2p219-240.html
   My bibliography  Save this article

Assessing the Accuracy of Event Forecasts

Author

Listed:
  • Ching-Chuan Tsong

    () (Department of Economics, National Chi Nan University, Taiwan)

Abstract

Event forecasts, often generated from estimated econometric models, comprise a binary time series. In empirical finance, the market timing test proposed by Henricksson and Merton (1981) is probably the most popular method to assess the accuracy of these forecasts. Unfortunately, event forecasts and/or realizations are serially correlated, violating the independent identical distributed (IID) assumption. Consequently, the market timing test has an inflated size that can lead to doubtful empirical results. We find that the heteroskedasticity- autocorrelation (HAC) robust t-test with fixed-b asymptotics in Kiefer and Vogelsang (2005) and with the empirical distribution obtained using the naive block bootstrap can overcome this problem. As compared to several extant testing methods, simulation results reveal that the empirical size of these two testing procedures is quite close to the nominal size in finite samples. An empirical study is performed to demonstrate the usefulness of the naive block bootstrap.

Suggested Citation

  • Ching-Chuan Tsong, 2009. "Assessing the Accuracy of Event Forecasts," Journal of Economics and Management, College of Business, Feng Chia University, Taiwan, vol. 5(2), pages 219-240, July.
  • Handle: RePEc:jec:journl:v:5:y:2009:i:2:p:219-240
    as

    Download full text from publisher

    File URL: http://www.jem.org.tw/content/pdf/Vol.5No.2/04.pdf
    Download Restriction: no

    File URL: http://www.jem.org.tw/content/abstract/Vol.5No.2/English/04.htm
    Download Restriction: no

    References listed on IDEAS

    as
    1. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
    2. Engel, Charles, 1994. "Can the Markov switching model forecast exchange rates?," Journal of International Economics, Elsevier, vol. 36(1-2), pages 151-165, February.
    3. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests," Econometric Theory, Cambridge University Press, vol. 21(06), pages 1130-1164, December.
    4. Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-533, October.
    5. Joon Y. Park, 2003. "Bootstrap Unit Root Tests," Econometrica, Econometric Society, vol. 71(6), pages 1845-1895, November.
    6. Dimitris Politis & Halbert White, 2004. "Automatic Block-Length Selection for the Dependent Bootstrap," Econometric Reviews, Taylor & Francis Journals, vol. 23(1), pages 53-70.
    7. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    8. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2002. "Heteroskedasticity-Autocorrelation Robust Testing Using Bandwidth Equal To Sample Size," Econometric Theory, Cambridge University Press, vol. 18(06), pages 1350-1366, December.
    9. Lahiri, Soumendra Nath, 1996. "On Edgeworth Expansion and Moving Block Bootstrap for StudentizedM-Estimators in Multiple Linear Regression Models," Journal of Multivariate Analysis, Elsevier, vol. 56(1), pages 42-59, January.
    10. Breen, William & Glosten, Lawrence R & Jagannathan, Ravi, 1989. " Economic Significance of Predictable Variations in Stock Index Returns," Journal of Finance, American Finance Association, vol. 44(5), pages 1177-1189, December.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    naive block bootstrap; HAC robust test; market timing test;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jec:journl:v:5:y:2009:i:2:p:219-240. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Yi-Ju Su). General contact details of provider: http://edirc.repec.org/data/cbfcutw.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.