IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v18y2003i4p445-456.html
   My bibliography  Save this article

Evaluating interval forecasts of high-frequency financial data

Author

Listed:
  • Michael P. Clements

    (Department of Economics, University of Warwick, Coventry CV4 7AL, UK)

  • Nick Taylor

    (Department of Accounting and Finance, Cardiff University, UK)

Abstract

A number of methods of evaluating the validity of interval forecasts of financial data are analysed, and illustrated using intraday FTSE100 index futures returns. Some existing interval forecast evaluation techniques, such as the Markov chain approach of Christoffersen (1998), are shown to be inappropriate in the presence of periodic heteroscedasticity. Instead, we consider a regression-based test, and a modified version of Christoffersen's Markov chain test for independence, and analyse their properties when the financial time series exhibit periodic volatility. These approaches lead to different conclusions when interval forecasts of FTSE100 index futures returns generated by various GARCH(1,1) and periodic GARCH(1,1) models are evaluated. Copyright © 2003 John Wiley & Sons, Ltd.

Suggested Citation

  • Michael P. Clements & Nick Taylor, 2003. "Evaluating interval forecasts of high-frequency financial data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 445-456.
  • Handle: RePEc:jae:japmet:v:18:y:2003:i:4:p:445-456
    DOI: 10.1002/jae.703
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.703
    File Function: Link to full text; subscription required
    Download Restriction: no

    File URL: http://qed.econ.queensu.ca:80/jae/2003-v18.4/
    File Function: Supporting data files and programs
    Download Restriction: no

    References listed on IDEAS

    as
    1. Wood, Robert A & McInish, Thomas H & Ord, J Keith, 1985. " An Investigation of Transactions Data for NYSE Stocks," Journal of Finance, American Finance Association, vol. 40(3), pages 723-739, July.
    2. Tim Bollerslev & Jeffrey M. Wooldridge, 1988. "Quasi-Maximum Likelihood Estimation of Dynamic Models with Time-Varying Covariances," Working papers 505, Massachusetts Institute of Technology (MIT), Department of Economics.
    3. Granger, C. W. J. & White, Halbert & Kamstra, Mark, 1989. "Interval forecasting : An analysis based upon ARCH-quantile estimators," Journal of Econometrics, Elsevier, vol. 40(1), pages 87-96, January.
    4. Bollerslev, Tim & Ghysels, Eric, 1996. "Periodic Autoregressive Conditional Heteroscedasticity," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(2), pages 139-151, April.
    5. Jose A. Lopez, 1996. "Regulatory Evaluation of Value-at-Risk Models," Center for Financial Institutions Working Papers 96-51, Wharton School Center for Financial Institutions, University of Pennsylvania.
    6. Bollerslev, Tim & Engle, Robert F. & Nelson, Daniel B., 1986. "Arch models," Handbook of Econometrics,in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 49, pages 2959-3038 Elsevier.
    7. McQueen, Grant & Thorley, Steven, 1993. "Asymmetric business cycle turning points," Journal of Monetary Economics, Elsevier, vol. 31(3), pages 341-362, June.
    8. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    9. Chatfield, Chris, 1993. "Calculating Interval Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 121-135, April.
    10. Baillie, Richard T & Bollerslev, Tim, 2002. "The Message in Daily Exchange Rates: A Conditional-Variance Tale," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 60-68, January.
    11. Baillie, Richard T. & Bollerslev, Tim, 1992. "Prediction in dynamic models with time-dependent conditional variances," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 91-113.
    12. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    13. Werner, Ingrid M & Kleidon, Allan W, 1996. "U.K. and U.S. Trading of British Cross-Listed Stocks: An Intraday Analysis of Market Integration," Review of Financial Studies, Society for Financial Studies, vol. 9(2), pages 619-664.
    14. Harvey, Campbell R & Huang, Roger D, 1991. "Volatility in the Foreign Currency Futures Market," Review of Financial Studies, Society for Financial Studies, vol. 4(3), pages 543-569.
    15. Peter F. Christoffersen & Francis X. Diebold, 2000. "How Relevant is Volatility Forecasting for Financial Risk Management?," The Review of Economics and Statistics, MIT Press, vol. 82(1), pages 12-22, February.
    16. Gallant, A Ronald & Rossi, Peter E & Tauchen, George, 1992. "Stock Prices and Volume," Review of Financial Studies, Society for Financial Studies, vol. 5(2), pages 199-242.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:eee:rensus:v:81:y:2018:i:p1:p:1548-1568 is not listed on IDEAS
    2. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    3. Taylor, Nicholas, 2007. "A note on the importance of overnight information in risk management models," Journal of Banking & Finance, Elsevier, vol. 31(1), pages 161-180, January.
    4. Storti, G., 2006. "Minimum distance estimation of GARCH(1,1) models," Computational Statistics & Data Analysis, Elsevier, vol. 51(3), pages 1803-1821, December.
    5. Dominique, C-Rene, 2013. "Estimating investors' behavior and errors in probabilistic forecasts by the Kolmogorov entropy and noise colors of non-hyperbolic attractors," MPRA Paper 46451, University Library of Munich, Germany.
    6. Elena-Ivona DUMITRESCU & Christophe HURLIN & Jaouad MADKOUR, 2011. "Testing Interval Forecasts: A New GMM-based Test," LEO Working Papers / DR LEO 1549, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    7. Tsyplakov, Alexander, 2011. "Evaluating density forecasts: a comment," MPRA Paper 31184, University Library of Munich, Germany.
    8. Tao Hong & Katarzyna Maciejowska & Jakub Nowotarski & Rafal Weron, 2014. "Probabilistic load forecasting via Quantile Regression Averaging of independent expert forecasts," HSC Research Reports HSC/14/10, Hugo Steinhaus Center, Wroclaw University of Technology.
    9. Li, Yushu & Andersson, Jonas, 2014. "A Likelihood Ratio and Markov Chain Based Method to Evaluate Density Forecasting," Discussion Papers 2014/12, Norwegian School of Economics, Department of Business and Management Science.
    10. Jakub Nowotarski & Rafał Weron, 2015. "Computing electricity spot price prediction intervals using quantile regression and forecast averaging," Computational Statistics, Springer, vol. 30(3), pages 791-803, September.
    11. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    12. Tsyplakov, Alexander, 2014. "Theoretical guidelines for a partially informed forecast examiner," MPRA Paper 55017, University Library of Munich, Germany.
    13. Tsyplakov, Alexander, 2013. "Evaluation of Probabilistic Forecasts: Proper Scoring Rules and Moments," MPRA Paper 45186, University Library of Munich, Germany.
    14. Carol Alexander & Emese Lazar & Silvia Stanescu, 2011. "Analytic Approximations to GARCH Aggregated Returns Distributions with Applications to VaR and ETL," ICMA Centre Discussion Papers in Finance icma-dp2011-08, Henley Business School, Reading University.
    15. Maciejowska, Katarzyna & Nowotarski, Jakub & Weron, Rafał, 2016. "Probabilistic forecasting of electricity spot prices using Factor Quantile Regression Averaging," International Journal of Forecasting, Elsevier, vol. 32(3), pages 957-965.
    16. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.
    17. Helmut Herwartz & Israel Waichman, 2010. "A comparison of bootstrap and Monte-Carlo testing approaches to value-at-risk diagnosis," Computational Statistics, Springer, vol. 25(4), pages 725-732, December.
    18. Mauricio Lopera & Ramón Javier Mesa & Charle Londoño, 2014. "Evaluando las intervenciones cambiarias en Colombia: 2004-2012," ESTUDIOS GERENCIALES, UNIVERSIDAD ICESI, March.
    19. Juan Reboredo & José Matías & Raquel Garcia-Rubio, 2012. "Nonlinearity in Forecasting of High-Frequency Stock Returns," Computational Economics, Springer;Society for Computational Economics, vol. 40(3), pages 245-264, October.
    20. Tsyplakov, Alexander, 2012. "Assessment of probabilistic forecasts: Proper scoring rules and moments," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 27(3), pages 115-132.
    21. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    22. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    23. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    24. Elena‐Ivona Dumitrescu & Christophe Hurlin & Jaouad Madkour, 2013. "Testing Interval Forecasts: A GMM‐Based Approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 32(2), pages 97-110, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:18:y:2003:i:4:p:445-456. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.