IDEAS home Printed from https://ideas.repec.org/p/han/dpaper/dp-571.html
   My bibliography  Save this paper

Comparing Predictive Accuracy under Long Memory - With an Application to Volatility Forecasting

Author

Listed:
  • Kruse, Robinson
  • Leschinski, Christian
  • Will, Michael

Abstract

This paper extends the popular Diebold-Mariano test to situations when the forecast error loss differential exhibits long memory. It is shown that this situation can arise frequently, since long memory can be transmitted from forecasts and the forecast objective to forecast error loss differentials. The nature of this transmission mainly depends on the (un)biasedness of the forecasts and whether the involved series share common long memory. Further results show that the conventional Diebold-Mariano test is invalidated under these circumstances. Robust statistics based on a memory and autocorrelation consistent estimator and an extended fixed-bandwidth approach are considered. The subsequent Monte Carlo study provides a novel comparison of these robust statistics. As an empirical application, we conduct forecast comparison tests for the realized volatility of the Standard and Poors 500 index among recent extensions of the heterogeneous autoregressive model. While we find that forecasts improve significantly if jumps in the log-price process are considered separately from continuous components, improvements achieved by the inclusion of implied volatility turn out to be insignificant.

Suggested Citation

  • Kruse, Robinson & Leschinski, Christian & Will, Michael, 2016. "Comparing Predictive Accuracy under Long Memory - With an Application to Volatility Forecasting," Hannover Economic Papers (HEP) dp-571, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
  • Handle: RePEc:han:dpaper:dp-571
    as

    Download full text from publisher

    File URL: http://diskussionspapiere.wiwi.uni-hannover.de/pdf_bib/dp-571.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    2. Mariano, Roberto S. & Preve, Daniel, 2012. "Statistical tests for multiple forecast comparison," Journal of Econometrics, Elsevier, vol. 169(1), pages 123-130.
    3. Dittmann, Ingolf & Granger, Clive W. J., 2002. "Properties of nonlinear transformations of fractionally integrated processes," Journal of Econometrics, Elsevier, vol. 110(2), pages 113-133, October.
    4. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    5. Corsi, Fulvio & Pirino, Davide & Renò, Roberto, 2010. "Threshold bipower variation and the impact of jumps on volatility forecasting," Journal of Econometrics, Elsevier, vol. 159(2), pages 276-288, December.
    6. Ole E. Barndorff-Nielsen & Neil Shephard, 2006. "Econometrics of Testing for Jumps in Financial Economics Using Bipower Variation," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 4(1), pages 1-30.
    7. Tim Bollerslev & George Tauchen & Hao Zhou, 2009. "Expected Stock Returns and Variance Risk Premia," Review of Financial Studies, Society for Financial Studies, vol. 22(11), pages 4463-4492, November.
    8. Yixiao Sun & Peter C. B. Phillips & Sainan Jin, 2008. "Optimal Bandwidth Selection in Heteroskedasticity-Autocorrelation Robust Testing," Econometrica, Econometric Society, vol. 76(1), pages 175-194, January.
    9. Deo, Rohit & Hurvich, Clifford & Lu, Yi, 2006. "Forecasting realized volatility using a long-memory stochastic volatility model: estimation, prediction and seasonal adjustment," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 29-58.
    10. Frederiksen, Per & Nielsen, Frank S. & Nielsen, Morten Ørregaard, 2012. "Local polynomial Whittle estimation of perturbed fractional processes," Journal of Econometrics, Elsevier, vol. 167(2), pages 426-447.
    11. Nielsen, Morten Orregaard, 2007. "Local Whittle Analysis of Stationary Fractional Cointegration and the ImpliedRealized Volatility Relation," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 427-446, October.
    12. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    13. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2007. "Roughing It Up: Including Jump Components in the Measurement, Modeling, and Forecasting of Return Volatility," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 701-720, November.
    14. Leschinski, Christian, 2017. "On the memory of products of long range dependent time series," Economics Letters, Elsevier, vol. 153(C), pages 72-76.
    15. K Abadir & W Distaso & L Giraitis, "undated". "Two estimators of the long-run variance," Discussion Papers 05/19, Department of Economics, University of York.
    16. Fulvio Corsi & Roberto Renò, 2012. "Discrete-Time Volatility Forecasting With Persistent Leverage Effect and the Link With Continuous-Time Volatility Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 368-380, January.
    17. repec:hal:journl:peer-00741630 is not listed on IDEAS
    18. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    19. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    20. Barbara Rossi, 2005. "Testing Long-Horizon Predictive Ability With High Persistence, And The Meese-Rogoff Puzzle," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(1), pages 61-92, February.
    21. Stefanos Kechagias & Vladas Pipiras, 2015. "Definitions And Representations Of Multivariate Long-Range Dependent Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 36(1), pages 1-25, January.
    22. Bekaert, Geert & Hoerova, Marie, 2014. "The VIX, the variance premium and stock market volatility," Journal of Econometrics, Elsevier, vol. 183(2), pages 181-192.
    23. Roxana Chiriac & Valeri Voev, 2011. "Modelling and forecasting multivariate realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 922-947, September.
    24. Martens, Martin & van Dijk, Dick & de Pooter, Michiel, 2009. "Forecasting S&P 500 volatility: Long memory, level shifts, leverage effects, day-of-the-week seasonality, and macroeconomic announcements," International Journal of Forecasting, Elsevier, vol. 25(2), pages 282-303.
    25. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    26. McElroy, Tucker & Politis, Dimitris N., 2012. "Fixed-B Asymptotics For The Studentized Mean From Time Series With Short, Long, Or Negative Memory," Econometric Theory, Cambridge University Press, vol. 28(2), pages 471-481, April.
    27. Kruse, Robinson, 2015. "A modified test against spurious long memory," Economics Letters, Elsevier, vol. 135(C), pages 34-38.
    28. Qu, Zhongjun, 2011. "A Test Against Spurious Long Memory," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 423-438.
    29. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    30. Xilong Chen & Eric Ghysels, 2011. "News--Good or Bad--and Its Impact on Volatility Predictions over Multiple Horizons," Review of Financial Studies, Society for Financial Studies, vol. 24(1), pages 46-81, October.
    31. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    32. Busch, Thomas & Christensen, Bent Jesper & Nielsen, Morten Ørregaard, 2011. "The role of implied volatility in forecasting future realized volatility and jumps in foreign exchange, stock, and bond markets," Journal of Econometrics, Elsevier, vol. 160(1), pages 48-57, January.
    33. Becker, Ralf & Clements, Adam E. & McClelland, Andrew, 2009. "The jump component of S&P 500 volatility and the VIX index," Journal of Banking & Finance, Elsevier, vol. 33(6), pages 1033-1038, June.
    34. Abadir, Karim M. & Distaso, Walter & Giraitis, Liudas, 2009. "Two estimators of the long-run variance: Beyond short memory," Journal of Econometrics, Elsevier, vol. 150(1), pages 56-70, May.
    35. Becker, Ralf & Clements, Adam E. & White, Scott I., 2007. "Does implied volatility provide any information beyond that captured in model-based volatility forecasts?," Journal of Banking & Finance, Elsevier, vol. 31(8), pages 2535-2549, August.
    36. Chernov, Mikhail, 2007. "On the Role of Risk Premia in Volatility Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 411-426, October.
    37. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    38. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests," Econometric Theory, Cambridge University Press, vol. 21(6), pages 1130-1164, December.
    39. McElroy, Tucker & Politis, Dimitris N., 2013. "Distribution theory for the studentized mean for long, short, and negative memory time series," Journal of Econometrics, Elsevier, vol. 177(1), pages 60-74.
    40. Chambers, Marcus J, 1998. "Long Memory and Aggregation in Macroeconomic Time Series," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 1053-1072, November.
    41. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    42. Donald W. K. Andrews & Yixiao Sun, 2004. "Adaptive Local Polynomial Whittle Estimation of Long-range Dependence," Econometrica, Econometric Society, vol. 72(2), pages 569-614, March.
    43. Bollerslev, Tim & Osterrieder, Daniela & Sizova, Natalia & Tauchen, George, 2013. "Risk and return: Long-run relations, fractional cointegration, and return predictability," Journal of Financial Economics, Elsevier, vol. 108(2), pages 409-424.
    44. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    45. Phillips, Peter C.B. & Kim, Chang Sik, 2007. "Long-Run Covariance Matrices For Fractionally Integrated Processes," Econometric Theory, Cambridge University Press, vol. 23(6), pages 1233-1247, December.
    46. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    47. Robinson, P. M., 2005. "Robust covariance matrix estimation : 'HAC' estimates with long memory/antipersistence correction," LSE Research Online Documents on Economics 323, London School of Economics and Political Science, LSE Library.
    48. Christensen, Bent Jesper & Nielsen, Morten Orregaard, 2006. "Asymptotic normality of narrow-band least squares in the stationary fractional cointegration model and volatility forecasting," Journal of Econometrics, Elsevier, vol. 133(1), pages 343-371, July.
    49. Robinson, P.M., 2005. "Robust Covariance Matrix Estimation: Hac Estimates With Long Memory/Antipersistence Correction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 171-180, February.
    50. Hou, Jie & Perron, Pierre, 2014. "Modified local Whittle estimator for long memory processes in the presence of low frequency (and other) contaminations," Journal of Econometrics, Elsevier, vol. 182(2), pages 309-328.
    51. Hwan-sik Choi & Nicholas M. Kiefer, 2010. "Improving robust model selection tests for dynamic models," Econometrics Journal, Royal Economic Society, vol. 13(2), pages 177-204, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Becker, Janis & Leschinski, Christian, 2018. "The Bias of Realized Volatility," Hannover Economic Papers (HEP) dp-642, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    2. Daniel Borup & Bent Jesper Christensen & Yunus Emre Ergemen, 2019. "Assessing predictive accuracy in panel data models with long-range dependence," CREATES Research Papers 2019-04, Department of Economics and Business Economics, Aarhus University.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kai Wenger & Christian Leschinski & Philipp Sibbertsen, 2019. "Change-in-mean tests in long-memory time series: a review of recent developments," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 103(2), pages 237-256, June.
    2. Bekaert, Geert & Hoerova, Marie, 2014. "The VIX, the variance premium and stock market volatility," Journal of Econometrics, Elsevier, vol. 183(2), pages 181-192.
    3. Francesco Audrino & Yujia Hu, 2016. "Volatility Forecasting: Downside Risk, Jumps and Leverage Effect," Econometrics, MDPI, vol. 4(1), pages 1-24, February.
    4. Wang, Yudong & Ma, Feng & Wei, Yu & Wu, Chongfeng, 2016. "Forecasting realized volatility in a changing world: A dynamic model averaging approach," Journal of Banking & Finance, Elsevier, vol. 64(C), pages 136-149.
    5. Sévi, Benoît, 2014. "Forecasting the volatility of crude oil futures using intraday data," European Journal of Operational Research, Elsevier, vol. 235(3), pages 643-659.
    6. Daniel Borup & Bent Jesper Christensen & Yunus Emre Ergemen, 2019. "Assessing predictive accuracy in panel data models with long-range dependence," CREATES Research Papers 2019-04, Department of Economics and Business Economics, Aarhus University.
    7. Wei Zhang & Kai Yan & Dehua Shen, 2021. "Can the Baidu Index predict realized volatility in the Chinese stock market?," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-31, December.
    8. Daniel Borup & Martin Thyrsgaard, 2017. "Statistical tests for equal predictive ability across multiple forecasting methods," CREATES Research Papers 2017-19, Department of Economics and Business Economics, Aarhus University.
    9. Wilms, Ines & Rombouts, Jeroen & Croux, Christophe, 2021. "Multivariate volatility forecasts for stock market indices," International Journal of Forecasting, Elsevier, vol. 37(2), pages 484-499.
    10. Bu, Ruijun & Hizmeri, Rodrigo & Izzeldin, Marwan & Murphy, Anthony & Tsionas, Mike, 2023. "The contribution of jump signs and activity to forecasting stock price volatility," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 144-164.
    11. Byun, Suk Joon & Kim, Jun Sik, 2013. "The information content of risk-neutral skewness for volatility forecasting," Journal of Empirical Finance, Elsevier, vol. 23(C), pages 142-161.
    12. Dimos Kambouroudis & David McMillan & Katerina Tsakou, 2019. "Forecasting Realized Volatility: The role of implied volatility, leverage effect, overnight returns and volatility of realized volatility," Working Papers 2019-03, Swansea University, School of Management.
    13. Seo, Sung Won & Kim, Jun Sik, 2015. "The information content of option-implied information for volatility forecasting with investor sentiment," Journal of Banking & Finance, Elsevier, vol. 50(C), pages 106-120.
    14. Andrew J. Patton & Kevin Sheppard, 2015. "Good Volatility, Bad Volatility: Signed Jumps and The Persistence of Volatility," The Review of Economics and Statistics, MIT Press, vol. 97(3), pages 683-697, July.
    15. repec:ipg:wpaper:2014-053 is not listed on IDEAS
    16. Wenger, Kai & Leschinski, Christian & Sibbertsen, Philipp, 2017. "The Memory of Volatility," Hannover Economic Papers (HEP) dp-601, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    17. Andersen, Torben G. & Varneskov, Rasmus T., 2021. "Consistent inference for predictive regressions in persistent economic systems," Journal of Econometrics, Elsevier, vol. 224(1), pages 215-244.
    18. Santos, Douglas G. & Candido, Osvaldo & Tófoli, Paula V., 2022. "Forecasting risk measures using intraday and overnight information," The North American Journal of Economics and Finance, Elsevier, vol. 60(C).
    19. Hirukawa, Masayuki, 2023. "Robust Covariance Matrix Estimation in Time Series: A Review," Econometrics and Statistics, Elsevier, vol. 27(C), pages 36-61.
    20. Clements, Adam & Preve, Daniel P.A., 2021. "A Practical Guide to harnessing the HAR volatility model," Journal of Banking & Finance, Elsevier, vol. 133(C).
    21. Byounghyun Jeon & Sung Won Seo & Jun Sik Kim, 2020. "Uncertainty and the volatility forecasting power of option‐implied volatility," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 40(7), pages 1109-1126, July.

    More about this item

    Keywords

    Equal Predictive Ability; Long Memory; Diebold-Mariano Test; Long-run Variance Estimation; Realized Volatility;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:han:dpaper:dp-571. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Heidrich, Christian (email available below). General contact details of provider: https://edirc.repec.org/data/fwhande.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.