IDEAS home Printed from https://ideas.repec.org/p/aah/create/2016-17.html
   My bibliography  Save this paper

Comparing Predictive Accuracy under Long Memory - With an Application to Volatility Forecasting

Author

Listed:
  • Robinson Kruse

    (Rijksuniversiteit Groningen and CREATES)

  • Christian Leschinski

    (Leibniz University Hannover)

  • Michael Will

    (Leibniz University Hannover)

Abstract

This paper extends the popular Diebold-Mariano test to situations when the forecast error loss differential exhibits long memory. It is shown that this situation can arise frequently, since long memory can be transmitted from forecasts and the forecast objective to forecast error loss differentials. The nature of this transmission mainly depends on the (un)biasedness of the forecasts and whether the involved series share common long memory. Further results show that the conventional Diebold-Mariano test is invalidated under these circumstances. Robust statistics based on a memory and autocorrelation consistent estimator and an extended fixed-bandwidth approach are considered. The subsequent Monte Carlo study provides a novel comparison of these robust statistics. As empirical applications, we conduct forecast comparison tests for the realized volatility of the Standard and Poors 500 index among recent extensions of the heterogeneous autoregressive model. While we find that forecasts improve significantly if jumps in the log-price process are considered separately from continuous components, improvements achieved by the inclusion of implied volatility turn out to be insignificant in most situations.

Suggested Citation

  • Robinson Kruse & Christian Leschinski & Michael Will, 2016. "Comparing Predictive Accuracy under Long Memory - With an Application to Volatility Forecasting," CREATES Research Papers 2016-17, Department of Economics and Business Economics, Aarhus University.
  • Handle: RePEc:aah:create:2016-17
    as

    Download full text from publisher

    File URL: https://repec.econ.au.dk/repec/creates/rp/16/rp16_17.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. McElroy, Tucker & Politis, Dimitris N., 2012. "Fixed-B Asymptotics For The Studentized Mean From Time Series With Short, Long, Or Negative Memory," Econometric Theory, Cambridge University Press, vol. 28(2), pages 471-481, April.
    2. Donald W. K. Andrews & Yixiao Sun, 2004. "Adaptive Local Polynomial Whittle Estimation of Long-range Dependence," Econometrica, Econometric Society, vol. 72(2), pages 569-614, March.
    3. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests," Econometric Theory, Cambridge University Press, vol. 21(6), pages 1130-1164, December.
    4. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    5. Corsi, Fulvio & Pirino, Davide & Renò, Roberto, 2010. "Threshold bipower variation and the impact of jumps on volatility forecasting," Journal of Econometrics, Elsevier, vol. 159(2), pages 276-288, December.
    6. Abadir, Karim M. & Distaso, Walter & Giraitis, Liudas, 2009. "Two estimators of the long-run variance: Beyond short memory," Journal of Econometrics, Elsevier, vol. 150(1), pages 56-70, May.
    7. Zhongjun Qu, 2011. "A Test Against Spurious Long Memory," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 423-438, July.
    8. Andersen T. G & Bollerslev T. & Diebold F. X & Labys P., 2001. "The Distribution of Realized Exchange Rate Volatility," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 42-55, March.
    9. Yixiao Sun & Peter C. B. Phillips & Sainan Jin, 2008. "Optimal Bandwidth Selection in Heteroskedasticity-Autocorrelation Robust Testing," Econometrica, Econometric Society, vol. 76(1), pages 175-194, January.
    10. Tim Bollerslev & George Tauchen & Hao Zhou, 2009. "Expected Stock Returns and Variance Risk Premia," Review of Financial Studies, Society for Financial Studies, vol. 22(11), pages 4463-4492, November.
    11. Ole E. Barndorff-Nielsen & Neil Shephard, 2006. "Econometrics of Testing for Jumps in Financial Economics Using Bipower Variation," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 1-30.
    12. Becker, Ralf & Clements, Adam E. & White, Scott I., 2007. "Does implied volatility provide any information beyond that captured in model-based volatility forecasts?," Journal of Banking & Finance, Elsevier, vol. 31(8), pages 2535-2549, August.
    13. McElroy, Tucker & Politis, Dimitris N., 2013. "Distribution theory for the studentized mean for long, short, and negative memory time series," Journal of Econometrics, Elsevier, vol. 177(1), pages 60-74.
    14. Barbara Rossi, 2005. "Testing Long-Horizon Predictive Ability With High Persistence, And The Meese-Rogoff Puzzle," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(1), pages 61-92, February.
    15. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    16. Kruse, Robinson, 2015. "A modified test against spurious long memory," Economics Letters, Elsevier, vol. 135(C), pages 34-38.
    17. Mariano, Roberto S. & Preve, Daniel, 2012. "Statistical tests for multiple forecast comparison," Journal of Econometrics, Elsevier, vol. 169(1), pages 123-130.
    18. Roxana Chiriac & Valeri Voev, 2011. "Modelling and forecasting multivariate realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 922-947, September.
    19. Bekaert, Geert & Hoerova, Marie, 2014. "The VIX, the variance premium and stock market volatility," Journal of Econometrics, Elsevier, vol. 183(2), pages 181-192.
    20. Chambers, Marcus J, 1998. "Long Memory and Aggregation in Macroeconomic Time Series," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 1053-1072, November.
    21. Becker, Ralf & Clements, Adam E. & McClelland, Andrew, 2009. "The jump component of S&P 500 volatility and the VIX index," Journal of Banking & Finance, Elsevier, vol. 33(6), pages 1033-1038, June.
    22. Dittmann, Ingolf & Granger, Clive W. J., 2002. "Properties of nonlinear transformations of fractionally integrated processes," Journal of Econometrics, Elsevier, vol. 110(2), pages 113-133, October.
    23. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    24. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    25. Chernov, Mikhail, 2007. "On the Role of Risk Premia in Volatility Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 411-426, October.
    26. Busch, Thomas & Christensen, Bent Jesper & Nielsen, Morten Ørregaard, 2011. "The role of implied volatility in forecasting future realized volatility and jumps in foreign exchange, stock, and bond markets," Journal of Econometrics, Elsevier, vol. 160(1), pages 48-57, January.
    27. Christensen, Bent Jesper & Nielsen, Morten Orregaard, 2006. "Asymptotic normality of narrow-band least squares in the stationary fractional cointegration model and volatility forecasting," Journal of Econometrics, Elsevier, vol. 133(1), pages 343-371, July.
    28. Phillips, Peter C.B. & Kim, Chang Sik, 2007. "Long-Run Covariance Matrices For Fractionally Integrated Processes," Econometric Theory, Cambridge University Press, vol. 23(6), pages 1233-1247, December.
    29. Robinson, P.M., 2005. "Robust Covariance Matrix Estimation: Hac Estimates With Long Memory/Antipersistence Correction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 171-180, February.
    30. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    31. repec:hal:journl:peer-00741630 is not listed on IDEAS
    32. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    33. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    34. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    35. Hou, Jie & Perron, Pierre, 2014. "Modified local Whittle estimator for long memory processes in the presence of low frequency (and other) contaminations," Journal of Econometrics, Elsevier, vol. 182(2), pages 309-328.
    36. Leschinski, Christian, 2017. "On the memory of products of long range dependent time series," Economics Letters, Elsevier, vol. 153(C), pages 72-76.
    37. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    38. Robinson, P. M., 2005. "Robust covariance matrix estimation : 'HAC' estimates with long memory/antipersistence correction," LSE Research Online Documents on Economics 323, London School of Economics and Political Science, LSE Library.
    39. Frederiksen, Per & Nielsen, Frank S. & Nielsen, Morten Ørregaard, 2012. "Local polynomial Whittle estimation of perturbed fractional processes," Journal of Econometrics, Elsevier, vol. 167(2), pages 426-447.
    40. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    41. Xilong Chen & Eric Ghysels, 2011. "News--Good or Bad--and Its Impact on Volatility Predictions over Multiple Horizons," The Review of Financial Studies, Society for Financial Studies, vol. 24(1), pages 46-81, October.
    42. Deo, Rohit & Hurvich, Clifford & Lu, Yi, 2006. "Forecasting realized volatility using a long-memory stochastic volatility model: estimation, prediction and seasonal adjustment," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 29-58.
    43. Stefanos Kechagias & Vladas Pipiras, 2015. "Definitions And Representations Of Multivariate Long-Range Dependent Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 36(1), pages 1-25, January.
    44. Nielsen, Morten Orregaard, 2007. "Local Whittle Analysis of Stationary Fractional Cointegration and the ImpliedRealized Volatility Relation," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 427-446, October.
    45. Bollerslev, Tim & Osterrieder, Daniela & Sizova, Natalia & Tauchen, George, 2013. "Risk and return: Long-run relations, fractional cointegration, and return predictability," Journal of Financial Economics, Elsevier, vol. 108(2), pages 409-424.
    46. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    47. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2007. "Roughing It Up: Including Jump Components in the Measurement, Modeling, and Forecasting of Return Volatility," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 701-720, November.
    48. Martens, Martin & van Dijk, Dick & de Pooter, Michiel, 2009. "Forecasting S&P 500 volatility: Long memory, level shifts, leverage effects, day-of-the-week seasonality, and macroeconomic announcements," International Journal of Forecasting, Elsevier, vol. 25(2), pages 282-303.
    49. K Abadir & W Distaso & L Giraitis, "undated". "Two estimators of the long-run variance," Discussion Papers 05/19, Department of Economics, University of York.
    50. Fulvio Corsi & Roberto Renò, 2012. "Discrete-Time Volatility Forecasting With Persistent Leverage Effect and the Link With Continuous-Time Volatility Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 368-380, January.
    51. Hwan-sik Choi & Nicholas M. Kiefer, 2010. "Improving robust model selection tests for dynamic models," Econometrics Journal, Royal Economic Society, vol. 13(2), pages 177-204, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Becker, Janis & Leschinski, Christian, 2018. "The Bias of Realized Volatility," Hannover Economic Papers (HEP) dp-642, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    2. Daniel Borup & Bent Jesper Christensen & Yunus Emre Ergemen, 2019. "Assessing predictive accuracy in panel data models with long-range dependence," CREATES Research Papers 2019-04, Department of Economics and Business Economics, Aarhus University.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kai Wenger & Christian Leschinski & Philipp Sibbertsen, 2019. "Change-in-mean tests in long-memory time series: a review of recent developments," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 103(2), pages 237-256, June.
    2. Sévi, Benoît, 2014. "Forecasting the volatility of crude oil futures using intraday data," European Journal of Operational Research, Elsevier, vol. 235(3), pages 643-659.
    3. Francesco Audrino & Yujia Hu, 2016. "Volatility Forecasting: Downside Risk, Jumps and Leverage Effect," Econometrics, MDPI, vol. 4(1), pages 1-24, February.
    4. Bekaert, Geert & Hoerova, Marie, 2014. "The VIX, the variance premium and stock market volatility," Journal of Econometrics, Elsevier, vol. 183(2), pages 181-192.
    5. Wei Zhang & Kai Yan & Dehua Shen, 2021. "Can the Baidu Index predict realized volatility in the Chinese stock market?," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-31, December.
    6. Daniel Borup & Martin Thyrsgaard, 2017. "Statistical tests for equal predictive ability across multiple forecasting methods," CREATES Research Papers 2017-19, Department of Economics and Business Economics, Aarhus University.
    7. Daniel Borup & Bent Jesper Christensen & Yunus Emre Ergemen, 2019. "Assessing predictive accuracy in panel data models with long-range dependence," CREATES Research Papers 2019-04, Department of Economics and Business Economics, Aarhus University.
    8. Wang, Yudong & Ma, Feng & Wei, Yu & Wu, Chongfeng, 2016. "Forecasting realized volatility in a changing world: A dynamic model averaging approach," Journal of Banking & Finance, Elsevier, vol. 64(C), pages 136-149.
    9. Seo, Sung Won & Kim, Jun Sik, 2015. "The information content of option-implied information for volatility forecasting with investor sentiment," Journal of Banking & Finance, Elsevier, vol. 50(C), pages 106-120.
    10. Wilms, Ines & Rombouts, Jeroen & Croux, Christophe, 2021. "Multivariate volatility forecasts for stock market indices," International Journal of Forecasting, Elsevier, vol. 37(2), pages 484-499.
    11. Bu, Ruijun & Hizmeri, Rodrigo & Izzeldin, Marwan & Murphy, Anthony & Tsionas, Mike, 2023. "The contribution of jump signs and activity to forecasting stock price volatility," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 144-164.
    12. Byun, Suk Joon & Kim, Jun Sik, 2013. "The information content of risk-neutral skewness for volatility forecasting," Journal of Empirical Finance, Elsevier, vol. 23(C), pages 142-161.
    13. Wenger, Kai & Leschinski, Christian & Sibbertsen, Philipp, 2017. "The Memory of Volatility," Hannover Economic Papers (HEP) dp-601, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    14. Dimos Kambouroudis & David McMillan & Katerina Tsakou, 2019. "Forecasting Realized Volatility: The role of implied volatility, leverage effect, overnight returns and volatility of realized volatility," Working Papers 2019-03, Swansea University, School of Management.
    15. repec:ipg:wpaper:2014-053 is not listed on IDEAS
    16. Andrew J. Patton & Kevin Sheppard, 2015. "Good Volatility, Bad Volatility: Signed Jumps and The Persistence of Volatility," The Review of Economics and Statistics, MIT Press, vol. 97(3), pages 683-697, July.
    17. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    18. Andersen, Torben G. & Varneskov, Rasmus T., 2021. "Consistent inference for predictive regressions in persistent economic systems," Journal of Econometrics, Elsevier, vol. 224(1), pages 215-244.
    19. Clements, Adam & Preve, Daniel P.A., 2021. "A Practical Guide to harnessing the HAR volatility model," Journal of Banking & Finance, Elsevier, vol. 133(C).
    20. Santos, Douglas G. & Candido, Osvaldo & Tófoli, Paula V., 2022. "Forecasting risk measures using intraday and overnight information," The North American Journal of Economics and Finance, Elsevier, vol. 60(C).
    21. Oikonomou, Ioannis & Stancu, Andrei & Symeonidis, Lazaros & Wese Simen, Chardin, 2019. "The information content of short-term options," Journal of Financial Markets, Elsevier, vol. 46(C).

    More about this item

    Keywords

    Equal Predictive Ability; Long Memory; Diebold-Mariano Test; Long-run Variance Estimation; Realized Volatility;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2016-17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.