IDEAS home Printed from https://ideas.repec.org/p/aah/create/2019-04.html
   My bibliography  Save this paper

Assessing predictive accuracy in panel data models with long-range dependence

Author

Listed:
  • Daniel Borup

    (Aarhus University and CREATES)

  • Bent Jesper Christensen

    (Aarhus University and CREATES and the Dale T. Mortensen Center)

  • Yunus Emre Ergemen

    (Aarhus University and CREATES)

Abstract

This paper proposes tests of the null hypothesis that model-based forecasts are uninformative in panels, allowing for individual and interactive fixed effects that control for cross-sectional dependence, endogenous predictors, and both short-range and long-range dependence. We consider a Diebold-Mariano style test based on comparison of the model-based forecast and a nested nopredictability benchmark, an encompassing style test of the same null, and a test of pooled uninformativeness in the entire panel. A simulation study shows that the encompassing style test is reasonably sized in finite samples, whereas the Diebold-Mariano style test is oversized. Both tests have non-trivial local power. The methods are applied to the predictive relation between economic policy uncertainty and future stock market volatility in a multi-country analysis.

Suggested Citation

  • Daniel Borup & Bent Jesper Christensen & Yunus Emre Ergemen, 2019. "Assessing predictive accuracy in panel data models with long-range dependence," CREATES Research Papers 2019-04, Department of Economics and Business Economics, Aarhus University.
  • Handle: RePEc:aah:create:2019-04
    as

    Download full text from publisher

    File URL: https://repec.econ.au.dk/repec/creates/rp/19/rp19_04.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Gonçalves, Sílvia & McCracken, Michael W. & Perron, Benoit, 2017. "Tests of equal accuracy for nested models with estimated factors," Journal of Econometrics, Elsevier, vol. 198(2), pages 231-252.
    3. Canova, Fabio & Ciccarelli, Matteo, 2004. "Forecasting and turning point predictions in a Bayesian panel VAR model," Journal of Econometrics, Elsevier, vol. 120(2), pages 327-359, June.
    4. Roxana Chiriac & Valeri Voev, 2011. "Modelling and forecasting multivariate realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 922-947, September.
    5. Bialkowski, Jedrzej & Gottschalk, Katrin & Wisniewski, Tomasz Piotr, 2008. "Stock market volatility around national elections," Journal of Banking & Finance, Elsevier, vol. 32(9), pages 1941-1953, September.
    6. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    7. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    8. Bos, Charles S. & Franses, Philip Hans & Ooms, Marius, 2002. "Inflation, forecast intervals and long memory regression models," International Journal of Forecasting, Elsevier, vol. 18(2), pages 243-264.
    9. Groen, Jan J J, 2005. "Exchange Rate Predictability and Monetary Fundamentals in a Small Multi-country Panel," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 495-516, June.
    10. George Bittlingmayer, 1998. "Output, Stock Volatility, and Political Uncertainty in a Natural Experiment: Germany, 1880-1940," Journal of Finance, American Finance Association, vol. 53(6), pages 2243-2257, December.
    11. Charles Engel & Nelson C. Mark & Kenneth D. West, 2008. "Exchange Rate Models Are Not as Bad as You Think," NBER Chapters, in: NBER Macroeconomics Annual 2007, Volume 22, pages 381-441, National Bureau of Economic Research, Inc.
    12. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    13. Ergemen, Yunus Emre & Velasco, Carlos, 2017. "Estimation of fractionally integrated panels with fixed effects and cross-section dependence," Journal of Econometrics, Elsevier, vol. 196(2), pages 248-258.
    14. Javier Hualde & Peter M Robinson, 2003. "Cointegration in Fractional Systems with Unkown Integration Orders," STICERD - Econometrics Paper Series 449, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    15. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    16. Chudik, Alexander & Grossman, Valerie & Pesaran, M. Hashem, 2016. "A multi-country approach to forecasting output growth using PMIs," Journal of Econometrics, Elsevier, vol. 192(2), pages 349-365.
    17. Robinson, Peter M. & Velasco, Carlos, 2015. "Efficient inference on fractionally integrated panel data models with fixed effects," Journal of Econometrics, Elsevier, vol. 185(2), pages 435-452.
    18. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    19. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
    20. Pesaran, M. Hashem & Schuermann, Til & Smith, L. Vanessa, 2009. "Forecasting economic and financial variables with global VARs," International Journal of Forecasting, Elsevier, vol. 25(4), pages 642-675, October.
    21. Ergemen, Yunus Emre & Haldrup, Niels & Rodríguez-Caballero, Carlos Vladimir, 2016. "Common long-range dependence in a panel of hourly Nord Pool electricity prices and loads," Energy Economics, Elsevier, vol. 60(C), pages 79-96.
    22. Bhardwaj, Geetesh & Swanson, Norman R., 2006. "An empirical investigation of the usefulness of ARFIMA models for predicting macroeconomic and financial time series," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 539-578.
    23. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    24. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    25. Su, Liangjun & Chen, Qihui, 2013. "Testing Homogeneity In Panel Data Models With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 29(6), pages 1079-1135, December.
    26. P. M. Robinson & J. Hualde, 2003. "Cointegration in Fractional Systems with Unknown Integration Orders," Econometrica, Econometric Society, vol. 71(6), pages 1727-1766, November.
    27. Clark, Todd E. & McCracken, Michael W., 2006. "The Predictive Content of the Output Gap for Inflation: Resolving In-Sample and Out-of-Sample Evidence," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1127-1148, August.
    28. Deo, Rohit & Hurvich, Clifford & Lu, Yi, 2006. "Forecasting realized volatility using a long-memory stochastic volatility model: estimation, prediction and seasonal adjustment," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 29-58.
    29. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    30. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    31. Robinson Kruse & Christian Leschinski & Michael Will, 2016. "Comparing Predictive Accuracy under Long Memory - With an Application to Volatility Forecasting," CREATES Research Papers 2016-17, Department of Economics and Business Economics, Aarhus University.
    32. Xingguo Luo & Xuyuanda Qi, 2017. "The dynamic correlations between the G7 economies and China: Evidence from both realized and implied volatilities," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 37(10), pages 989-1002, October.
    33. Busch, Thomas & Christensen, Bent Jesper & Nielsen, Morten Ørregaard, 2011. "The role of implied volatility in forecasting future realized volatility and jumps in foreign exchange, stock, and bond markets," Journal of Econometrics, Elsevier, vol. 160(1), pages 48-57, January.
    34. Pesaran, M. Hashem & Schuermann, Til & Smith, L. Vanessa, 2009. "Rejoinder to comments on forecasting economic and financial variables with global VARs," International Journal of Forecasting, Elsevier, vol. 25(4), pages 703-715, October.
    35. K Abadir & W Distaso & L Giraitis, "undated". "Two estimators of the long-run variance," Discussion Papers 05/19, Department of Economics, University of York.
    36. Lubos Pástor & Pietro Veronesi, 2012. "Uncertainty about Government Policy and Stock Prices," Journal of Finance, American Finance Association, vol. 67(4), pages 1219-1264, August.
    37. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    38. Hualde, Javier & Robinson, Peter M., 2003. "Cointegration in fractional systems with unkown integration orders," LSE Research Online Documents on Economics 58050, London School of Economics and Political Science, LSE Library.
    39. Pesaran, M. Hashem & Pick, Andreas & Timmermann, Allan, 2011. "Variable selection, estimation and inference for multi-period forecasting problems," Journal of Econometrics, Elsevier, vol. 164(1), pages 173-187, September.
    40. Abadir, Karim M. & Distaso, Walter & Giraitis, Liudas, 2009. "Two estimators of the long-run variance: Beyond short memory," Journal of Econometrics, Elsevier, vol. 150(1), pages 56-70, May.
    41. Baltagi, Badi H., 2013. "Panel Data Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 995-1024, Elsevier.
    42. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    43. Gil-Alana, L. A. & Robinson, P. M., 1997. "Testing of unit root and other nonstationary hypotheses in macroeconomic time series," Journal of Econometrics, Elsevier, vol. 80(2), pages 241-268, October.
    44. Chernov, Mikhail, 2007. "On the Role of Risk Premia in Volatility Forecasting," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 411-426, October.
    45. Robinson, Peter M. & Hualde, Javier, 2003. "Cointegration in fractional systems with unknown integration orders," LSE Research Online Documents on Economics 2223, London School of Economics and Political Science, LSE Library.
    46. Robinson, P.M., 2005. "Robust Covariance Matrix Estimation: Hac Estimates With Long Memory/Antipersistence Correction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 171-180, February.
    47. Jörg Breitung & Malte Knüppel, 2021. "How far can we forecast? Statistical tests of the predictive content," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(4), pages 369-392, June.
    48. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    49. Yunus Emre Ergemen, 2019. "System Estimation of Panel Data Models Under Long-Range Dependence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 13-26, January.
    50. Bollerslev, Tim & Osterrieder, Daniela & Sizova, Natalia & Tauchen, George, 2013. "Risk and return: Long-run relations, fractional cointegration, and return predictability," Journal of Financial Economics, Elsevier, vol. 108(2), pages 409-424.
    51. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2013. "International Stock Return Predictability: What Is the Role of the United States?," Journal of Finance, American Finance Association, vol. 68(4), pages 1633-1662, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kruse, Robinson & Leschinski, Christian & Will, Michael, 2016. "Comparing Predictive Accuracy under Long Memory - With an Application to Volatility Forecasting," Hannover Economic Papers (HEP) dp-571, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Yunus Emre Ergemen, 2016. "System Estimation of Panel Data Models under Long-Range Dependence," CREATES Research Papers 2016-02, Department of Economics and Business Economics, Aarhus University.
    4. Ergemen, Yunus Emre & Velasco, Carlos, 2017. "Estimation of fractionally integrated panels with fixed effects and cross-section dependence," Journal of Econometrics, Elsevier, vol. 196(2), pages 248-258.
    5. Andersen, Torben G. & Varneskov, Rasmus T., 2021. "Consistent inference for predictive regressions in persistent economic systems," Journal of Econometrics, Elsevier, vol. 224(1), pages 215-244.
    6. Bucci, Andrea & Palomba, Giulio & Rossi, Eduardo, 2023. "The role of uncertainty in forecasting volatility comovements across stock markets," Economic Modelling, Elsevier, vol. 125(C).
    7. Andrea Bucci & Giulio Palomba & Eduardo Rossi, 2019. "Does macroeconomics help in predicting stock markets volatility comovements? A nonlinear approach," Working Papers 440, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    8. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    9. Tobias Hartl & Roland Weigand, 2018. "Multivariate Fractional Components Analysis," Papers 1812.09149, arXiv.org, revised Jan 2019.
    10. Ergemen, Yunus Emre, 2023. "Parametric estimation of long memory in factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1483-1499.
    11. Apostolos Kourtis & Raphael N. Markellos & Lazaros Symeonidis, 2016. "An International Comparison of Implied, Realized, and GARCH Volatility Forecasts," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 36(12), pages 1164-1193, December.
    12. Buncic, Daniel & Gisler, Katja I.M., 2016. "Global equity market volatility spillovers: A broader role for the United States," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1317-1339.
    13. Pyun, Sungjune, 2019. "Variance risk in aggregate stock returns and time-varying return predictability," Journal of Financial Economics, Elsevier, vol. 132(1), pages 150-174.
    14. Abakah, Emmanuel Joel Aikins & Caporale, Guglielmo Maria & Gil-Alana, Luis Alberiko, 2021. "Economic policy uncertainty: Persistence and cross-country linkages," Research in International Business and Finance, Elsevier, vol. 58(C).
    15. Abbritti, Mirko & Carcel, Hector & Gil-Alana, Luis & Moreno, Antonio, 2023. "Term premium in a fractionally cointegrated yield curve," Journal of Banking & Finance, Elsevier, vol. 149(C).
    16. Chun, Dohyun & Cho, Hoon & Ryu, Doojin, 2023. "Discovering the drivers of stock market volatility in a data-rich world," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 82(C).
    17. Javier Haulde & Morten Ørregaard Nielsen, 2022. "Fractional integration and cointegration," CREATES Research Papers 2022-02, Department of Economics and Business Economics, Aarhus University.
    18. Morales-Arias, Leonardo & Moura, Guilherme V., 2013. "Adaptive forecasting of exchange rates with panel data," International Journal of Forecasting, Elsevier, vol. 29(3), pages 493-509.
    19. Ergemen, Yunus Emre & Rodríguez-Caballero, C. Vladimir, 2023. "Estimation of a dynamic multi-level factor model with possible long-range dependence," International Journal of Forecasting, Elsevier, vol. 39(1), pages 405-430.
    20. Dichtl, Hubert & Drobetz, Wolfgang & Neuhierl, Andreas & Wendt, Viktoria-Sophie, 2021. "Data snooping in equity premium prediction," International Journal of Forecasting, Elsevier, vol. 37(1), pages 72-94.

    More about this item

    Keywords

    Panel data; predictability; long-range dependence; Diebold-Mariano test; encompassing test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2019-04. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.