IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20150083.html
   My bibliography  Save this paper

In-Sample Confidence Bands and Out-of-Sample Forecast Bands for Time-Varying Parameters in Observation Driven Models

Author

Listed:
  • Francisco Blasques

    (VU University Amsterdam, the Netherlands)

  • Siem Jan Koopman

    (VU University Amsterdam, the Netherlands)

  • Katarzyna Lasak

    (VU University Amsterdam, the Netherlands)

  • André Lucas

    (VU University Amsterdam, the Netherlands)

Abstract

We study the performance of alternative methods for calculating in-sample confidence and out of-sample forecast bands for time-varying parameters. The in-sample bands reflect parameter uncertainty only. The out-of-sample bands reflect both parameter uncertainty and innovation uncertainty. The bands are applicable to a large class of observation driven models and a wide range of estimation procedures. A Monte Carlo study is conducted for time-varying parameter models such as generalized autoregressive conditional heteroskedasticity and autoregressive conditional duration models. Our results show clear differences between the actual coverage provided by the different methods. We illustrate our findings in a volatility analysis for monthly Standard & Poor’s 500 index returns.

Suggested Citation

  • Francisco Blasques & Siem Jan Koopman & Katarzyna Lasak & André Lucas, 2015. "In-Sample Confidence Bands and Out-of-Sample Forecast Bands for Time-Varying Parameters in Observation Driven Models," Tinbergen Institute Discussion Papers 15-083/III, Tinbergen Institute.
  • Handle: RePEc:tin:wpaper:20150083
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/15083.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Creal, Drew & Koopman, Siem Jan & Lucas, André, 2011. "A Dynamic Multivariate Heavy-Tailed Model for Time-Varying Volatilities and Correlations," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(4), pages 552-563.
    2. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107630024.
    3. Robert Engle, 2002. "New frontiers for arch models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 425-446.
    4. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    5. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178, Decembrie.
    6. Pascual, Lorenzo & Romo, Juan & Ruiz, Esther, 2006. "Bootstrap prediction for returns and volatilities in GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 50(9), pages 2293-2312, May.
    7. Richard A. Davis, 2003. "Observation-driven models for Poisson counts," Biometrika, Biometrika Trust, vol. 90(4), pages 777-790, December.
    8. Tina Hviid Rydberg & Neil Shephard, 2003. "Dynamics of Trade-by-Trade Price Movements: Decomposition and Models," Journal of Financial Econometrics, Oxford University Press, vol. 1(1), pages 2-25.
    9. Joachim Grammig & Kai-Oliver Maurer, 2000. "Non-monotonic hazard functions and the autoregressive conditional duration model," Econometrics Journal, Royal Economic Society, vol. 3(1), pages 16-38.
    10. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    11. Robert F. Engle & Jeffrey R. Russell, 1998. "Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data," Econometrica, Econometric Society, vol. 66(5), pages 1127-1162, September.
    12. Andre Lucas & Bernd Schwaab & Xin Zhang, 2013. "Measuring Credit Risk in a Large Banking System: Econometric Modeling and Empirics," Tinbergen Institute Discussion Papers 13-063/IV/DSF56, Tinbergen Institute, revised 13 Oct 2014.
    13. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    14. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    15. Shephard, Neil (ed.), 2005. "Stochastic Volatility: Selected Readings," OUP Catalogue, Oxford University Press, number 9780199257201.
    16. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Davide Delle Monache & Ivan Petrella & Fabrizio Venditti, 2021. "Price Dividend Ratio and Long-Run Stock Returns: A Score-Driven State Space Model," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(4), pages 1054-1065, October.
    2. Giacomo Bormetti & Fulvio Corsi, 2021. "A Lucas Critique Compliant SVAR model with Observation-driven Time-varying Parameters," Papers 2107.05263, arXiv.org, revised Feb 2022.
    3. P. Gorgi & Siem Jan (S.J.) Koopman & R. Lit, 2018. "The analysis and forecasting of ATP tennis matches using a high-dimensional dynamic model," Tinbergen Institute Discussion Papers 18-009/III, Tinbergen Institute.
    4. Anna Gloria Billé & Leopoldo Catania, 2018. "Dynamic Spatial Autoregressive Models with Time-varying Spatial Weighting Matrices," BEMPS - Bozen Economics & Management Paper Series BEMPS55, Faculty of Economics and Management at the Free University of Bozen.
    5. Angelini, Giovanni & Gorgi, Paolo, 2018. "DSGE Models with observation-driven time-varying volatility," Economics Letters, Elsevier, vol. 171(C), pages 169-171.
    6. Schwaab, Bernd & Zhang, Xin & Lucas, André & D’Innocenzo, Enzo, 2020. "Modeling extreme events:time-varying extreme tail shape," Working Paper Series 399, Sveriges Riksbank (Central Bank of Sweden), revised 01 Jun 2023.
    7. Hong, Yanran & Yu, Jize & Su, Yuquan & Wang, Lu, 2023. "Southern oscillation: Great value of its trends for forecasting crude oil spot price volatility," International Review of Economics & Finance, Elsevier, vol. 84(C), pages 358-368.
    8. Mariana Arozo B. de Melo & Cristiano A. C. Fernandes & Eduardo F. L. de Melo, 2018. "Forecasting aggregate claims using score‐driven time series models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(3), pages 354-374, August.
    9. Eric Beutner & Alexander Heinemann & Stephan Smeekes, 2017. "A Justification of Conditional Confidence Intervals," Papers 1710.00643, arXiv.org, revised Jan 2019.
    10. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    11. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.
    12. Olofsson, Petter & Råholm, Anna & Uddin, Gazi Salah & Troster, Victor & Kang, Sang Hoon, 2021. "Ethical and unethical investments under extreme market conditions," International Review of Financial Analysis, Elsevier, vol. 78(C).
    13. Giovanni Angelini & Paolo Gorgi, 2018. "DSGE Models with Observation-Driven Time-Varying parameters," Tinbergen Institute Discussion Papers 18-030/III, Tinbergen Institute.
    14. P. Gorgi & S. J. Koopman & R. Lit, 2023. "Estimation of final standings in football competitions with a premature ending: the case of COVID-19," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 107(1), pages 233-250, March.
    15. Peng, Kang-Lin & Wu, Chih-Hung & Lin, Pearl M.C. & Kou, IokTeng Esther, 2023. "Investor sentiment in the tourism stock market," Journal of Behavioral and Experimental Finance, Elsevier, vol. 37(C).
    16. Heil, Thomas L.A. & Peter, Franziska J. & Prange, Philipp, 2022. "Measuring 25 years of global equity market co-movement using a time-varying spatial model," Journal of International Money and Finance, Elsevier, vol. 128(C).
    17. F. Campigli & G. Bormetti & F. Lillo, 2022. "Measuring price impact and information content of trades in a time-varying setting," Papers 2212.12687, arXiv.org, revised Dec 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francisco Blasques & Siem Jan Koopman & Katarzyna Lasak & André Lucas, 2015. "In-Sample Bounds for Time-Varying Parameters of Observation Driven Models," Tinbergen Institute Discussion Papers 15-027/III, Tinbergen Institute, revised 07 Sep 2015.
    2. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Information Theoretic Optimality of Observation Driven Time Series Models," Tinbergen Institute Discussion Papers 14-046/III, Tinbergen Institute.
    3. Francesco Calvori & Drew Creal & Siem Jan Koopman & Andre Lucas, 2014. "Testing for Parameter Instability in Competing Modeling Frameworks," Tinbergen Institute Discussion Papers 14-010/IV/DSF71, Tinbergen Institute.
    4. Drew Creal & Siem Jan Koopman & André Lucas & Marcin Zamojski, 2015. "Generalized Autoregressive Method of Moments," Tinbergen Institute Discussion Papers 15-138/III, Tinbergen Institute, revised 06 Jul 2018.
    5. Drew Creal & Siem Jan Koopman & André Lucas, 2008. "A General Framework for Observation Driven Time-Varying Parameter Models," Tinbergen Institute Discussion Papers 08-108/4, Tinbergen Institute.
    6. Olusanya E. Olubusoye & OlaOluwa S. Yaya, 2016. "Time series analysis of volatility in the petroleum pricing markets: the persistence, asymmetry and jumps in the returns series," OPEC Energy Review, Organization of the Petroleum Exporting Countries, vol. 40(3), pages 235-262, September.
    7. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    8. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107034723.
    9. Sucarrat, Genaro & Grønneberg, Steffen, 2016. "Models of Financial Return With Time-Varying Zero Probability," MPRA Paper 68931, University Library of Munich, Germany.
    10. Francisco Blasques & Siem Jan Koopman & Andre Lucas, 2012. "Stationarity and Ergodicity of Univariate Generalized Autoregressive Score Processes," Tinbergen Institute Discussion Papers 12-059/4, Tinbergen Institute.
    11. Marco Bazzi & Francisco Blasques & Siem Jan Koopman & Andre Lucas, 2017. "Time-Varying Transition Probabilities for Markov Regime Switching Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(3), pages 458-478, May.
    12. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Maximum Likelihood Estimation for correctly Specified Generalized Autoregressive Score Models: Feedback Effects, Contraction Conditions and Asymptotic Properties," Tinbergen Institute Discussion Papers 14-074/III, Tinbergen Institute.
    13. Lucas, André & Opschoor, Anne & Schaumburg, Julia, 2016. "Accounting for missing values in score-driven time-varying parameter models," Economics Letters, Elsevier, vol. 148(C), pages 96-98.
    14. Mohamed El Ghourabi & Asma Nani & Imed Gammoudi, 2021. "A value‐at‐risk computation based on heavy‐tailed distribution for dynamic conditional score models," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(2), pages 2790-2799, April.
    15. Blasques, Francisco & van Brummelen, Janneke & Koopman, Siem Jan & Lucas, André, 2022. "Maximum likelihood estimation for score-driven models," Journal of Econometrics, Elsevier, vol. 227(2), pages 325-346.
    16. Mauro Bernardi & Leopoldo Catania, 2015. "Switching-GAS Copula Models With Application to Systemic Risk," Papers 1504.03733, arXiv.org, revised Jan 2016.
    17. Trojan, Sebastian, 2014. "Modeling Intraday Stochastic Volatility and Conditional Duration Contemporaneously with Regime Shifts," Economics Working Paper Series 1425, University of St. Gallen, School of Economics and Political Science.
    18. Mauro Bernardi & Leopoldo Catania, 2016. "Portfolio Optimisation Under Flexible Dynamic Dependence Modelling," Papers 1601.05199, arXiv.org.
    19. Bernardi, Mauro & Catania, Leopoldo, 2018. "Portfolio optimisation under flexible dynamic dependence modelling," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 1-18.
    20. Francisco Blasques & Paolo Gorgi & Siem Jan Koopman & Olivier Wintenberger, 2016. "Feasible Invertibility Conditions and Maximum Likelihood Estimation for Observation-Driven Models," Tinbergen Institute Discussion Papers 16-082/III, Tinbergen Institute.

    More about this item

    Keywords

    autoregressive conditional duration; delta-method; generalized autoregressive;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20150083. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.