IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20140010.html
   My bibliography  Save this paper

Testing for Parameter Instability in Competing Modeling Frameworks

Author

Listed:
  • Francesco Calvori

    (Department of Statistics 'G. Parenti', University of Florence, Italy)

  • Drew Creal

    (Booth School of Business, University of Chicago)

  • Siem Jan Koopman

    (VU University Amsterdam)

  • Andre Lucas

    (VU University Amsterdam)

Abstract

We develop a new parameter stability test against the alternative of observation driven generalized autoregressive score dynamics. The new test generalizes the ARCH-LM test of Engle (1982) to settings beyond time-varying volatility and exploits any autocorrelation in the likelihood scores under the alternative. We compare the test's performance with that of alternative tests developed for competing time-varying parameter frameworks, such as structural breaks and observation driven parameter dynamics. The new test has higher and more stable power against alternatives with frequent regime switches or with non-local parameter driven time-variation. For parameter driven time variation close to the null or for infrequent structural changes, the test of Muller and Petalas (2010) performs best overall. We apply all tests empirically to a panel of losses given default over the period 1982--2010 and find significant evidence of parameter variation in the underlying beta distribution.

Suggested Citation

  • Francesco Calvori & Drew Creal & Siem Jan Koopman & Andre Lucas, 2014. "Testing for Parameter Instability in Competing Modeling Frameworks," Tinbergen Institute Discussion Papers 14-010/IV/DSF71, Tinbergen Institute.
  • Handle: RePEc:tin:wpaper:20140010
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/14010.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Drew Creal & Bernd Schwaab & Siem Jan Koopman & Andr� Lucas, 2014. "Observation-Driven Mixed-Measurement Dynamic Factor Models with an Application to Credit Risk," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 898-915, December.
    2. Fabrizio Cipollini & Robert F. Engle & Giampiero M. Gallo, 2013. "Semiparametric Vector Mem," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(7), pages 1067-1086, November.
    3. Lee, John H. H., 1991. "A Lagrange multiplier test for GARCH models," Economics Letters, Elsevier, vol. 37(3), pages 265-271, November.
    4. Creal, Drew & Koopman, Siem Jan & Lucas, André, 2011. "A Dynamic Multivariate Heavy-Tailed Model for Time-Varying Volatilities and Correlations," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(4), pages 552-563.
    5. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    6. Bauwens, Luc & Veredas, David, 2004. "The stochastic conditional duration model: a latent variable model for the analysis of financial durations," Journal of Econometrics, Elsevier, vol. 119(2), pages 381-412, April.
    7. Dong Hwan Oh & Andrew J. Patton, 2018. "Time-Varying Systemic Risk: Evidence From a Dynamic Copula Model of CDS Spreads," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(2), pages 181-195, April.
    8. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    9. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    10. Engle, Robert F. & Gallo, Giampiero M., 2006. "A multiple indicators model for volatility using intra-daily data," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 3-27.
    11. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    12. Zhongjun Qu & Pierre Perron, 2007. "Estimating and Testing Structural Changes in Multivariate Regressions," Econometrica, Econometric Society, vol. 75(2), pages 459-502, March.
    13. Richard A. Davis, 2003. "Observation-driven models for Poisson counts," Biometrika, Biometrika Trust, vol. 90(4), pages 777-790, December.
    14. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    15. Vogelsang, Timothy J & Perron, Pierre, 1998. "Additional Tests for a Unit Root Allowing for a Break in the Trend Function at an Unknown Time," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 1073-1100, November.
    16. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    17. Christian M. Hafner & Hans Manner, 2012. "Dynamic stochastic copula models: estimation, inference and applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(2), pages 269-295, March.
    18. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    19. Andrew J. Patton, 2006. "Modelling Asymmetric Exchange Rate Dependence," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(2), pages 527-556, May.
    20. BAUWENS, Luc & VEREDAS, David, 1999. "The stochastic conditional duration model: a latent factor model for the analysis of financial durations," LIDAM Discussion Papers CORE 1999058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    21. Bruce E. Hansen, 2001. "The New Econometrics of Structural Change: Dating Breaks in U.S. Labour Productivity," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 117-128, Fall.
    22. Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
    23. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    24. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    25. Shephard, Neil (ed.), 2005. "Stochastic Volatility: Selected Readings," OUP Catalogue, Oxford University Press, number 9780199257201.
    26. Ploberger, Werner & Kramer, Walter & Kontrus, Karl, 1989. "A new test for structural stability in the linear regression model," Journal of Econometrics, Elsevier, vol. 40(2), pages 307-318, February.
    27. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Emilian DOBRESCU, 2017. "Modelling an Emergent Economy and Parameter Instability Problem," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(2), pages 5-28, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    2. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Information Theoretic Optimality of Observation Driven Time Series Models," Tinbergen Institute Discussion Papers 14-046/III, Tinbergen Institute.
    3. Marco Bazzi & Francisco Blasques & Siem Jan Koopman & Andre Lucas, 2017. "Time-Varying Transition Probabilities for Markov Regime Switching Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(3), pages 458-478, May.
    4. Drew Creal & Siem Jan Koopman & André Lucas, 2008. "A General Framework for Observation Driven Time-Varying Parameter Models," Tinbergen Institute Discussion Papers 08-108/4, Tinbergen Institute.
    5. Djennad, Abdelmajid & Rigby, Robert & Stasinopoulos, Dimitrios & Voudouris, Vlasios & Eilers, Paul, 2015. "Beyond location and dispersion models: The Generalized Structural Time Series Model with Applications," MPRA Paper 62807, University Library of Munich, Germany.
    6. Blasques, Francisco & Koopman, Siem Jan & Łasak, Katarzyna & Lucas, André, 2016. "In-sample confidence bands and out-of-sample forecast bands for time-varying parameters in observation-driven models," International Journal of Forecasting, Elsevier, vol. 32(3), pages 875-887.
    7. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107034723, February.
    8. Vêlayoudom Marimoutou & Manel Soury, 2015. "Energy Markets and CO2 Emissions: Analysis by Stochastic Copula Autoregressive Model," AMSE Working Papers 1520, Aix-Marseille School of Economics, France.
    9. Lucas, André & Opschoor, Anne & Schaumburg, Julia, 2016. "Accounting for missing values in score-driven time-varying parameter models," Economics Letters, Elsevier, vol. 148(C), pages 96-98.
    10. Fu, Zhonghao & Hong, Yongmiao, 2019. "A model-free consistent test for structural change in regression possibly with endogeneity," Journal of Econometrics, Elsevier, vol. 211(1), pages 206-242.
    11. Patton, Andrew, 2013. "Copula Methods for Forecasting Multivariate Time Series," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 899-960, Elsevier.
    12. Blasques, Francisco & Ji, Jiangyu & Lucas, André, 2016. "Semiparametric score driven volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 58-69.
    13. Carlo Campajola & Domenico Di Gangi & Fabrizio Lillo & Daniele Tantari, 2020. "Modelling time-varying interactions in complex systems: the Score Driven Kinetic Ising Model," Papers 2007.15545, arXiv.org, revised Aug 2021.
    14. Vêlayoudom Marimoutou & Manel Soury, 2015. "Energy Markets and CO2 Emissions: Analysis by Stochastic Copula Autoregressive Model," Working Papers halshs-01148746, HAL.
    15. Drew Creal & Siem Jan Koopman & André Lucas & Marcin Zamojski, 2015. "Generalized Autoregressive Method of Moments," Tinbergen Institute Discussion Papers 15-138/III, Tinbergen Institute, revised 06 Jul 2018.
    16. Mauro Bernardi & Leopoldo Catania, 2015. "Switching-GAS Copula Models With Application to Systemic Risk," Papers 1504.03733, arXiv.org, revised Jan 2016.
    17. Marimoutou, Vêlayoudom & Soury, Manel, 2015. "Energy markets and CO2 emissions: Analysis by stochastic copula autoregressive model," Energy, Elsevier, vol. 88(C), pages 417-429.
    18. Trojan, Sebastian, 2014. "Modeling Intraday Stochastic Volatility and Conditional Duration Contemporaneously with Regime Shifts," Economics Working Paper Series 1425, University of St. Gallen, School of Economics and Political Science.
    19. Francisco Blasques & Siem Jan Koopman & Katarzyna Lasak & André Lucas, 2015. "In-Sample Bounds for Time-Varying Parameters of Observation Driven Models," Tinbergen Institute Discussion Papers 15-027/III, Tinbergen Institute, revised 07 Sep 2015.
    20. Bernardi, Mauro & Catania, Leopoldo, 2018. "Portfolio optimisation under flexible dynamic dependence modelling," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 1-18.

    More about this item

    Keywords

    time-varying parameters; observation driven models; parameter driven models; structural breaks; generalized autoregressive score model; regime switching; credit risk;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20140010. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.