IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/57147.html
   My bibliography  Save this paper

Multiple-change-point detection for high dimensional time series via sparsified binary segmentation

Author

Listed:
  • Cho, Haeran
  • Fryzlewicz, Piotr

Abstract

Time series segmentation, which is also known as multiple-change-point detection, is a well-established problem. However, few solutions have been designed specifically for high dimensional situations. Our interest is in segmenting the second-order structure of a high dimensional time series. In a generic step of a binary segmentation algorithm for multivariate time series, one natural solution is to combine cumulative sum statistics obtained from local periodograms and cross-periodograms of the components of the input time series. However, the standard 'maximum' and 'average' methods for doing so often fail in high dimensions when, for example, the change points are sparse across the panel or the cumulative sum statistics are spuriously large. We propose the sparsified binary segmentation algorithm which aggregates the cumulative sum statistics by adding only those that pass a certain threshold. This 'sparsifying' step reduces the influence of irrelevant noisy contributions, which is particularly beneficial in high dimensions. To show the consistency of sparsified binary segmentation, we introduce the multivariate locally stationary wavelet model for time series, which is a separate contribution of this work.

Suggested Citation

  • Cho, Haeran & Fryzlewicz, Piotr, 2015. "Multiple-change-point detection for high dimensional time series via sparsified binary segmentation," LSE Research Online Documents on Economics 57147, London School of Economics and Political Science, LSE Library.
  • Handle: RePEc:ehl:lserod:57147
    as

    Download full text from publisher

    File URL: http://eprints.lse.ac.uk/57147/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hernando Ombao & Jonathan Raz & Rainer von Sachs & Wensheng Guo, 2002. "The SLEX Model of a Non-Stationary Random Process," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 54(1), pages 171-200, March.
    2. G. P. Nason & R. Von Sachs & G. Kroisandt, 2000. "Wavelet processes and adaptive estimation of the evolutionary wavelet spectrum," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(2), pages 271-292.
    3. Sanderson, Jean & Fryzlewicz, Piotr & Jones, M. W., 2010. "Estimating linear dependence between nonstationary time series using the locally stationary wavelet model," LSE Research Online Documents on Economics 29141, London School of Economics and Political Science, LSE Library.
    4. Piotr Fryzlewicz & Guy P. Nason, 2006. "Haar–Fisz estimation of evolutionary wavelet spectra," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(4), pages 611-634, September.
    5. Fryzlewicz, Piotr & van Bellegem, Sébastien & von Sachs, Rainer, 2003. "Forecasting non-stationary time series by wavelet process modelling," LSE Research Online Documents on Economics 25830, London School of Economics and Political Science, LSE Library.
    6. Ombao H. C & Raz J. A & von Sachs R. & Malow B. A, 2001. "Automatic Statistical Analysis of Bivariate Nonstationary Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 543-560, June.
    7. J. Sanderson & P. Fryzlewicz & M. W. Jones, 2010. "Estimating linear dependence between nonstationary time series using the locally stationary wavelet model," Biometrika, Biometrika Trust, vol. 97(2), pages 435-446.
    8. Ombao, Hernando & von Sachs, Rainer & Guo, Wensheng, 2005. "SLEX Analysis of Multivariate Nonstationary Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 519-531, June.
    9. Marc Lavielle & Eric Moulines, 2000. "Least‐squares Estimation of an Unknown Number of Shifts in a Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 21(1), pages 33-59, January.
    10. Guy Nason, 2013. "A test for second-order stationarity and approximate confidence intervals for localized autocovariances for locally stationary time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(5), pages 879-904, November.
    11. Piotr Fryzlewicz & Sébastien Bellegem & Rainer Sachs, 2003. "Forecasting non-stationary time series by wavelet process modelling," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 55(4), pages 737-764, December.
    12. Jianqing Fan & Jinchi Lv & Lei Qi, 2011. "Sparse High-Dimensional Models in Economics," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 291-317, September.
    13. Yogesh Dwivedi & Suhasini Subba Rao, 2011. "A test for second‐order stationarity of a time series based on the discrete Fourier transform," Journal of Time Series Analysis, Wiley Blackwell, vol. 32(1), pages 68-91, January.
    14. Fryzlewicz, Piotr & Nason, Guy P., 2006. "Haar-Fisz estimation of evolutionary wavelet spectra," LSE Research Online Documents on Economics 25227, London School of Economics and Political Science, LSE Library.
    15. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guy Nason, 2013. "A test for second-order stationarity and approximate confidence intervals for localized autocovariances for locally stationary time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(5), pages 879-904, November.
    2. Embleton, Jonathan & Knight, Marina I. & Ombao, Hernando, 2022. "Wavelet testing for a replicate-effect within an ordered multiple-trial experiment," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    3. I A Eckley & G P Nason, 2018. "A test for the absence of aliasing or local white noise in locally stationary wavelet time series," Biometrika, Biometrika Trust, vol. 105(4), pages 833-848.
    4. Antonis A. Michis & Guy P. Nason, 2017. "Case study: shipping trend estimation and prediction via multiscale variance stabilisation," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(15), pages 2672-2684, November.
    5. von Sachs, Rainer, 2019. "Spectral Analysis of Multivariate Time Series," LIDAM Discussion Papers ISBA 2019008, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    6. Tata Subba Rao & Granville Tunnicliffe Wilson & Alessandro Cardinali & Guy P. Nason, 2017. "Locally Stationary Wavelet Packet Processes: Basis Selection and Model Fitting," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(2), pages 151-174, March.
    7. Sanderson, Jean & Fryzlewicz, Piotr & Jones, M. W., 2010. "Estimating linear dependence between nonstationary time series using the locally stationary wavelet model," LSE Research Online Documents on Economics 29141, London School of Economics and Political Science, LSE Library.
    8. Euan T. McGonigle & Rebecca Killick & Matthew A. Nunes, 2022. "Trend locally stationary wavelet processes," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(6), pages 895-917, November.
    9. Zhelin Huang & Ngai Hang Chan, 2020. "Walsh Fourier Transform of Locally Stationary Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 41(2), pages 312-340, March.
    10. Mark Fiecas & Hernando Ombao, 2016. "Modeling the Evolution of Dynamic Brain Processes During an Associative Learning Experiment," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1440-1453, October.
    11. Fryzlewicz, Piotr & Nason, Guy P., 2004. "Smoothing the wavelet periodogram using the Haar-Fisz transform," LSE Research Online Documents on Economics 25231, London School of Economics and Political Science, LSE Library.
    12. Fryzlewicz, Piotr & Ombao, Hernando, 2009. "Consistent classification of non-stationary time series using stochastic wavelet representations," LSE Research Online Documents on Economics 25162, London School of Economics and Political Science, LSE Library.
    13. Marios Sergides & Efstathios Paparoditis, 2009. "Frequency Domain Tests of Semiparametric Hypotheses for Locally Stationary Processes," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(4), pages 800-821, December.
    14. Barigozzi, Matteo & Cho, Haeran & Fryzlewicz, Piotr, 2018. "Simultaneous multiple change-point and factor analysis for high-dimensional time series," Journal of Econometrics, Elsevier, vol. 206(1), pages 187-225.
    15. Schroeder, Anna Louise & Fryzlewicz, Piotr, 2013. "Adaptive trend estimation in financial time series via multiscale change-point-induced basis recovery," LSE Research Online Documents on Economics 54934, London School of Economics and Political Science, LSE Library.
    16. Triantafyllopoulos, K. & Nason, G.P., 2009. "A note on state space representations of locally stationary wavelet time series," Statistics & Probability Letters, Elsevier, vol. 79(1), pages 50-54, January.
    17. Guy Nason & Kara Stevens, 2015. "Bayesian Wavelet Shrinkage of the Haar-Fisz Transformed Wavelet Periodogram," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-24, September.
    18. repec:dau:papers:123456789/6515 is not listed on IDEAS
    19. Aki-Hiro Sato & Hideki Takayasu, 2013. "Segmentation procedure based on Fisher's exact test and its application to foreign exchange rates," Papers 1309.0602, arXiv.org.
    20. Aykroyd, Robert G. & Barber, Stuart & Miller, Luke R., 2016. "Classification of multiple time signals using localized frequency characteristics applied to industrial process monitoring," Computational Statistics & Data Analysis, Elsevier, vol. 94(C), pages 351-362.
    21. Zhibiao Zhao, 2015. "Inference for Local Autocorrelations in Locally Stationary Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 296-306, April.

    More about this item

    Keywords

    binary segmentation; cumulative sum statistic; high dimensional time series; locally stationary wavelet model; multiple-change-point detection; thresholding;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:57147. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.