IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i19p2394-d643407.html
   My bibliography  Save this article

Robust Algorithms for Change-Point Regressions Using the t -Distribution

Author

Listed:
  • Kang-Ping Lu

    (Department of Applied Statistics, National Taichung University of Science and Technology, Taichung 404336, Taiwan)

  • Shao-Tung Chang

    (Department of Mathematics, National Taiwan Normal University, Taipei 116059, Taiwan)

Abstract

Regression models with change-points have been widely applied in various fields. Most methodologies for change-point regressions assume Gaussian errors. For many real data having longer-than-normal tails or atypical observations, the use of normal errors may unduly affect the fit of change-point regression models. This paper proposes two robust algorithms called EMT and FCT for change-point regressions by incorporating the t -distribution with the expectation and maximization algorithm and the fuzzy classification procedure, respectively. For better resistance to high leverage outliers, we introduce a modified version of the proposed method, which fits the t change-point regression model to the data after moderately pruning high leverage points. The selection of the degrees of freedom is discussed. The robustness properties of the proposed methods are also analyzed and validated. Simulation studies show the effectiveness and resistance of the proposed methods against outliers and heavy-tailed distributions. Extensive experiments demonstrate the preference of the t -based approach over normal-based methods for better robustness and computational efficiency. EMT and FCT generally work well, and FCT always performs better for less biased estimates, especially in cases of data contamination. Real examples show the need and the practicability of the proposed method.

Suggested Citation

  • Kang-Ping Lu & Shao-Tung Chang, 2021. "Robust Algorithms for Change-Point Regressions Using the t -Distribution," Mathematics, MDPI, vol. 9(19), pages 1-28, September.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:19:p:2394-:d:643407
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/19/2394/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/19/2394/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jin-Guan Lin & Li-Xing Zhu & Feng-Chang Xie, 2009. "Heteroscedasticity diagnostics for t linear regression models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 70(1), pages 59-77, June.
    2. Carina Gerstenberger, 2018. "Robust Wilcoxon†Type Estimation of Change†Point Location Under Short†Range Dependence," Journal of Time Series Analysis, Wiley Blackwell, vol. 39(1), pages 90-104, January.
    3. Anna Louise Schröder & Hernando Ombao, 2019. "FreSpeD: Frequency-Specific Change-Point Detection in Epileptic Seizure Multi-Channel EEG Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 115-128, January.
    4. Andrea Cerioli & Marco Riani & Anthony C. Atkinson & Aldo Corbellini, 2018. "Rejoinder to the discussion of “The power of monitoring: how to make the most of a contaminated multivariate sample”," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(4), pages 661-666, December.
    5. Yao, Weixin & Wei, Yan & Yu, Chun, 2014. "Robust mixture regression using the t-distribution," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 116-127.
    6. Gabriela Ciuperca, 2011. "Penalized least absolute deviations estimation for nonlinear model with change-points," Statistical Papers, Springer, vol. 52(2), pages 371-390, May.
    7. Ciuperca, Gabriela, 2011. "A general criterion to determine the number of change-points," Statistics & Probability Letters, Elsevier, vol. 81(8), pages 1267-1275, August.
    8. Andrea Cerioli & Marco Riani & Anthony C. Atkinson & Aldo Corbellini, 2018. "The power of monitoring: how to make the most of a contaminated multivariate sample," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(4), pages 559-587, December.
    9. Klaus Frick & Axel Munk & Hannes Sieling, 2014. "Multiscale change point inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(3), pages 495-580, June.
    10. Hawkins, Douglas M., 2001. "Fitting multiple change-point models to data," Computational Statistics & Data Analysis, Elsevier, vol. 37(3), pages 323-341, September.
    11. Gabriela Ciuperca, 2011. "Estimating nonlinear regression with and without change-points by the LAD method," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(4), pages 717-743, August.
    12. Paul Fearnhead & Guillem Rigaill, 2019. "Changepoint Detection in the Presence of Outliers," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 169-183, January.
    13. Fengkai Yang, 2014. "Robust Mean Change-Point Detecting through Laplace Linear Regression Using EM Algorithm," Journal of Applied Mathematics, Hindawi, vol. 2014, pages 1-9, November.
    14. Jin-Guan Lin & Ji Chen & Yong Li, 2012. "Bayesian Analysis of Student t Linear Regression with Unknown Change-Point and Application to Stock Data Analysis," Computational Economics, Springer;Society for Computational Economics, vol. 40(3), pages 203-217, October.
    15. Fryzlewicz, Piotr, 2014. "Wild binary segmentation for multiple change-point detection," LSE Research Online Documents on Economics 57146, London School of Economics and Political Science, LSE Library.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kang-Ping Lu & Shao-Tung Chang, 2022. "Robust Switching Regressions Using the Laplace Distribution," Mathematics, MDPI, vol. 10(24), pages 1-24, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kang-Ping Lu & Shao-Tung Chang, 2022. "Robust Switching Regressions Using the Laplace Distribution," Mathematics, MDPI, vol. 10(24), pages 1-24, December.
    2. Kang-Ping Lu & Shao-Tung Chang, 2023. "An Advanced Segmentation Approach to Piecewise Regression Models," Mathematics, MDPI, vol. 11(24), pages 1-23, December.
    3. Bill Russell & Dooruj Rambaccussing, 2019. "Breaks and the statistical process of inflation: the case of estimating the ‘modern’ long-run Phillips curve," Empirical Economics, Springer, vol. 56(5), pages 1455-1475, May.
    4. Lu Shaochuan, 2023. "Scalable Bayesian Multiple Changepoint Detection via Auxiliary Uniformisation," International Statistical Review, International Statistical Institute, vol. 91(1), pages 88-113, April.
    5. Holger Dette & Theresa Eckle & Mathias Vetter, 2020. "Multiscale change point detection for dependent data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1243-1274, December.
    6. Salvatore Fasola & Vito M. R. Muggeo & Helmut Küchenhoff, 2018. "A heuristic, iterative algorithm for change-point detection in abrupt change models," Computational Statistics, Springer, vol. 33(2), pages 997-1015, June.
    7. Pokojovy, Michael & Jobe, J. Marcus, 2022. "A robust deterministic affine-equivariant algorithm for multivariate location and scatter," Computational Statistics & Data Analysis, Elsevier, vol. 172(C).
    8. Michael Messer, 2022. "Bivariate change point detection: Joint detection of changes in expectation and variance," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(2), pages 886-916, June.
    9. Wu Wang & Xuming He & Zhongyi Zhu, 2020. "Statistical inference for multiple change‐point models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1149-1170, December.
    10. Davis, Richard A. & Hancock, Stacey A. & Yao, Yi-Ching, 2016. "On consistency of minimum description length model selection for piecewise autoregressions," Journal of Econometrics, Elsevier, vol. 194(2), pages 360-368.
    11. Fryzlewicz, Piotr, 2020. "Detecting possibly frequent change-points: Wild Binary Segmentation 2 and steepest-drop model selection," LSE Research Online Documents on Economics 103430, London School of Economics and Political Science, LSE Library.
    12. Marco Riani & Anthony C. Atkinson & Francesca Torti & Aldo Corbellini, 2022. "Robust correspondence analysis," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1381-1401, November.
    13. Andreas Anastasiou & Piotr Fryzlewicz, 2022. "Detecting multiple generalized change-points by isolating single ones," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(2), pages 141-174, February.
    14. Ardia, David & Dufays, Arnaud & Ordás Criado, Carlos, 2023. "Linking Frequentist and Bayesian Change-Point Methods," MPRA Paper 119486, University Library of Munich, Germany.
    15. Fissler Tobias & Ziegel Johanna F., 2021. "On the elicitability of range value at risk," Statistics & Risk Modeling, De Gruyter, vol. 38(1-2), pages 25-46, January.
    16. Stefan Albert & Michael Messer & Julia Schiemann & Jochen Roeper & Gaby Schneider, 2017. "Multi-Scale Detection of Variance Changes in Renewal Processes in the Presence of Rate Change Points," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(6), pages 1028-1052, November.
    17. Florian Pein & Hannes Sieling & Axel Munk, 2017. "Heterogeneous change point inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(4), pages 1207-1227, September.
    18. Gabriela Ciuperca & Zahraa Salloum, 2015. "Empirical likelihood test in a posteriori change-point nonlinear model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(8), pages 919-952, November.
    19. Claudia Kirch & Christina Stoehr, 2022. "Sequential change point tests based on U‐statistics," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(3), pages 1184-1214, September.
    20. Trevor Harris & Bo Li & J. Derek Tucker, 2022. "Scalable multiple changepoint detection for functional data sequences," Environmetrics, John Wiley & Sons, Ltd., vol. 33(2), March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:19:p:2394-:d:643407. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.