IDEAS home Printed from https://ideas.repec.org/p/tse/wpaper/125186.html
   My bibliography  Save this paper

ICS for multivariate functional anomaly detection with applications to predictive maintenance and quality control

Author

Listed:
  • Archimbaud, Aurore
  • Boulfani, Fériel
  • Gendre, Xavier
  • Nordhausen, Klaus
  • Ruiz-Gazen, Anne
  • Virta, Joni

Abstract

Multivariate functional anomaly detection has received a large amount of attention recently. Accounting both the time dimension and the correlations between variables is challenging due to the existence of different types of outliers and the dimension of the data. Most of the existing methods focus on a small number of variables. In the context of predictive maintenance and quality control however, data sets often contain a large number of functional variables. Moreover, in fields that have high reliability standards, detecting a small number of potential multivariate functional outliers with as few false positives as possible is crucial. In such a context, the adaptation of the Invariant Component Selection (ICS) method from the multivariate to the multivariate functional case is of particular interest. Two extensions of ICS are proposed: point-wise and global. For both methods, the choice of the relevant components together with outlier identification and interpretation are discussed. A comparison is made on a predictive maintenance example from the avionics field and a quality control example from the microelectronics field. It appears that in such a context, point-wise and global ICS with a small number of selected components are complementary and can be recommended.

Suggested Citation

  • Archimbaud, Aurore & Boulfani, Fériel & Gendre, Xavier & Nordhausen, Klaus & Ruiz-Gazen, Anne & Virta, Joni, 2021. "ICS for multivariate functional anomaly detection with applications to predictive maintenance and quality control," TSE Working Papers 21-1182, Toulouse School of Economics (TSE), revised Mar 2022.
  • Handle: RePEc:tse:wpaper:125186
    as

    Download full text from publisher

    File URL: https://www.tse-fr.eu/sites/default/files/TSE/documents/doc/wp/2021/wp_tse_1182.pdf
    File Function: Full Text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Tucker, J. Derek & Wu, Wei & Srivastava, Anuj, 2013. "Generative models for functional data using phase and amplitude separation," Computational Statistics & Data Analysis, Elsevier, vol. 61(C), pages 50-66.
    2. Febrero-Bande, Manuel & de la Fuente, Manuel Oviedo, 2012. "Statistical Computing in Functional Data Analysis: The R Package fda.usc," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 51(i04).
    3. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2015. "Multivariate functional outlier detection," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 177-202, July.
    4. Laura Millán-Roures & Irene Epifanio & Vicente Martínez, 2018. "Detection of Anomalies in Water Networks by Functional Data Analysis," Mathematical Problems in Engineering, Hindawi, vol. 2018, pages 1-13, June.
    5. Nordhausen, Klaus & Ruiz-Gazen, Anne, 2022. "On the usage of joint diagonalization in multivariate statistics," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    6. David E. Tyler & Frank Critchley & Lutz Dümbgen & Hannu Oja, 2009. "Invariant co‐ordinate selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(3), pages 549-592, June.
    7. Kuhnt, Sonja & Rehage, André, 2016. "An angle-based multivariate functional pseudo-depth for shape outlier detection," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 325-340.
    8. Ilmonen, Pauliina & Nevalainen, Jaakko & Oja, Hannu, 2010. "Characteristics of multivariate distributions and the invariant coordinate system," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1844-1853, December.
    9. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2015. "Rejoinder to ‘multivariate functional outlier detection’," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 269-277, July.
    10. Dai, Wenlin & Mrkvička, Tomáš & Sun, Ying & Genton, Marc G., 2020. "Functional outlier detection and taxonomy by sequential transformations," Computational Statistics & Data Analysis, Elsevier, vol. 149(C).
    11. Archimbaud, Aurore & Nordhausen, Klaus & Ruiz-Gazen, Anne, 2018. "ICS for multivariate outlier detection with application to quality control," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 184-199.
    12. Jarry, Gabriel & Delahaye, Daniel & Nicol, Florence & Feron, Eric, 2020. "Aircraft atypical approach detection using functional principal component analysis," Journal of Air Transport Management, Elsevier, vol. 84(C).
    13. Virta, Joni & Li, Bing & Nordhausen, Klaus & Oja, Hannu, 2020. "Independent component analysis for multivariate functional data," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    14. Nordhausen, Klaus & Oja, Hannu & Tyler, David E., 2022. "Asymptotic and bootstrap tests for subspace dimension," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    15. Pallavi Sawant & Nedret Billor & Hyejin Shin, 2012. "Functional outlier detection with robust functional principal component analysis," Computational Statistics, Springer, vol. 27(1), pages 83-102, March.
    16. Klaus Nordhausen & David E. Tyler, 2015. "A cautionary note on robust covariance plug-in methods," Biometrika, Biometrika Trust, vol. 102(3), pages 573-588.
    17. Dai, Wenlin & Genton, Marc G., 2019. "Directional outlyingness for multivariate functional data," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 50-65.
    18. Kokoszka, Piotr & Oja, Hanny & Park, Byeong & Sangalli, Laura, 2017. "Special issue on functional data analysis," Econometrics and Statistics, Elsevier, vol. 1(C), pages 99-100.
    19. Clara Happ & Sonja Greven, 2018. "Multivariate Functional Principal Component Analysis for Data Observed on Different (Dimensional) Domains," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 649-659, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Thomas-Agnan, Christine & Mondon, Camille & Trinh, Thi-Huong & Ruiz-Gazen, Anne, 2024. "ICS for complex data with application to outlier detection for density data," TSE Working Papers 24-1585, Toulouse School of Economics (TSE), revised May 2025.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moritz Herrmann & Fabian Scheipl, 2021. "A Geometric Perspective on Functional Outlier Detection," Stats, MDPI, vol. 4(4), pages 1-41, November.
    2. Ojo, Oluwasegun Taiwo & Fernández Anta, Antonio & Genton, Marc G. & Lillo Rodríguez, Rosa Elvira, 2022. "Multivariate Functional Outlier Detection using the FastMUOD Indices," DES - Working Papers. Statistics and Econometrics. WS 35665, Universidad Carlos III de Madrid. Departamento de Estadística.
    3. Dai, Wenlin & Mrkvička, Tomáš & Sun, Ying & Genton, Marc G., 2020. "Functional outlier detection and taxonomy by sequential transformations," Computational Statistics & Data Analysis, Elsevier, vol. 149(C).
    4. Thomas-Agnan, Christine & Mondon, Camille & Trinh, Thi-Huong & Ruiz-Gazen, Anne, 2024. "ICS for complex data with application to outlier detection for density data," TSE Working Papers 24-1585, Toulouse School of Economics (TSE), revised May 2025.
    5. Boente, Graciela & Parada, Daniela, 2023. "Robust estimation for functional quadratic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    6. Nordhausen, Klaus & Ruiz-Gazen, Anne, 2022. "On the usage of joint diagonalization in multivariate statistics," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    7. Oluwasegun Taiwo Ojo & Antonio Fernández Anta & Rosa E. Lillo & Carlo Sguera, 2022. "Detecting and classifying outliers in big functional data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(3), pages 725-760, September.
    8. Ruiz-Gazen, Anne & Thomas-Agnan, Christine & Laurent, Thibault & Mondon, Camille, 2022. "Detecting outliers in compositional data using Invariant Coordinate Selection," TSE Working Papers 22-1320, Toulouse School of Economics (TSE).
    9. Qiu, Zhiping & Fan, Jiangyuan & Zhang, Jin-Ting & Chen, Jianwei, 2024. "Tests for equality of several covariance matrix functions for multivariate functional data," Journal of Multivariate Analysis, Elsevier, vol. 199(C).
    10. Guillermo Vinue & Irene Epifanio, 2021. "Robust archetypoids for anomaly detection in big functional data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(2), pages 437-462, June.
    11. Cristian F. Jiménez‐Varón & Fouzi Harrou & Ying Sun, 2024. "Pointwise data depth for univariate and multivariate functional outlier detection," Environmetrics, John Wiley & Sons, Ltd., vol. 35(5), August.
    12. Jorge R. Sosa Donoso & Miguel Flores & Salvador Naya & Javier Tarrío-Saavedra, 2023. "Local Correlation Integral Approach for Anomaly Detection Using Functional Data," Mathematics, MDPI, vol. 11(4), pages 1-18, February.
    13. Qiu, Zhiping & Chen, Jianwei & Zhang, Jin-Ting, 2021. "Two-sample tests for multivariate functional data with applications," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    14. Fabrizio Maturo & Francesca Fortuna & Tonio Di Battista, 2024. "Outliers detection in assessment tests’ quality evaluation through the blended use of functional data analysis and item response theory," Annals of Operations Research, Springer, vol. 342(3), pages 1547-1562, November.
    15. Łukasz Smaga & Hidetoshi Matsui, 2018. "A note on variable selection in functional regression via random subspace method," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(3), pages 455-477, August.
    16. Virta, Joni & Li, Bing & Nordhausen, Klaus & Oja, Hannu, 2020. "Independent component analysis for multivariate functional data," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    17. Kyunghee Han & Pantelis Z Hadjipantelis & Jane-Ling Wang & Michael S Kramer & Seungmi Yang & Richard M Martin & Hans-Georg Müller, 2018. "Functional principal component analysis for identifying multivariate patterns and archetypes of growth, and their association with long-term cognitive development," PLOS ONE, Public Library of Science, vol. 13(11), pages 1-18, November.
    18. Graciela Boente & Matías Salibián-Barrera, 2021. "Robust functional principal components for sparse longitudinal data," METRON, Springer;Sapienza Università di Roma, vol. 79(2), pages 159-188, August.
    19. Weiyi Xie & Sebastian Kurtek & Karthik Bharath & Ying Sun, 2017. "A Geometric Approach to Visualization of Variability in Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 979-993, July.
    20. Amovin-Assagba, Martial & Gannaz, Irène & Jacques, Julien, 2022. "Outlier detection in multivariate functional data through a contaminated mixture model," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tse:wpaper:125186. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/tsetofr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.