IDEAS home Printed from https://ideas.repec.org/p/tse/wpaper/129830.html

ICS for complex data with application to outlier detection for density data

Author

Listed:
  • Mondon, Camille
  • Trinh, Thi-Huong
  • Ruiz-Gazen, Anne
  • Thomas-Agnan, Christine

Abstract

Invariant coordinate selection (ICS) is a dimension reduction method, used as a preliminary step for clustering and outlier detection. It has been primarily applied to multivariate data. This work introduces a coordinate-free definition of ICS in an abstract Euclidean space and extends the method to complex data. Functional and distributional data are preprocessed into a finite-dimensional subspace. For example, in the framework of Bayes Hilbert spaces, distributional data are smoothed into compositional spline functions through the Maximum Penalised Likelihood method. We describe an outlier detection procedure for complex data and study the impact of some preprocessing parameters on the results. We compare our approach with other outlier detection methods through simulations, producing promising results in scenarios with a low proportion of outliers. ICS allows detecting abnormal climate events in a sample of daily maximum temperature distributions recorded across the provinces of Northern Vietnam between 1987 and 2016.

Suggested Citation

  • Mondon, Camille & Trinh, Thi-Huong & Ruiz-Gazen, Anne & Thomas-Agnan, Christine, 2024. "ICS for complex data with application to outlier detection for density data," TSE Working Papers 24-1585, Toulouse School of Economics (TSE), revised May 2025.
  • Handle: RePEc:tse:wpaper:129830
    as

    Download full text from publisher

    File URL: https://www.tse-fr.eu/sites/default/files/TSE/documents/doc/wp/2024/wp_tse_1585.pdf
    File Function: Working Paper Version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Archimbaud, Aurore & Nordhausen, Klaus & Ruiz-Gazen, Anne, 2018. "ICS for multivariate outlier detection with application to quality control," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 184-199.
    2. Tyler, David E., 2010. "A note on multivariate location and scatter statistics for sparse data sets," Statistics & Probability Letters, Elsevier, vol. 80(17-18), pages 1409-1413, September.
    3. Frédéric Ferraty & Philippe Vieu, 2002. "The Functional Nonparametric Model and Application to Spectrometric Data," Computational Statistics, Springer, vol. 17(4), pages 545-564, December.
    4. López-Pintado, Sara & Romo, Juan, 2009. "On the Concept of Depth for Functional Data," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 718-734.
    5. Nordhausen, Klaus & Ruiz-Gazen, Anne, 2022. "On the usage of joint diagonalization in multivariate statistics," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    6. Virta, Joni & Li, Bing & Nordhausen, Klaus & Oja, Hannu, 2020. "Independent component analysis for multivariate functional data," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    7. Loperfido, Nicola, 2021. "Some theoretical properties of two kurtosis matrices, with application to invariant coordinate selection," Journal of Multivariate Analysis, Elsevier, vol. 186(C).
    8. Jitka Machalová & Renáta Talská & Karel Hron & Aleš Gába, 2021. "Compositional splines for representation of density functions," Computational Statistics, Springer, vol. 36(2), pages 1031-1064, June.
    9. Aurore Archimbaud & Fériel Boulfani & Xavier Gendre & Klaus Nordhausen & Anne Ruiz-Gazen & Joni Virta, 2022. "ICS for multivariate functional anomaly detection with applications to predictive maintenance and quality control," Post-Print hal-03703244, HAL.
    10. Anne Ruiz-Gazen & Christine Thomas-Agnan & Thibault Laurent & Camille Mondon, 2023. "Detecting Outliers in Compositional Data Using Invariant Coordinate Selection," Springer Books, in: Mengxi Yi & Klaus Nordhausen (ed.), Robust and Multivariate Statistical Methods, pages 197-224, Springer.
    11. J. Machalová & K. Hron & G.S. Monti, 2016. "Preprocessing of centred logratio transformed density functions using smoothing splines," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(8), pages 1419-1435, June.
    12. David E. Tyler & Frank Critchley & Lutz Dümbgen & Hannu Oja, 2009. "Invariant co‐ordinate selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(3), pages 549-592, June.
    13. Oluwasegun Taiwo Ojo & Antonio Fernández Anta & Rosa E. Lillo & Carlo Sguera, 2022. "Detecting and classifying outliers in big functional data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(3), pages 725-760, September.
    14. Trinh, Thi-Huong & Thomas-Agnan, Christine & Simioni, Michel, 2023. "Scalar-on-distribution regression for assessing the impact of climate change on rice yield in Vietnam," TSE Working Papers 23-1410, Toulouse School of Economics (TSE), revised Dec 2025.
    15. Aurore Archimbaud & Zlatko Drmac & Klaus Nordhausen & Una Radojicic & Anne Ruiz-Gazen, 2023. "Numerical Considerations and a New Implementation for Invariant Coordinate Selection," Post-Print hal-04038657, HAL.
    16. Archimbaud, Aurore & Boulfani, Feriel & Gendre, Xavier & Nordhausen, Klaus & Ruiz-Gazen, Anne & Virta, Joni, 2025. "ICS for multivariate functional anomaly detection with applications to predictive maintenance and quality control," Econometrics and Statistics, Elsevier, vol. 33(C), pages 282-303.
    17. Dai, Wenlin & Mrkvička, Tomáš & Sun, Ying & Genton, Marc G., 2020. "Functional outlier detection and taxonomy by sequential transformations," Computational Statistics & Data Analysis, Elsevier, vol. 149(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Becquart, Colombe & Archimbaud, Aurore & Ruiz-Gazen, Anne & Prilć, Luka & Nordhausen, Klaus, 2026. "Invariant Coordinate Selection and Fisher discriminant subspace beyond the case of two groups," Journal of Multivariate Analysis, Elsevier, vol. 211(C).
    2. Archimbaud, Aurore, 2026. "Generalized implementation of invariant coordinate selection with positive semi-definite scatter matrices," Journal of Multivariate Analysis, Elsevier, vol. 211(C).
    3. Archimbaud, Aurore & Boulfani, Feriel & Gendre, Xavier & Nordhausen, Klaus & Ruiz-Gazen, Anne & Virta, Joni, 2025. "ICS for multivariate functional anomaly detection with applications to predictive maintenance and quality control," Econometrics and Statistics, Elsevier, vol. 33(C), pages 282-303.
    4. Nordhausen, Klaus & Ruiz-Gazen, Anne, 2022. "On the usage of joint diagonalization in multivariate statistics," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    5. Anne Ruiz-Gazen & Christine Thomas-Agnan & Thibault Laurent & Camille Mondon, 2023. "Detecting Outliers in Compositional Data Using Invariant Coordinate Selection," Springer Books, in: Mengxi Yi & Klaus Nordhausen (ed.), Robust and Multivariate Statistical Methods, pages 197-224, Springer.
    6. Zhuo Qu & Wenlin Dai & Carolina Euan & Ying Sun & Marc G. Genton, 2025. "Rejoinder to the discussion on “Exploratory Functional Data Analysis”," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 34(2), pages 502-507, June.
    7. Ojo, Oluwasegun Taiwo & Fernández Anta, Antonio & Genton, Marc G. & Lillo Rodríguez, Rosa Elvira, 2022. "Multivariate Functional Outlier Detection using the FastMUOD Indices," DES - Working Papers. Statistics and Econometrics. WS 35665, Universidad Carlos III de Madrid. Departamento de Estadística.
    8. Trinh, Thi-Huong & Thomas-Agnan, Christine & Simioni, Michel, 2023. "Scalar-on-distribution regression for assessing the impact of climate change on rice yield in Vietnam," TSE Working Papers 23-1410, Toulouse School of Economics (TSE), revised Dec 2025.
    9. Terrén-Serrano, Guillermo & Ludkovski, Michael, 2025. "Extreme day-ahead renewables scenario selection in power grid operations," Applied Energy, Elsevier, vol. 391(C).
    10. Loperfido, Nicola, 2021. "Some theoretical properties of two kurtosis matrices, with application to invariant coordinate selection," Journal of Multivariate Analysis, Elsevier, vol. 186(C).
    11. Fabrizio Maturo & Annamaria Porreca, 2026. "Environmental Loss Assessment via Functional Outlier Detection of Transformed Biodiversity Profiles," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 31(1), pages 176-197, March.
    12. Cristian F. Jiménez‐Varón & Fouzi Harrou & Ying Sun, 2024. "Pointwise data depth for univariate and multivariate functional outlier detection," Environmetrics, John Wiley & Sons, Ltd., vol. 35(5), August.
    13. Ortiz, Santiago & Laniado, Henry & Peña, Daniel & Prieto, Francisco J., 2026. "Dimension reduction for outlier detection in high-dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 211(C).
    14. Loperfido, Nicola, 2026. "Star products and dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 211(C).
    15. Radojičić, Una & Nordhausen, Klaus & Virta, Joni, 2026. "Unsupervised linear discrimination using skewness," Journal of Multivariate Analysis, Elsevier, vol. 211(C).
    16. Oluwasegun Taiwo Ojo & Antonio Fernández Anta & Rosa E. Lillo & Carlo Sguera, 2022. "Detecting and classifying outliers in big functional data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(3), pages 725-760, September.
    17. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2015. "Multivariate functional outlier detection," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 177-202, July.
    18. Francesca Ieva & Anna Paganoni, 2015. "Discussion of “multivariate functional outlier detection” by M. Hubert, P. Rousseeuw and P. Segaert," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 217-221, July.
    19. Crespo, Luis G. & Stanford, Bret K. & Alexandrov, Natalia, 2026. "A data-driven approach to risk-aware robust design," Reliability Engineering and System Safety, Elsevier, vol. 265(PB).
    20. Daniel Kosiorowski & Dominik Mielczarek & Jerzy. P. Rydlewski, 2017. "Forecasting of a Hierarchical Functional Time Series on Example of Macromodel for Day and Night Air Pollution in Silesia Region: A Critical Overview," Papers 1712.03797, arXiv.org.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tse:wpaper:129830. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/tsetofr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.