IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v50y2023i3p1466-1502.html

Outlier detection based on extreme value theory and applications

Author

Listed:
  • Shrijita Bhattacharya
  • Francois Kamper
  • Jan Beirlant

Abstract

Whether an extreme observation is an outlier or not depends strongly on the corresponding tail behavior of the underlying distribution. We develop an automatic, data‐driven method rooted in the mathematical theory of extremes to identify observations that deviate from the intermediate and central characteristics. The proposed algorithm is an extension of a method previously proposed in the literature for the specific case of heavy tailed Pareto‐type distributions to all max‐domains of attraction. We propose some applications such as a tail‐adjusted boxplot which yields a more accurate representation of possible outliers, and the identification of outliers in a multivariate context through an analysis of associated random variables such as local outlier factors. Several examples and simulation results illustrate the finite sample behavior of the algorithm and its applications.

Suggested Citation

  • Shrijita Bhattacharya & Francois Kamper & Jan Beirlant, 2023. "Outlier detection based on extreme value theory and applications," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 50(3), pages 1466-1502, September.
    • Handle: RePEc:bla:scjsta:v:50:y:2023:i:3:p:1466-1502
    DOI: 10.1111/sjos.12665
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/sjos.12665
    Download Restriction: no
    File URL: https://libkey.io/10.1111/sjos.12665?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hubert, M. & Vandervieren, E., 2008. "An adjusted boxplot for skewed distributions," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5186-5201, August.
    2. Vandewalle, B. & Beirlant, J. & Christmann, A. & Hubert, M., 2007. "A robust estimator for the tail index of Pareto-type distributions," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6252-6268, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hubert, Mia & Dierckx, Goedele & Vanpaemel, Dina, 2013. "Detecting influential data points for the Hill estimator in Pareto-type distributions," Computational Statistics & Data Analysis, Elsevier, vol. 65(C), pages 13-28.
    2. Asimit, Alexandru V. & Badescu, Alexandru M. & Verdonck, Tim, 2013. "Optimal risk transfer under quantile-based risk measurers," Insurance: Mathematics and Economics, Elsevier, vol. 53(1), pages 252-265.
    3. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2015. "Multivariate functional outlier detection," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 177-202, July.
    4. Birghila, Corina & Aigner, Maximilian & Engelke, Sebastian, 2025. "Distributionally robust tail bounds based on Wasserstein distance and f-divergence," Insurance: Mathematics and Economics, Elsevier, vol. 125(C).
    5. Chengping Gong & Chengxiu Ling, 2018. "Robust Estimations for the Tail Index of Weibull-Type Distribution," Risks, MDPI, vol. 6(4), pages 1-15, October.
    6. Nicodemo, Catia & Satorra, Albert, 2020. "Exploratory Data Analysis on Large Data Sets: The Example of Salary Variation in Spanish Social Security Data," IZA Discussion Papers 13459, IZA Network @ LISER.
    7. Gareth W. Peters & Matteo Malavasi & Georgy Sofronov & Pavel V. Shevchenko & Stefan Trück & Jiwook Jang, 2023. "Cyber loss model risk translates to premium mispricing and risk sensitivity," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 48(2), pages 372-433, April.
    8. Dierckx, Goedele & Goegebeur, Yuri & Guillou, Armelle, 2013. "An asymptotically unbiased minimum density power divergence estimator for the Pareto-tail index," Journal of Multivariate Analysis, Elsevier, vol. 121(C), pages 70-86.
    9. Warshaw, Evan, 2020. "Asymmetric volatility spillover between European equity and foreign exchange markets: Evidence from the frequency domain," International Review of Economics & Finance, Elsevier, vol. 68(C), pages 1-14.
    10. Aleix Alcacer & Irene Epifanio, 2024. "Outlier detection of clustered functional data with image and signal processing applications by archetype analysis," PLOS ONE, Public Library of Science, vol. 19(11), pages 1-23, November.
    11. Finger, Robert, 2012. "Biases in Farm-Level Yield Risk Analysis due to Data Aggregation," German Journal of Agricultural Economics, Humboldt-Universitaet zu Berlin, Department for Agricultural Economics, vol. 61(01), pages 1-14, February.
    12. Guillermo Vinue & Irene Epifanio, 2021. "Robust archetypoids for anomaly detection in big functional data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(2), pages 437-462, June.
    13. Frederico Caeiro & Ayana Mateus, 2023. "A New Class of Generalized Probability-Weighted Moment Estimators for the Pareto Distribution," Mathematics, MDPI, vol. 11(5), pages 1-17, February.
    14. Shirin Enshaeifar & Ahmed Zoha & Andreas Markides & Severin Skillman & Sahr Thomas Acton & Tarek Elsaleh & Masoud Hassanpour & Alireza Ahrabian & Mark Kenny & Stuart Klein & Helen Rostill & Ramin Nilf, 2018. "Health management and pattern analysis of daily living activities of people with dementia using in-home sensors and machine learning techniques," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-20, May.
    15. Fábio M. Bayer & Francisco Cribari‐Neto & Jéssica Santos, 2021. "Inflated Kumaraswamy regressions with application to water supply and sanitation in Brazil," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 75(4), pages 453-481, November.
    16. Mario A. Rojas & Yuri A. Iriarte, 2022. "A Lindley-Type Distribution for Modeling High-Kurtosis Data," Mathematics, MDPI, vol. 10(13), pages 1-19, June.
    17. Milan Stehlík & Rastislav Potocký & Helmut Waldl & Zdeněk Fabián, 2010. "On the favorable estimation for fitting heavy tailed data," Computational Statistics, Springer, vol. 25(3), pages 485-503, September.
    18. Maciej Kostrzewski & Jadwiga Kostrzewska, 2021. "The Impact of Forecasting Jumps on Forecasting Electricity Prices," Energies, MDPI, vol. 14(2), pages 1-17, January.
    19. Giovana Fumes-Ghantous & Silvia L. P. Ferrari & José Eduardo Corrente, 2018. "Box–Cox t random intercept model for estimating usual nutrient intake distributions," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(4), pages 715-734, December.
    20. Goegebeur, Yuri & Guillou, Armelle & Ho, Nguyen Khanh Le & Qin, Jing, 2020. "Robust nonparametric estimation of the conditional tail dependence coefficient," Journal of Multivariate Analysis, Elsevier, vol. 178(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:50:y:2023:i:3:p:1466-1502. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.