IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v167y2004i2p275-294.html
   My bibliography  Save this article

Multivariate outlier detection in incomplete survey data: the epidemic algorithm and transformed rank correlations

Author

Listed:
  • Cédric Béguin
  • Beat Hulliger

Abstract

Summary. As a part of the EUREDIT project new methods to detect multivariate outliers in incomplete survey data have been developed. These methods are the first to work with sampling weights and to be able to cope with missing values. Two of these methods are presented here. The epidemic algorithm simulates the propagation of a disease through a population and uses extreme infection times to find outlying observations. Transformed rank correlations are robust estimates of the centre and the scatter of the data. They use a geometric transformation that is based on the rank correlation matrix. The estimates are used to define a Mahalanobis distance that reveals outliers. The two methods are applied to a small data set and to one of the evaluation data sets of the EUREDIT project.

Suggested Citation

  • Cédric Béguin & Beat Hulliger, 2004. "Multivariate outlier detection in incomplete survey data: the epidemic algorithm and transformed rank correlations," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(2), pages 275-294, May.
    • Handle: RePEc:bla:jorssa:v:167:y:2004:i:2:p:275-294
    DOI: 10.1046/j.1467-985X.2003.00753.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1046/j.1467-985X.2003.00753.x
    Download Restriction: no
    File URL: https://libkey.io/10.1046/j.1467-985X.2003.00753.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Billor, Nedret & Hadi, Ali S. & Velleman, Paul F., 2000. "BACON: blocked adaptive computationally efficient outlier nominators," Computational Statistics & Data Analysis, Elsevier, vol. 34(3), pages 279-298, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Catherine Fuss & Angelos Theodorakopoulos, 2018. "Compositional Changes in Aggregate Productivity in an Era of Globalisation and Financial Crisis," Working Papers of VIVES - Research Centre for Regional Economics 627696, KU Leuven, Faculty of Economics and Business (FEB), VIVES - Research Centre for Regional Economics.
    2. L. Pitsoulis & G. Zioutas, 2010. "A fast algorithm for robust regression with penalised trimmed squares," Computational Statistics, Springer, vol. 25(4), pages 663-689, December.
    3. Cristian BARRA & Roberto ZOTTI, 2019. "Bank Performance, Financial Stability And Market Concentration: Evidence From Cooperative And Non‐Cooperative Banks," Annals of Public and Cooperative Economics, Wiley Blackwell, vol. 90(1), pages 103-139, March.
    4. Hong Choon Ong & Ekele Alih, 2015. "A Control Chart Based on Cluster-Regression Adjustment for Retrospective Monitoring of Individual Characteristics," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-30, April.
    5. Stefani, Gianluca & Gadanakis, Yiorgos & Lombardi, Ginevra Virginia & Tiberti, Marco, 2017. "The impact of financial leverage on farms capacity to react in market shocks," 2017 International Congress, August 28-September 1, 2017, Parma, Italy 261156, European Association of Agricultural Economists.
    6. Batalla-Bejerano, Joan & Costa-Campi, Maria Teresa & Trujillo-Baute, Elisa, 2016. "Collateral effects of liberalisation: Metering, losses, load profiles and cost settlement in Spain’s electricity system," Energy Policy, Elsevier, vol. 94(C), pages 421-431.
    7. A.A.M. Nurunnabi & M. Nasser & A.H.M.R. Imon, 2016. "Identification and classification of multiple outliers, high leverage points and influential observations in linear regression," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(3), pages 509-525, March.
    8. Jiří Schwarz & Martin Pospíšil, 2018. "Bankruptcy, Investment, and Financial Constraints: Evidence from the Czech Republic," Eastern European Economics, Taylor & Francis Journals, vol. 56(2), pages 99-121, March.
    9. AMENDOLA, Adalgiso & BARRA, Cristian & BOCCIA, Marinella & PAPACCIO, Anna, 2018. "Market Structure and Financial Stability: Theory and Evidence," CELPE Discussion Papers 156, CELPE - CEnter for Labor and Political Economics, University of Salerno, Italy.
    10. Fratianni, Michele & Marchionne, Francesco, 2017. "Bank asset reallocation and sovereign debt," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 47(C), pages 15-32.
    11. Sylvain Weber, 2010. "bacon: An effective way to detect outliers in multivariate data using Stata (and Mata)," Stata Journal, StataCorp LP, vol. 10(3), pages 331-338, September.
    12. Mele, Antonio & Paglialunga, Elena & Sforna, Giorgia, 2021. "Climate cooperation from Kyoto to Paris: What can be learnt from the CDM experience?," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    13. Sevvandi Kandanaarachchi & Mario A Munoz & Rob J Hyndman & Kate Smith-Miles, 2018. "On normalization and algorithm selection for unsupervised outlier detection," Monash Econometrics and Business Statistics Working Papers 16/18, Monash University, Department of Econometrics and Business Statistics.
    14. Balcazar Salazar,Carlos Felipe, 2015. "Long-run effects of democracy on income inequality : evidence from repeated cross-sections," Policy Research Working Paper Series 7153, The World Bank.
    15. Claude Diebolt & Audrey-Rose Menard & Faustine Perrin, 2016. "Behind the Fertility-Education Nexus: What Triggered the French Development Process?," Working Papers 03-16, Association Française de Cliométrie (AFC).
    16. Philippe Kabore & Nicholas Rivers, 2023. "Manufacturing output and extreme temperature: Evidence from Canada," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 56(1), pages 191-224, February.
    17. ShengLi Tzeng & Chi‐Wei Lai & Hsin‐Cheng Huang, 2023. "Spatially adaptive calibrations of airbox PM2.5 data," Biometrics, The International Biometric Society, vol. 79(4), pages 3637-3649, December.
    18. Basher, Syed Abul & Raboy, David G. & Kaitibie, Simeon & Hossain, Ishrat, 2012. "The economics of food security in Arab micro states: preliminary evidence from micro data," MPRA Paper 39357, University Library of Munich, Germany.
    19. Bozzola, Martina & Smale, Melinda, 2020. "The welfare effects of crop biodiversity as an adaptation to climate shocks in Kenya," World Development, Elsevier, vol. 135(C).
    20. M. Hubert & P. Rousseeuw & K. Vakili, 2014. "Shape bias of robust covariance estimators: an empirical study," Statistical Papers, Springer, vol. 55(1), pages 15-28, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:167:y:2004:i:2:p:275-294. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.