IDEAS home Printed from https://ideas.repec.org/a/apb/japsss/2019p30-36.html
   My bibliography  Save this article

A distributed intrusion detection system based on apache spark and scikit-learn library

Author

Listed:
  • Mohamed Seghire Othman Djediden

    (Laboratoire SIMPA, Universite des Sciences et de la Technologie d'Oran Mohamed Boudiaf, USTO-MB, Oran, Algeria)

  • Hicham Reguieg

    (Laboratoire SIMPA, Universite des Sciences et de la Technologie d'Oran Mohamed Boudiaf, USTO-MB, Oran, Algeria)

  • Zoulikha Mekkakia Maaza

    (Laboratoire SIMPA, Universite des Sciences et de la Technologie d'Oran Mohamed Boudiaf, USTO-MB, Oran, Algeria)

Abstract

With the great explosion of data generated in computer networks. The main task of Intrusion Detection Systems (IDS) has become more complicated. Most of the existing IDS are deployed on a single server and do not support the distributed processing. These systems encountered several problems as soon as the volume of the data to be analysed is larger and more varied. The main goal of this paper is to create an intrusion detection system that can analyse massive data quickly with great precision while supporting distributed data processing. This type of data processing assures that our system will be more available and fault-tolerant. In our work, we have combined the Apache Spark framework with known feature selection methods and machine learning algorithms from the improved Sickit-learn library called Sk-dist. The UNSW-NB15 dataset was used to assess the performance of our system. The results of comparisons made with other existing work have shown that our approach is much better in terms of accuracy, reduction of features and above all fault tolerance

Suggested Citation

  • Mohamed Seghire Othman Djediden & Hicham Reguieg & Zoulikha Mekkakia Maaza, 2019. "A distributed intrusion detection system based on apache spark and scikit-learn library," Journal of Applied and Physical Sciences, Prof. Vakhrushev Alexander, vol. 5(1), pages 30-36.
    • Handle: RePEc:apb:japsss:2019:p:30-36
    DOI: 10.20474/japs-5.1.4
    as

    Download full text from publisher

    File URL: https://tafpublications.com/platform/Articles/full-japs5.1.4.php
    Download Restriction: no
    File URL: https://tafpublications.com/gip_content/paper/Japs-5.1.4.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.20474/japs-5.1.4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ali Hakem Al-Saeedi & OÄŸuz Altun, 2016. "Binary mean-variance mapping optimization algorithm (BMVMO)," Journal of Applied and Physical Sciences, Prof. Vakhrushev Alexander, vol. 2(2), pages 42-47.
    2. Harnedi Maizir & Reni Suryanita & Hendra Jingga, 2016. "Estimation of Pile Bearing Capacity of Single Driven Pile in Sandy Soil Using Finite Element and Artificial Neural Network Methods," International Journal of Applied and Physical Sciences, Dr K.Vivehananthan, vol. 2(2), pages 45-50.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. G. Turkoglu Demirkol & M. S. Ozcoban & N. Tufekci, 2017. "Removal rate of compacted clay soil in the batch and continuous reactors and its permeability," Journal of Advances in Technology and Engineering Research, A/Professor Akbar A. Khatibi, vol. 3(5), pages 176-183.
    2. Reni Suryanita & Harnedi Maizir & Hendra Jingga, 2017. "Prediction of Structural Response Based on Ground Acceleration Using Artificial Neural Networks," International Journal of Technology and Engineering Studies, PROF.IR.DR.Mohid Jailani Mohd Nor, vol. 3(2), pages 74-83.
    3. Ramcis N. Vilchez, 2019. "Bidirectional Enhanced Selection Sort Algorithm Technique," International Journal of Applied and Physical Sciences, Dr K.Vivehananthan, vol. 5(1), pages 28-35.
    4. Savkovic B. & Kovac P. & Mankova I. & Gostimirovic M. & Rokosz K. & Rodic D., 2017. "Surface roughness modeling of semi solid aluminum milling by fuzzy logic," Journal of Advances in Technology and Engineering Research, A/Professor Akbar A. Khatibi, vol. 3(2), pages 34-46.
    5. Panova Elena & Oleynikova Galina, 2018. "Information Resources of Soil Nanoparticles Chemistry," International Journal of Applied and Physical Sciences, Dr K.Vivehananthan, vol. 4(2), pages 45-49.
    6. Jiahui Chen, 2018. "The Application of tree-based ML algorithm in steel plates Ffaults identification," Journal of Applied and Physical Sciences, Prof. Vakhrushev Alexander, vol. 4(2), pages 47-54.
    7. Latief Mahir Rachman, 2018. "Technical development to assess soil health using soil health index in Indonesia," Journal of Applied and Physical Sciences, Prof. Vakhrushev Alexander, vol. 4(3), pages 79-85.
    8. Mohd. Ahmed & Saeed AlQadhi & Javed Mallick & Nabil Ben Kahla & Hoang Anh Le & Chander Kumar Singh & Hoang Thi Hang, 2022. "Artificial Neural Networks for Sustainable Development of the Construction Industry," Sustainability, MDPI, vol. 14(22), pages 1-21, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:apb:japsss:2019:p:30-36. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Prof. Vakhrushev Alexander (email available below). General contact details of provider: https://tafpublications.com/platform/published_papers/11 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.