Various Platforms and Machine Learning Techniques for Big Data Analytics : A Technological Survey

Data is growing drastically more and more every day and it becomes difficult task to store, analyse and interpret this data. Big data is a term that describe large volumes of high velocity, complex and variable data that cannot be stored and processed using traditional approach. Big data analytics require advanced tools and techniques in order to capture, storage, distribution, management, and analysis the data. Because of the complexity and heterogeneity of big data, various data mining and machine learning techniques are being used for big data analytics in order to develop better expert systems of real-world problems. In this paper, we have surveyed the state-of-art analysis of various platforms (software as well as hardware) for big data analytics like Hadoop ecosystem, Spark, High performance clusters (HPC), Graphical Processing Unit (GPU), etc., which are together used to collect, store, process and analyse the big data. This paper also reinforces some machine learning techniques that must be taken in account while dealing with big data lifecycle.