Machine learning algorithms for Big Data analytics including deep learning

Abstract

Owing to recent development in technology, major changes have been noticed in human being's life. Today's lives of human being are becoming more convenient (i.e., in terms of living standard). In current real-world applications, we have shifted our attention from wired devices to wireless devices. As a result, we moved into the era of smart technology, where a lot of Internet devices are connected together in a distributed and decentralized manner. Such Internet-connected devices (ICDs) or Internet of Things (IoTs) engender tremendous data (i.e., via communicating other smart devices). With the tremendous increase in the amount of data, there is a higher requirement to process this huge amount of data (generated through billions of ICDs) using efficient machine learning (ML) algorithms.In the past decade, we refer data mining algorithms to make some decision from collected data-sets. But, due to increasing data on a large scale, data mining fail to handle this data. So, as substitute of data mining algorithms and to refine this information in an efficient manner, we require tradition analytics algorithms, i.e., ML or data mining algorithms. In current scenario, some of the ML algorithms (available to analysis this data) are supervised (used with labeled data), unsupervised (used with unlabelled data) and semi-supervised (work as reward-based learning). Supervised learning algorithms are like linear regression, classification and k-nearest neighbor (KNN), etc. Whereas, unsupervised learning algorithms are clustering, k-means, etc. In general, ML focuses on building the systems that learn and hence improves with the knowledge and experience. Being the heart of artificial intelligence (AI) and data science, ML is gaining popularity day by day. Several algorithms have already been developed (in the past decade) for processing of data, although this field focuses on developing new learning algorithm for big data computability with minimum complexity (i.e., in terms of time and space). ML algorithms are not only applicable to computer science field but also extend to medical, psychological, marketing, manufacturing, automobile, etc.On another side, Big Data including deep learning are the two primary and highly demandable fields of data science. A subset of ML, computer vision or AI, deep learning is used here. The large (or massive) amount of data related to a specific domain which forms Big Data (in form of 5 V's like velocity, volume, value, variety, and veracity) contains valuable information related to various fields like marketing, automobile, finance, cyber security, medical, fraud detection, etc. Such real-world applications are creating a lot of information every day. The valuable (i.e., needful or meaningful) information are required to be processed (or retrieved) from analysis of this unstructured/ large amount of data for further processing of the data for future use (or for prediction). Big organizations have to accord with the tremendous volume of data for prediction, classification, decision making, etc. The use of ML algorithms for big data analytics, which extracts the high-level semantics from the valuable (meaningful) information form the data. It uses hierarchical process for efficient processing and retrieving the complex abstraction from the data.Hence, this chapter discusses several algorithms of ML, to analysis of Big Data. Also, the subset AI like ML algorithms, deep learning algorithms are being discussed here (i.e., to analysis this Big Data for efficient prediction). Later, this chapter focuses on benefits of ML, deep learning algorithms in analyzing tremendous volume of data (i.e., in unsupervised or unstructured form) for numerous complex problems like information retrieval, medical diagnosis, cognitive science, indexing using semantic analysis, data tagging, speech recognition, natural language processing, etc. Also, weakness, raised issues, and challenges (during analysis big data) using (in) ML or deep learning have been discussed in detail. In other words, research gaps in using ML, deep learning algorithms for big data will also be discussed (covering future research aspects/trends). Finally, this chapter discusses the significance of the smart era, computational intelligence, and AI in depth.