RTID: On-demand real-time data processing for IoT network

Abstract

Internet of Things (IoT) solutions that can sense and actuate based on user commands have been around for a while. Modern IoT systems should be smart enough to sense their environment and actuate based on the data received. Since IoT systems accumulate a huge volume of Real-Time data, it gives rise to various challenges including Big Data. The traditional approach such as conventional 6LoWPAN (IPv6 over Low-Power Wireless Personal Area Networks), and IoT with Cloud system (CCS) does not provide full flexible and efficient data management capability. In this paper, a modern IoT system namely RTID is proposed that can overcome some of the limitations of the existing 6LoWPAN and CCS network architectures. To overcome the processing of huge volume of real-time data, RTID framework is coupled with Apache Spark. The proposed RTID framework ensures that the IoT system is not downgraded by real-time IoT data by processing historical data in micro-batches and extracting meaningful pieces of information for the IoT system to actuate upon. Moreover, the proposed RTID framework uses industrial standard REST-API and OAuth 2.0 to provide secure access to the system. This additional features provides RTID framework to overcome the issue of providing secure transmission of data between the gateway and the cloud. Furthermore, this paper also presents some of the future research scopes that can improve the overall performance of the existing IoT system.