A design of distributed storage and processing system for Internet of Vehicles

Abstract

With the explosion of vehicles, the concept of Internet of Vehicles (IoV) has drawn increasing concern among academics. The IoV refers to extracting and processing information from massive data which are gathering from vehicles and their surrounds. And an integrated IoV system which is reliable on data storage and efficient on data processing is indispensable. In this paper, we design a distributed storage and processing system depending on Hadoop, HBase and Spark to store and process IoV data. The system can overcome the single point of failure problem, guarantee the reliable data storage and meet the real-time computing requirements. We do thorough tests to evaluate the system performance based on practical IoV data of Fuzhou city. The results indicate that the system can satisfy the requirements of stable data storage and efficient data processing.