HTME: A data streams processing strategy based on Hoeffding tree in MapReduce environment

Abstract

In recent years Wireless Sensor Networks have provided a effective solution for sensing and gathering spatial data by ZigBee protocol or other wireless network protocols. So the massive sensor data streams processing has reached many areas of monitoring application in internet of things. The sensor data streams constantly flow in and flow out of the monitoring system, cloud computing can provide a scalable storage and the massive data processing power to perform both online and offline analysis and mining of the heterogeneous sensor data streams. In order to support the classification of the sensor data streams, in this paper, a sensor data streams processing strategy is proposed based on Hoeffding tree algorithm for event monitoring application in cloud computing. The proposed strategy is sufficient for sensor data streams classification tasks using map-reduce platform of cloud computing. Finally, the possibilities of the strategy are demonstrated on spatial sensing data streams processing operations in comparison with existing solutions in the MapReduce environment. The simulation results show that the strategy achieves more energy savings and also ensures few amounts of sensor data retained in memory.