Resource-Aware Classification via Model Management Enabled Data Stream Optimization

Abstract

The integration of machine learning (ML) approaches in sensor-based applications in the field of pervasive computing is becoming increasingly prominent due to the increasing number of sensor-based applications in general and the continuous adaption of ML approaches to new domains. Several ML models are used within a processing pipeline that operates on the same sensor data. Still, the cloud computing approach is a straightforward solution where all sensor data is sent to the cloud before processing, which is inefficient according to resource utilization. Appropriate management of the different processing tasks for ML models enhances resource utilization.This paper proposes an architecture for resource-aware classification empowered by an ML model management (MLMM) framework and a distributed data stream management system (DDSMS). First, the classification pipeline is decomposed and implemented as data stream operators. Second, ML models are retrieved from an MLMM framework considering preprocessing, segmentation, and feature alignment to enable an effective redundancy elimination. Finally, the classification pipeline is deployed using resource-aware operator placement optimization. The evaluation results on a real-world scenario of a sensor-based activity classification pipeline for dairy cows show that our approach can reduce network utilization up to 98.9%.