Breaking Hardware Boundaries of IoT Devices via Inverse Feature Completion

Abstract

Privacy-preserving collaborative learning enables resource-constrained edge devices (e.g., Internet of Things (IoT) devices and smartphones) to build a knowledge-shared model while keeping individual data locally, achieving privacy preservation by designing an effective communication protocol. However, the learning paradigm raises high requirements for aligned input features of models, which is hard to realize in complicated IoT scenarios with various monitoring indicators. In this article, we propose a novel collaborative learning framework that is tolerant of IoT devices with unaligned feature spaces. Local bilevel optimizations for both model parameters and input features are performed iteratively in the training phase, in which the internal correlations of local sensor data provide additional guidance for the feature inference and completion. The scheme breaks hardware boundaries among various IoT devices in collaboration with the assistance of model inversion inference, which gains a new perspective on the utilization of model confidentiality and requires minimal modifications to the existing collaborative learning process. The framework achieves significant improvement compared with state-of-the-art methods, as we demonstrate through extensive simulations on real-world data sets.