FusedAR: Energy-Positive Human Activity Recognition Using Kinetic and Solar Signal Fusion

Abstract

Today’s wearable Internet of Things (IoT) devices, which have been fêted for numerous applications, suffer from the limited lifetime of batteries due to the high power consumption of conventional inertial activity sensors. Recently, kinetic energy harvesters have been employed as a source of energy as well as context information to replace conventional activity sensors. However, the harvested power from human movements using miniaturised kinetic transducers may not be sufficient to enable a perpetual and self-powered activity recognition system. In this paper, we propose a novel mechanism of Fused signal based human Activity Recognition (FusedAR), which employs miniaturised wearable solar and kinetic energy harvesters simultaneously as an energy source as well as an activity sensor. As human activities engender distinct movement patterns, and interact and interfere with the ambient light differently, the kinetic and solar energy harvesting signals incorporate unique information about the underlying activities while generating sufficient power. After detailed experiments, we find that FusedAR which employs both solar and kinetic energy signals, achieves superior activity recognition performance by up to 10%, particularly in outdoor and night-time contexts, and can recognise not only activities but also contexts, compared to the individual energy harvesting signals. Furthermore, our analysis demonstrates that FusedAR, in addition to significant energy generation, consumes up to 22% less power than the highly optimised conventional 3-axis accelerometer-based mechanisms, achieving energy-positive human activity recognition leading towards perpetual, uninterrupted and autonomous operation of wearable IoT devices.