Skeleton-Based Human Activity Recognition by Spatio-Temporal Representation and Convolutional Neural Networks with application to Cyber Physical Systems with Human in the Loop

Abstract

The developments in Cyber-physical systems where smart computers that can sense and understand human behavior will have enormous societal and economic impact facilitating various services in critical infrastructure and everyday life. CPS with Human in the Loop is a system that takes human response into consideration and human presence and behavior are key parts of the system. So these architectures of smart devices will need to interpret human action in real-time and predict humans' immediate intention in complex, noisy and cluttered environments. One of the main goals of researchers will be the development of CPS that can understand complex human activities. In this paper we propose a novel skeleton-based approach utilizing spatio-temporal information and convolutional neural networks for classification of human activities.