Simultaneous and fast 3D tracking of multiple faces in video by GPU-based stream processing

Abstract

In this work, we implement a real-time visual tracker that targets the position and 3D pose of objects in video sequences, specifically faces. Using stream processors for performing the computations as well as efficient sparse-template-based particle filtering allows us to achieve real-time processing even when tracking multiple objects simultaneously in high- resolution video frames. Stream processing is a relatively new computing paradigm that permits the expression and execution of data-parallel algorithms with great efficiency and minimum effort. Using a GPU (graphics processing unit, a consumer-grade stream processor) and the NVIDIA CUDAtrade technology, we can achieve real-time performance even when tracking multiple objects in high-quality videos.