Multiple feature fusion‐based video face tracking for IoT big data

Abstract

With the advancement of Internet of Things (IoT) and artificial intelligence technologies, and the need for rapid application growth in fields, such as security entrance control and financial business trade, facial information processing has become an important means for achieving identity authentication and information security. However, in the process of acquiring facial feature information, face information is easily affected by factors, such as object occlusion, lighting changes, and similar backgrounds. In this paper, we propose a multifeature fusion algorithm based on integral histograms and a real-time update tracking particle filtering (PF) module. First, edge features and colour features are extracted, weighting methods are used to weight the colour histogram and edge features to describe facial features, and fusion of colour features and edge features is made adaptive by using fusion coefficients to improve face tracking reliability. Then, the integral histogram is integrated into the PF algorithm to simplify the calculation steps of complex particles and improve operational efficiency. Finally, the tracking window size is adjusted in real-time according to the change in the average distance from the particle centre to the edge of the current model and the initial model to reduce the drift problem and achieve stable tracking with significant changes in the target dimension. The results show that the algorithm improves video tracking accuracy, simplifies particle operation complexity, improves the speed, and has good anti-interference ability and robustness compared with extracting a single feature.