Surveillance Recognition Research Articles

Gait Energy Image-Based Human Attribute Recognition Using Two-Branch Deep Convolutional Neural Network

Gait is an attractive biometric identifier, playing an essential role in addressing the issue of identity and attribute recognition in surveillance for its non-invasive and non-cooperative features. In this study, we propose a two-branch deep convolutional neural network for gait-based attribute recognition, including age estimation and gender recognition. We improve the estimation module by predicting a joint distribution instead of two independent distributions. In addition, several improvements are also proposed for improving the final performance of human attribute recognition, including data augmentation methods and loss functions. We implement several gait-based attribute recognition experiments on the OULP-Age and OU-MVLP datasets. Experimental results show that the proposed method outperforms existing approaches. Finally, we elicit different body regions’ contributions on attribute recognition tasks. Our conclusions can help improve the robustness of gait-based human attribute recognition systems in future.

Cascaded Split-and-Aggregate Learning with Feature Recombination for Pedestrian Attribute Recognition

Multi-label pedestrian attribute recognition in surveillance is inherently a challenging task due to poor imaging quality, large pose variations, and so on. In this paper, we improve its performance from the following two aspects: (1) We propose a cascaded Split-and-Aggregate Learning (SAL) to capture both the individuality and commonality for all attributes, with one at the feature map level and the other at the feature vector level. For the former, we split the features of each attribute by using a designed attribute-specific attention module (ASAM). For the later, the split features for each attribute are learned by using constrained losses. In both modules, the split features are aggregated by using several convolutional or fully connected layers. (2) We propose a Feature Recombination (FR) that conducts a random shuffle based on the split features over a batch of samples to synthesize more training samples, which spans the potential samples’ variability. To the end, we formulate a unified framework, named CAScaded Split-and-Aggregate Learning with Feature Recombination (CAS-SAL-FR), to learn the above modules jointly and concurrently. Experiments on five popular benchmarks, including RAP, PA-100K, PETA, Market-1501 and Duke attribute datasets, show the proposed CAS-SAL-FR achieves new state-of-the-art performance.

Visual-Semantic Graph Reasoning for Pedestrian Attribute Recognition

Pedestrian attribute recognition in surveillance is a challenging task due to poor image quality, significant appearance variations and diverse spatial distribution of different attributes. This paper treats pedestrian attribute recognition as a sequential attribute prediction problem and proposes a novel visual-semantic graph reasoning framework to address this problem. Our framework contains a spatial graph and a directed semantic graph. By performing reasoning using the Graph Convolutional Network (GCN), one graph captures spatial relations between regions and the other learns potential semantic relations between attributes. An end-to-end architecture is presented to perform mutual embedding between these two graphs to guide the relational learning for each other. We verify the proposed framework on three large scale pedestrian attribute datasets including PETA, RAP, and PA100k. Experiments show superiority of the proposed method over state-of-the-art methods and effectiveness of our joint GCN structures for sequential attribute prediction.

A Learning Framework for Target Detection and Human Face Recognition in Real Time

Inspired by the function, mechanism and efficiency of the visual nerve system of human beings, a revolutionary detection and reorganization method named YOLO is present to provide an accurate, stable and fast arithmetic for a variety of targets, be it target detection for unmanned vehicle, car license recognition and optimization for surveillance. The traditional method for object detection is to reuse the classifier to implement detection, in contrast, the method named YOLOV2 process this problem by considering it in the mathematical area as a regression of spatially discrete bordered areas and relative class probability. However, as a cost of stable and fast response of this arithmetic, inaccurate detection maybe caused by YOLOV2 when the detected object is tiny (e.g., face recognition in surveillance). In this article, the authors provide a new method to further improve the performance of YOLOV2 by utilizing the accurate, stable and fast properties of YOLOV2 and editing the original code of YOLOV2 to eliminate the inaccuracy of tiny object detection, and implement this method on an embedded system.

Face super-resolution reconstruction and recognition using non-local similarity dictionary learning based algorithm

One of the challenges of face recognition in surveillance is the low resolution of face region. Therefore many superresolution (SR) face reconstruction methods are proposed to produce a high-resolution face image from one or a set of low-resolution face images. However, existing dictionary learning based algorithms are sensitive to noise and very time-consuming. In this paper, we define and prove the multi-scale linear combination consistency. In order to improve the performance of SR, we propose a novel SR face reconstruction method based on nonlocal similarity and multi-scale linear combination consistency (NLS-MLC). We further proposed a new recognition approach for very low resolution face images based on resolution scale invariant feature (RSIF). A series of experiments are conducted on two public face image databases to test feasibility of our proposed methods. Experimental results show that the proposed SR method is more robust and computationally effective in face hallucination, and the recognition accuracy of RSIF is higher than some state-of-art algorithms.

Hybrid human detection and recognition in surveillance

In this paper, we present a hybrid human recognition system for surveillance. A Cascade Head–Shoulder Detector (CHSD) with human body model is proposed to find the face region in a surveillance video frame image. The CHSD is a chain of rejecters which combines the advantages of Haar-like feature and HoG feature to make the detector more efficient and effective. For human recognition, we introduce an Overlapping Local Phase Feature (OLPF) to describe the face region, which can improve the robustness to pose change and blurring. To well model the variations of faces, an Adaptive Gaussian Mixture Model (AGMM) is presented to describe the distributions of the face images. Since AGMM does not need the facial topology, the proposed method is resistant to face detection error caused by imperfect localization or misalignment. Experimental results demonstrate the effectiveness of the proposed method in public dataset as well as real surveillance video.