Concept Detection System Research Articles

Semantic Video Concept Detection using Novel Mixed-Hybrid-Fusion Approach for Multi-Label Data

The performance of the semantic concept detection method depends on, the selection of the low-level visual features used to represent key-frames of a shot and the selection of the feature-fusion method used. This paper proposes a set of low-level visual features of considerably smaller size and also proposes novel ‘hybrid-fusion’ and ‘mixed-hybrid-fusion’, approaches which are formulated by combining early and late-fusion strategies proposed in the literature. In the initially proposed hybrid-fusion approach, the features from the same feature group are combined using early-fusion before classifier training; and the concept probability scores from multiple classifiers are merged using late-fusion approach to get final detection scores. A feature group is defined as the features from the same feature family such as color moment. The hybrid-fusion approach is refined and the “mixed-hybrid-fusion” approach is proposed to further improve detection rate. This paper presents a novel video concept detection system for multi-label data using a proposed mixed-hybrid-fusion approach. Support Vector Machine (SVM) is used to build classifiers that produce concept probabilities for a test frame. The proposed approaches are evaluated on multi-label TRECVID2007 development dataset. Experimental results show that, the proposed mixed-hybrid-fusion approach performs better than other proposed hybrid-fusion approach and outperforms all conventional early-fusion and late-fusion approaches by large margins with respect to feature set dimensionality and Mean Average Precision (MAP) values.

Segmentation of Moving Object In Video Using Background Registration and GMEC

Emerging multimedia applications demand content-based video processing. Content based video retrieval or concept detection systems require video to be segmented in to objects. A large number of video object segmentation algorithms have been developed such as semiautomatic and automatic. Semiautomatic methods requires the human intervention and also not suitable for some applications. Many applications require automatic segmentation but still there is lot of scope for the improvement. The proposed work aims at contributing to identify the lacunas that are present in the existing segmentation system and also to give the possible solutions to overcome those lacunas so that the precise and effective video segmentation system can be developed. The proposed system deals with the issue of automatic video segmentation system such as uncovered background, Temporary poses and Global motion of background.

An efficient concept detection system via sparse ensemble learning

In this paper, we present an efficient concept detection system based on a novel bag of words extraction method and sparse ensemble learning. The presented system can efficiently build the concept detectors upon large scale image dataset, and achieve real-time concept detection on unseen images with the state-of-the-arts accuracy. To do so, we first develop an efficient bag of visual words (BoW) construction method based on sparse non-negative matrix factorization (NMF) and GPU enabled SIFT feature extraction. We then develop a sparse ensemble learning method to build the detection model, which drastically reduces learning time in order of magnitude over traditional methods like Support Vector Machine. To overcome the difficulty of manual annotation of training dataset, we construct a large training set with both pseudo relevance feedback of negative samples and interactive feedback of positive samples. Experiments on TRECVID 2012 dataset and MIRFlickr-1M dataset show both efficiency and effectiveness of our system.

Image and Video Indexing Using Networks of Operators

This article presents a framework for the design of concept detection systems for image and video indexing. This framework integrates in a homogeneous way all the data and processing types. The semantic gap is crossed in a number of steps, each producing a small increase in the abstraction level of the handled data. All the data inside the semantic gap and on both sides included are seen as a homogeneous type called numcept and all the processing modules between the various numcepts are seen as a homogeneous type called operator. Concepts are extracted from the raw signal using networks of operators operating on numcepts. These networks can be represented as data-flow graphs and the introduced homogenizations allow fusing elements regardless of their nature. Low-level descriptors can be fused with intermediate of final concepts. This framework has been used to build a variety of indexing networks for images and videos and to evaluate many aspects of them. Using annotated corpora and protocols of the 2003 to 2006 TRECVID evaluation campaigns, the benefit brought by the use of individual features, the use of several modalities, the use of various fusion strategies, and the use of topologic and conceptual contexts was measured. The framework proved its efficiency for the design and evaluation of a series of network architectures while factorizing the training effort for common subnetworks.