Multimedia Image Retrieval Research Articles

ENHANCED AI BASED FEATURE EXTRACTION TECHNIQUE IN MULTIMEDIA IMAGE RETRIEVAL

In the era of rapid technological advancements, the demand for efficient and accurate identification and retrieval of information from multimedia images has seen a substantial increase. To meet this growing demand, artificial intelligence (AI)-based technologies, particularly feature extraction techniques, have gained significant popularity. Feature extraction involves the extraction of salient features from multimedia images, such as edges, lines, curves, textures, and colors, with the aim of representing the data in a more suitable format for analysis. This paper presents an enhanced AI-based feature extraction technique for multimedia image retrieval. The proposed method introduces a novel approach that combines the power of deep learning and evolutionary algorithms in a neuro-symbolic computation framework. Specifically, the renowned VGG16 deep learning algorithm is employed as the initial feature extractor. VGG16 is a state-of-the-art deep convolutional neural network that has demonstrated exceptional performance in various computer vision tasks, including image classification and feature extraction. The primary idea behind this approach is to leverage the capabilities of AI to extract the most discriminative features from the source images using VGG16. These features are then further refined using evolutionary algorithms, which employ a search and optimization process inspired by natural evolution. By iteratively improving the extracted features through the evolutionary algorithms, the method aims to enhance the discriminative power and representational quality of the extracted features. To evaluate the performance of the proposed approach, extensive experiments were conducted. The results demonstrate that the method achieves superior performance in terms of precision, recall, and F-measure when compared to conventional feature extraction techniques. Furthermore, a comprehensive comparison with state-of-the-art AI-based feature extraction techniques further highlights the potential and effectiveness of the proposed approach in multimedia image retrieval applications.

Multimedia Image Retrieval System by Combining CNN With Handcraft Features in Three Different Similarity Measures

The authors propose WNAHVF, a combined weighted and normalized AlexNet with handcrafted visual features for extracting features from images and using those vectors for image retrieval and classification. The authors test the WNAHVF method on two general datasets, Corel-1k and Corel-10k, and one medical dataset. The outcomes demonstrate combining Bag of Features and Local Neighbor patterns with AlexNet enhances the accuracy and gives better results in general and medical image datasets in retrieval and classification problems. This algorithm gives results that are superior to existing strategies.

Local extreme complete trio pattern for multimedia image retrieval system

This paper presents a new feature descriptor, namely local extreme complete trio pattern (LECTP) for image retrieval application. The LECTP extracts complete extreme to minimal edge information in all possible directions using trio values. The LECTP integrates the local extreme sign trio patterns (LESTP) with magnitude local operator (MLOP) for image retrieval. The performance of the LECTP is tested by conducting three experiments on Corel-5 000, Corel-10 000 and MIT-VisTex color databases, respectively. The results after investigation show a significant improvement in terms of average retrieval precision (ARP) and average retrieval rate (ARR) as compared to the other state-of-the art techniques in content based image retrieval (CBIR).

Multimodal indexing based on semantic cohesion for image retrieval

This paper introduces two novel strategies for representing multimodal images with application to multimedia image retrieval. We consider images that are composed of both text and labels: while text describes the image content at a very high semantic level (e.g., making reference to places, dates or events), labels provide a mid-level description of the image (i.e., in terms of the objects that can be seen in the image). Accordingly, the main assumption of this work is that by combining information from text and labels we can develop very effective retrieval methods. We study standard information fusion techniques for combining both sources of information. However, whereas the performance of such techniques is highly competitive, they cannot capture effectively the content of images. Therefore, we propose two novel representations for multimodal images that attempt to exploit the semantic cohesion among terms from different modalities. Such representations are based on distributional term representations widely used in computational linguistics. Under the considered representations the content of an image is modeled by a distribution of co-occurrences over terms or of occurrences over other images, in such a way that the representation can be considered an expansion of the multimodal terms in the image. We report experimental results using the SAIAPR TC12 benchmark on two sets of topics used in ImageCLEF competitions with manually and automatically generated labels. Experimental results show that the proposed representations outperform significantly both, standard multimodal techniques and unimodal methods. Results on manually assigned labels provide an upper bound in the retrieval performance that can be obtained, whereas results with automatically generated labels are encouraging. The novel representations are able to capture more effectively the content of multimodal images. We emphasize that although we have applied our representations to multimedia image retrieval the same formulation can be adopted for modeling other multimodal documents (e.g., videos).