Efficiency Of Image Retrieval Research Articles

Deep hashing and attention mechanism-based image retrieval of osteosarcoma scans for diagnosis of bone cancer

BackgroundDue to its intricate nature and substantial data size, microscopic image data of osteosarcoma often present a significant obstacle to the effectiveness of conventional image retrieval methods. Therefore, this study investigates a new approach for medical image retrieval using advanced deep hashing techniques and attention mechanisms to address these challenges more effectively. MethodThe proposed algorithm significantly improves osteosarcoma cell microscopic image retrieval efficiency and accuracy using deep hashing and attention mechanisms. Image preprocessing includes adaptive histogram equalization and dataset augmentation to enhance quality and diversity. Feature extraction employs the WRN-AM model to map high-dimensional features to a low-dimensional hash code space, improving retrieval efficiency. Finally, similarity matching via Hamming distance allows rapid and precise identification of similar images. ResultsThe study shows notable advancements: the WRN-AM model achieves 93.2% classification accuracy and 97.09% mAP using 64-bit hash codes. These findings underscore the technique’s effective performance in extracting and categorizing diverse microscopic cell data efficiently and reliably. ConclusionsThis innovative approach provides a robust solution for retrieving and classifying microscopic data of osteosarcoma cells and other cell types, speeding up clinical diagnosis and medical research. It facilitates quicker access and analysis of patient image data, enhancing diagnostic precision and treatment planning for healthcare professionals. Concurrently, it supports researchers in leveraging medical image data more efficiently, fostering progress and innovation in the medical field.

Research on sports image classification method based on SE-RES-CNN model

As computer image processing and digital technologies advance, creating an efficient method for classifying sports images is crucial for the rapid retrieval and management of large image datasets. Traditional manual methods for classifying sports images are impractical for large-scale data and often inaccurate when distinguishing similar images. This paper introduces an SE module that adaptively adjusts the weights of input feature mapping channels, and a Res module that excels in deep feature extraction, preventing gradient vanishing, multi-scale processing, and enhancing generalization in image recognition. Through extensive experimentation on network structure adjustments, the SE-RES-CNN neural network model is applied to sports image classification. The model is trained on a sports image classification dataset from Kaggle, alongside VGG-16 and ResNet50 models. Training results show that the proposed SE-RES-CNN model improves classification accuracy by approximately 5% compared to VGG-16 and ResNet50 models. Testing revealed that the SE-RES-CNN model classifies 100 out of 500 sports images in 6 s, achieving an accuracy rate of up to 98% and a single prediction time of 0.012 s. This validates the model's accuracy and effectiveness, significantly enhancing sports image retrieval and classification efficiency. This validates the model's accuracy and effectiveness, significantly enhancing sports image retrieval and classification efficiency.

Deep Attention Fusion Hashing (DAFH) Model for Medical Image Retrieval.

To address this, we propose a novel deep learning-based hashing model, the Deep Attention Fusion Hashing (DAFH) model, which integrates advanced attention mechanisms with medical imaging data. The DAFH model enhances retrieval performance by integrating multi-modality medical imaging data and employing attention mechanisms to optimize the feature extraction process. Utilizing multimodal medical image data from the Cancer Imaging Archive (TCIA), this study constructed and trained a deep hashing network that achieves high-precision classification of various cancer types. At hash code lengths of 16, 32, and 48 bits, the model respectively attained Mean Average Precision (MAP@10) values of 0.711, 0.754, and 0.762, highlighting the potential and advantage of the DAFH model in medical image retrieval. The DAFH model demonstrates significant improvements in the efficiency and accuracy of medical image retrieval, proving to be a valuable tool in clinical settings.

Performance evaluation of attention-deep hashing based medical image retrieval in brain MRI datasets

BackgroundBrain MRI images pose significant challenges due to their complexity and voluminous data, which often hinder the accuracy of traditional image retrieval methods. In response, this research delves into a novel medical image retrieval approach grounded in attention mechanisms and deep hashing techniques. MethodologyThe study enhances the network's edge perception capability by incorporating a dual mixed attention module (CBAM-MA dual attention) into the convolutional neural network architecture. This addition optimally captures edge saliency and distributional features by introducing an extra attention layer atop CBAM. Furthermore, a novel triple loss function is introduced, amalgamating Euclidean and cosine distances. This fusion exploits the strengths of both distance metrics to comprehensively consider sample geometric attributes, thereby generating more robust and expressive feature representations crucial for preserving categorical details. ResultsExperimental evaluations showcase significant performance advancements in MRI image retrieval tasks using the proposed method. The average hit rate stands at 0.7783, average precision at 0.752246, and average inverse rank at 0.956721. These metrics collectively underscore the method's efficacy in enhancing the quality and expediting the diagnosis of brain diseases. ConclusionThe research underscores the critical role of attention and deep hashing techniques in augmenting the accuracy and efficiency of medical image retrieval, particularly in the context of brain MRI images. The proposed method's notable performance improvements pave the way for enhanced diagnostic capabilities, signaling a significant step forward in improving healthcare outcomes related to brain diseases.

Deep Learning based Smart Image Search Engine

Abstract: This paper introduces a new reverse search engine integration into content-based image retrieval (CBIR) systems that employs convolutional neural networks (CNNs) for feature extraction. It generates global descriptors using pre-trained CNN architectures such as ResNet50, InceptionV3, and InceptionResNetV2. It retrieves visually similar images without depending on linguistic annotations. Comparative analysis against existing methods, such as Gabor Wavelet, CNN-SVM, Metaheuristic Algorithm, etc., has been tested, and it proves the superiority of the proposed algorithm, the Cartoon Texture Algorithm, in CBIR. As the Internet sees an exponential growth of different data types, the importance of CBIR continues to grow. In order to efficiently retrieve images, solely relying on image features while ignoring metadata is exactly what we need. As such, this paper is a reminder of the need for CBIR in this changing world. They showed that CBIR continues to be quite effective in the age of the Internet. Their proposed model for CBIR, which integrates ResNet-50-based feature extraction, a neural network model trained on different image datasets, and clustering techniques to make retrieval fast, provides a significant improvement in accuracy and efficiency for content-dependent image retrieval. This methodology is likely to be very useful as we work with the increasingly huge data of vision and beyond on the Internet. It provides a good basis for an effective image search and retrieval system

An Online Hashing Algorithm for Image Retrieval Based on Optical-Sensor Network.

Online hashing is a valid storage and online retrieval scheme, which is meeting the rapid increase in data in the optical-sensor network and the real-time processing needs of users in the era of big data. Existing online-hashing algorithms rely on data tags excessively to construct the hash function, and ignore the mining of the structural features of the data itself, resulting in a serious loss of the image-streaming features and the reduction in retrieval accuracy. In this paper, an online hashing model that fuses global and local dual semantics is proposed. First, to preserve the local features of the streaming data, an anchor hash model, which is based on the idea of manifold learning, is constructed. Second, a global similarity matrix, which is used to constrain hash codes is built by the balanced similarity between the newly arrived data and previous data, which makes hash codes retain global data features as much as possible. Then, under a unified framework, an online hash model that integrates global and local dual semantics is learned, and an effective discrete binary-optimization solution is proposed. A large number of experiments on three datasets, including CIFAR10, MNIST and Places205, show that our proposed algorithm improves the efficiency of image retrieval effectively, compared with several existing advanced online-hashing algorithms.

A self-attention multi-scale convolutional neural network method for SAR image despeckling

ABSTRACT The speckle noise found in synthetic aperture radar (SAR) images severely affects the efficiency of image interpretation, retrieval and other applications. Thus, effective methods for despeckling SAR image are required. The traditional methods for SAR image despeckling fail to balance in terms of the relationship between the intensity of speckle noise filtering and the retention of texture details. Deep learning based SAR image despeckling methods have been shown to have the potential to achieve this balance. Therefore, this study proposes a self-attention multi-scale convolution neural network (SAMSCNN) method for SAR image despeckling. The advantage of the SAMSCNN method is that it considers both multi-scale feature extraction and channel attention mechanisms for multi-scale fused features. In the SAMSCNN method, multi-scale features are extracted from SAR images through convolution layers with different depths. These are concatenated; then, and an attention mechanism is introduced to assign different weights to features of different scales, obtaining multi-scale fused features with weights. Finally, the despeckled SAR image is generated through global residual noise reduction and image structure fine-tuning. The despeckling experiments in this study involved a variety of scenes using simulated and real data. The performance of the proposed model was analysed using quantitative and qualitative evaluation methods and compared to probabilistic patch-based (PPB), SAR block-matching 3-D (SAR-BM3D) and SAR-CNN methods. The experimental results show that the method proposed in this paper improves the objective indexes and shows great advantages in visual effects compared to these classical methods. The method proposed in this study can provide key technical support for the practical application of SAR images.

Improving the Efficiency of Semantic Image Retrieval Using a Combined Graph and SOM Model

Improving the Efficiency of Semantic Image Retrieval Using a Combined Graph and SOM Model

Design of Quick Search Method for Key Feature Images in Mobile Networks

In order to promote the efficiency of image retrieval in mobile network and realize the fast query of key images, this paper designs a quick search method of key feature images in mobile networks. The key features of retrieved images are extracted by rotation invariant local binary method. According to the extracted key features of the image, the query target image is processed by coarse quantization then the distance of the key features of the image is calculated and retrieved. Finally, non-exhaustive search method is used to achieve quick search of key feature images in mobile network. Experimental results show that this method can effectively extract specific images, The desired image can be quickly searched by reserved key features, and the F-score value of quick search is higher than 0.9.

Transformer-Based Distillation Hash Learning for Image Retrieval

In recent years, Transformer has become a very popular architecture in deep learning and has also achieved the same state-of-the-art performance as convolutional neural networks on multiple image recognition baselines. Transformer can obtain global perceptual fields through a self-attention mechanism and can enhance the weights of unique discriminable features for image retrieval tasks to improve the retrieval quality. However, Transformer is computationally intensive and finds it difficult to satisfy real-time requirements when used for retrieval tasks. In this paper, we propose a Transformer-based image hash learning framework and compress the constructed framework to perform efficient image retrieval using knowledge distillation. By combining the self-attention mechanism of the Transformer model, the image hash code is enabled to be global and unique. At the same time, this advantage is instilled into the efficient lightweight model by knowledge distillation, thus reducing the computational complexity and having the advantage of an attention mechanism in the Transformer. The experimental results on the MIRFlickr-25K dataset and NUS-WIDE dataset show that our approach can effectively improve the accuracy and efficiency of image retrieval.

Feature Extraction Based Deep Indexing by Deep Fuzzy Clustering for Image Retrieval Using Jaro Winkler Distance

Abstract Image retrieval aims to locate similar image based on given query from large-sized image dataset. In the recent decades, different methods are developed to retrieve similar images, but increasing the retrieval performance is a challenging task. Hence, an effective method named Lion Henry Gas Solubility Optimization-based Deep Fuzzy Clustering (LHGSO-based DFC) is developed to increase the retrieval efficiency of image retrieval. Based on the features extraction, images are indexed efficiently to the corresponding cluster using clustering model. The proposed method retrieves the relevant images with respect to query image based on the similarity. The similarity measure is computed using Jaro Winkler distance, in which the images corresponding to the cluster that have higher similarity measure is retrieved more effectively. The proposed method achieved higher performance in terms of the metrics, like F-measure, precision and recall with the values of 0.887, 0.891 and 0.882.

A Novel Feature Aggregation Approach for Image Retrieval Using Local and Global Features

The current deep convolution features based on retrieval methods cannot fully use the characteristics of the salient image regions. Also, they cannot effectively suppress the background noises, so it is a challenging task to retrieve objects in cluttered scenarios. To solve the problem, we propose a new image retrieval method that employs a novel feature aggregation approach with an attention mechanism and utilizes a combination of local and global features. The method first extracts global and local features of the input image and then selects keypoints from local features by using the attention mechanism. After that, the feature aggregation mechanism aggregates the keypoints to a compact vector representation according to the scores evaluated by the attention mechanism. The core of the aggregation mechanism is to allow features with high scores to participate in residual operations of all cluster centers. Finally, we get the improved image representation by fusing aggregated feature descriptor and global feature of the input image. To effectively evaluate the proposed method, we have carried out a series of experiments on large-scale image datasets and compared them with other state-of-the-art methods. Experiments show that this method greatly improves the precision of image retrieval and computational efficiency.

Analysis of Content Based Image Retrieval using Deep Feature Extraction and Similarity Matching

Image retrieval using a textual query becomes a major challenge mainly due to human perception subjectivity and the impreciseness of image annotations. These drawbacks can be overcome by focusing on the content of images rather than on the textual descriptions of images. Traditional feature extraction techniques demand for expert knowledge to select the limited feature types and are also sensitive to changing imaging conditions. Deep feature extraction using Convolutional Neural Network (CNN) are a solution to these drawbacks as they can learn the feature representations automatically. This work carries out a detailed performance comparison of various pre-trained models of CNN in feature extraction. Features are extracted from men footwear and women clothing datasets using the VGG16, VGG19, InceptionV3, Xception and ResNet50 models. Further, these extracted features are used for classification using SVM, Random Forest and K-Nearest Neighbors classifiers. Results of feature extraction and image retrieval show that VGG19, Inception and Xception features perform well with feature extraction, achieving a good image classification accuracy of 97.5%. These results are further justified by performing a comparison of image retrieval efficiency, with the extracted features and similarity metrics. This work also compares the accuracy obtained by features extracted by the selected pretrained CNN models with the results obtained using conventional classification techniques on CIFAR 10 dataset. The features extracted using CNN can be used in image-based systems like recommender systems, where images have to be analyzed to generate item profiles.

Rapid Face Image Retrieval for Large Scale Based on Spark and Machine Learning

This paper proposed a distributed computing environment large-scale face image retrieval method. Based on Spark platform, a face retrieval method based on machine learning is established, which takes advantage of parallel computing to improve the efficiency of face image retrieval. In the method, SIFT algorithm is used for feature coding, PCA dimension reduction processing, HBase database is used for data storage, and KD-Tree query algorithm is used to match images similar to the query images. Meanwhile, large-scale computing engine uses Spark to process data to improve the retrieval efficiency. The CelebA dataset is selected to test the method, and the experimental results show the effectiveness of the method.

Improved search space shrinking for medical image retrieval using capsule architecture and decision fusion

Medical diagnosis is a challenging procedure that involves issues such as data imbalance, insufficient labels, obscure images, redundancy and lack of effective model training directions to shrink the semantic gap between human knowledge and computer algorithms. Due to privacy norms, sometimes medical images are difficult to access and therefore, retrieval of identical existing images from an existing repository is quite useful. This paper proposes a search space to narrow down the identical images in an archive by using (i) Capsule Networks, followed by a (ii) decision fusion with Wavelet-Discrete Cosine Transform (W-DCT) and Radon Barcodes (RBC). Empirical case study has been applied on IRMA (Image Retrieval in Medical Applications) dataset, ImageCLEFMed-2009, containing 14,410 X-ray images, but the proposed method is generic, reproducible and scalable. Subjective and quantitative performance has been compared with the state-of-art and it has been found superior to yield accuracy of 92.83% and IRMA error of 124.25 for 193 class-code category. Thus, the proof-of-concept helps to improves diagnosis efficiency for automatic image retrieval and annotation by clustering similar images from the underlying repository.

Deep learning for fast bronze inscription image retrieval

Collections of bronze inscription images are increasing rapidly. To use these images efficiently, we proposed an effective content-based image retrieval framework using deep learning. Specifically, we extract discriminative local features for image retrieval using the activations of the convolutional neural network and binarize the extracted features for improving the efficiency of image retrieval, firstly. Then, we use the cosine metric and Euclidean metric to calculate the similarity between the query image and dataset images. The result shows that the proposed framework has an impressive accuracy.

Image Retrieval Based on Deep Feature Extraction and Reduction with Improved CNN and PCA

With the rapid development of information technology, the speed and efficiency of image retrieval are increasingly required in many fields, and a compelling image retrieval method is critical for the development of information. Feature extraction based on deep learning has become dominant in image retrieval due to their discrimination more complete, information more complementary and higher precision. However, the high-dimension deep features extracted by CNNs (convolutional neural networks) limits the retrieval efficiency and makes it difficult to satisfy the requirements of existing image retrieval. To solving this problem, the high-dimension feature reduction technology is proposed with improved CNN and PCA quadratic dimensionality reduction. Firstly, in the last layer of the classical networks, this study makes a well-designed DR-Module (dimensionality reduction module) to compress the number of channels of the feature map as much as possible, and ensures the amount of information. Secondly, the deep features are compressed again with PCA (Principal Components Analysis), and the compression ratios of the two dimensionality reductions are reduced, respectively. Therefore, the retrieval efficiency is dramatically improved. Finally, it is proved on the Cifar100 and Caltech101 datasets that the novel method not only improves the retrieval accuracy but also enhances the retrieval efficiency. Experimental results strongly demonstrate that the proposed method performs well in small and medium-sized datasets.

Content-Based E-Commerce Image Classification Research

The 21st century is the era of big data in the Internet. Online shopping has become a trend, and e-commerce has developed rapidly. With the exponential increase of the amount of commodity image data, the management of massive commodity image database restricts the development of e-commerce to some extent. In order to effectively manage goods and improve the accuracy and efficiency of product image retrieval, this paper uses content-based methods to classify e-commerce images. Aiming at the problems of insufficient classification accuracy and long classification training time in e-commerce image classification, an adaptive momentum learning rate based LBP-DBN training algorithm-AML-LBP-DBN and commodity image classification method based on image local feature multi-level clustering and image-class nearest neighbor classifier are proposed. By simulating the commodity identification dataset RPC, the results show that the proposed method has obvious advantages in the classification training time and classification accuracy of e-commerce images.

A Novel Image Retrieval Method with Improved DCNN and Hash

In large-scale image retrieval, deep features extracted by Convolutional Neural Network (CNN) can effectively express more image information than those extracted by traditional manual methods. However, the deep feature dimensions obtained by Deep Convolutional Neural Network (DCNN) are too high and redundant, which leads to low retrieval efficiency. We propose a novel image retrieval method, which combines deep features selection with improved DCNN and hash transform based on high-dimension features reduction to gain lowdimension deep features and realizes efficient image retrieval. Firstly, the improved network is based on the existing deep model to build a more profound and broader network by adding multiple groups of different branches. Therefore, it is named DFS-Net (Deep Feature Selection Network). The adaptive learning deep features of the Network can effectively alleviate the influence of over-fitting and improve the feature expression of image content. Secondly, the information gain rate method is used to filter the extracted deep features to reduce the feature dimension and ensure the information loss is small. The last step of the method, hash Transform, sparsifies and binarizes this representation to reduce the computation and storage pressure while maintaining the retrieval accuracy. Finally, the scheme is based on the distinguished ResNet50, InceptionV3, and MobileNetV2 models, and studied and evaluated deeply on the CIFAR10 and Caltech256 datasets. The experimental results show that the novel method can train the deep features with stronger recognition ability on limited training samples, and improve the accuracy and efficiency of image retrieval effectively.

Deep learning for multi-modal classification of cloud, shadow and land cover scenes in PlanetScope and Sentinel-2 imagery

With the increasing availability of high-resolution satellite imagery it is important to improve the efficiency and accuracy of satellite image indexing, retrieval and classification. Furthermore, there is a need for utilizing all available satellite imagery in identifying general land cover types and monitoring their changes through time irrespective of their spatial, spectral, temporal and radiometric resolutions. Therefore, in this study, we developed deep learning models able to efficiently and accurately classify cloud, shadow and land cover scenes in different high-resolution (<10 m) satellite imagery. Specifically, we trained deep convolutional neural network (CNN) models to perform multi-label classification of multi-modal, high-resolution satellite imagery at the scene level. Multi-label classification at the scene level (a.k.a. image indexing), as opposed to the pixel level, allows for faster performance, higher accuracy (although at the cost of detail) and higher generalizability. We investigated the generalization ability (i.e. cross-dataset and geographic independence) of individual and ensemble CNN models trained on multi-modal satellite imagery (i.e. PlanetScope and Sentinel-2). The models trained on PlanetScope imagery collected over the Amazon performed well when applied to PlanetScope and Sentinel-2 imagery collected over the Wet Tropics of Australia with an F2 score of 0.72 and 0.69, respectively. Similarly, PlanetScope-based CNN models trained on imagery collected over the Wet Tropics of Australia performed well when applied to Sentinel-2 imagery with an F2 score of 0.76, and the reverse scenario resulted in the same F2 score of 0.76. This suggests that our CNN models have high cross-dataset generalization ability and are suitable for classifying cloud, shadow and land cover classes in satellite imagery with resolutions from 3 m (PlanetScope) to 10 m (Sentinel-2). The performance of our CNN models was also comparable to the state-of-the-art methods (i.e. Sen2Cor and MACCS) developed specifically for classifying cloud and shadow classes in Sentinel-2 imagery. Finally, we show the potential of our CNN models to mask cloud and shadow contaminated areas from PlanetScope- and Sentinel-2-derived NDVI time-series.