Accurate Image Retrieval Research Articles

Medical Image Key Area Protection Scheme Based on QR Code and Reversible Data Hiding

Medical image data, like most patient information, has high requirements for privacy and confidentiality. To improve the security of medical image transmission within the open network, we proposed a medical image key area protection algorithm based on reversible data hiding. First, the coefficient of variation is used to identify the key area, that is, the lesion area of the image. Then, the other regions are divided into blocks to analyze the texture complexity. Next, we propose a new reversible data hiding algorithm, which embeds the content of the key area into the high-texture regions. On this basis, a quick response (QR) code is generated using the ciphertext of the basic image information to replace the original lesion area. Experimental results show that this method can not only safely transmit sensitive patient information by hiding the content of the lesion, it can also store copyright information through QR code and achieve accurate image retrieval.

Noise Resilient Local Gradient Orientation for Content-Based Image Retrieval

In a world of multimedia information, where users seek accurate results against search query and demand relevant multimedia content retrieval, developing an accurate content-based image retrieval (CBIR) system is difficult due to the presence of noise in the image. The performance of the CBIR system is impaired by this noise. To estimate the distance between the query and database images, CBIR systems use image feature representation. The noise or artifacts present within the visual data might confuse the CBIR when retrieving relevant results. Therefore, we propose Noise Resilient Local Gradient Orientation (NRLGO) feature representation that overcomes the noise factor within the visual information and strengthens the CBIR to retrieve accurate and relevant results. The proposed NRLGO consists of three steps: estimation and removal of noise to protect the local visual structure; extraction of color, texture, and local contrast features; and, at the end, generation of microstructure for visual representation. The Manhattan distance between the query image and the database image is used to measure their similarity. The proposed technique was tested using the Corel dataset, which contains 10000 images from 100 different categories. The outcomes of the experiment signify that the proposed NRLGO has higher retrieval performance in comparison with state-of-the-art techniques.

DenserNet: Weakly Supervised Visual Localization Using Multi-Scale Feature Aggregation

In this work, we introduce a Denser Feature Network(DenserNet) for visual localization. Our work provides three principal contributions. First, we develop a convolutional neural network (CNN) architecture which aggregates feature maps at different semantic levels for image representations. Using denser feature maps, our method can produce more key point features and increase image retrieval accuracy. Second, our model is trained end-to-end without pixel-level an-notation other than positive and negative GPS-tagged image pairs. We use a weakly supervised triplet ranking loss to learn discriminative features and encourage keypoint feature repeatability for image representation. Finally, our method is computationally efficient as our architecture has shared features and parameters during forwarding propagation. Our method is flexible and can be crafted on a light-weighted backbone architecture to achieve appealing efficiency with a small penalty on accuracy. Extensive experiment results indicate that our method sets a new state-of-the-art on four challenging large-scale localization benchmarks and three image retrieval benchmarks with the same level of supervision. The code is available at https://github.com/goodproj13/DenserNet

IMAGE RETRIEVAL USING MODIFIED BLOCK TRUNCATION CODING FEATURE

With the advent of digital camera, improvement in the digital storage media and rapid development in internet provide a huge collection of images. Fast and accurate image retrieval from this huge collection of image database is a challenging task. This is possible only by combining the image retrieval mechanism along with image compression technique. Content Based Image Retrieval (CBIR) uses the visual information in the images to retrieve the similar images. In this paper, image feature descriptor from the compressed stream of image data is extracted where the images are compressed using a variant of Block Truncation Coding (BTC) named Dot Diffused Block Truncation Coding (DDBTC). Here the Colour Histogram Feature (CHF) and the Bit Pattern Features (BPF) are extracted and used to represent the image and similarity computation.

Deep multiscale divergence hashing for image retrieval

Image retrieval based on deep learning of hash has made great progress. The hash method increases retrieval speed greatly while saving storage space. However, some problems exist, such as the distinctiveness of image feature still needs to be improved and some image features are still redundant. We propose a new deep learning to hash method, namely, deep multiscale divergence hashing, which provides a high diversity and compact image feature for image retrieval. The discriminative features from deep neural networks are identified by the importance criterion in network pruning techniques and the feature redundancy is reduced. Then, the selected features across different layers are fused in a certain proportion to increase the diversity of features for image retrieval. We also present a hybrid loss function in hash space, which consists of the weighted pairwise cross-entropy loss function and the KL-divergence. It tends to minimize the hamming distance between similar images and maximize the hamming distance between different images, which helps improve the accuracy. Massive experimental results show that our method achieves better feature distinguishability and more advanced image retrieval accuracy, and surpasses HashNet by 11.46%, 7.58%, and 13.86% on MS COCO, NUS-WIDE, and CIFAR-10 datasets, respectively.

Feature Extraction and Retrieval of Ecommerce Product Images Based on Image Processing

The new retail is an industry featured by online ecommerce. One of the key techniques of the industry is the product identification based on image processing. This technique has an important business application value, because it is capable of improving the retrieval efficiency of products and the level of information supervision. To acquire high-level semantics of images and enhance the retrieval effect of products, this paper explores the feature extraction and retrieval of ecommerce product images based on image processing. The improved Fourier descriptor was innovatively into a metric learning-based product image feature extraction network, and the attention mechanism was introduced to realize accurate retrieval of product images. Firstly, the authors detailed how to acquire the product contour and the axis with minimum moment of inertia, and then extracted the shape feature of products. Next, a feature extraction network was established based on the metric learning supervision, which is capable of obtaining distinctive feature, and thus realized the extraction of distinctive and classification features of products. Finally, the authors expounded on the product image retrieval method based on cluster attention neural network. The effectiveness of our method was confirmed through experiments. The research results provide a reference for feature extraction and retrieval in other fields of image processing.

SemanticHash: Hash Coding Via Semantics-Guided Label Prototype Learning

In this article, we propose SemanticHash, a simple and effective deep neural network model, to leverage semantic word embeddings (e.g., BERT) in hash codes learning. Both images and class labels are compressed into <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$K$</tex-math></inline-formula> -bit binary vectors by using the visual (or the semantic) hash functions, which are jointly learned and aligned to optimize the semantic consistency. The <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$K$</tex-math></inline-formula> -dimensional class label prototypes—projected from semantic word embeddings—guide the hash mapping on the image side and vice versa, creating the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$K$</tex-math></inline-formula> -bit image hash codes being aligned with their semantic prototypes and therefore more discriminative. Extensive experimental results on four benchmarks, CIFAR10, NUS-WIDE, ImageNet, and MS-COCO datasets, demonstrate the effectiveness of our approach. We also perform studies to analyze the effects of quantization and word semantic spaces and to explain the relations among the learned class prototypes. Finally, the generalization capability of the proposed approach is further demonstrated. It achieves competitive performance in comparison with state-of-the-art unsupervised and zero-shot hashing methods. <p xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Impact Statement</i>—Hash code learning is an important technology that enables efficient image retrieval on large-scale data. While existing hashing algorithms can effectively generate compact binary codes in a supervised learning setting trained with a moderate-size dataset, they are demanding to be scalable to large datasets and do not generalize to unseen datasets. The proposed approach overcomes these limitations. Compared with state-of-the-art ones, our solution achieves 2.1% of average performance improvement on four moderate-size benchmarks and 4.7% of improvement on ImageNet, a large-scale dataset with over 1.2 M training images. With superior performance on popular benchmarks for binary hash code learning, the technology introduced performs well on cross-dataset and zero-shot (i.e., the testing concepts are unseen during training) scenarios too. Our approach attains over 17.7% of zero-shot retrieval performance improvement when compared to the state-of-the-art in the area. This article thus provides a powerful solution to utilize massive data for fast and accurate image retrieval in the big data era.

The use of data mining and artificial intelligence technology in art colors and graph and images of computer vision under 6G internet of things communication

To further optimize the existing methods in the field of computer vision and improve the intelligence of image data mining technology, the relevant feedback technology is combined with traditional image data mining technology, and an image data mining technology based on the relevant feedback K-Nearest-Neighbor (K-NN) algorithm is designed and further optimized. The focus is the actual feature extraction test for image color and shape. The test results reveal that for retrieval of K = 1, K = 2, K = 3 images, both positive feedback K-NN algorithm and negative feedback K-NN algorithm can effectively improve the accuracy of image data mining. Among them, negative feedback K-NN algorithm has the highest accuracy for image shape feature extraction. When there are K = 3 images, the accuracy of image data mining can reach 78.3%. Then, the image mining research is conducted on multiple databases. In a total of four databases, the accuracy of image retrieval increases with the increase of feedback times. At the same time, using the optimized KNN algorithm can greatly improve the accuracy of image feature extraction, and the highest accuracy can reach 99.3%. The research content can provide a scientific reference for the follow-up study of KNN algorithm.

A Cloud-Guided Feature Extraction Approach for Image Retrieval in Mobile Edge Computing

Mobile Edge Computing (MEC) can facilitate various important image retrieval applications for mobile users by offloading partial computation tasks from resource-limited mobile devices to edge servers. However, existing related works suffer from two major limitations. (i) High network bandwidth cost : they need to extract numerous features from the image and upload these feature data to the cloud server. (ii) Low retrieval accuracy : they separate the feature extraction processes from the image data set in the cloud server, thus unable to provide effective features for accurate image retrieval. In this paper, we propose a cloud-guided feature extraction approach for mobile image retrieval. In the proposed approach, the cloud server first leverages the relationships among labeled images in the data set to learn a projection matrix ${{\mathbf P}}$ P . Then, it uses the matrix ${{\mathbf P}}$ P to extract discriminative features from the image data set and form a low-dimensional feature data set. Following that, the cloud server sends the matrix ${{\mathbf P}}$ P to the edge server and uses it to multiply the image ${{\mathbf x}}$ x . The result ${{\mathbf P}}^T{{\mathbf x}}$ P T x , i.e. , image features, is uploaded to the cloud server to find the label of the image with the most similar multiplying result. The label is regarded as the retrieval result and returned to the mobile user. In the cloud-guided feature extraction approach, the matrix ${{\mathbf P}}$ P can extract a small number of effective image features, which not only reduces network traffic but also improves retrieval accuracy. We have implemented a prototype system to validate the proposed approach and evaluate its performance by conducting extensive experiments using a real MEC environment and data set. The experimental results show that the proposed approach reduces the network traffic by nearly 93 percent and improves the retrieval accuracy by nearly 6.9 percent compared with the state-of-the-art image retrieval approaches in MEC.

Social image retrieval based on topic diversity

Image search re-ranking is one of the most important approaches to enhance the text-based image search results. Extensive efforts have been dedicated to improve the accuracy and diversity of tag-based image retrieval. However, how to make the top-ranked results relevant and diverse is still a challenging problem. In this paper, we propose a novel method to diversify the retrieval results by latent topic analysis. We first employ NMF (Non-negative Matrix Factorization) Lee and Seung (Nature 401(6755):788–791, 1999) to estimate the initial relevance score to the query q. Then, the initial relevance score is fed into an adaptive multi-feature fusion model to learn the final relevance score. Next, the diversification process is conducted. We group all the images by semantic clustering and estimate the topic distribution of each cluster by topic analysis. The clusters are ranked based on the topic distribution vector and the final retrieval image list is obtained by a greedy selection mechanism based on the estimated relevances. Experimental results on the NUS-Wide dataset show the effectiveness of the proposed approach.

Improve the Effectiveness of Image Retrieval by Combining the Optimal Distance and Linear Discriminant Analysis

In image retrieval with relevant feedback, classification and distance calculation have a great influence on image retrieval accuracy. In this paper, we propose an image retrieval method, called ODLDA (Image Retrieval using the optimal distance and linear discriminant analysis). The proposed method can effectively exploit user’s feedback from relevant and irrelevant image sets, which uses linear discriminant analysis to find a linear projection with an improved similarity measure. The experimental results performed on the two benchmark datasets have confirmed the superiority of the proposed method.

An Analysis of Two Novel and Efficient Deep Learning Models for Fast and Accurate Image Retrieval

An Analysis of Two Novel and Efficient Deep Learning Models for Fast and Accurate Image Retrieval

Distress Image Retrieval for Infrastructure Maintenance via Self-Trained Deep Metric Learning Using Experts’ Knowledge

Distress image retrieval for infrastructure maintenance via self-trained deep metric learning using experts’ knowledge is proposed in this paper. Since engineers take multiple images of a single distress part for inspection of road structures, it is necessary to construct a similar distress image retrieval method considering the input of multiple images to support determination of the level of deterioration. Thus, the construction of an image retrieval method while selecting an effective input from multiple images is described in this paper. The proposed method performs deep metric learning by using a small number of effective images labeled by experts’ knowledge with information about their effectiveness and a large number of unlabeled images via a self-training approach. Specifically, an end-to-end learning approach that performs retraining of the model by assigning pseudo-labels to these unlabeled images according to the output confidence of the model is achieved. Thus, the proposed method can select an effective image from multiple images that are input at the retrieval as a query image. This is the main contribution of this paper. As a result, the proposed method realizes highly accurate retrieval of similar distress images considering the actual situation of inspection in which multiple images of a distress part are input.

Full Direction Local Neighbors Pattern (FDLNP)

In this paper, we proposed the Full Direction Local Neighbor Pattern (FDLNP) algorithm, which is a novel method for Content-Based Image Retrieval. FDLNP consists of many steps, starting from generating Max and Min Quantizers followed by building two matrix types (the Eight Neighbors Euclidean Decimal Coding matrix, and Full Direction Matrixes). After that, we extracted Gray-Level Co-occurrence Matrix (GLCM) from those matrixes to derive the important features from each GLCM matrixes and finishing with merging the output of previous steps with Local Neighbor Patterns (LNP) histogram. For decreasing the feature vector length, we proposed five extension methods from FDLNP by choosing the specific direction matrixes. Our results demonstrate the effectiveness of our proposed algorithm on color and texture databases, comparing with recent works, with regard to the Precision, Recall, mean Average Precision (mAP), and Average Retrieval Rate (ARR). For enhancing the image retrieval accuracy, we proposed a novel framework that combined the image retrieval system with clustering and classification algorithms. Moreover, we proposed a distributed model that used our FDLNP method with Hadoop to get the ability to process a huge number of images in a reasonable time.

Feature Extraction and Image Retrieval of Landscape Images Based on Image Processing

Facing the existing digital image libraries on landscape, researchers need to urgently solve a challenging problem: how to realize rational management and accurate retrieval of landscape images that contain feature information like hierarchy, layout, color system, and color matching. For accurate organization and labeling of landscape Images, this paper presents a novel method for feature extraction and image retrieval of landscape images based on image processing. Firstly, a color quantization process was designed for landscape images, and used to analyze the color composition and color space pattern (CSP) of such images. Next, the existing methods, which are suitable for the extraction of color features from landscape Images, were briefly reviewed, and the basic flows of our improved algorithm and division method of landscape color blocks (LCBs) were explained. Finally, the retrieval performance of landscape images was improved by matching of weighted color blocks of regional landscape, based on the multi-dimensional color eigenvectors of landscape image. The experimental results demonstrate the effectiveness of our algorithm. The research results shed light on the feature extraction from other types of color images.

Bow image retrieval method based on SSD target detection

The query image is usually a simple and single object in image retrieval, and the reference images in the database usually have many distractions. The precision of image retrieval can be greatly improved If the target regions in the database image are extracted during retrieval. So this paper proposes a Bow image retrieval method based on SSD target detection. First, the training gallery is manually annotated to record the location and size information. Second, the SSD target detection model is trained with the labeled training gallery to obtain the target object SSD model. Third, the SSD model is used to locate the similar target regions of the reference image and the query graph. Finally, the target region information is mapped into the convolutional features, and these feature vectors are used for image similarity matching. The performance of the proposed method is evaluated on Paris6k, Oxford5k, Paris106k and Oxford105k databases. The experimental results show that the accuracy of image retrieval will be greatly improved by adding optimization methods in the proposed image retrieval framework. The image retrieval accuracy of this method is higher than that of similar methods in recent years.

The application of interactive methods under swarm computing and artificial intelligence in image retrieval and personalized analysis

The aim is to explore the interactive methods based on swarm computing and improve the image retrieval effects and personalized recommendation accuracy. The interactive methods based on swarm computing are explored. The mechanism of swarm intelligence (SI) algorithm is analyzed, in which the particle swarm optimization (PSO) algorithm and its improved algorithm are selected. The selected algorithms are combined with content-based image retrieval technology and applied to the image retrieval process, thereby realizing personalized analysis and recommendation based on users’ interests. Finally, the image retrieval behaviors of users are analyzed through simulation experiments, which verify the accuracy of the recommendation results. In the six sets of experiments, the image retrieval system based on the quantum behavior PSO (QPSO) has better performance compared to other PSO and SI evolution algorithms. The image retrieval accuracy of the proposed Bayesian personalized ranking (BPR) optimization algorithm (BPR-U2B) has significantly better performance compared to other recommendation algorithms. The QPSO algorithm is the best SI evolution algorithm for image retrieval. The BPR-U2B algorithm is combined with the collaborative filtering algorithm based on BPR. It optimizes the objective function to limit the ranking results of the BPR algorithm, which is beneficial to complete the image recommendations and improve the personalized recommendation effects for users.

DSHPoolF: deep supervised hashing based on selective pool feature map for image retrieval

Deep supervised hashing has turned up to unravel many large-scale image retrieval challenges. Although deep supervised hashing accomplishes good results for image retrieval process, requisite for further improving the retrieval accuracy always remains the primal focus of interest. In Deep hashing methods, feature representation happens at the outset of the fully connected (FC) layers, causing shortage of spatial information owing to its global nature, whereas deeper pooling layers preserve semantically similar information by retaining the images spatial information, which can result in uplifting the retrieval performance. Hereby, for enhancing the image retrieval accuracy through exploring spatial information, a novel way of deep supervised hashing based on Pooled Feature map (DSHPoolF) is proposed to generate compact hash codes that explore the spatial information by weighing the informative Feature maps from the last pooling layer. This is achieved, firstly, by weighing the last pooling layers Feature map in two ways, namely average–max-based pooling and probability-based pooling strategies. Secondly, informative Feature maps are selected with the help of the weights. In addition to this, the informative Feature maps play a key role in optimizing quantization error together with the loss function and classification errors in a single-step, point-wise ranking manner. This proposed DSHPoolF method is assessed using three datasets (CIFAR-10, MNIST and ImageNet) that unveils primitive outcome in comparison with other existing prominent hash-based methods.

Content‐based gastric image retrieval using convolutional neural networks

AbstractThe endoscopy procedure has demonstrated great efficiency in detecting stomach lesions, with extensive numbers of endoscope images produced globally each day. The content‐based gastric image retrieval (CBGIR) system has demonstrated substantial potential in gastric image analysis. Gastric precancerous diseases (GPD) have higher prevalence in gastric cancer patients. Thus, effective intervention is crucial at the GPD stage. In this paper, a CBGIR method is proposed using a modified ResNet‐18 to generate binary hash codes for a rapid and accurate image retrieval process. We tested several popular models (AlexNet, VGGNet and ResNet), with ResNet‐18 determined as the optimum option. Our proposed method was valued using a GPD data set, resulting in a classification accuracy of 96.21 ± 0.66% and a mean average precision of 0.927 ± 0.006, outperforming other state‐of‐art conventional methods. Furthermore, we constructed a Gastric‐Map (GM) based on feature representations in order to visualize the retrieval results. This work has great auxiliary significance for endoscopists in terms of understanding the typical GPD characteristics and improving aided diagnosis.

Research on Fabric Image Retrieval Method Based on Multi-feature Layered Fusionon

In recent years, with the maturity of computer technology and the increasing development of Internet technology, online transaction has become an important and popular sales method. As a necessities of life, clothing accounts for a considerable proportion of online transactions. Whether it is clothing manufacturers buying fabrics, or customers buying clothing online, they rely on fabric images on the Internet to browse, compare and select satisfactory products. This method of manual comparison is both time consuming and error prone. To effectively manage and use the fabric, it is very important to establish a fabric image retrieval system. The variety of fabrics and various styles, and the fabric image itself has the characteristics of large amount of data and large amount of information. The traditional retrieval method cannot achieve fast and accurate retrieval of fabric images. This paper proposes a retrieval method based on multi-feature fusion, which can accurately analyze the characteristics of fabric images. Experiments show that the using this method to retrieve fabric images can achieve good results.