Image Retrieval System Research Articles

Detection of Acromion Types in Shoulder Magnetic Resonance Image Examination with Developed Convolutional Neural Network and Textural-Based Content-Based Image Retrieval System

Background: The morphological type of the acromion may play a role in the etiopathogenesis of various pathologies, such as shoulder impingement syndrome and rotator cuff disorders. Therefore, it is important to determine the acromion’s morphological types accurately and quickly. In this study, it was aimed to detect the acromion shape, which is one of the etiological causes of chronic shoulder disorders that may cause a decrease in work capacity and quality of life, on shoulder MR images by developing a new model for image retrieval in Content-Based Image Retrieval (CBIR) systems. Methods: Image retrieval was performed in CBIR systems using Convolutional Neural Network (CNN) architectures and textural-based methods as the basis. Feature maps of the images were extracted to measure image similarities in the developed CBIR system. For feature map extraction, feature extraction was performed with Histogram of Gradient (HOG), Local Binary Pattern (LBP), Darknet53, and Densenet201 architectures, and the Minimum Redundancy Maximum Relevance (mRMR) feature selection method was used for feature selection. The feature maps obtained after the dimensionality reduction process were combined. The Euclidean distance and Peak Signal-to-Noise Ratio (PSNR) were used as similarity measurement methods. Image retrieval was performed using features obtained from CNN architectures and textural-based models to compare the performance of the proposed method. Results: The highest Average Precision (AP) value was reached in the PSNR similarity measurement method with 0.76 in the proposed model. Conclusions: The proposed model is promising for accurately and rapidly determining morphological types of the acromion, thus aiding in the diagnosis and understanding of chronic shoulder disorders.

Evaluation of a content-based image retrieval system for radiologists in high-resolution CT of interstitial lung diseases

BackgroundThis retrospective study aims to evaluate the impact of a content-based image retrieval (CBIR) application on diagnostic accuracy and confidence in interstitial lung disease (ILD) assessment using high-resolution computed tomography CT (HRCT).MethodsTwenty-eight patients with verified pattern-based ILD diagnoses were split into two equal datasets (1 and 2). The images were assessed by two radiology residents (3rd and 5th year) and one expert radiologist in four sessions. Dataset 1 was used for sessions A and C, assessing diagnostic accuracy and confidence with mandatory and without CBIR software. Dataset 2 was used for sessions B and D with optional CBIR use, assessing time spending and frequency of CBIR usage. Accuracy was assessed on the CT pattern level, comparing readers’ diagnoses with reference diagnoses and CBIR results with region-of-interest (ROI) patterns.ResultsDiagnostic accuracy and confidence of readers showed an increasing trend with CBIR use compared to no CBIR use (53.6% versus 35.7% and 50.0% versus 32.2%, respectively). Time for reading significantly decreased in both datasets (A versus C: 104 s versus 54 s, p < 0.001; B versus D: 88.5 s versus 70 s, p = 0.009), whereas time for research increased with CBIR software use (A versus C: 31 s versus 81 s, p = 0.040). CBIR results showed a high pattern-based accuracy of overall 73.4%. Comparison between readers indicates a slightly higher accuracy of CBIR results when more than one ROI was used as input (77.7% versus 70.1%).ConclusionCBIR software improves in-training radiologist diagnostic accuracy and confidence while reducing interpretation time in ILD assessment.Relevance statementContent-based image retrieval software improves the assessment of interstitial lung diseases (ILD) in high-resolution CT, especially for radiology residents, by increasing diagnostic accuracy and confidence while reducing interpretation time. This can provide educational benefits and more time-efficient management of complex cases.Key PointsA content-based image retrieval (CBIR) software improves diagnostic accuracy and confidence for in-training radiologists for interstitial lung disease (ILD) assessment on computed tomography (CT).A CBIR application provides condensed information about similar HRCT cases reducing time for ILD assessment.CBIR algorithms benefit from the input of multiple regions of interest per ILD case.Graphical

Enhancing Convolutional Neural Network for Image Retrieval

With the continuous progress of image retrieval technology, the speed of searching for the required image from a large amount of image data has become an important issue. Convolutional neural networks (CNNs) have been used in image retrieval. However, many image retrieval systems based on CNNs have poor ability to express image features. Content-based Image Retrieval (CBIR) is a method of finding desired images from image databases. However, CBIR suffers from lower accuracy in retrieving images from large-scale image databases. In this paper, the proposed system is an improvement of the convolutional neural network for greater accuracy and a machine learning tool that can be used for automatic image retrieval. It includes two phases; the first phase (offline processing) consist of two stages; stage1 for CNN model classification while stage 2 for extracts high-level features directly from CNN by a flattening layer, which will be stored into a vector. In the second phase (online processing), the retrieval depends on query by image (QBI) from the system, which relies on the online CNN model stage to extract the features of the transmitted image. Afterward, an evaluation is conducted between the extracted features and the features that were previously stored by employing the Hamming distance to return all similar images. Last, it retrieves all the images and sends them to the system. Classification for images was achieved with 97.94% deep learning results, while for retrieved images, the deep learning was 98.94%. For this paper, work done on COREL image dataset. The images in the dataset used for training are more difficult than image classification due to the need for more computational resources. In the experimental part, training images using CNN achieved high accuracy, proving that the model has high accuracy in image retrieval.

Convolutional neural network-based strategies for efficient content-based image retrieval

Recent years have seen a meteoric rise in the usage of enormous image databases due to advancements in multimedia technologies. One of the most critical technologies for image processing nowadays is image retrieval. This study uses convolutional neural networks (CNNs) for content-based image retrieval (CBIR). With the ever-growing number of digital photos, practical methods for retrieving these images are crucial. CNNs are incredibly efficient in many computer vision applications. Improving the efficacy and precision of image retrieval systems is the primary goal of our research into using deep learning. The paper starts with a thorough analysis of the current state of CBIR methods and the difficulties they face. Afterwards, it explores CNN’s design and operation, focusing on CNN’s capacity to learn hierarchical features from images autonomously. This paper also looks at how the model performs when it alters its hyperparameters, transfer learning techniques, and CNN topologies. The insights obtained from these experiments enhance the comprehension of the elements impacting CNN effectiveness in CBIR. Finally, our study shows that CNNs can change the game for image search by transforming CBIR systems. This research adds to the expanding body of information about using cutting-edge deep learning algorithms to make image retrieval more efficient and accurate.

Efficient Image Retrieval in Fashion: Leveraging Clustering and Principal Component Analysis for Search Space Reduction

In this study, a novel approach using clustering techniques and Principal Component Analysis (PCA) for reducing the search space in fashion image retrieval systems is introduced. The study focuses on extracting high-dimensional feature vectors from images of clothing items and finding the same or the most similar product using these feature vectors, thereby narrowing the search space. The proposed method employs unsupervised learning algorithms to analyze high-dimensional fashion image feature vectors, grouping them into meaningful clusters. This enhances search efficiency and improves user experience. By reducing the dimensionality of feature vectors with PCA, computational costs are minimized. Experimental results demonstrate that the proposed method significantly accelerates computation time while maintaining an acceptable level of accuracy.

Deep deterministic policy gradients with a self-adaptive reward mechanism for image retrieval

Traditional image retrieval methods often face challenges in adapting to varying user preferences and dynamic datasets. To address these limitations, this research introduces a novel image retrieval framework utilizing deep deterministic policy gradients (DDPG) augmented with a self-adaptive reward mechanism (SARM). The DDPG-SARM framework dynamically adjusts rewards based on user feedback and retrieval context, enhancing the learning efficiency and retrieval accuracy of the agent. Key innovations include dynamic reward adjustment based on user feedback, context-aware reward structuring that considers the specific characteristics of each retrieval task, and an adaptive learning rate strategy to ensure robust and efficient model convergence. Extensive experimentation with the three distinct datasets demonstrates that the proposed framework significantly outperforms traditional methods, achieving the highest retrieval accuracy having 3.38%, 5.26%, and 0.21% improvement overall as compared to the mainstream models over DermaMNIST, PneumoniaMNIST, and OrganMNIST datasets, respectively. The findings contribute to the advancement of reinforcement learning applications in image retrieval, providing a user-centric solution adaptable to various dynamic environments. The proposed method also offers a promising direction for future developments in intelligent image retrieval systems.

Enhanced Semantic Natural Scenery Retrieval System Through Novel Dominant Colour and Multi‐Resolution Texture Feature Learning Model

ABSTRACTA conventional content‐based image retrieval system (CBIR) extracts image features from every pixel of the images, and its depiction of the feature is entirely different from human perception. Additionally, it takes a significant amount of time for retrieval. An optimal combination of appropriate image features is necessary to bridge the semantic gap between user queries and retrieval responses. Furthermore, users should require minimal interactions with the CBIR system to obtain accurate responses. Therefore, the proposed work focuses on extracting highly relevant feature information from a set of images in various natural image databases. Subsequently, a feature‐based learning/classification model is introduced before similarity measure calculations, aiming to minimise retrieval time and the number of comparisons. The proposed work analyses the learning models based on the retrieval system's performance separately for the following features: (i) dominant colour, (ii) multi‐resolution radial difference texture patterns, and a combination of both. The developed work is assessed with other techniques, and the results are reported. The results demonstrate that the implemented ensemble learning model‐based CBIR outperforms the recent CBIR techniques.

Content-Based Image Retrieval and Image Classification System for Early Prediction of Bladder Cancer.

Bladder cancer is a type of cancer that begins in the cells lining the inner surface of the bladder. Although it usually begins in the bladder, it can spread to surrounding tissues, lymph nodes, and other organs in later stages. Early detection of bladder cancer is, therefore, of great importance. Therefore, this study developed two systems based on classification and Content-Based Image Retrieval (CBIR). The primary purpose of CBIR systems is to compare the visual similarities of a user-provided image with the images in the database and return the most similar ones. CBIR systems offer an effective search and retrieval mechanism by directly using the content of the image data. In the proposed CBIR system, five different CNNs, two different textural-based feature extraction methods, and seven different similarity measurement metrics were tested for feature selection and similarity measurement. Successful feature extraction methods and similarity measurement metrics formed the infrastructure of the developed system. Densenet201 was preferred for feature extraction in the developed system. The cosine metric was used in the proposed CBIR system as a similarity measurement metric, the most successful among seven different metrics. As a result, it was seen that the proposed CBIR model showed the highest success using the Densenet201 model for feature extraction and the Cosine similarity measurement method.

CLIP-Llama: A New Approach for Scene Text Recognition with a Pre-Trained Vision-Language Model and a Pre-Trained Language Model.

This study focuses on Scene Text Recognition (STR), which plays a crucial role in various applications of artificial intelligence such as image retrieval, office automation, and intelligent transportation systems. Currently, pre-trained vision-language models have become the foundation for various downstream tasks. CLIP exhibits robustness in recognizing both regular (horizontal) and irregular (rotated, curved, blurred, or occluded) text in natural images. As research in scene text recognition requires substantial linguistic knowledge, we introduce the pre-trained vision-language model CLIP and the pre-trained language model Llama. Our approach builds upon CLIP's image and text encoders, featuring two encoder-decoder branches: one visual branch and one cross-modal branch. The visual branch provides initial predictions based on image features, while the cross-modal branch refines these predictions by addressing the differences between image features and textual semantics. We incorporate the large language model Llama2-7B in the cross-modal branch to assist in correcting erroneous predictions generated by the decoder. To fully leverage the potential of both branches, we employ a dual prediction and refinement decoding scheme during inference, resulting in improved accuracy. Experimental results demonstrate that CLIP-Llama achieves state-of-the-art performance on 11 STR benchmark tests, showcasing its robust capabilities. We firmly believe that CLIP-Llama lays a solid and straightforward foundation for future research in scene text recognition based on vision-language models.

A Dual-Module System for Copyright-Free Image Recommendation and Infringement Detection in Educational Materials.

Images are extensively utilized in educational materials due to their efficacy in conveying complex concepts. However, unauthorized use of images frequently results in legal issues related to copyright infringement. To mitigate this problem, we introduce a dual-module system specifically designed for educators. The first module, a copyright infringement detection system, employs deep learning techniques to verify the copyright status of images. It utilizes a Convolutional Variational Autoencoder (CVAE) model to extract significant features from copyrighted images and compares them against user-provided images. If infringement is detected, the second module, an image retrieval system, recommends alternative copyright-free images using a Vision Transformer (ViT)-based hashing model. Evaluation on benchmark datasets demonstrates the system's effectiveness, achieving a mean Average Precision (mAP) of 0.812 on the Flickr25k dataset. Additionally, a user study involving 65 teachers indicates high satisfaction levels, particularly in addressing copyright concerns and ease of use. Our system significantly aids educators in creating educational materials that comply with copyright regulations.

An optimized pair-wise comparison approach for automated feature weight assignment in content-based image retrieval system

An optimized pair-wise comparison approach for automated feature weight assignment in content-based image retrieval system

Retraction Note: Analytic hierarchy process-based automatic feature weight assignment method for content-based satellite image retrieval system

Retraction Note: Analytic hierarchy process-based automatic feature weight assignment method for content-based satellite image retrieval system

PERBANDINGAN JARAK EUCLIDEAN, CITYBLOCK, MINKOWSKI, CANBERRA, DAN CHEBYSHEV DALAM SISTEM TEMU KEMBALI CITRA BATIK

Batik is a highly valuable cultural heritage in Indonesia, showcasing a rich diversity of motifs with deep meaning and aesthetics. To enhance the accessibility and utilization of batik collections, an efficient image retrieval system is essential. This study compares distance measurement methods in a batik image retrieval system: Euclidean, Cityblock, Minkowski, Canberra, and Chebyshev, using a combination of color and texture features. The dataset comprises 50 types of batik images. The results show that the Cityblock method achieves the highest Mean Average Precision (MAP) of 97.71, followed by Canberra with MAP 96.87. The Euclidean method also performs well with a MAP of 94.56, while Minkowski and Chebyshev have lower MAP values of 92.93 and 90.89, respectively. Chebyshev experiences the largest MAP drop when images are rotated (5.98), while Cityblock demonstrates the best resistance to rotation with the smallest MAP drop (1.51). This research successfully developed a Content-Based Image Retrieval (CBIR) system with a GUI in MATLAB and suggests integrating the latest image processing and machine learning techniques for further enhancement.

Ontology supported semantic based image retrieval

In this study, a two-stage approach for developing a Semantic-Based Image Retrieval system supported by Ontology is proposed. In the initial stage, the Object Detection process is employed to identify objects within the image. Subsequently, a predicate describing the relationship between these two objects is determined using the developed Bi-directional Recurrent Neural Network (Bi-RNN) model. In the second stage, relations defined in the form of &lt;subject-predicate-object&gt; are transformed into Ontologies and utilized to search for images that are semantically similar. In addressing the primary challenge of Semantic Gap within the Semantic-Based Image Retrieval approach, the proposed solution involves measuring the number of similar relationships between two images through the utilization of entropy. The Semantic Gap between two images was computed using the Joint Entropy method, leveraging the number of relationships (X) identified in the query image and the total number of relationships (Y) in the image with similar relationships obtained as a query result. The proposed approach exhibits characteristics of a novel method within this field, distinct from other similar methods employed in Semantic-Based Image Retrieval through the utilization of Ontologies. In the performance measurement of the developed model, 91% accuracy was obtained according to the Recall@100 (Top-5 accuracy) result.

Feature-level Fusion vs. Score-level Fusion for Image Retrieval Based on Pre-trained Deep Neural Networks

Today’s complex multimedia content made retrieving images similar to the user’s query from the database a challenging task. The performance of a Content-Based Image Retrieval System (CBIR) system highly depends on the image representation in a form of low-level features and similarity measurement. The traditional visual descriptors that do not provide good prior domain knowledge could lead to poor performance retrieval results. On the other hand, Deep Convolutional Neural Networks (DCNNs) have recently achieved a remarkable success as methods for image classification in various domains. Recently, pre-trained deep convolution neural networks on thousands of classes have the ability to extract very accurate and representative features which, in addition to classification, can also be successfully used in image retrieval systems. ResNet152, GoogLeNet and InceptionV3 are some of the effective and successful examples of pre-trained DCNNs recently applied in a computer vision tasks such as object recognition, clustering, and classification. In this paper, two approaches for a CBIR system, namely early fusion and late fusion, have been presented and compared. The early fusion utilizes concatenation of the features extracted by each possible pair of DCNNs, that is ResNet152-GoogLeNet, ResNet152-InceptionV3, and GoogLeNet-InceptionV3, and the late fusion apply CombSum method with Z-Score standardization to combine the score results provided by each DCNN of the aforementioned pairs. In the experiments on a popular WANG dataset it has been shown that late fusion approach slightly outperforms early fusion approach. The best performance of our experiments in terms of Average Precision (AP) for the top 20 results reaches 96.82%.

A Human Retrieval System based on Human Attribute Ontology and Deep Multi-task Neural Network

The goal of this research is to enhance the capabilityof image retrieval systems to understand images moreeffectively. We present a model designed for searching humanobjects (such as pedestrians or persons) within expansiveimage datasets. Our unique approach involves developing animage retrieval system that incorporates attribute learningand the Human Attribute Ontology (HAO). This researchoffers several key contributions: (1) The development of theHuman Attribute Ontology (HAO) which serves as a repositoryfor storing prior knowledge about images. Thanks toits hierarchical structure, this ontology facilitates the reuse ofprior knowledge, optimizing the subsequent stages of attributelearning and image retrieval; (2) The implementation of aConvolutional Neural Network (CNN) to spearhead attributelearning, leveraging the HAO to enhance accuracy; (3) Thecreation of a Human Image Retrieval system that utilizes bothattribute learning and the HAO. Our system delves deeperby understanding images at the attribute level, highlightingthe advantages of harnessing the ontology to reuse existingknowledge. The efficacy of our methodology is validatedthrough experiments on benchmark datasets like PETA andPa100k achieving state-of-the-art results.

A comprehensive guide to content-based image retrieval algorithms with visualsift ensembling.

Content-based image retrieval (CBIR) systems are vital for managing the large volumes of data produced by medical imaging technologies. They enable efficient retrieval of relevant medical images from extensive databases, supporting clinical diagnosis, treatment planning, and medical research. This study aims to enhance CBIR systems' effectiveness in medical image analysis by introducing the VisualSift Ensembling Integration with Attention Mechanisms (VEIAM). VEIAM seeks to improve diagnostic accuracy and retrieval efficiency by integrating robust feature extraction with dynamic attention mechanisms. VEIAM combines Scale-Invariant Feature Transform (SIFT) with selective attention mechanisms to emphasize crucial regions within medical images dynamically. Implemented in Python, the model integrates seamlessly into existing medical image analysis workflows, providing a robust and accessible tool for clinicians and researchers. The proposed VEIAM model demonstrated an impressive accuracy of 97.34% in classifying and retrieving medical images. This performance indicates VEIAM's capability to discern subtle patterns and textures critical for accurate diagnostics. By merging SIFT-based feature extraction with attention processes, VEIAM offers a discriminatively powerful approach to medical image analysis. Its high accuracy and efficiency in retrieving relevant medical images make it a promising tool for enhancing diagnostic processes and supporting medical research in CBIR systems.

A New Approach for Effective Retrieval of Medical Images: A Step towards Computer-Assisted Diagnosis.

The biomedical imaging field has grown enormously in the past decade. In the era of digitization, the demand for computer-assisted diagnosis is increasing day by day. The COVID-19 pandemic further emphasized how retrieving meaningful information from medical repositories can aid in improving the quality of patient's diagnosis. Therefore, content-based retrieval of medical images has a very prominent role in fulfilling our ultimate goal of developing automated computer-assisted diagnosis systems. Therefore, this paper presents a content-based medical image retrieval system that extracts multi-resolution, noise-resistant, rotation-invariant texture features in the form of a novel pattern descriptor, i.e., MsNrRiTxP, from medical images. In the proposed approach, the input medical image is initially decomposed into three neutrosophic images on its transformation into the neutrosophic domain. Afterwards, three distinct pattern descriptors, i.e., MsTrP, NrTxP, and RiTxP, are derived at multiple scales from the three neutrosophic images. The proposed MsNrRiTxP pattern descriptor is obtained by scale-wise concatenation of the joint histograms of MsTrP×RiTxP and NrTxP×RiTxP. To demonstrate the efficacy of the proposed system, medical images of different modalities, i.e., CT and MRI, from four test datasets are considered in our experimental setup. The retrieval performance of the proposed approach is exhaustively compared with several existing, recent, and state-of-the-art local binary pattern-based variants. The retrieval rates obtained by the proposed approach for the noise-free and noisy variants of the test datasets are observed to be substantially higher than the compared ones.

A fast and efficient large-scale near duplicate image retrieval system using double perceptual hashing

A fast and efficient large-scale near duplicate image retrieval system using double perceptual hashing

Cross-modality sub-image retrieval using contrastive multimodal image representations

In tissue characterization and cancer diagnostics, multimodal imaging has emerged as a powerful technique. Thanks to computational advances, large datasets can be exploited to discover patterns in pathologies and improve diagnosis. However, this requires efficient and scalable image retrieval methods. Cross-modality image retrieval is particularly challenging, since images of similar (or even the same) content captured by different modalities might share few common structures. We propose a new application-independent content-based image retrieval (CBIR) system for reverse (sub-)image search across modalities, which combines deep learning to generate representations (embedding the different modalities in a common space) with robust feature extraction and bag-of-words models for efficient and reliable retrieval. We illustrate its advantages through a replacement study, exploring a number of feature extractors and learned representations, as well as through comparison to recent (cross-modality) CBIR methods. For the task of (sub-)image retrieval on a (publicly available) dataset of brightfield and second harmonic generation microscopy images, the results show that our approach is superior to all tested alternatives. We discuss the shortcomings of the compared methods and observe the importance of equivariance and invariance properties of the learned representations and feature extractors in the CBIR pipeline. Code is available at: https://github.com/MIDA-group/CrossModal_ImgRetrieval.