Proposed Content-based Image Retrieval System Research Articles

Deep Learning Model for Retrieving Color Logo Images in Content Based Image Retrieval

Content-Based Image retrieval (CBIR) has gained a magnificent deal of consideration because of the digital image data's epidemic growth. The advancement of deep learning has enabled Convolutional Neural Networks to become an influential technique for extraction of discriminative image features. In recent years, convolutional neural networks (CNNs) have proven extremely effective at extracting unique information from images. In contrast to text-based image retrieval, CBIR gathers comparable images based primarily on their visual content. The use of deep learning, especially CNNs, for feature extraction and image processing has been shown to perform better than other techniques. In the proposed study, we investigate CNNs for CBIR focusing on how well they extract discriminative visual features and facilitate accurate image retrieval. Also Principal Component Analysis and Linear Discriminant Analysis are combined for optimization of features resulting in boosting the retrieval results. Using hierarchical representations learned by CNNs, we aim to improve retrieval accuracy and efficiency. In comparison with conventional retrieval techniques, our proposed CBIR system shows superior performance on a benchmark dataset.

Evaluation of retrieval accuracy and visual similarity in content-based image retrieval of chest CT for obstructive lung disease

The aim of our study was to assess the performance of content-based image retrieval (CBIR) for similar chest computed tomography (CT) in obstructive lung disease. This retrospective study included patients with obstructive lung disease who underwent volumetric chest CT scans. The CBIR database included 600 chest CT scans from 541 patients. To assess the system performance, follow-up chest CT scans of 50 patients were evaluated as query cases, which showed the stability of the CT findings between baseline and follow-up chest CT, as confirmed by thoracic radiologists. The CBIR system retrieved the top five similar CT scans for each query case from the database by quantifying and comparing emphysema extent and size, airway wall thickness, and peripheral pulmonary vasculatures in descending order from the database. The rates of retrieval of the same pairs of query CT scans in the top 1–5 retrievals were assessed. Two expert chest radiologists evaluated the visual similarities between the query and retrieved CT scans using a five-point scale grading system. The rates of retrieving the same pairs of query CTs were 60.0% (30/50) and 68.0% (34/50) for top-three and top-five retrievals. Radiologists rated 64.8% (95% confidence interval 58.8–70.4) of the retrieved CT scans with a visual similarity score of four or five and at least one case scored five points in 74% (74/100) of all query cases. The proposed CBIR system for obstructive lung disease integrating quantitative CT measures demonstrated potential for retrieving chest CT scans with similar imaging phenotypes. Further refinement and validation in this field would be valuable.

Multi-channel content based image retrieval method for skin diseases using similarity network fusion and deep community analysis

Content-based image retrieval (CBIR) could be an efficient diagnostic tool. Physicians could consult a CBIR system before making a diagnosis for a clinical case by retrieving a set of images with similar appearance and pathological diagnosis from a data archive. With access to various imaging modalities, physicians may want to match more than one image modality and non-image information. How to make full use of this diverse information is an important research question. In this paper, we propose a CBIR framework for skin diseases that incorporates multi-sourced information including dermoscopic images, clinical images, and meta information. The proposed framework fuses the multi-sourced features in mutual similarity level; thus, solving severe dimensional bias problems for image and non-image information. We then utilize a graph-based community analysis on similarity networks where similar images are strongly connected and help retrieve similar images with improved performance. Evaluations were carried out using two well-known skin datasets EDRA and ISIC 2019. The carefully designed framework demonstrates a substantial improvement in finding similar cases for different skin diseases with an average precision of 0.836, which is the state-of-the-art performance for retrieving skin disease types. In addition, the proposed framework is also applicable to scenarios with a single typed feature with improved performance. By integrating multi-sourced information from the same patient, the proposed CBIR system could be potentially used in complex clinical scenarios with a trustable performance benefitting from both abundant information and advanced community search technique.

Modified cuckoo search algorithm: Feature subset selection &Shape,Color and Texture Features Descriptors for Content-Based Image Retrieval

With the recent advances in knowledge, the complication of multimedia has increased expressively and new areas of research have opened up in search of new multimedia content. Content-based image retrieval (CBIR) are used to extract images associated with image queries (IQs) from huge databases. The CBIR schemes accessible at present have limited functionality because they only have a partial number of functions. This document presents an improved cookie detection algorithm with coarse sentences for processing large amounts of data using selected examples. The improved cuckoo detection algorithm mimics the behavior of brood attachment parasites in some cuckoo species, including some birds. Modified cuckoo recognition uses approximate set theory to create a fitness function that takes into account the sum of features and the quality of classification as a small amount. For an image entered as IQ from a database, distance metrics are used to find the appropriate image. This is the central idea of CBIR. The projected CBIR method is labelled and can extract shape features based on the RGB color using the and canny Edge (CED) and neutrosophic clustering algorithm scheme. After YCbCrcolor cut, and the CED to get the features to extract the vascular matrix. The combination of these techniques improves the efficiency of the CBR image recovery infrastructure. In this thesis recursive neural network techniques are used to measure the similarity. In addition, the accuracy of the results is: The recall score is measured to evaluate system performance. The proposed CBIR system provides more precise and accurate values than the complex CBIR system.

A CBIR system based on saliency driven local image features and multi orientation texture features

In Content-based Image Retrieval (CBIR), the user provides the query image in which only a selective portion of the image carries the foremost vital information known as the object region of the image. However, the human visual system also focuses on a particular salient region of an image to instinctively understand its semantic meaning. Therefore, the human visual attention technique can be well imposed in the CBIR scheme. Inspired by these facts, we initially utilized the signature saliency map-based approach to decompose the image into its respective main object region (ObR) and non-object region (NObR). ObR possesses most of the vital image information, so block-level normalized singular value decomposition (SVD) has been used to extract salient features of the ObR. In most natural images, NObR plays a significant role in understanding the actual semantic meaning of the image. Accordingly, multi-directional texture features have been extracted from NObR using Gabor filter on different wavelengths. Since the importance of ObR and NObR features are not equal, a new homogeneity-based similarity matching approach has been devised to enhance retrieval accuracy. Finally, we have demonstrated retrieval performances using both the combined and distinct ObR and NObR features on seven standard coral, texture, object, and heterogeneous datasets. The experimental outcomes show that the proposed CBIR system has a promising retrieval efficiency and outperforms various existing systems substantially.

Dynamic Mode Decomposition based salient edge/region features for content based image retrieval

Considering the gap between low-level image features and high-level retrieval concept, this paper investigates the effect of incorporating visual saliency based features for content-based image retrieval(CBIR).Visual saliency plays an important role in human perception due to its capability to focus the attention on the point of interest, i.e. an intended target. This selection based processing can be well explored in localized CBIR systems, since in context of CBIR the users will be interested only in certain parts of the image. The proposed methodology uses Dynamic Mode Decomposition framework to extract the saliency map which highlights the part of the image that grabs human attention. Then, based on the saliency map, an efficient salient edge detection model is introduced. Visual saliency based features (salient region, edge) are then combined with texture and color features to formulate the high dimensional feature vector for image retrieval. State-of-the-art learning based CBIR models demands for user feed back to model the retrieval concept. In contrast with these models, proposed CBIR system does not require any user interaction, since it uses perceptual level features for the retrieval task. Performance of the proposed CBIR system is evaluated and confirmed on images from Wang’s dataset using benchmark evaluation metrics like precision and recall. Experimental results reveals that incorporation of saliency features can represent human perception well and produces good retrieval performance.

WITHDRAWN: Key point oriented shape features and SVM classifier for content based image retrieval

For personal digital libraries as well as automatically acquired image collections, traditional text and metadata based approaches for image retrieval are not sufficient. Commonly, these methods lack detailed descriptions that could be used for searching the required image. In digital libraries, content based image retrieval (CBIR) methods are required to support better image search. A highly robust and efficient shape descriptor based CBIR model has been proposed in this work. Canny edge detection algorithm is employed to identify strong key points on the edges. For key point set formation, the generalized distance transform scheme has been used. Combination of shape and key point identification are used to make proposed CBIR system more robust. Extracted features are fed to Support Vector Machine (SVM) classifier. For retrieval we used similarity matching using Euclidean distance metric. The proposed model provides superior performance while comparing with existing retrieval models.

Content-Based Image Retrieval of Chest CT with Convolutional Neural Network for Diffuse Interstitial Lung Disease: Performance Assessment in Three Major Idiopathic Interstitial Pneumonias.

ObjectiveTo assess the performance of content-based image retrieval (CBIR) of chest CT for diffuse interstitial lung disease (DILD).Materials and MethodsThe database was comprised by 246 pairs of chest CTs (initial and follow-up CTs within two years) from 246 patients with usual interstitial pneumonia (UIP, n = 100), nonspecific interstitial pneumonia (NSIP, n = 101), and cryptogenic organic pneumonia (COP, n = 45). Sixty cases (30-UIP, 20-NSIP, and 10-COP) were selected as the queries. The CBIR retrieved five similar CTs as a query from the database by comparing six image patterns (honeycombing, reticular opacity, emphysema, ground-glass opacity, consolidation and normal lung) of DILD, which were automatically quantified and classified by a convolutional neural network. We assessed the rates of retrieving the same pairs of query CTs, and the number of CTs with the same disease class as query CTs in top 1–5 retrievals. Chest radiologists evaluated the similarity between retrieved CTs and queries using a 5-scale grading system (5-almost identical; 4-same disease; 3-likelihood of same disease is half; 2-likely different; and 1-different disease).ResultsThe rate of retrieving the same pairs of query CTs in top 1 retrieval was 61.7% (37/60) and in top 1–5 retrievals was 81.7% (49/60). The CBIR retrieved the same pairs of query CTs more in UIP compared to NSIP and COP (p = 0.008 and 0.002). On average, it retrieved 4.17 of five similar CTs from the same disease class. Radiologists rated 71.3% to 73.0% of the retrieved CTs with a similarity score of 4 or 5.ConclusionThe proposed CBIR system showed good performance for retrieving chest CTs showing similar patterns for DILD.

Phase congruency and ODBTC based image retrieval

In this study, the authors investigate content based image retrieval (CBIR) using ordered-dither block truncation coding (ODBTC) and phase congruency feature (PCF). Relevant feature extraction plays a vital role for retrieving the image in CBIR. The unique reason to choose PCF with ODBTC is that it detects the edges and corners during variation of image while preserving image brightness and contrast. Combining the PCF and ODBTC features improves CBIR system usage in various visual data processing domains. Thus, yields a better CBIR system which assists in the reduction of storage space, decreases retrieval time and increases accuracy of the system. The precision and recall are used as performance metrics to evaluate the proposed method based on retrieval of relevant images. Extensive experimental results with Corel 1 K (1000 images), Corel 10 K (10000 images) and CALTECH 256 (30144 images) proves that the proposed method is more desirable than antecedent proposed CBIR system in terms of accuracy, precision and recall.

An Efficient Clustering Based CBIR System using Hadoop to Analyze Massive MRI Images Dataset for Early Disease Diagnosis

In past decade, the use of medical imaging for disease diagnosis is increased rapidly. The medical images provide useful information about the anatomy of patients. The medical images are used not only to assist the doctors for diagnosis purpose, but also used in Research & Development for deeper insights and better understanding into cause and cure of numerous diseases. To retrieve medical images from large scale repositories in real time, there is urgent need of an efficient medical image retrieval system. For this purpose, an efficient clustering based content based image retrieval (CBIR) system using Hadoop is proposed to analyze massive magnetic resonance imaging (MRI) images dataset for early disease diagnosis. The proposed CBIR system uses Hadoop platform, local mesh peak valley edge patterns (LMePVEP) for feature extraction, MapReduce based parallel k-means algorithm for clustering and euclidean distance to measure similarity. The method proposed is tested and compared with state-of-the-art CBIR methods on massive MRI images dataset. The experimental results obtained show that the method proposed in our work outperforms traditional CBIR methods in terms of average retrieval time and mean average precision for massive MRI images dataset.

A hierarchical CBIR framework using adaptive tetrolet transform and novel histograms from color and shape features

Content-Based Image Retrieval (CBIR) systems retrieve the most analogous images from the image database with respect to a given query image based on the texture, shape, and/or color image features. These three image features can be used alone for the image retrieval or also can be used together for the retrieval purpose. In hierarchical CBIR system, three image features are extracted in proper order to discard the irrelevant images in each hierarchy level for reducing the image search space. In this paper, the authors have proposed a three-level hierarchical CBIR system/framework where, each level of the hierarchy uses either texture, shape or color image features to reduce the size of the image database by discarding the irrelevant images and at final level of the hierarchy, it will extract the most analogous images from the reduced image database. We have used adaptive tetrolet transform to extract the texture features from the regions of interest of the images. To extract the shape features of the image, a novel edge joint histogram has been proposed which uses the orientation of the edge pixels and their distance from the origin together to create a novel joint histogram. For color feature extraction, another color channel correlation histogram has been introduced. The order of the three different feature extraction processes on each level of the hierarchy is not rigid because it is difficult to predict the proper order for the highest retrieval. In the experiment, we have considered all possible order of the texture, shape and color features for image retrieval process. The retrieval experiments have been carried out in six different types of standard image databases and results show that the performance of proposed CBIR system has been increased significantly as compared to the other state-of-arts CBIR systems.

An efficient content based image retrieval system using BayesNet and K-NN

In the progression of web and multi-media, substantial measure of pictures is created and appropriated, to viably store and offer such vast measure of bulky database is a big issue. In this way, Content Based Image Retrieval (CBIR) techniques are used to retrieve images from the massive database based on the desired information. In this proposed work, we are considering two local image feature extraction methods, namely, SIFT and ORB. Scale Invariant Feature Transform (SIFT) is used for detecting features and feature descriptor of an image. Oriented Fast Rotated and BRIEF (ORB) uses FAST (Features from Accelerated Segment Test) key point detector and binary BRIEF (Binary Robust Independent Elementary Features) descriptor of an image. K-Means clustering algorithm is also used in the present paper for analyzing the data, which generates number of clusters using the descriptor vector. Locality Preserving Projection (LPP) is employed to reduce the length of the feature vector to enhance the performance of image retrieval system. For classification, we have considered two classifiers, namely, BayesNet and K-Nearest Neighbours (K-NN). Wang image dataset has been used for experimentation work. We have accomplished the highest precision rate of 88.9% using proposed CBIR system.

A FUZZY FRAMEWORK FOR CONTENT BASED MAGNETIC RESONANCE IMAGES RETRIEVAL USING SALIENCY MAP

Content-based image retrieval (CBIR) has turned into an important research field with the advancement in multimedia and imaging technology. The term CBIR has been widely used to describe the process of retrieving desired images from a large collection on the basis of features such as color, texture and shape that can be automatically extracted from the images themselves. Considering the gap between low-level image features and the high-level semantic concepts in the CBIR, we proposed an image retrieval system for brain magnetic resonance images based on saliency map. First, the proposed approach exploits the ant colony optimization (ACO) technique to measure the image’s saliency through ants’ movements on the image. The textural features are then calculated from the saliency map of the images. The image retrieval of the proposed CBIR system is based on textural features and the fuzzy approach using Adaptive neuro-fuzzy inference system (ANFIS). Regarding the various categories of images in a database, we define some membership functions in the ANFIS output in order to determine the membership values of the images related to the existing categories. In online image retrieval, a query image is introduced to the system and the relevant images can be retrieved based on query membership values into different classes including normal or tumoral. The experimental results indicate that the proposed method is reliable and has high image retrieval efficiency compared with the previous works.

A learning automata framework based on relevance feedback for content-based image retrieval

The need for efficient image browsing and searching motivates the use of Content-Based Image Retrieval (CBIR) systems. However, they suffer from a big gap between high-level image semantics and low-level features. So, a learning process to reduce the gap seems quite useful. This paper presents a novel Learning Automata (LA)-based approach to improve the CBIR systems. Distributed Learning Automata (DLA) is used in this work to learn the relevant images from textual query feedbacks of the users. Subsequently, the retrieved images are ranked according to the learning outcome and similarity measure. In this study, the similarity between images is evaluated based on two color descriptors: the global color histogram and local color auto-correlogram. A thorough observation and comparison of these color descriptors performances are performed with different color spaces and also with various similarity measures. Experimental results on two publicly available databases demonstrate that the performance of the proposed CBIR system after each round is improved and the system could retrieve images compatible with the users’ perception.

An efficient similarity measure for content based image retrieval using memetic algorithm

Content based image retrieval (CBIR) systems work by retrieving images which are related to the query image (QI) from huge databases. The available CBIR systems extract limited feature sets which confine the retrieval efficacy. In this work, extensive robust and important features were extracted from the images database and then stored in the feature repository. This feature set is composed of color signature with the shape and color texture features. Where, features are extracted from the given QI in the similar fashion. Consequently, a novel similarity evaluation using a meta-heuristic algorithm called a memetic algorithm (genetic algorithm with great deluge) is achieved between the features of the QI and the features of the database images. Our proposed CBIR system is assessed by inquiring number of images (from the test dataset) and the efficiency of the system is evaluated by calculating precision-recall value for the results. The results were superior to other state-of-the-art CBIR systems in regard to precision.

Content-Based Image Retrieval System for Pulmonary Nodules: Assisting Radiologists in Self-Learning and Diagnosis of Lung Cancer.

Visual information of similar nodules could assist the budding radiologists in self-learning. This paper presents a content-based image retrieval (CBIR) system for pulmonary nodules, observed in lung CT images. The reported CBIR systems of pulmonary nodules cannot be put into practice as radiologists need to draw the boundary of nodules during query formation and feature database creation. In the proposed retrieval system, the pulmonary nodules are segmented using a semi-automated technique, which requires a seed point on the nodule from the end-user. The involvement of radiologists in feature database creation is also reduced, as only a seed point is expected from radiologists instead of manual delineation of the boundary of the nodules. The performance of the retrieval system depends on the accuracy of the segmentation technique. Several 3D features are explored to improve the performance of the proposed retrieval system. A set of relevant shape and texture features are considered for efficient representation of the nodules in the feature space. The proposed CBIR system is evaluated for three configurations such as configuration-1 (composite rank of malignancy "1","2" as benign and "4","5" as malignant), configuration-2 (composite rank of malignancy "1","2", "3" as benign and "4","5" as malignant), and configuration-3 (composite rank of malignancy "1","2" as benign and "3","4","5" as malignant). Considering top 5 retrieved nodules and Euclidean distance metric, the precision achieved by the proposed method for configuration-1, configuration-2, and configuration-3 are 82.14, 75.91, and 74.27 %, respectively. The performance of the proposed CBIR system is close to the most recent technique, which is dependent on radiologists for manual segmentation of nodules. A computer-aided diagnosis (CAD) system is also developed based on CBIR paradigm. Performance of the proposed CBIR-based CAD system is close to performance of the CAD system using support vector machine.

A Key Point Selection Shape Technique for Content Based Image Retrieval System

Content Based Image Retrieval (CBIR) is the process of retrieving visually similar images from huge datasets. Images are identified based on their content. Content identification using shape features is considered in this paper. Content identification using shapes is a challenging task considering multiple variations observed in images, complex backgrounds and vast categories of contents. This paper describes a shape descriptor based CBIR system. The content of an image is identified using a key point based shape descriptor. Template matching techniques are adopted to accurately describe object shapes. The object shape identified is described using histogram vectors. The use of SVM classifier for content recognition and image retrieval task is considered. Results presented prove robustness of the key point technique to accurately describe object shapes even in complex images. Performance of the proposed system is compared with existing state of art systems. Results obtained and described in the paper prove a better performance of proposed CBIR system.

NPFAM: Non-Proliferation Fuzzy ARTMAP for Image Classification in Content Based Image Retrieval

A Content-based Image Retrieval (CBIR) system employs visual features rather than manual annotation of images. The selection of optimal features used in classification of images plays a key role in its performance. Category proliferation problem has a huge impact on performance of systems using Fuzzy Artmap (FAM) classifier. The proposed CBIR system uses a modified version of FAM called Non-Proliferation Fuzzy Artmap (NPFAM). This is developed by introducing significant changes in the learning process and the modified algorithm is evaluated by extensive experiments. Results have proved that NPFAM classifier generates a more compact rule set and performs better than FAM classifier. Accordingly, the CBIR system with NPFAM classifier yields good retrieval.

Lattice vector quantisation for indexing and retrieval of medical images using texture features based on 2-D Wold decomposition

Medical image retrieval to search for clinically relevant and visually similar images to support radiologists' examination has been attracting lot of research interest. It provides a baseline essential for confirmation, comparison and evaluation of suspicious radiographic signs detected on current examination images. Content-based image retrieval (CBIR) is an important alternate and complement to traditional text-based image retrieval (TBIR) using keywords. The proposed CBIR system is based on the effective use of texture information within images using 2-D Wold decomposition of homogeneous random fields. To speed up the search process, selected features are extracted and indexed using the proposed indexing structure. This paper describes a new efficient indexing structure for elongated vectors of feature space using lattice vector quantisation (LVQ). Selected features are indexed based on norm, leader and permutation indices. Simple Euclidean distance measure is used to display the retrieved images in the decreasing order of similarity. Features for harmonic structures and evanescent components are compared based on precision and recall. Experiments were carried out on MR-T2 axial brain slices. Features of harmonic structure gives better results when compared to evanescent components.

An intelligent content-based image retrieval system for clinical decision support in brain tumor diagnosis

Accurate diagnosis is crucial for successful treatment of the brain tumor. Accordingly in this paper, we propose an intelligent content-based image retrieval (CBIR) system which retrieves similar pathology bearing magnetic resonance (MR) images of the brain from a medical database to assist the radiologist in the diagnosis of the brain tumor. A single feature vector will not perform well for finding similar images in the medical domain as images within the same disease class differ by severity, density and other such factors. To handle this problem, the proposed CBIR system uses a two-step approach to retrieve similar MR images. The first step classifies the query image as benign or malignant using the features that discriminate the classes. The second step then retrieves the most similar images within the predicted class using the features that distinguish the subclasses. In order to provide faster image retrieval, we propose an indexing method called clustering with principal component analysis (PCA) and KD-tree which groups subclass features into clusters using modified K-means clustering and separately reduces the dimensionality of each cluster using PCA. The reduced feature set is then indexed using a KD-tree. The proposed CBIR system is also made robust against misalignment that occurs during MR image acquisition. Experiments were carried out on a database consisting of 820 MR images of the brain tumor. The experimental results demonstrate the effectiveness of the proposed system and show the viability of clinical application.