Content-based Image Retrieval Research Articles

Deep ensemble architectures with heterogeneous approach for an efficient content-based image retrieval

<span lang="EN-US">In the field of digital image processing, content-based image retrieval (CBIR) has become essential for searching images based on visual content characteristics like color, shape, and texture, rather than relying on text-based annotations. To address the increasing demands for efficiency and precision in CBIR systems, we introduce the HybridEnsembleNet methodology. HybridEnsembleNet combines deep learning algorithms with an asymmetric retrieval framework to optimize feature extraction and comparison in extensive image databases. This novel approach, specifically custom-made for CBIR, employs a lightweight query structure skilled at handling large-scale data under resource-constrained environments. The experiments were performed on the ROxford and RParis datasets. The deep learning component of HybridEnsembleNet significantly refines the accuracy of image matching and retrieval. RParis The ROxford dataset, specifically in the medium and hard difficulty benchmarks, demonstrates an enhancement of 5.53% and 10.44%, respectively. Similarly, the RParis dataset, under medium and hard benchmarks, exhibits improvements of 3.01% and 5.83%, showcasing superior performance compared to existing models. By overcoming the traditional limitations of CBIR systems in mean average precision (mAP) metrics, HybridEnsembleNet provides a scalable, efficient, and more accurate solution for retrieving relevant images from vast digital libraries.</span>

An Innovative Attention-based Triplet Deep Hashing Approach to Retrieve Histopathology Images.

Content-based histopathology image retrieval (CBHIR) can assist in the diagnosis of different diseases. The retrieval procedure can be complex and time-consuming if high-dimensional features are required. Thus, hashing techniques are employed to address these issues by mapping the feature space into binary values of varying lengths. The performance of deep hashing approaches in image retrieval is often superior to that of traditional hashing methods. Among deep hashing approaches, triplet-based models are typically more effective than pairwise ones. Recent studies have demonstrated that incorporating the attention mechanism into a deep hashing approach can improve its effectiveness in retrieving images. This paper presents an innovative triplet deep hashing strategy based on the attention mechanism for retrieving histopathology images, called histopathology attention triplet deep hashing (HATDH). Three deep attention-based hashing models with identical architectures and weights are employed to produce binary values. The proposed attention module can aid the models in extracting features more efficiently. Moreover, we introduce an improved triplet loss function considering pair inputs separately in addition to triplet inputs for increasing efficiency during the training and retrieval steps. Based on experiments conducted on two public histopathology datasets, BreakHis and Kather, HATDH significantly outperforms state-of-the-art hashing algorithms.

Using Deep Learning and Cbir To Address Copyright Concerns of AI-Generated Art: A Systematic Literature Review

This systematic literature review explores the intersection of deep learning and content-based image retrieval (CBIR) in addressing copyright concerns related to AI-generated art. As artificial intelligence rapidly transforms various artistic domains, it raises critical questions regarding authorship, ownership, and the ethical implications of machine-generated creativity. The review examines the capabilities of CBIR systems in identifying AI-generated images by analyzing visual features such as color, texture, and shape. Additionally, it highlights the role of deep learning models in enhancing the accuracy of these systems through the detection of distinctive patterns characteristic of AI artworks. The findings underscore the importance of developing robust methodologies that leverage AI and CBIR technologies to protect intellectual property rights while fostering innovation in the creative industries. This research contributes to the broader discourse on the legal and ethical challenges posed by AI in art, providing insights for policymakers, artists, and technologists in navigating the evolving landscape of AI-generated content.

An optimized pair-wise comparison approach for automated feature weight assignment in content-based image retrieval system

An optimized pair-wise comparison approach for automated feature weight assignment in content-based image retrieval system

Retraction Note: Analytic hierarchy process-based automatic feature weight assignment method for content-based satellite image retrieval system

Retraction Note: Analytic hierarchy process-based automatic feature weight assignment method for content-based satellite image retrieval system

An Image-based Search for Pulsar Candidates in the MeerKAT Bulge Survey

We report on the results of an image-based search for pulsar candidates toward the Galactic bulge. We used mosaic images from the MeerKAT radio telescope that were taken as part of a 173 deg2 survey of the bulge and Galactic center of our Galaxy at L band (856–1712 MHz) in all four Stokes I, Q, U, and V. The image rms noise levels of 12–17 μJy ba−1 represent a significant increase in sensitivity over past image-based pulsar searches. Our primary search criterion was circular polarization, but we used other criteria, including linear polarization, in-band spectral index, compactness, variability, and multiwavelength counterparts to select pulsar candidates. We first demonstrate the efficacy of this technique by searching for polarized emission from known pulsars and comparing our results with measurements from the literature. Our search resulted in a sample of 75 polarized sources. Bright stars or young stellar objects were associated with 28 of these sources, including a small sample of highly polarized dwarf stars with pulsar-like steep spectra. Comparing the properties of this sample with the known pulsars, we identified 30 compelling candidates for pulsation follow-up, including two sources with both strong circular and linear polarization. The remaining 17 sources are either pulsars or stars, but we cannot rule out an extragalactic origin or image artifacts among the brighter, flat-spectrum objects.

PERBANDINGAN JARAK EUCLIDEAN, CITYBLOCK, MINKOWSKI, CANBERRA, DAN CHEBYSHEV DALAM SISTEM TEMU KEMBALI CITRA BATIK

Batik is a highly valuable cultural heritage in Indonesia, showcasing a rich diversity of motifs with deep meaning and aesthetics. To enhance the accessibility and utilization of batik collections, an efficient image retrieval system is essential. This study compares distance measurement methods in a batik image retrieval system: Euclidean, Cityblock, Minkowski, Canberra, and Chebyshev, using a combination of color and texture features. The dataset comprises 50 types of batik images. The results show that the Cityblock method achieves the highest Mean Average Precision (MAP) of 97.71, followed by Canberra with MAP 96.87. The Euclidean method also performs well with a MAP of 94.56, while Minkowski and Chebyshev have lower MAP values of 92.93 and 90.89, respectively. Chebyshev experiences the largest MAP drop when images are rotated (5.98), while Cityblock demonstrates the best resistance to rotation with the smallest MAP drop (1.51). This research successfully developed a Content-Based Image Retrieval (CBIR) system with a GUI in MATLAB and suggests integrating the latest image processing and machine learning techniques for further enhancement.

Content-Based CT Image Retrieval for Emphysema Using Texture and Shape Features

Content-Based CT Image Retrieval for Emphysema Using Texture and Shape Features

Feature-level Fusion vs. Score-level Fusion for Image Retrieval Based on Pre-trained Deep Neural Networks

Today’s complex multimedia content made retrieving images similar to the user’s query from the database a challenging task. The performance of a Content-Based Image Retrieval System (CBIR) system highly depends on the image representation in a form of low-level features and similarity measurement. The traditional visual descriptors that do not provide good prior domain knowledge could lead to poor performance retrieval results. On the other hand, Deep Convolutional Neural Networks (DCNNs) have recently achieved a remarkable success as methods for image classification in various domains. Recently, pre-trained deep convolution neural networks on thousands of classes have the ability to extract very accurate and representative features which, in addition to classification, can also be successfully used in image retrieval systems. ResNet152, GoogLeNet and InceptionV3 are some of the effective and successful examples of pre-trained DCNNs recently applied in a computer vision tasks such as object recognition, clustering, and classification. In this paper, two approaches for a CBIR system, namely early fusion and late fusion, have been presented and compared. The early fusion utilizes concatenation of the features extracted by each possible pair of DCNNs, that is ResNet152-GoogLeNet, ResNet152-InceptionV3, and GoogLeNet-InceptionV3, and the late fusion apply CombSum method with Z-Score standardization to combine the score results provided by each DCNN of the aforementioned pairs. In the experiments on a popular WANG dataset it has been shown that late fusion approach slightly outperforms early fusion approach. The best performance of our experiments in terms of Average Precision (AP) for the top 20 results reaches 96.82%.

Multiple semantic X-ray medical image retrieval using efficient feature vector extracted by FPN.

Content-based medical image retrieval (CBMIR) has become an important part of computer-aided diagnostics (CAD) systems. The complex medical semantic information inherent in medical images is the most difficult part to improve the accuracy of image retrieval. Highly expressive feature vectors play a crucial role in the search process. In this paper, we propose an effective deep convolutional neural network (CNN) model to extract concise feature vectors for multiple semantic X-ray medical image retrieval. We build a feature pyramid based CNN model with ResNet50V2 backbone to extract multi-level semantic information. And we use the well-known public multiple semantic annotated X-ray medical image data set IRMA to train and test the proposed model. Our method achieves an IRMA error of 32.2, which is the best score compared to the existing literature on this dataset. The proposed CNN model can effectively extract multi-level semantic information from X-ray medical images. The concise feature vectors can improve the retrieval accuracy of multi-semantic and unevenly distributed X-ray medical images.

A Scene Graph Similarity-Based Remote Sensing Image Retrieval Algorithm

With the rapid development of remote sensing image data, the efficient retrieval of target images of interest has become an important issue in various applications including computer vision and remote sensing. This research addressed the low-accuracy problem in traditional content-based image retrieval algorithms, which largely rely on comparing entire image features without capturing sufficient semantic information. We proposed a scene graph similarity-based remote sensing image retrieval algorithm. Firstly, a one-shot object detection algorithm was designed for remote sensing images based on Siamese networks and tailored to the objects of an unknown class in the query image. Secondly, a scene graph construction algorithm was developed, based on the objects and their attributes and spatial relationships. Several construction strategies were designed based on different relationships, including full connections, random connections, nearest connections, star connections, or ring connections. Thirdly, by making full use of edge features for scene graph feature extraction, a graph feature extraction network was established based on edge features. Fourthly, a neural tensor network-based similarity calculation algorithm was designed for graph feature vectors to obtain image retrieval results. Fifthly, a dataset named remote sensing images with scene graphs (RSSG) was built for testing, which contained 929 remote sensing images with their corresponding scene graphs generated by the developed construction strategies. Finally, through performance comparison experiments with remote sensing image retrieval algorithms AMFMN, MiLaN, and AHCL, in precision rates, Precision@1 improved by 10%, 7.2%, and 5.2%, Precision@5 improved by 3%, 5%, and 1.7%; and Precision@10 improved by 1.7%, 3%, and 0.6%. In recall rates, Recall@1 improved by 2.5%, 4.3%, and 1.3%; Recall@5 improved by 3.7%, 6.2%, and 2.1%; and Recall@10 improved by 4.4%, 7.7% and 1.6%.

Content-Based Image Retrieval and Feature Extraction: Analysing the Literature

A significant amount of multimedia data consists of digital images, and multimedia content analysis is used in many real-world computer vision applications. Multimedia information, especially photos, has become much more complicated in the last several years. Every day, millions of photos are posted to various websites, such as Instagram, Facebook, and Twitter. Finding a suitable image in an archive is a difficult research subject for the field of computer vision. Most search engines use standard text-based techniques that depend on metadata and captions in order to fetch photos. Over the past 20 years, a great deal of research has been conducted on content-based image retrieval (CBIR), picture categorization, and analysis. In image classification models and CBIR, high-level picture representations are represented as feature vectors made up of numerical values. Empirical evidence indicates a considerable disparity between picture feature representation and human visual understanding. Reducing the semantic gap between human visual understanding and picture feature representation is the aim of this study. This study aims to do a thorough analysis of the latest advancements in the domains of Content-Based picture Retrieval and picture representation. We performed a comprehensive analysis of many models for image retrieval and picture representation, encompassing the most recent advancements in semantic deep-learning methods and feature extraction. This paper provides an in-depth analysis of the key ideas and important studies related to image representation and content-based picture retrieval. In an effort to stimulate more research in this field, it also offers a preview of potential future study topics.

COMPUTER VISION METHODS FOR CONDUCTING OSINT INVESTIGATIONS

This paper researches the application of computer vision techniques in concern with OSINT (Open Source Intelligence) investigations. It explores how state-ofthe- art algorithms and models in computer vision can be used to automate and enhance the process of gathering, analyzing, and interpreting visual data from open sources. The research focuses on the critical steps of image scraping, data preprocessing, and embedding generation using advanced deep learning models such as CLIP. Additionally, the study examines the challenges of managing large-scale visual data and implementing efficient search mechanisms through vector databases like Faiss and Weaviate. By applying these technologies, the paper illustrates how investigators can improve the accuracy and efficiency of imagebased searches, which are later used for uncovering hidden connections and verifying information in OSINT investigations. The findings contribute to the growing field of computer vision and intelligence gathering, offering practical recommendations for enhancing investigative processes through the integration of computer vision methodologies.

SMedIR: secure medical image retrieval framework with ConvNeXt-based indexing and searchable encryption in the cloud

The security and privacy of medical images are crucial due to their sensitive nature and the potential for severe consequences from unauthorized modifications, including data breaches and inaccurate diagnoses. This paper introduces a method for lossless medical image retrieval from encrypted images stored on third-party clouds. The proposed approach employs a symmetric integrity-centric image encryption scheme, leveraging multiple chaotic maps and cryptographic hash techniques, to ensure lossless image reconstruction. Medical images are first encrypted by the image owners and converted into hashcodes encapsulating essential features using a deep hashing technique with the ConvNeXt network as the backbone in parallel. To ensure index privacy, these hashcodes are encrypted in a searchable manner. The encrypted medical images, along with a secure index, are subsequently uploaded to cloud storage. Authorized medical image users can request similar medical images for diagnostic purposes by submitting a query image, from which a search trapdoor is generated and sent to the cloud. The retrieval process involves a secure similar image search over the encrypted indexes, followed by decryption along with integrity verification of the retrieved images. The proposed method has been rigorously tested on three standard medical datasets, demonstrating an improvement of 5-20% in retrieval accuracy compared to standard baselines. Formal security analysis and experimental results indicate that the proposed scheme offers enhanced security and retrieval accuracy, making it an effective solution for the encrypted storage and secure retrieval of medical image data.

A comprehensive guide to content-based image retrieval algorithms with visualsift ensembling.

Content-based image retrieval (CBIR) systems are vital for managing the large volumes of data produced by medical imaging technologies. They enable efficient retrieval of relevant medical images from extensive databases, supporting clinical diagnosis, treatment planning, and medical research. This study aims to enhance CBIR systems' effectiveness in medical image analysis by introducing the VisualSift Ensembling Integration with Attention Mechanisms (VEIAM). VEIAM seeks to improve diagnostic accuracy and retrieval efficiency by integrating robust feature extraction with dynamic attention mechanisms. VEIAM combines Scale-Invariant Feature Transform (SIFT) with selective attention mechanisms to emphasize crucial regions within medical images dynamically. Implemented in Python, the model integrates seamlessly into existing medical image analysis workflows, providing a robust and accessible tool for clinicians and researchers. The proposed VEIAM model demonstrated an impressive accuracy of 97.34% in classifying and retrieving medical images. This performance indicates VEIAM's capability to discern subtle patterns and textures critical for accurate diagnostics. By merging SIFT-based feature extraction with attention processes, VEIAM offers a discriminatively powerful approach to medical image analysis. Its high accuracy and efficiency in retrieving relevant medical images make it a promising tool for enhancing diagnostic processes and supporting medical research in CBIR systems.

A New Approach for Effective Retrieval of Medical Images: A Step towards Computer-Assisted Diagnosis.

The biomedical imaging field has grown enormously in the past decade. In the era of digitization, the demand for computer-assisted diagnosis is increasing day by day. The COVID-19 pandemic further emphasized how retrieving meaningful information from medical repositories can aid in improving the quality of patient's diagnosis. Therefore, content-based retrieval of medical images has a very prominent role in fulfilling our ultimate goal of developing automated computer-assisted diagnosis systems. Therefore, this paper presents a content-based medical image retrieval system that extracts multi-resolution, noise-resistant, rotation-invariant texture features in the form of a novel pattern descriptor, i.e., MsNrRiTxP, from medical images. In the proposed approach, the input medical image is initially decomposed into three neutrosophic images on its transformation into the neutrosophic domain. Afterwards, three distinct pattern descriptors, i.e., MsTrP, NrTxP, and RiTxP, are derived at multiple scales from the three neutrosophic images. The proposed MsNrRiTxP pattern descriptor is obtained by scale-wise concatenation of the joint histograms of MsTrP×RiTxP and NrTxP×RiTxP. To demonstrate the efficacy of the proposed system, medical images of different modalities, i.e., CT and MRI, from four test datasets are considered in our experimental setup. The retrieval performance of the proposed approach is exhaustively compared with several existing, recent, and state-of-the-art local binary pattern-based variants. The retrieval rates obtained by the proposed approach for the noise-free and noisy variants of the test datasets are observed to be substantially higher than the compared ones.

Bi-level feature Classification Approach in Privacy Preserving Cloud Network for High-Performance Content-based Image retrieval Mechanism

Bi-level feature Classification Approach in Privacy Preserving Cloud Network for High-Performance Content-based Image retrieval Mechanism

Cross-modality sub-image retrieval using contrastive multimodal image representations

In tissue characterization and cancer diagnostics, multimodal imaging has emerged as a powerful technique. Thanks to computational advances, large datasets can be exploited to discover patterns in pathologies and improve diagnosis. However, this requires efficient and scalable image retrieval methods. Cross-modality image retrieval is particularly challenging, since images of similar (or even the same) content captured by different modalities might share few common structures. We propose a new application-independent content-based image retrieval (CBIR) system for reverse (sub-)image search across modalities, which combines deep learning to generate representations (embedding the different modalities in a common space) with robust feature extraction and bag-of-words models for efficient and reliable retrieval. We illustrate its advantages through a replacement study, exploring a number of feature extractors and learned representations, as well as through comparison to recent (cross-modality) CBIR methods. For the task of (sub-)image retrieval on a (publicly available) dataset of brightfield and second harmonic generation microscopy images, the results show that our approach is superior to all tested alternatives. We discuss the shortcomings of the compared methods and observe the importance of equivariance and invariance properties of the learned representations and feature extractors in the CBIR pipeline. Code is available at: https://github.com/MIDA-group/CrossModal_ImgRetrieval.

Design and Implementation of a Mobile E-Commerce Platform Based-on Machine Learning

In this paper, the “STORY”, which is an e-commerce mobile platform, is developed based-on machine learning techniques in order to consolidate selling methods into a unified, efficient, and personalized environment. Also, to elevate user experiences, and cultivate a thriving e-commerce environment in Libya. STORY is designed to serve the needs of both customers and merchants, aiming to bridge the gap between consumer demands and efficient business interactions. This platform strives to provide customers with a wide range of services and functions that match their preferences, while empowering merchants with a user-friendly mobile interface for effective business management. Among its notable features, STORY boasts an image-based search function, which simplifies the process of searching for desired or similar products. Additionally, the platform integrates an intelligent recommendation system capable of tracking and analyzing customer behaviors within the platform. This system collects pertinent data to offer personalized product recommendations and tailored offers, elevating the shopping experience. The system underwent an evaluation via a questionnaire, which had overwhelmingly positive results. User feedback and satisfaction regarding the system's functionalities and performance were notably favorable.

Content-based image retrieval by classification with reinforcement optimisation evolutionary machine learning with applications

ABSTRACT Content Based Image Retrieval (CBIR) plays a significant role in identifying the similarity of images with large datasets. It is identified based on the size, colour, and texture features of the image. But in such conditions, it is complex to determine the features of query images in large datasets and does not show accurate similarity when compared with every image in the retrieval process. In order to perform an efficient similarity of images, a novel Machine Learning (ML) approach Kernelized Radial Basis Auto-Encoder Function Neural Network (Ker_RadBAEFNN) technique is proposed that performs the individual image classification in the retrieval process. Moreover, the neural networks are optimised based on the reinforcement process and perform the extraction process regarding individual images. Further,reinforcement-based optimisation estimates the images in neural networks for undertaking an automatic feature extraction of query images. The performance of the classification process is validated based on MNIST, METU, and COCO datasets that determined the efficiency of the recognition and classification process of image retrieval. The experimental analysis is carried out based on various measures such as accuracy, precision, recall, F1-score, RMSE, and MAPE for the proposed and existing GLCM-ABC, PSO-ANN, IRB-CNN, FAGWO, and OCAM methods. The analysis shows that the performance of the proposed attained better effectiveness with attained accuracy by 98% and diminished for state-of-the-art techniques as 92%, 95%, 94%, 96.8%, as well as 96%, respectively. Compared to existing methods, the accuracy rate of the proposed method is maximised by 1.3%.