Extract Discriminative Features Research Articles

Multi-granularity tooth analysis via YOLO-based object detection models for effective tooth detection and classification

Accurate detection and classification of teeth is the first step in dental disease diagnosis. However, the same class of tooth exhibits significant variations in surface appearance. Moreover, the complex geometrical structure poses challenges in learning discriminative features among the different tooth classes. Due to these complex features, tooth classification is one of the challenging research domains in deep learning. To address the aforementioned issues, the presented study proposes discriminative local feature extraction at different granular levels using YOLO models. However, this necessitates a granular intra-oral image dataset. To facilitate this requirement, a dataset at three granular levels (two, four, and seven teeth classes) is developed. YOLOv5, YOLOv6, and YOLOv7 models were trained using 2,790 images. The results indicate superior performance of YOLOv6 for two-class classification problems. The model generated a mean average precision (mAP) value of 94%. However, as the granularity level is increased, the performance of YOLO models decreases. For, four and seven-class classification problems, the highest mAP value of 87% and 79% was achieved by YOLOv5 respectively. The results indicate that different levels of granularity play an important role in tooth detection and classification. The YOLO’s performance gradually decreased as the granularity decreased especially at the finest granular level.

Decoding Innocence: Advancing Forensic Facial Discrimination through Comparative Analysis of Conventional CNN and Advanced Architectures

The field of Digital Image Forensics (DIF) faces a critical issue in accurately identifying children in digital images, notably in cases involving the proliferation of child sexual abuse content. Existing techniques face hurdles due to model architecture limitations, dataset suitability concerns, and classification imbalance, impeding their ability to recognize children to deter pornographic images. Addressing this challenge, this study introduces Implicit Feature Extraction (IFE), a specialized approach for distinguishing child and adult images in object detection. Leveraging Convolutional Neural Networks (CNNs), the IFE method automates the extraction of discriminative facial features, surpassing the constraints of Explicit Feature Extraction (EFE) methods, which achieve an accuracy of around 70%. The research focuses on three core objectives introducing IFE for detailed face feature detection in DIF's child and adult image identification, implementing IFE with CNNs to enhance image classification, and conducting a thorough evaluation of the proposed technique's performance using key metrics like accuracy and balanced classification results and comparing the result with a basic CNN model’s performance. This research's significance lies in its notable contributions to digital image forensics, particularly in combatting child exploitation. The fusion of IFE with CNNs showcases 92% accuracy in distinguishing child and adult images, promising advancements with practical implications in child protection and forensic investigations. The comprehensive evaluation using the UTKFace dataset underscores the proposed technique's efficacy, marking a substantial improvement in child image identification within digital image forensics.

Traffic Sign Classification Using CNN

This study presents a novel approach for traffic sign classification leveraging Convolutional Neural Networks (CNNs). With the proliferation of autonomous vehicles and advanced driver assistance systems, accurate and efficient traffic sign recognition is imperative for safe and efficient navigation. The proposed CNN-based method utilizes deep learning techniques to automatically extract discriminative features from traffic sign images, enabling robust classification across diverse environmental conditions and variations in sign appearance. Experimental results demonstrate the effectiveness of the proposed approach. This research contributes to the advancement of intelligent transportation systems by providing a reliable and scalable solution for real-time traffic sign classification. Our findings highlight the potential of deep learning for robust and accurate traffic sign classification in real-world scenarios.

Multi-culture Sign Language Detection and Recognition Using Fine-tuned Convolutional Neural Network

The speech and hearing-impaired community use sign language as the primary means of communication. It is quite challenging for the general population to interpret or learn sign language completely. A sign language recognition system must be designed and developed to address this communication barrier. Most current sign language recognition systems rely on wearable sensors, keeping the recognition system unaffordable for most individuals. Moreover, the existing vision-based sign recognition frameworks do not consider all of the spatial and temporal information required for accurate recognition. A novel vision-based hybrid deep neural net methodology is proposed in this project for recognizing American Sign Language (ASL) and custom sign gestures. The proposed framework aims to establish a single framework for tracking and extracting multi-semantic properties, such as non-manual components and manual co-articulations. Furthermore, spatial feature extraction from the sign gestures is deployed using a Hybrid Deep Neural Network (HDNN) with atrous convolutions. The temporal and sequential feature extraction is carried out by employing attention-based HDNN. In addition, the distinguished abstract feature extraction is done using modified autoencoders. The discriminative feature extraction for differentiating the sign gestures from unwanted transition gestures is done by leveraging the hybrid attention module. The experimentation of the proposed model has been carried out on the novel multi-signer ASL and custom sign language dataset. The proposed sign language recognition framework with hybrid neural nets, specifically using HDNN, yields better results than other state-of-the-art frameworks. Additionally, a detection module is incorporated using Flask web, allowing manual input of images/signs for real-time recognition.

Employing a Convolutional Neural Network to Classify Sleep Stages from EEG Signals Using Feature Reduction Techniques

One of the most essential components of human life is sleep. One of the first steps in spotting abnormalities connected to sleep is classifying sleep stages. Based on the kind and frequency of signals obtained during a polysomnography test, sleep phases can be separated into groups. Accurate classification of sleep stages from electroencephalogram (EEG) signals plays a crucial role in sleep disorder diagnosis and treatment. This study proposes a novel approach that combines feature selection techniques with convolutional neural networks (CNNs) to enhance the classification performance of sleep stages using EEG signals. Firstly, a comprehensive feature selection process was employed to extract discriminative features from raw EEG data, aiming to reduce dimensionality and enhance the efficiency of subsequent classification using mutual information (MI) and analysis of variance (ANOVA) after splitting the dataset into two sets—the training set (70%) and testing set (30%)—then processing it using the standard scalar method. Subsequently, a 1D-CNN architecture was designed to automatically learn hierarchical representations of the selected features, capturing complex patterns indicative of different sleep stages. The proposed method was evaluated on a publicly available EDF-Sleep dataset, demonstrating superior performance compared to traditional approaches. The results highlight the effectiveness of integrating feature selection with CNNs in improving the accuracy and reliability of sleep stage classification from EEG signals, which reached 99.84% with MI-50. This approach not only contributes to advancing the field of sleep disorder diagnosis, but also holds promise for developing more efficient and robust clinical decision support systems.

DLA-Net: dual lesion attention network for classification of pneumoconiosis using chest X-ray images

Accurate and early detection of pneumoconiosis using chest X-rays (CXR) is important for preventing the progression of this incurable disease. It is also a challenging task due to large variations in appearance, size and location of lesions in the lung regions as well as inter-class similarity and intra-class variance. Compared to traditional methods, Convolutional Neural Networks-based methods have shown improved results; however, these methods are still not applicable in clinical practice due to limited performance. In some cases, limited computing resources make it impractical to develop a model using whole CXR images. To address this problem, the lung fields are divided into six zones, each zone is classified separately and the zone classification results are then aggregated into an image classification score, based on state-of-the-art. In this study, we propose a dual lesion attention network (DLA-Net) for the classification of pneumoconiosis that can extract features from affected regions in a lung. This network consists of two main components: feature extraction and feature refinement. Feature extraction uses the pre-trained Xception model as the backbone to extract semantic information. To emphasise the lesion regions and improve the feature representation capability, the feature refinement component uses a DLA module that consists of two sub modules: channel attention (CA) and spatial attention (SA). The CA module focuses on the most important channels in the feature maps extracted by the backbone model, and the SA module highlights the spatial details of the affected regions. Thus, both attention modules combine to extract discriminative and rich contextual features to improve classification performance on pneumoconiosis. Experimental results show that the proposed DLA-Net outperforms state-of-the-art methods for pneumoconiosis classification.

Spectral Spatial Neighborhood Attention Transformer for Hyperspectral Image Classification

Hyperspectral image (HSI) can provide rich spectral information, which can be helpful for accurate classification in many applications. However, the hyperspectral image classification task has challenges, including limited labeled data, data redundancy, data sparsity, and imbalanced class samples. Over time, various methods have been proposed to solve the above-mentioned problems. To mitigate the issue mentioned above in this paper, we present the neighborhood attention transformer with a channel-wise shift technique for hyperspectral image classification. The neighborhood attention transformer leverages the power of the attention mechanism to capture the spatial relationship between neighboring pixels and extract discriminative features. The channel-wise shift techniques empower the model to adjust the spectral characteristics of each channel adaptively, enhancing its ability to handle the spectral variations present in hyperspectral data. To validate the effectiveness of the proposed model, we conduct comprehensive experiments on the publically available dataset. The results demonstrate that our model consistently outperforms other state-of-the-art methods. The overall accuracy of the proposed model reached 99.41 % , 99.93 % , 98.35 % 99.59 % four datasets.

Handwritten Character Recognition System

Digitizing handwritten documents and enabling efficient information processing and retrieval require systems that can recognize handwritten characters. This research offers a unique approach for handwritten character detection using state-of-the-art machine learning algorithms. The proposed technique automatically extracts discriminative features from photos of handwritten characters using convolutional neural networks (CNNs). These attributes are then used by a classifier to determine which characters are related. The dataset used for training and assessment is made up of a large collection of handwritten characters gathered under various writing styles, sizes, and orientations in order to guarantee the durability and generalization power of the model. To enhance its quality and diversity, the training data is put through a rigorous preparation procedure that includes picture augmentation, noise removal, and normalization. The studies' results demonstrate how well and precisely the proposed system can recognize handwritten characters in a range of languages and writing styles. The system performs competitively compared to state-of-the-art methods and demonstrates robustness against variations in handwriting style and quality. Furthermore, the system has potential in terms of efficiency and scalability, making it suitable for real-time applications such as document digitalization, handwritten word recognition in electronic devices, and automatic form processing.

Face Recognition and Identification System for Crime Detection Using Python Programming Language

Abstract: Throughout the years, finding criminals has posed a challenging endeavor. In the past, the method relied on leads derived from evidence discovered at the crime scene. Genetic evidence is comparatively straightforward to trace, yet wrongdoers have grown increasingly proficient at obscuring their trail and leaving behind no discernible mark. To address this issue, a face recognition system for crime detection was developed. In this study, a qualitative method was used to collect the face images of criminals in collaboration with law enforcement agencies. An API was built using the criminals National Identification Numbers. Then, a face recognition view that returns the object of the user gotten from the National Identification Number was built. The returned user objects (including face images of the user) underwent preprocessing steps, including normalization, resizing, and noise removal, to enhance the quality and standardize the facial features. Local Binary Patterns algorithm in Python OpenCV library was applied to the preprocessed face images to extract discriminative features from the preprocessed face images. These features aimed to capture the unique characteristics of each face for subsequent recognition. The algorithm was trained on the extracted features and tested given a new input image. The interface component specification of the system was designed using HTML, CSS, and JavaScript client-side technologies.

Multiple Disease Detection System

Abstract: In the realm of healthcare, the early detection of multiple diseases presents a formidable challenge but holds immense potential for improving patient outcomes. This paper proposes an integrative approach for the simultaneous detection of four prevalent diseases: heart disease, Parkinson's disease, diabetes, and skin cancer. Leveraging advanced machine learning techniques, our framework encompasses data preprocessing methods for cleaning and normalization, feature selection strategies to extract discriminative features from heterogeneous medical datasets, and ensemble classification models for accurate disease prediction. Real-world datasets encompassing diverse medical conditions are utilized to evaluate the efficacy of the proposed framework. Experimental results demonstrate its superior performance in terms of accuracy, sensitivity, and specificity compared to conventional methods. This framework stands as a testament to the transformative potential of technology in healthcare, facilitating early detection and intervention across multiple diseases, thereby enhancing patient care and quality of life.

A neuroergonomics model for evaluating nuclear power plants operators’ performance under heat stress driven by ECG time-frequency spectrums and fNIRS prefrontal cortex network: A CNN-GAT fusion model

Operators experience complicated physiological and psychological states when exposed to extreme heat stress, which can impair cognitive function and decrease performance significantly, ultimately leading to severe secondary disasters. Therefore, there is an urgent need for a feasible technique to identify their abnormal states to enhance the reliability of human-cybernetics systems. With the advancement of deep learning in physiological modeling, a model for evaluating operators’ performance driven by electrocardiogram (ECG) and functional near-infrared spectroscopy (fNIRS) was proposed, demonstrating high ecological validity. The model fused a convolutional neural network (CNN) backbone and a graph attention network (GAT) backbone to extract discriminative features from ECG time-frequency spectrums and fNIRS prefrontal cortex (PFC) network respectively with deeper neuroscience domain knowledge, and eventually achieved 0.90 AUC. Results supported that handcrafted features extracted by specialized neuroscience methods can alleviate overfitting. Inspired by the small-world nature of the brain network, the fNIRS PFC network was organized as an undirected graph and embedded by GAT. It is proven to perform better in information aggregation and delivery compared to a simple non-linear transformation. The model provides a potential neuroergonomics application to evaluate the human state in vital human-cybernetics systems under industry 5.0 scenarios.

Attention-based convolution neural network for magnetic tile surface defect classification and detection

Effectively identifying surface defects in magnetic tiles has proven to be highly challenging due to limited sample availability and irrelevant background interference, which also plays a crucial role in significantly influencing the lifespan and reliability of permanent magnet motors. To address these challenges, our study draws inspiration from a comprehensive analysis of the retinal attention mechanism and proposes three guiding criteria: multi-level resolution, what to look for, and where to look at. These criteria are utilized as foundational principles to enhance the representation learning capability of designed neural network structures through the incorporation of the retinal attention mechanism. Subsequently, based on these guiding criteria, we introduce a novel convolutional retinal attention block (CRAB) to learn discriminative and robust feature representations for magnetic tile surface defect classification and detection. The proposed CRAB comprises three modules: multi-resolution module (MRM), global attention aggregation module (GAAM), and local attention aggregation module (LAAM), designed to extract discriminative and robust features by refining meaningful information and suppressing redundant ones. Comprehensive experimental results across image classification and object detection tasks demonstrate that the proposed CRAB outperforms existing methods such as SE, ECA, and CBAM, and can effectively amplify the representation power across various backbone networks, including VGG-16, GoogLeNet, ResNet-18, and ResNet-50. An evaluation on surface defect classification and detection tasks for industrial magnetic tiles further shows that CRAB achieves accuracies of 99.50% and 96.98%, respectively. These results emphasize the promising application prospects of the proposed method in detecting industrial surface defects amid expansive and inconsequential backgrounds. The code of the proposed method is available at: https://github.com/KWflyer/CRAB.

Sequence based model using deep neural network and hybrid features for identification of 5-hydroxymethylcytosine modification

RNA modifications are pivotal in the development of newly synthesized structures, showcasing a vast array of alterations across various RNA classes. Among these, 5-hydroxymethylcytosine (5HMC) stands out, playing a crucial role in gene regulation and epigenetic changes, yet its detection through conventional methods proves cumbersome and costly. To address this, we propose Deep5HMC, a robust learning model leveraging machine learning algorithms and discriminative feature extraction techniques for accurate 5HMC sample identification. Our approach integrates seven feature extraction methods and various machine learning algorithms, including Random Forest, Naive Bayes, Decision Tree, and Support Vector Machine. Through K-fold cross-validation, our model achieved a notable 84.07% accuracy rate, surpassing previous models by 7.59%, signifying its potential in early cancer and cardiovascular disease diagnosis. This study underscores the promise of Deep5HMC in offering insights for improved medical assessment and treatment protocols, marking a significant advancement in RNA modification analysis.

Discriminative Suprasphere Embedding for Fine-Grained Visual Categorization.

Despite the great success of the existing work in fine-grained visual categorization (FGVC), there are still several unsolved challenges, e.g., poor interpretation and vagueness contribution. To circumvent this drawback, motivated by the hypersphere embedding method, we propose a discriminative suprasphere embedding (DSE) framework, which can provide intuitive geometric interpretation and effectively extract discriminative features. Specifically, DSE consists of three modules. The first module is a suprasphere embedding (SE) block, which learns discriminative information by emphasizing weight and phase. The second module is a phase activation map (PAM) used to analyze the contribution of local descriptors to the suprasphere feature representation, which uniformly highlights the object region and exhibits remarkable object localization capability. The last module is a class contribution map (CCM), which quantitatively analyzes the network classification decision and provides insight into the domain knowledge about classified objects. Comprehensive experiments on three benchmark datasets demonstrate the effectiveness of our proposed method in comparison with state-of-the-art methods.

Exploiting channel state information of WiFi signal for human activity detection: an experimental study

Ubiquitous computing aims to seamlessly integrate computing into our daily lives, and requires reliable information on human activities and state for various applications. In this paper, we propose a device-free human activity recognition system that leverages the rich information behind WiFi signals to detect human activities in indoor environments, including walking, sitting, and standing. The key idea of our system is to use the dynamic features of activities, which we carefully examine and analyze through the characteristics of channel state information. We evaluate the impact of location changes on WiFi signal distribution for different activities and design an activity detection system that employs signal processing techniques to extract discriminative features from wireless signals in the frequency and temporal domains. We implement our system on a single off-the-shelf WiFi device connecting to a commercial wireless access point and evaluate it in laboratory and conference room environments. Our experiments demonstrate the feasibility of using WiFi signals for device-free human activity recognition, which could provide a practical and non-intrusive solution for indoor monitoring and ubiquitous computing applications.

Deep learning cigarette defect detection method based on saliency feature guidance

AbstractCigarette defect detection is important in industrial production. Existing methods extract features for defect detection manually or using deep learning. However, due to the small size of cigarette defects, these methods are unable to effectively extract discriminative features, limiting detection performance. Hence, a deep learning‐based method called significant feature‐guided cigarette defect detection (SFGCD) is proposed, which combines saliency feature extraction methods with deep learning to enhance feature representation and improve detection. First, edge saliency features are extracted using the proposed target gradient saliency feature extraction (GSFE) strategy. Then, a dense multi‐level feature fusion network is designed to combine the original features with the saliency features obtained from the target gradient saliency feature extraction strategy. This network enriches feature representation and improves detection by fusing original and saliency features at different levels and scales. Experimental results demonstrate that the proposed method achieves a higher accuracy of 0.02 mean average precision (MAP) value and a detection speed of 5 frames per second (FPS) on the authors' own labeled cigarette defect dataset compared to existing state‐of‐the‐art methods.

Deep Learning Model for Retrieving Color Logo Images in Content Based Image Retrieval

Content-Based Image retrieval (CBIR) has gained a magnificent deal of consideration because of the digital image data's epidemic growth. The advancement of deep learning has enabled Convolutional Neural Networks to become an influential technique for extraction of discriminative image features. In recent years, convolutional neural networks (CNNs) have proven extremely effective at extracting unique information from images. In contrast to text-based image retrieval, CBIR gathers comparable images based primarily on their visual content. The use of deep learning, especially CNNs, for feature extraction and image processing has been shown to perform better than other techniques. In the proposed study, we investigate CNNs for CBIR focusing on how well they extract discriminative visual features and facilitate accurate image retrieval. Also Principal Component Analysis and Linear Discriminant Analysis are combined for optimization of features resulting in boosting the retrieval results. Using hierarchical representations learned by CNNs, we aim to improve retrieval accuracy and efficiency. In comparison with conventional retrieval techniques, our proposed CBIR system shows superior performance on a benchmark dataset.

Towards More Faithful Natural Language Explanation Using Multi-Level Contrastive Learning in VQA

Natural language explanation in visual question answer (VQA-NLE) aims to explain the decision-making process of models by generating natural language sentences to increase users' trust in the black-box systems. Existing post-hoc methods have achieved significant progress in obtaining a plausible explanation. However, such post-hoc explanations are not always aligned with human logical inference, suffering from the issues on: 1) Deductive unsatisfiability, the generated explanations do not logically lead to the answer; 2) Factual inconsistency, the model falsifies its counterfactual explanation for answers without considering the facts in images; and 3) Semantic perturbation insensitivity, the model can not recognize the semantic changes caused by small perturbations. These problems reduce the faithfulness of explanations generated by models. To address the above issues, we propose a novel self-supervised Multi-level Contrastive Learning based natural language Explanation model (MCLE) for VQA with semantic-level, image-level, and instance-level factual and counterfactual samples. MCLE extracts discriminative features and aligns the feature spaces from explanations with visual question and answer to generate more consistent explanations. We conduct extensive experiments, ablation analysis, and case study to demonstrate the effectiveness of our method on two VQA-NLE benchmarks.

Cross-Layer and Cross-Sample Feature Optimization Network for Few-Shot Fine-Grained Image Classification

Recently, a number of Few-Shot Fine-Grained Image Classification (FS-FGIC) methods have been proposed, but they primarily focus on better fine-grained feature extraction while overlooking two important issues. The first one is how to extract discriminative features for Fine-Grained Image Classification tasks while reducing trivial and non-generalizable sample level noise introduced in this procedure, to overcome the over-fitting problem under the setting of Few-Shot Learning. The second one is how to achieve satisfying feature matching between limited support and query samples with variable spatial positions and angles. To address these issues, we propose a novel Cross-layer and Cross-sample feature optimization Network for FS-FGIC, C2-Net for short. The proposed method consists of two main modules: Cross-Layer Feature Refinement (CLFR) module and Cross-Sample Feature Adjustment (CSFA) module. The CLFR module further refines the extracted features while integrating outputs from multiple layers to suppress sample-level feature noise interference. Additionally, the CSFA module addresses the feature mismatch between query and support samples through both channel activation and position matching operations. Extensive experiments have been conducted on five fine-grained benchmark datasets, and the results show that the C2-Net outperforms other state-of-the-art methods by a significant margin in most cases. Our code is available at: https://github.com/zenith0923/C2-Net.

DVFNet: A deep feature fusion-based model for the multiclassification of skin cancer utilizing dermoscopy images.

Skin cancer is a common cancer affecting millions of people annually. Skin cells inside the body that grow in unusual patterns are a sign of this invasive disease. The cells then spread to other organs and tissues through the lymph nodes and destroy them. Lifestyle changes and increased solar exposure contribute to the rise in the incidence of skin cancer. Early identification and staging are essential due to the high mortality rate associated with skin cancer. In this study, we presented a deep learning-based method named DVFNet for the detection of skin cancer from dermoscopy images. To detect skin cancer images are pre-processed using anisotropic diffusion methods to remove artifacts and noise which enhances the quality of images. A combination of the VGG19 architecture and the Histogram of Oriented Gradients (HOG) is used in this research for discriminative feature extraction. SMOTE Tomek is used to resolve the problem of imbalanced images in the multiple classes of the publicly available ISIC 2019 dataset. This study utilizes segmentation to pinpoint areas of significantly damaged skin cells. A feature vector map is created by combining the features of HOG and VGG19. Multiclassification is accomplished by CNN using feature vector maps. DVFNet achieves an accuracy of 98.32% on the ISIC 2019 dataset. Analysis of variance (ANOVA) statistical test is used to validate the model's accuracy. Healthcare experts utilize the DVFNet model to detect skin cancer at an early clinical stage.