Deep Features Research Articles

Deep Learning Driven Real-Time Airspace Monitoring Using Satellite Imagery

Detecting aircraft in remote sensing images poses a formidable challenge due to the diverse characteristics of aircraft, including type, size, pose, and intricate backgrounds. Traditional algorithms encounter difficulties in manually extracting features from numerous candidate regions. This paper introduces an innovative aircraft detection approach that combines corner clustering with a diverse set of Deep Learning (DL) models. The proposed method involves two main stages: region proposal and classification. In the region proposal stage, initial candidate regions are generated using a mean-shift clustering algorithm applied to corners detected on binary images. Subsequently, a comprehensive set of classifiers, encompassing CNN, DenseNet, MobileNetV2, Inception v3, Random Forest (R.F), ResNet50, ResNeXT, Support Vector Machine (SVM), VGG16, Xception, EfficientNet, and InceptionResNetv2, is employed for feature extraction and classification. The presented approach demonstrates superior accuracy and efficiency compared to conventional methods. By leveraging the autonomous learning capabilities of CNN and DL models on extensive datasets, the methodology generates a reduced yet high-quality set of candidate regions. Inspired by the detection methodology employed by image analysts, the approach adopts a coarse-to-fine strategy using CNN and DL models. The first CNN proposes coarse candidate regions, and the second identifies individual airplanes within these regions in finer detail. This framework results in a decreased number of candidate regions compared to existing literature while extracting distinctive deep features. Experimental evaluations on Google Earth images validate the efficiency of the proposed method, underscoring its potential for practical applications in both civilian and military contexts.

MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition

In recent years, with the rise of deep learning technologies, EEG-based emotion recognition has garnered significant attention. However, most existing methods tend to focus on the spatiotemporal information of EEG signals while overlooking the potential topological information of brain regions. To address this issue, this paper proposes a dynamic graph attention network with multi-branch feature extraction and staged fusion (MAS-DGAT-Net), which integrates graph convolutional neural networks (GCN) for EEG emotion recognition. Specifically, the differential entropy (DE) features of EEG signals are first reconstructed into a correlation matrix using the Spearman correlation coefficient. Then, the brain-region connectivity-feature extraction (BCFE) module is employed to capture the brain connectivity features associated with emotional activation states. Meanwhile, this paper introduces a dual-branch cross-fusion feature extraction (CFFE) module, which consists of an attention-based cross-fusion feature extraction branch (A-CFFEB) and a cross-fusion feature extraction branch (CFFEB). A-CFFEB efficiently extracts key channel-frequency information from EEG features by using an attention mechanism and then fuses it with the output features from the BCFE. The fused features are subsequently input into the proposed dynamic graph attention module with a broad learning system (DGAT-BLS) to mine the brain connectivity feature information further. Finally, the deep features output by DGAT-BLS and CFFEB are combined for emotion classification. The proposed algorithm has been experimentally validated on SEED, SEED-IV, and DEAP datasets in subject-dependent and subject-independent settings, with the results confirming the model's effectiveness. The source code is publicly available at: https://github.com/cvmdsp/MAS-DGAT-Net

LRAF-Net: Long-Range Attention Fusion Network for Visible-Infrared Object Detection.

Visible-infrared object detection aims to improve the detector performance by fusing the complementarity of visible and infrared images. However, most existing methods only use local intramodality information to enhance the feature representation while ignoring the efficient latent interaction of long-range dependence between different modalities, which leads to unsatisfactory detection performance under complex scenes. To solve these problems, we propose a feature-enhanced long-range attention fusion network (LRAF-Net), which improves detection performance by fusing the long-range dependence of the enhanced visible and infrared features. First, a two-stream CSPDarknet53 network is used to extract the deep features from visible and infrared images, in which a novel data augmentation (DA) method is designed to reduce the bias toward a single modality through asymmetric complementary masks. Then, we propose a cross-feature enhancement (CFE) module to improve the intramodality feature representation by exploiting the discrepancy between visible and infrared images. Next, we propose a long-range dependence fusion (LDF) module to fuse the enhanced features by associating the positional encoding of multimodality features. Finally, the fused features are fed into a detection head to obtain the final detection results. Experiments on several public datasets, i.e., VEDAI, FLIR, and LLVIP, show that the proposed method obtains state-of-the-art performance compared with other methods.

An ensemble deep learning model for fast classification of Twitter spam

Twitter spam needs to be detected and arrested quickly. The paper examines methods for classification of spam in terms of determination of important features, comparative performance of classification models, and improvement in time performance for classification. It presents a conceptualization of several novel rich, deep, and naïve features. The extraction processes for rich and deep features increase the time complexity of spam classification. To address this, the proposed model selectively segregates and combines features to enable near real-time processing. This supersedes the time performance of standard machine learning and deep learning models, with no compromise on the quality of classification.

Fruit and vegetable leaf disease recognition based on a novel custom convolutional neural network and shallow classifier.

Fruits and vegetables are among the most nutrient-dense cash crops worldwide. Diagnosing diseases in fruits and vegetables is a key challenge in maintaining agricultural products. Due to the similarity in disease colour, texture, and shape, it is difficult to recognize manually. Also, this process is time-consuming and requires an expert person. We proposed a novel deep learning and optimization framework for apple and cucumber leaf disease classification to consider the above challenges. In the proposed framework, a hybrid contrast enhancement technique is proposed based on the Bi-LSTM and Haze reduction to highlight the diseased part in the image. After that, two custom models named Bottleneck Residual with Self-Attention (BRwSA) and Inverted Bottleneck Residual with Self-Attention (IBRwSA) are proposed and trained on the selected datasets. After the training, testing images are employed, and deep features are extracted from the self-attention layer. Deep extracted features are fused using a concatenation approach that is further optimized in the next step using an improved human learning optimization algorithm. The purpose of this algorithm was to improve the classification accuracy and reduce the testing time. The selected features are finally classified using a shallow wide neural network (SWNN) classifier. In addition to that, both trained models are interpreted using an explainable AI technique such as LIME. Based on this approach, it is easy to interpret the inside strength of both models for apple and cucumber leaf disease classification and identification. A detailed experimental process was conducted on both datasets, Apple and Cucumber. On both datasets, the proposed framework obtained an accuracy of 94.8% and 94.9%, respectively. A comparison was also conducted using a few state-of-the-art techniques, and the proposed framework showed improved performance.

Reproducible and Interpretable Machine Learning-Based Radiomic Analysis for Overall Survival Prediction in Glioblastoma Multiforme

Purpose: To develop and validate an MRI-based radiomic model for predicting overall survival (OS) in patients diagnosed with glioblastoma multiforme (GBM), utilizing a retrospective dataset from multiple institutions. Materials and Methods: Pre-treatment MRI images of 289 GBM patients were collected. From each patient’s tumor volume, 660 radiomic features (RFs) were extracted and subjected to robustness analysis. The initial prognostic model with minimum RFs was subsequently enhanced by including clinical variables. The final clinical–radiomic model was derived through repeated three-fold cross-validation on the training dataset. Performance evaluation included assessment of concordance index (C-Index), integrated area under curve (iAUC) alongside patient stratification into low and high-risk groups for overall survival (OS). Results: The final prognostic model, which has the highest level of interpretability, utilized primary gross tumor volume (GTV) and one MRI modality (T2-FLAIR) as a predictor and integrated the age variable with two independent, robust RFs, achieving moderately good discriminatory performance (C-Index [95% confidence interval]: 0.69 [0.62–0.75]) with significant patient stratification (p = 7 × 10−5) on the validation cohort. Furthermore, the trained model exhibited the highest iAUC at 11 months (0.81) in the literature. Conclusion: We identified and validated a clinical–radiomic model for stratification of patients into low and high-risk groups based on OS in patients with GBM using a multicenter retrospective dataset. Future work will focus on the use of deep learning-based features, with recently standardized convolutional filters on OS tasks.

Robust Face Recognition System Based on Deep Facial Feature Extraction and Machine Learning

Facial Recognition is a common challenge in research for security applications. Wide-ranging applications of this technology include biometrics, security data, access to controlled locations, smart cards, and surveillance systems. A practical approach to identifying individuals depends on factors such as partial face occlusion, illumination, age, expression, makeup, and poses. These complex face recognition variables affect most face recognition systems. In this paper, we propose a deep transfer learning for facial features based on the pose and illumination variations of celebrities’ faces in a free environment for face recognition. The new approach that combines deep learning methods for feature extraction with machine learning classification methods. Also, studies the performance of the pre-trained model (VGGFace2 with ResNet-50 model weights) for feature extraction with a Multilayer Perceptron Classifier (MLP), Decision Tree, and Bootstrap Aggregation (Bagging) to perform classification. The convolution neural network has lately achieved excellent advancement in facial recognition. The outcome indicated that VGGFace2 with MLP obtained more precision and provided the best results (Accuracy, F-measure, Recall, and Precision). The results for all metric for the proposed model is 99%. The benchmark for this model is a dataset of 105 people’s faces.

An Expert Model Using Deep Learning for Image-based Pest Identification with the TSLM Approach for Enhancing Precision Farming

The rise of digital agriculture has sparked considerable interest in its potential to revolutionize farming practices by integrating of advanced technologies. Unmanned aerial vehicles (UAVs), commonly known as drones, have emerged as a crucial tool in precision agriculture, offering diverse applications for real-world scenarios. This research focuses on harnessing the power of drones in the context of digital agriculture support, particularly in addressing the challenges of crop protection and pest management. The objective is to develop an innovative approach for crop-disease diagnosis using an upgraded Transfer-Driven Self-Adaptive Learning Model (TSLM) that leverages multispectral remote sensing data of drone-captured images to improve pest classification and streamline pesticide application. The study explores nine potent deep neural network models' capabilities for identifying plant diseases using various approaches within the digital agriculture framework. Transfer learning and advanced feature extraction techniques are employed to tailor these deep neural networks to the specific crop protection context. Using of pre-trained deep learning models for feature extraction and fine-tuning enhances the effectiveness of the proposed model. Evaluating the model's performance, precision, sensitivity, specificity, and F1-score metrics are assessed, leading to the discovery that deep feature extraction and Self-Adaptive Learning Model (SLM) classification outperform traditional transfer learning methods. The novelty of this work lies in its application of communication protocols to coordinate a fleet of drones for crop protection within the digital agriculture framework. By combining deep learning techniques with transfer-driven self-adaptive learning, the proposed approach significantly enhances the accuracy and efficiency of pest classification in precision agriculture. The study's findings offer valuable insights into optimizing drone-based technologies to combat plant disease epidemics, thereby contributing to the advancement of digital agriculture and its role in supporting sustainable farming practices.

LUT-SLS: A Lightweight Transformer Network Based on U-Net for Skin Lesion Segmentation

In recent years, deep learning has achieved significant advancements in medical image segmentation, primarily focusing on CNN structures and Transformer-based architectures. However, these network architectures often suffer from high computational complexity and a large number of parameters. To address these challenges, this paper proposes a lightweight, novel structured network called LUT-SLS, based on U-Net and Transformer. Firstly, the overall structure integrates U-Net and Transformer, which effectively captures long-range dependencies in image relationships and contextual information, thereby improving segmentation accuracy. Secondly, a novel PLTS module is designed, which replaces the traditional self-attention mechanism with average pooling operations to extract global features and local details. Additionally, a novel MMLP structure is introduced, incorporating residual depth-separable operations into the traditional fully-connected framework. This enhances the processing of pooled features and further improves feature expression capability. Finally, the encoder and decoder parts are connected by the MSBN module, which facilitates the extraction of deep features while fusing encoder features. Experimental results demonstrate that the proposed model achieves competitive advantages in balancing the number of parameters, computational complexity, and performance compared to current leading models on multiple public datasets. This solution enables model deployment on IoT terminals, assisting doctors in making more accurate clinical decisions.

Multi-channel depth segmentation network based on 3D graph convolution algorithm and its application in point cloud segmentation

At the current stage, 3D graph convolutional algorithms face the following issues: (1) The problem of determining the neighborhood in graph convolution. (2) The issue of fusing features at different depths in deep graph convolutional algorithms. (3) The challenge of feature fusion and recognition in multi-path deep graph convolutional algorithms. Based on these, the paper "Multi-Path Deep Segmentation Network Based on 3D Graph Convolutional Algorithm and Its Application in Point Cloud Segmentation" is proposed. Inspired by visual computing theory, the neighborhood for 3D graph convolution is determined based on the receptive field theory, and a 3D graph convolutional algorithm based on visual selectivity is proposed; A single-link deep feature extraction algorithm for 3D graph convolution based on visual selectivity is proposed, it achieve the fusion of features at different depths learned by the graph convolutional algorithm by a pyramid learning method; A multi-link feature extraction algorithm for 3D graph convolution based on visual selectivity is proposed, and achieve multi-link feature fusion and segmentation to utilize the RPN calculation method. compared with algorithms such as PointNet, PointNet++, KPConv deform, 3D GCN, and My Algorithm, The segmentation performance and geometric invariance of the proposed algorithm are validated on the ShapeNetPart dataset and the custom Mortise_and_Tenon_DB dataset, and Experiments demonstrate that the proposed algorithm is correct and feasible, offers superior 3D point cloud segmentation performance, and exhibits strong geometric invariance.

Prediction of Crohn's disease based on deep feature recognition

BackgroundCrohn's disease is a complex genetic disease that involves chronic gastrointestinal inflammation and results from a complex set of genetic, environmental, and immunological factors. By analyzing data from the human microbiome, genetic information can be used to predict Crohn's disease. Recent advances in deep learning have demonstrated its effectiveness in feature extraction and the use of deep learning to decode genetic information for disease prediction. MethodsIn this paper, we present a deep learning-based model that utilizes a sequential convolutional attention network (SCAN) for feature extraction, incorporates adaptive additive interval losses to enhance these features, and employs support vector machines (SVM) for classification. To address the challenge of unbalanced Crohn's disease samples, we propose a random noise one-hot encoding data augmentation method. ResultsData augmentation with random noise accelerates training convergence, while SCAN-SVM effectively extracts features with adaptive additive interval loss enhancing differentiation. Our approach outperforms benchmark methods, achieving an average accuracy of 0.80 and a kappa value of 0.76, and we validate the effectiveness of feature enhancement. ConclusionsIn summary, we use deep feature recognition to effectively analyze the potential information in genes, which has a good application potential for gene analysis and prediction of Crohn's disease.

A Representation-Learning-Based Graph and Generative Network for Hyperspectral Small Target Detection

Hyperspectral small target detection (HSTD) is a promising pixel-level detection task. However, due to the low contrast and imbalanced number between the target and the background spatially and the high dimensions spectrally, it is a challenging one. To address these issues, this work proposes a representation-learning-based graph and generative network for hyperspectral small target detection. The model builds a fusion network through frequency representation for HSTD, where the novel architecture incorporates irregular topological data and spatial–spectral features to improve its representation ability. Firstly, a Graph Convolutional Network (GCN) module better models the non-local topological relationship between samples to represent the hyperspectral scene’s underlying data structure. The mini-batch-training pattern of the GCN decreases the high computational cost of building an adjacency matrix for high-dimensional data sets. In parallel, the generative model enhances the differentiation reconstruction and the deep feature representation ability with respect to the target spectral signature. Finally, a fusion module compensates for the extracted different types of HS features and integrates their complementary merits for hyperspectral data interpretation while increasing the detection and background suppression capabilities. The performance of the proposed approach is evaluated using the average scores of AUCD,F, AUCF,τ, AUCBS, and AUCSNPR. The corresponding values are 0.99660, 0.00078, 0.99587, and 333.629, respectively. These results demonstrate the accuracy of the model in different evaluation metrics, with AUCD,F achieving the highest score, indicating strong detection performance across varying thresholds. Experiments on different hyperspectral data sets demonstrate the advantages of the proposed architecture.

Iterative Optimization-Enhanced Contrastive Learning for Multimodal Change Detection

Multimodal change detection (MCD) harnesses multi-source remote sensing data to identify surface changes, thereby presenting prospects for applications within disaster management and environmental surveillance. Nonetheless, disparities in imaging mechanisms across various modalities impede the direct comparison of multimodal images. In response, numerous methodologies employing deep learning features have emerged to derive comparable features from such images. Nevertheless, several of these approaches depend on manually labeled samples, which are resource-intensive, and their accuracy in distinguishing changed and unchanged regions is not satisfactory. In addressing these challenges, a new MCD method based on iterative optimization-enhanced contrastive learning is proposed in this paper. With the participation of positive and negative samples in contrastive learning, the deep feature extraction network focuses on extracting the initial deep features of multimodal images. The common projection layer unifies the deep features of two images into the same feature space. Then, the iterative optimization module expands the differences between changed and unchanged areas, enhancing the quality of the deep features. The final change map is derived from the similarity measurements of these optimized features. Experiments conducted across four real-world multimodal datasets, benchmarked against eight well-established methodologies, incontrovertibly illustrate the superiority of our proposed approach.

Distance-based loss function for deep feature space learning of convolutional neural networks

Convolutional Neural Networks (CNNs) have been on the forefront of neural network research in recent years. Their breakthrough performance in fields such as image classification has gathered efforts in the development of new CNN-based architectures, but recently more attention has been directed to the study of new loss functions. Softmax loss remains the most popular loss function due mainly to its efficiency in class separation, but the function is unsatisfactory in terms of intra-class compactness. While some studies have addressed this problem, most solutions attempt to refine softmax loss or combine it with other approaches. We present a novel loss function based on distance matrices (LDMAT), softmax independent, that maximizes interclass distance and minimizes intraclass distance. The loss function operates directly on deep features, allowing their use on arbitrary classifiers. LDMAT minimizes the distance between two distance matrices, one constructed with the model’s deep features and the other calculated from the labels. The use of a distance matrix in the loss function allows a two-dimensional representation of features and imposes a fixed distance between classes, while improving intra-class compactness. A regularization method applied to the distance matrix of labels is also presented, that allows a degree of relaxation of the solution and leads to a better spreading of features in the separation space. Efficient feature extraction was observed on datasets such as MNIST, CIFAR10 and CIFAR100.

Combining 2.5D deep learning and conventional features in a joint model for the early detection of sICH expansion.

The study aims to investigate the potential of training efficient deep learning models by using 2.5D (2.5-Dimension) masks of sICH. Furthermore, it intends to evaluate and compare the predictive performance of a joint model incorporating four types of features with standalone 2.5D deep learning, radiomics, radiology, and clinical models for early expansion in sICH. A total of 254 sICH patients were enrolled retrospectively and divided into two groups according to whether the hematoma was enlarged or not. The 2.5D mask of sICH is constructed with the maximum axial, coronal and sagittal planes of the hematoma, which is used to train the deep learning model and extract deep learning features. Predictive models were built on clinic, radiology, radiomics and deep learning features separately and four type features jointly. The diagnostic performance of each model was measured using the receiver operating characteristic curve (AUC), Accuracy, Recall, F1 and decision curve analysis (DCA). The AUCs of the clinic model, radiology model, radiomics model, deep learning model, joint model, and nomogram model on the train set (training and Cross-validation) were 0.639, 0.682, 0.859, 0.807, 0.939, and 0.942, respectively, while the AUCs on the test set (external validation) were 0.680, 0.758, 0.802, 0.857, 0.929, and 0.926. Decision curve analysis showed that the joint model was superior to the other models and demonstrated good consistency between the predicted probability of early hematoma expansion and the actual occurrence probability. Our study demonstrates that the joint model is a more efficient and robust prediction model, as verified by multicenter data. This finding highlights the potential clinical utility of a multifactorial prediction model that integrates various data sources for prognostication in patients with intracerebral hemorrhage. The Critical Relevance Statement: Combining 2.5D deep learning features with clinic features, radiology markers, and radiomics signatures to establish a joint model enabling physicians to conduct better-individualized assessments the risk of early expansion of sICH.

Automatic Classification of Defective Photovoltaic Module Cells Based on a Novel CNN-PCA-SVM Deep Hybrid Model in Electroluminescence Images

In today’s world, the rapid development of photovoltaic (PV) power plants has facilitated sustainable energy production. Maintenance and fault detection play a crucial role in ensuring the continuity of energy production. Manual inspection of electroluminescence (EL) images of PV modules requires significant human resources and time investment. This study presents a method for automatic fault detection of PV cells in EL images using hybrid deep features optimized with the principal component analysis (PCA) feature selection algorithm. A lightweight and high-performance model that combines the strengths of convolutional neural network (CNN) architectures is proposed. Firstly, data augmentation techniques are employed due to the imbalance between defective and functional classes in the dataset containing EL images. In experimental studies conducted by integrating the PCA algorithm into MobileNetV2, DenseNet201, and InceptionV3 CNN models, accuracy, precision, recall, and F1-score values of 92.19%, 92%, 90% and 91%, respectively, were achieved. When the results were analyzed, it was observed that the proposed method had an effective performance in detecting faults in PV panel cells.

Wave masked autoencoder: An electrocardiogram signal diagnosis model based on wave making strategy

ECG signal labeling is time-consuming and laborious, significantly constraining the performance of deep learning models on ECG diagnosis. Self-supervised learning methods offer a means to mitigate the reliance on annotated ECG data. Nevertheless, the direct transposition of these methods to ECG diagnostics may encounter challenges stemming from deficient domain knowledge and incongruous model architectures. Therefore, a self-supervised learning model that introduces ECG prior knowledge, called wave masked autoencoder (WMAE), is proposed. Firstly, considering that various waves that make up the ECG signal are key features for diagnosing arrhythmias, we design a wave masking strategy as an auxiliary task for self-supervised learning to introduce ECG-related knowledge. Secondly, sliding window slicing is utilized to divide each ECG signal into a series of subsequences, which are mapped into deep features with a convolutional feature mapper to increase the information density of basic semantic units and learn complete waveform representations. In this way, the proposed WMAE can capture robust and transferable ECG signal features from unlabeled data, thereby alleviating the problem of insufficient annotated ECG data and improving the performance of the model on cardiovascular disease diagnosis. Experimental results show that WMAE is significantly better than other benchmark models and has high practical value.

AerialIRGAN: unpaired aerial visible-to-infrared image translation with dual-encoder structure

Due to the high cost of equipment and the constraints of shooting conditions, obtaining aerial infrared images of specific targets is very challenging. Most methods using Generative Adversarial Networks for translating visible images to infrared greatly depend on registered data and struggle to handle the diversity and complexity of scenes in aerial infrared targets. This paper proposes a one side end-to-end unpaired aerial visible-to-infrared image translation algorithm, termed AerialIRGAN. AerialIRGAN introduces a dual-encoder structure, where one encoder is designed based on the Segment Anything Model to extract deep semantic features from visible images, and the other encoder is designed based on UniRepLKNet to capture small-scale patterns and sparse patterns from visible images. Subsequently, AerialIRGAN constructs a bridging module to deeply integrate the features of both encoders and their corresponding decoders. Finally, AerialIRGAN proposes a structural appearance consistency loss to guide the synthetic infrared images to maintain the structure of the source image while possessing distinct infrared characteristics. The experimental results show that compared to the existing typical infrared image generation algorithms, the proposed method can generate higher-quality infrared images and achieve better performance in both subjective visual description and objective metric evaluation.

A dual-channel correlation filtering tracker for real-time tracking based on deep features of improved CaffeNet and integrated manual features

A dual-channel correlation filtering tracker for real-time tracking based on deep features of improved CaffeNet and integrated manual features

MLFEU-NET: A Multi-scale Low-level Feature Enhancement Unet for breast lesions segmentation in ultrasound images

Breast lesions constantly threaten the health of females. Segmentation methods of breast lesions are important for clinical diagnosis, and neural networks have been widely used and played a significant role in this field. However, false detections and miss detections still exist due to the variability in the shape and location of breast lesions, artifacts and noise in breast ultrasound (BUS) images, and structural defects in conventional segmentation networks. In this paper, a multi-scale low-level feature enhancement Unet (MLFEU-net) structure is presented, consisting of the U-net structure, low-level feature enhancement block (LFEB), and a parallel multiscale feature fusion (PMFF) module. Specifically, LFEB enhances the detail information during shallow downsampling and further feature selection. Meanwhile, in the neck of Unet, PMFF module uses different scales of dilation convolution to provide different sizes of sensory fields, and to efficiently merge shallow and deep features filtered, leads to more accurate segmentation results. To evaluate the MLFEU-net’s segmentation ability, five quantitative metrics were used on two breast ultrasound datasets, and it was compared with several advanced segmentation techniques. The results illustrate that our approach surpasses other methods in performance. Moreover, robustness experiments validate the effectiveness of our approach in achieving robust segmentation of breast lesions.