Remote Sensing Image Classification Research Articles

A multi-attention residual integrated network with enhanced fireworks algorithm for remote sensing image classification

This research examines a multi-attention residual integrated network with an enhanced fireworks algorithm for remote sensing image classification. Remote sensing (RS) picture classification is important for land cover mapping, environmental monitoring, and urban planning. Remote sensing image classification is important in earth observation since the military and commercial sectors have focused on it. Due to RS data's high complexity and limited labelled examples, classifying RS pictures is difficult. Deep Learning (DL) techniques have made great strides in RS image categorization, expanding this field's potential. This research introduces Multi-Attention Residual Integrated Network with Enhanced Fireworks Algorithm (MAR-EFA) to improve hyper spectral image identification. MARIN-EFA improves feature fusion and removes unneeded features to overcome technique constraints. The suggested method weights features using different attention models. These characteristics are then carefully extracted and integrated using a residual network. Final contextual semantic integration on deeply fused features is done with a Bi-LSTM network. Our population-based Enhanced Fireworks Algorithm (EFA) is inspired by fireworks' explosive performance and optimises MARIN parameters. Attention techniques and an improved optimisation algorithm improve performance over current systems. Numerous Eurosat dataset studies were assessed using various performance indicators. The simulation results show that MARIN-EFA outperforms current methods. The suggested technique shows promise for improving RS picture classification and allowing more accurate and reliable data categorization.

Remote sensing image classification method based on improved ShuffleNet convolutional neural network

As a list of remotely sensed data sources is available, the effective processing of remote sensing images is of great significance in practical applications in various fields. This paper proposes a new lightweight network to solve the problem of remote sensing image processing by using the method of deep learning. Specifically, the proposed model employs ShuffleNet V2 as the backbone network, appropriately increases part of the convolution kernels to improve the classification accuracy of the network, and uses the maximum overlapping pooling layer to enhance the detailed features of the input images. Finally, Squeeze and Excitation (SE) blocks are introduced as the attention mechanism to improve the architecture of the network. Experimental results based on several multisource data show that our proposed network model has a good classification effect on the test samples and can achieve more excellent classification performance than some existing methods, with an accuracy of 91%, and can be used for the classification of remote sensing images. Our model not only has high accuracy but also has faster training speed compared with large networks and can greatly reduce computation costs. The demo code of our proposed method will be available at https://github.com/li-zi-qi.

LDS2AE: Local Diffusion Shared-Specific Autoencoder for Multimodal Remote Sensing Image Classification with Arbitrary Missing Modalities

Recent research on the joint classification of multimodal remote sensing data has achieved great success. However, due to the limitations imposed by imaging conditions, the case of missing modalities often occurs in practice. Most previous researchers regard the classification in case of different missing modalities as independent tasks. They train a specific classification model for each fixed missing modality by extracting multimodal joint representation, which cannot handle the classification of arbitrary (including multiple and random) missing modalities. In this work, we propose a local diffusion shared-specific autoencoder (LDS2AE), which solves the classification of arbitrary missing modalities with a single model. The LDS2AE captures the data distribution of different modalities to learn multimodal shared feature for classification by designing a novel local diffusion autoencoder which consists of a modality-shared encoder and several modality-specific decoders. The modality-shared encoder is designed to extract multimodal shared feature by employing the same parameters to map multimodal data into a shared subspace. The modality-specific decoders put the multimodal shared feature to reconstruct the image of each modality, which facilitates the shared feature to learn unique information of different modalities. In addition, we incorporate masked training to the diffusion autoencoder to achieve local diffusion, which significantly reduces the training cost of model. The approach is tested on widely-used multimodal remote sensing datasets, demonstrating the effectiveness of the proposed LDS2AE in addressing the classification of arbitrary missing modalities. The code is available at https://github.com/Jiahuiqu/LDS2AE.

Multiscale attention for few‐shot image classification

AbstractIn recent years, the application of traditional deep learning methods in the agricultural field using remote sensing techniques, such as crop area and growth monitoring, crop classification, and agricultural disaster monitoring, has been greatly facilitated by advancements in deep learning. The accuracy of image classification plays a crucial role in these applications. Although traditional deep learning methods have achieved significant success in remote sensing image classification, they often involve convolutional neural networks with a large number of parameters that require extensive optimization using numerous remote sensing images for training purposes. To address these challenges, we propose a novel approach called multiscale attention network (MAN) for sample‐based remote sensing image classification. This method consists primarily of feature extractors and attention modules to effectively utilize different scale features through multiscale feature training during the training phase. We evaluate our proposed method on three datasets comprising agricultural remote sensing images and observe superior performance compared to existing approaches. Furthermore, we validate its generalizability by testing it on an oil well indicator diagram specifically designed for classification tasks.

An improved interval type-2 possibilistic C-means clustering algorithm for interclass maximization

Cluster analysis is an important method for data analysis, which is also widely used in remote sensing image classification. An effective clustering algorithm is proposed for the uncertainty caused by the overlap between categories in pattern data and remote sensing images. First, an improved PCM (Possibilistic C-means) algorithm based on distance of cluster center (dc-PCM) is proposed to solve the clustering consistency problem of PCM algorithm. Then, based on dc-PCM algorithm, an improved interval type-2 probabilistic c-means clustering algorithm (IT2-dcPCM) is proposed for interclass maximization. The computational complexity of the proposed algorithm is analyzed, and its performance is evaluated by three data sets, two groups of images segmentation and two groups of remote sensing image classification experiments. The results show that IT2-dcPCM algorithm can assign proper membership degrees to clustering samples, and it has good performance in image segmentation and remote sensing image classification with serious spectral aliasing.

Joint superpixel and Transformer for high resolution remote sensing image classification

Deep neural networks combined with superpixel segmentation have proven to be superior to high-resolution remote sensing image (HRI) classification. Currently, most HRI classification methods that combine deep learning and superpixel segmentation use stacking on multiple scales to extract contextual information from segmented objects. However, this approach does not take into account the contextual dependencies between each segmented object. To solve this problem, a joint superpixel and Transformer (JST) framework is proposed for HRI classification. In JST, HRI is first segmented into superpixel objects as input, and Transformer is used to model the long-range dependencies. The contextual relationship between each input superpixel object is obtained and the class of analyzed objects is output by designing an encoding and decoding Transformer. Additionally, we explore the effect of semantic range on classification accuracy. JST is also tested by using two HRI datasets with overall classification accuracy, average accuracy and Kappa coefficients of 0.79, 0.70, 0.78 and 0.91, 0.85, 0.89, respectively. The effectiveness of the proposed method is compared qualitatively and quantitatively, and the results achieve competitive and consistently better than the benchmark comparison method.

Duplex-Hierarchy Representation Learning for Remote Sensing Image Classification.

Remote sensing image classification (RSIC) is designed to assign specific semantic labels to aerial images, which is significant and fundamental in many applications. In recent years, substantial work has been conducted on RSIC with the help of deep learning models. Even though these models have greatly enhanced the performance of RSIC, the issues of diversity in the same class and similarity between different classes in remote sensing images remain huge challenges for RSIC. To solve these problems, a duplex-hierarchy representation learning (DHRL) method is proposed. The proposed DHRL method aims to explore duplex-hierarchy spaces, including a common space and a label space, to learn discriminative representations for RSIC. The proposed DHRL method consists of three main steps: First, paired images are fed to a pretrained ResNet network for extracting the corresponding features. Second, the extracted features are further explored and mapped into a common space for reducing the intra-class scatter and enlarging the inter-class separation. Third, the obtained representations are used to predict the categories of the input images, and the discrimination loss in the label space is minimized to further promote the learning of discriminative representations. Meanwhile, a confusion score is computed and added to the classification loss for guiding the discriminative representation learning via backpropagation. The comprehensive experimental results show that the proposed method is superior to the existing state-of-the-art methods on two challenging remote sensing image scene datasets, demonstrating that the proposed method is significantly effective.

Simplified Multi-head Mechanism for Few-Shot Remote Sensing Image Classification

The study of few-shot remote sensing image classification has received significant attention. Although meta-learning-based algorithms have been the primary focus of recent examination, feature fusion methods stress feature extraction and representation. Nonetheless, current feature fusion methods, like the multi-head mechanism, are restricted by their complicated network structure and challenging training process. This manuscript presents a simplified multi-head mechanism for obtaining multiple feature representations from a single sample. Furthermore, we perform specific fundamental transformations on remote-sensing images to obtain more suitable features for information representation. Specifically, we reduce multiple feature extractors of the multi-head mechanism to a single one and add an image transformation module before the feature extractor. After transforming the image, the features are extracted resulting in multiple features for each sample. The feature fusion stage is integrated with the classification prediction stage, and multiple linear classifiers are combined for multi-decision fusion to complete feature fusion and classification. By combining image transformation with feature decision fusion, we compare our results with other methods through validation tests and demonstrate that our algorithm simplifies the multi-head mechanism while maintaining or improving classification performance.

A Comprehensive Framework for Improving Remote Sensing Image Classification: Combining Augmentation and Missing Pixel Imputation

A Comprehensive Framework for Improving Remote Sensing Image Classification: Combining Augmentation and Missing Pixel Imputation

Unsupervised Joint Contrastive Learning for Aerial Person Re-Identification and Remote Sensing Image Classification

Unsupervised person re-identification (Re-ID) aims to match the query image of a person with images in the gallery without the use of supervision labels. Most existing methods usually generate pseudo-labels through clustering algorithms for contrastive learning, which inevitably results in noisy labels assigned to samples. In addition, methods that only apply contrastive learning at the clustering level fail to fully consider instance-level relationships between instances. Motivated by this, we propose a joint contrastive learning (JCL) framework for unsupervised person Re-ID. Our proposed method involves creating two memory banks to store features of cluster centroids and instances and applies cluster and instance-level contrastive learning, respectively, to jointly optimize the neural networks. The cluster-level contrastive loss is used to promote feature compactness within the same cluster and reinforce identity similarity. The instance-level contrastive loss is used to distinguish easily confused samples. In addition, we use a WaveBlock attention module (WAM), which can continuously wave feature map blocks and introduce attention mechanisms to produce more robust feature representations of a person without considerable information loss. Furthermore, we enhance the quality of our clustering by leveraging camera label information to eliminate clusters containing single camera captures. Extensive experimental results on two widely used person Re-ID datasets verify the effectiveness of our JCL method. Meanwhile, we also used two remote sensing datasets to demonstrate the generalizability of our method.

Semantic interleaving global channel attention for multilabel remote sensing image classification

ABSTRACT Multilabel remote sensing image classification (MLRSIC) has received increasing research interest. Taking the co-occurrence relationship of multiple labels as additional information helps to improve the overall performance. However, current methods only focus on using it to constrain the final feature which is output from a convolutional neural network (CNN). On the one hand, these methods need to exploit the potential of label correlation in feature representation fully. On the other hand, they increase the label noise sensitivity of the system, resulting in poor robustness. In this paper, a novel method called ‘Semantic Interleaving Global chaNnel Attention’ (SIGNA) is proposed for MLRSIC. First, the label co-occurrence graph is obtained according to the statistical information of the training set and fed into a graph neural network (GNN) to generate optimal semantic feature representations of each label. Next, the semantic features are interleaved with visual features which are extracted by CNNs to guide the overall features of the input image transform from the original feature space to the semantic feature space with embedded label relations. Then, global attention triggered by semantic interleaving is used to emphasize visual features in important channels. Finally, to make SIGNA easier to use and more optimized, multihead SIGNA-based feature adaptive weighting networks are proposed as plug-in blocks to plug into any layers of a CNN. For remote sensing images, better classification performance can be achieved by inserting the plug-in blocks into the shallow layers of CNNs. We conducted extensive experimental comparisons on three data sets: UCM, AID and DFC15. Experimental results demonstrate that the proposed SIGNA achieves superior classification performance compared to state-of-the-art (SOTA) methods. Notes that the codes of this paper will be open to the community for reproducibility research.

A Unified Multiple Proxy Deep Metric Learning Framework Embedded With Distribution Optimization for Fine-Grained Ship Classification in Remote Sensing Images

A Unified Multiple Proxy Deep Metric Learning Framework Embedded With Distribution Optimization for Fine-Grained Ship Classification in Remote Sensing Images

Fast and Effective: Progressive Hierarchical Fusion Classification for Remote Sensing Images

Fast and Effective: Progressive Hierarchical Fusion Classification for Remote Sensing Images

Region-Based Global-Local Contrastive Representation Learning for Fine-Grained Ship Classification in Remote Sensing Images

Region-Based Global-Local Contrastive Representation Learning for Fine-Grained Ship Classification in Remote Sensing Images

From Spatial to Frequency Domain: A Pure Frequency Domain FDNet Model for the Classification of Remote Sensing Images

From Spatial to Frequency Domain: A Pure Frequency Domain FDNet Model for the Classification of Remote Sensing Images

RSMamba: Remote Sensing Image Classification With State Space Model

RSMamba: Remote Sensing Image Classification With State Space Model

Research on Remote Sensing Image Target Recognition and Image Change Detection Algorithm Based on Deep Learning

Deep learning is a deep field of neural networks, and its application in remote sensing image classification and recognition processing has attracted attention and discussion from all walks of life. This paper first briefly introduces the traditional remote sensing image processing methods and the limitations of these algorithms and emphasizes the limitations of these techniques. Then, the research status of target recognition and change detection in remote sensing images based on deep learning is discussed, and how to select and design appropriate deep learning models. And then, the datasets of two different provinces were selected for comparative experiments, and the implementation process of target recognition and change detection in remote sensing images was described in detail. Finally, based on the experimental results, the future trend of deep learning application in remote sensing identification and classification is prospected.

Dual-branch Branch Networks Based on Contrastive Learning for Long-Tailed Remote Sensing

Deep learning has been widely used in remote sensing image classification and achieves many excellent results. These methods are all based on relatively balanced data sets. However, in real-world scenarios, many data sets belong to the long-tailed distribution, resulting in poor performance. In view of the good performance of contrastive learning in long-tailed image classification, a new dual-branch fusion learning classification model is proposed to fuse the discriminative features of remote sensing images with spatial data, making full use of valuable image representation information in imbalance data. This paper also presents a hybrid loss, which solves the problem of poor discrimination of extracted features caused by large intra-class variation and inter-class ambiguity. Extended experiments on three long-tailed remote sensing image classification data sets demonstrate the advantages of the proposed dual-branch model based on contrastive learning in long-tailed image classification.

MHFNet: An Improved HGR Multimodal Network for Informative Correlation Fusion in Remote Sensing Image Classification

MHFNet: An Improved HGR Multimodal Network for Informative Correlation Fusion in Remote Sensing Image Classification

Robust Remote Sensing Image Classification utilizing Multiverse Optimization Model with Deep Transfer Learning Approach

The classifying process of Remote Sensing Image (RSI) has been crucial in diverse applications, involving land cover mapping, environmental monitoring, disaster assessment, and urban planning. Conventionally, image classification in Remote Sensing (RS) relies on Machine Learning (ML) and handcrafted feature extraction approaches. But, lately, Deep Learning (DL) has become an effective and powerful method for RSI classification. DL algorithms, especially Convolutional Neural Network (CNN), have shown great performance in different Computer Vision (CV) tasks, involving image classification. This study proposes a Robust RSI Classification using Multiverse Optimization Algorithm with Deep Transfer Learning (RRSIC-MVO) model. The RRSIC-MVO technique exploits the DL with hyper-parameter selection mechanism to classify the RSI. In the presented RRSIC-MVO technique, the noise occurrence can be handled by joint bilateral filter (JBF). Following, MobileNetv3 model is applied for feature extractor and its hyper-parameters can be elected by the use of FA. Finally, soft-margin support vector machine (SM-SVM) model is applied for classification purposes. A series of investigations are accomplished on RS dataset for assessing the RRSIC-MVO model. The outputs demonstrate the effectiveness of RRSIC-MVO technique, outperforming traditional machine learning methods.