Convolutional Neural Networks Backbone Research Articles

Semi-Supervised Medical Image Segmentation Based on Deep Consistent Collaborative Learning.

In the realm of medical image analysis, the cost associated with acquiring accurately labeled data is prohibitively high. To address the issue of label scarcity, semi-supervised learning methods are employed, utilizing unlabeled data alongside a limited set of labeled data. This paper presents a novel semi-supervised medical segmentation framework, DCCLNet (deep consistency collaborative learning UNet), grounded in deep consistent co-learning. The framework synergistically integrates consistency learning from feature and input perturbations, coupled with collaborative training between CNN (convolutional neural networks) and ViT (vision transformer), to capitalize on the learning advantages offered by these two distinct paradigms. Feature perturbation involves the application of auxiliary decoders with varied feature disturbances to the main CNN backbone, enhancing the robustness of the CNN backbone through consistency constraints generated by the auxiliary and main decoders. Input perturbation employs an MT (mean teacher) architecture wherein the main network serves as the student model guided by a teacher model subjected to input perturbations. Collaborative training aims to improve the accuracy of the main networks by encouraging mutual learning between the CNN and ViT. Experiments conducted on publicly available datasets for ACDC (automated cardiac diagnosis challenge) and Prostate datasets yielded Dice coefficients of 0.890 and 0.812, respectively. Additionally, comprehensive ablation studies were performed to demonstrate the effectiveness of each methodological contribution in this study.

Hybrid manifold smoothing and label propagation technique for Kannada handwritten character recognition.

Handwritten character recognition is one of the classical problems in the field of image classification. Supervised learning techniques using deep learning models are highly effective in their application to handwritten character recognition. However, they require a large dataset of labeled samples to achieve good accuracies. Recent supervised learning techniques for Kannada handwritten character recognition have state of the art accuracy and perform well over a large range of input variations. In this work, a framework is proposed for the Kannada language that incorporates techniques from semi-supervised learning. The framework uses features extracted from a convolutional neural network backbone and uses regularization to improve the trained features and label propagation to classify previously unseen characters. The episodic learning framework is used to validate the framework. Twenty-four classes are used for pre-training, 12 classes are used for testing and 11 classes are used for validation. Fine-tuning is tested using one example per unseen class and five examples per unseen class. Through experimentation the components of the network are implemented in Python using the Pytorch library. It is shown that the accuracy obtained 99.13% make this framework competitive with the currently available supervised learning counterparts, despite the large reduction in the number of labeled samples available for the novel classes.

Pairwise CNN-Transformer Features for Human-Object Interaction Detection.

Human-object interaction (HOI) detection aims to localize and recognize the relationship between humans and objects, which helps computers understand high-level semantics. In HOI detection, two-stage and one-stage methods have distinct advantages and disadvantages. The two-stage methods can obtain high-quality human-object pair features based on object detection but lack contextual information. The one-stage transformer-based methods can model good global features but cannot benefit from object detection. The ideal model should have the advantages of both methods. Therefore, we propose the Pairwise Convolutional neural network (CNN)-Transformer (PCT), a simple and effective two-stage method. The model both fully utilizes the object detector and has rich contextual information. Specifically, we obtain pairwise CNN features from the CNN backbone. These features are fused with pairwise transformer features to enhance the pairwise representations. The enhanced representations are superior to using CNN and transformer features individually. In addition, the global features of the transformer provide valuable contextual cues. We fairly compare the performance of pairwise CNN and pairwise transformer features in HOI detection. The experimental results show that the previously neglected CNN features still have a significant edge. Compared to state-of-the-art methods, our model achieves competitive results on the HICO-DET and V-COCO datasets.

A Contemporary Survey on Deepfake Detection: Datasets, Algorithms, and Challenges

Deepfakes are notorious for their unethical and malicious applications to achieve economic, political, and social reputation goals. Recent years have seen widespread facial forgery, which does not require technical skills. Since the development of generative adversarial networks (GANs) and diffusion models (DMs), deepfake generation has been moving toward better quality. Therefore, it is necessary to find an effective method to detect fake media. This contemporary survey provides a comprehensive overview of several typical facial forgery detection methods proposed from 2019 to 2023. We also analyze and group them into four categories in terms of their feature extraction methods and network architectures: traditional convolutional neural network (CNN)-based detection, CNN backbone with semi-supervised detection, transformer-based detection, and biological signal detection. Furthermore, it summarizes several representative deepfake detection datasets with their advantages and disadvantages. Finally, we evaluate the performance of these detection models with respect to different datasets by comparing their evaluating metrics. Across all experimental results on these state-of-the-art detection models, we find that the accuracy is largely degraded if we utilize cross-dataset evaluation. These results will provide a reference for further research to develop more reliable detection algorithms.

Real-time canola damage detection: An end-to-end framework with semi-automatic crusher and lightweight ShuffleNetV2_YOLOv5s

The current method employed in detecting damages present in canola kernels is inefficient and time-consuming. The sample preparation process is laborious and the judgment between sound and damaged seeds using visual methods is prone to errors as they are small and indistinguishable. To date, there is no hardware and supporting software solution that can expedite this time-consuming yet crucial task. This study demonstrates an end-to-end damage detection framework that has two components: a semi-automatic machine to crush the canola seeds to prepare the samples rapidly for detecting the damages and a supporting object detection algorithm based on a compressed YOLOv5s model. The lightweight detection model was deployed in an Edge-AI device and integrated with the crusher to detect the damages in real-time. Two Convolutional Neural Network (CNN) architectures, viz. ShuffleNetV2 and MobileNetV3 were compared in terms of model parameters, computational cost, and model size to replace the standard CSPDarknet53 CNN backbone present in YOLOv5s. The best-performing model was deployed into an NVIDIA Jetson Nano embedded device for real-time inferencing. Results indicate that in terms of model size, the ShuffleNetV2_YOLOv5s model was 56.5 and 80.4 % smaller than the MobileNetV3_YOLOv5s and the baseline YOLOv5s models, respectively. While, in terms of computational cost, the ShuffleNetV2_YOLOv5s model was 64.1 % and 99.5 % less expensive than the MobileNetV3_YOLOv5s and the baseline YOLOv5s models, respectively. This study demonstrated an end-to-end framework for detecting damages in canola supported by a real-time and lightweight damage detection model.

An automatic network structure search via channel pruning for accelerating human activity inference on mobile devices

During recent years, deep convolutional neural networks (CNNs) have become increasingly popular in sensor-based human activity recognition (HAR), due to powerful feature extraction capacity. However, the required high computational cost has hindered their practical deployment in real-world applications. To address this issue, this paper presents a novel approach named ABCSearch to prune channels through an artificial bee colony (ABC) algorithm, which is a meta-heuristic optimization algorithm inspired by the foraging behavior of honeybees. Unlike traditional pruning strategies that prioritize channel importance, the proposed method seeks to identify the optimal number of channels at each layer, i.e., the optimal pruning structure. To lessen human interference, we transform the search problem of the optimal pruning structure into a simple optimization problem and solve it automatically through the ABC algorithm, which can significantly decrease both model size and computational cost without compromising performance. Specifically, we validate the effectiveness of ABCSearch for a standard five-layer CNN backbone architecture, which achieves 97.05%, 98.45%, 91.71%, 78.89% classification accuracies on four HAR benchmarks, i.e., UCI-HAR, WISDM, PAMAP2, UniMiB-SHAR. Our approach can yield 87.44%, 89.41%, 89.06%, 89.59% FLOPs reductions, and 89.54%, 88.70%, 88.38%, 90.45% less memory consumptions, as well as 4.4×, 5.0×, 5.8×, 6.1× practical speedups on real hardware devices, while maintaining comparable accuracy.

Learning convolutional multi-level transformers for image-based person re-identification

As a vital vision task, person re-identification (Re-ID) aims to retrieve the same person under non-overlapping cameras. It is a very challenging task due to the presence of complex backgrounds, diverse illuminations and different perspectives. In this work, we integrate the advantages of convolutional neural networks (CNNs) and transformers, and propose a novel learning framework named convolutional multi-level transformer (CMT) for image-based person Re-ID. More specifically, we first propose a scale-aware feature enhancement (SFE) module to extract multi-scale local features from a pre-trained CNN backbone. Then, we introduce a part-aware transformer encoder (PTE) to further mine discriminative local information guided by global semantics. Finally, a deeply-supervised learning (DSL) technique is adopted to optimize the proposed CMT and improve its training efficiency. Extensive experiments on four large-scale Re-ID benchmarks demonstrate that our method performs favorably against several state-of-the-art methods.

Enhancing texture representation with deep tracing pattern encoding

Texture representation is a challenging problem due to the complex underlying physics of texture as well as the variations caused by changes in viewpoint. Recent progress in texture analysis has been made by the power of convolutional neural networks (CNNs) in feature learning. However, most current methods aggregate the features from the last convolutional layer of the CNN to obtain a global feature vector, which fails to leverage shallow low-level visual cues and cross-layer feature patterns, limiting their performance. In this paper, we propose to trace the features generated along the convolutional layers via a histogram of local 3D invariant binary patterns, called deep tracing patterns. This leads to a highly discriminative yet robust global feature representation module. Building such a module into a CNN backbone, we develop an effective approach for texture recognition. Extensive experiments on six benchmark datasets show that the proposed approach provides a discriminative and robust texture descriptor, with state-of-the-art performance achieved.

From coarse to fine: a deep 3D probability volume contours framework for tumour segmentation and dose painting in PET images.

With the increasing integration of functional imaging techniques like Positron Emission Tomography (PET) into radiotherapy (RT) practices, a paradigm shift in cancer treatment methodologies is underway. A fundamental step in RT planning is the accurate segmentation of tumours based on clinical diagnosis. Furthermore, novel tumour control methods, such as intensity modulated radiation therapy (IMRT) dose painting, demand the precise delineation of multiple intensity value contours to ensure optimal tumour dose distribution. Recently, convolutional neural networks (CNNs) have made significant strides in 3D image segmentation tasks, most of which present the output map at a voxel-wise level. However, because of information loss in subsequent downsampling layers, they frequently fail to precisely identify precise object boundaries. Moreover, in the context of dose painting strategies, there is an imperative need for reliable and precise image segmentation techniques to delineate high recurrence-risk contours. To address these challenges, we introduce a 3D coarse-to-fine framework, integrating a CNN with a kernel smoothing-based probability volume contour approach (KsPC). This integrated approach generates contour-based segmentation volumes, mimicking expert-level precision and providing accurate probability contours crucial for optimizing dose painting/IMRT strategies. Our final model, named KsPC-Net, leverages a CNN backbone to automatically learn parameters in the kernel smoothing process, thereby obviating the need for user-supplied tuning parameters. The 3D KsPC-Net exploits the strength of KsPC to simultaneously identify object boundaries and generate corresponding probability volume contours, which can be trained within an end-to-end framework. The proposed model has demonstrated promising performance, surpassing state-of-the-art models when tested against the MICCAI 2021 challenge dataset (HECKTOR).

Vehicle detection in diverse traffic using an ensemble convolutional neural backbone via feature concatenation

ABSTRACT Nowadays, deploying an intelligent vehicle detection system (IVDS) in diverse traffic is a work priority. It provides real-time traffic information with vehicle counts and types of vehicles. IVDS deployment in diverse traffic is challenging because different vehicle classes occlude each other on the road. In recent years, convolutional neural network (CNN) based deep learning (DL) methods have attained incredible progress in implementing IVDS. However, most CNN-based DL methods do not include diverse traffic conditions in Asian countries. Also, due to existing feature extraction backbones, they cannot accurately detect multi-scale vehicles. This work proposes an advanced visual computing deep learning (AVCDL) method with a vast labeled vehicle dataset to detect vehicles in diverse traffic. It includes an ensemble backbone and an improved multi-stage vehicle detection head (MSVDH). An ensemble CNN backbone extracts the vehicle features and combines them on a single channel via a feature concatenation. The final detection is carried out by an improved MSVDH that classifies the target vehicles. The proposed method is examined, tested, and evaluated using traffic statistics. It is contrasted with current cutting-edge vehicle detection techniques. It achieves 86.32% mean average precision (mAP) on self-collected diverse traffic labeled dataset (DTLD) and 86.17% mAP on KITTI. Moreover, the real-time performance is validated with NVIDIA Jetson Tx2 and Nano boards. It achieves 15 frames per second (FPS) on Jetson Tx2 and 7 FPS on Jetson Nano.

Overlapping filter bank convolutional neural network for multisubject multicategory motor imagery brain-computer interface

BackgroundMotor imagery brain-computer interfaces (BCIs) is a classic and potential BCI technology achieving brain computer integration. In motor imagery BCI, the operational frequency band of the EEG greatly affects the performance of motor imagery EEG recognition model. However, as most algorithms used a broad frequency band, the discrimination from multiple sub-bands were not fully utilized. Thus, using convolutional neural network (CNNs) to extract discriminative features from EEG signals of different frequency components is a promising method in multisubject EEG recognition.MethodsThis paper presents a novel overlapping filter bank CNN to incorporate discriminative information from multiple frequency components in multisubject motor imagery recognition. Specifically, two overlapping filter banks with fixed low-cut frequency or sliding low-cut frequency are employed to obtain multiple frequency component representations of EEG signals. Then, multiple CNN models are trained separately. Finally, the output probabilities of multiple CNN models are integrated to determine the predicted EEG label.ResultsExperiments were conducted based on four popular CNN backbone models and three public datasets. And the results showed that the overlapping filter bank CNN was efficient and universal in improving multisubject motor imagery BCI performance. Specifically, compared with the original backbone model, the proposed method can improve the average accuracy by 3.69 percentage points, F1 score by 0.04, and AUC by 0.03. In addition, the proposed method performed best among the comparison with the state-of-the-art methods.ConclusionThe proposed overlapping filter bank CNN framework with fixed low-cut frequency is an efficient and universal method to improve the performance of multisubject motor imagery BCI.

ConvMatch: Rethinking Network Design for Two-View Correspondence Learning

Multilayer perceptron (MLP) has been widely used in two-view correspondence learning for only unordered correspondences provided, and it extracts deep features from individual correspondence effectively. However, the problem of lacking context information limits its performance and hence, many extra complex blocks are designed to capture such information in the follow-up studies. In this paper, from a novel perspective, we design a correspondence learning network called ConvMatch that for the first time can leverage convolutional neural network (CNN) as the backbone to capture better context, thus avoiding the complex design of extra blocks. Specifically, with the observation that sparse motion vectors and dense motion field can be converted into each other with interpolating and sampling, we regularize the putative motion vectors by estimating dense motion field implicitly, then rectify the errors caused by outliers in local areas with CNN, and finally obtain correct motion vectors from the rectified motion field. Extensive experiments reveal that ConvMatch with a simple CNN backbone consistently outperforms state-of-the-arts including MLP-based methods for relative pose estimation and homography estimation, and shows promising generalization ability to different datasets and descriptors. Our code is publicly available at https://github.com/SuhZhang/ConvMatch.

GMTS: GNN-based multi-scale transformer siamese network for remote sensing building change detection

ABSTRACT With the remarkable success of change detection (CD) in remote sensing images in the context of deep learning, many convolutional neural network (CNN) based methods have been proposed. In the current research, to obtain a better context modeling method for remote sensing images and to capture more spatiotemporal characteristics, several attention-based methods and transformer (TR)-based methods have been proposed. Recent research has also continued to innovate on TR-based methods, and many new methods have been proposed. Most of them require a huge number of calculation to achieve good results. Therefore, using the TR-based mehtod while maintaining the overhead low is a problem to be solved. Here, we propose a GNN-based multi-scale transformer siamese network for remote sensing image change detection (GMTS) that maintains a low network overhead while effectively modeling context in the spatiotemporal domain. We also design a novel hybrid backbone to extract features. Compared with the current CNN backbone, our backbone network has a lower overhead and achieves better results. Further, we use high/low frequency (HiLo) attention to extract more detailed local features and the multi-scale pooling pyramid transformer (MPPT) module to focus on more global features respectively. Finally, we leverage the context modeling capabilities of TR in the spatiotemporal domain to optimize the extracted features. We have a relatively low number of parameters compared to that required by current TR-based methods and achieve a good effect improvement, which provides a good balance between efficiency and performance.

A convolutional and transformer based deep neural network for automatic modulation classification

Automatic modulation classification (AMC) aims at identifying the modulation of the received signals, which is a significant approach to identifying the target in military and civil applications. In this paper, a novel data-driven framework named con-volutional and transformer-based deep neural network (CTDNN) is proposed to improve the classification performance. CTDNN can be divided into four modules, i.e., convolutional neural network (CNN) backbone, transition module, transformer module, and final classifier. In the CNN backbone, a wide and deep convolution structure is designed, which consists of 1 × 15 convolution kernels and intensive cross-layer connections instead of traditional 1×3 kernels and sequential connections. In the transition module, a 1 × 1 convolution layer is utilized to compress the channels of the previous multi-scale CNN features. In the transformer module, three self-attention layers are designed for extracting global features and generating the classification vector. In the classifier, the final decision is made based on the maximum a posterior probability. Extensive simulations are conducted, and the result shows that our proposed CTDNN can achieve superior classification performance than traditional deep models.

MSHT: Multi-stage Hybrid Transformer for the ROSE Image Analysis of Pancreatic Cancer.

Pancreatic cancer is one of the most malignant cancers with high mortality. The rapid on-site evaluation (ROSE) technique can significantly accelerate the diagnostic workflow of pancreatic cancer by immediately analyzing the fast-stained cytopathological images with on-site pathologists. However, the broader expansion of ROSE diagnosis has been hindered by the shortage of experienced pathologists. Deep learning has great potential for the automatic classification of ROSE images in diagnosis. But it is challenging to model the complicated local and global image features. The traditional convolutional neural network (CNN) structure can effectively extract spatial features, while it tends to ignore global features when the prominent local features are misleading. In contrast, the Transformer structure has excellent advantages in capturing global features and long-range relations, while it has limited ability in utilizing local features. We propose a multi-stage hybrid Transformer (MSHT) to combine the strengths of both, where a CNN backbone robustly extracts multi-stage local features at different scales as the attention guidance, and a Transformer encodes them for sophisticated global modeling. Going beyond the strength of each single method, the MSHT can simultaneously enhance the Transformer global modeling ability with the local guidance from CNN features. To evaluate the method in this unexplored field, a dataset of 4240 ROSE images is collected where MSHT achieves 95.68% in classification accuracy with more accurate attention regions. The distinctively superior results compared to the state-of-the-art models make MSHT extremely promising for cytopathological image analysis. The codes and records are available at: https://github.com/sagizty/ Multi-Stage-Hybrid-Transformer.

Oil spills detection from SAR Earth observations based on a hybrid CNN transformer networks

Oil spills are the main threats to marine and coastal environments. Due to the increase in the marine transportation and shipping industry, oil spills have increased in recent years. Moreover, the rapid spread of oil spills in open waters seriously affects the fragile marine ecosystem and creates environmental concerns. Effective monitoring, quick identification, and estimation of the volume of oil spills are the first and most crucial steps for a successful cleanup operation and crisis management. Remote Sensing observations, especially from Synthetic Aperture Radar (SAR) sensors, are a very suitable choice for this purpose due to their ability to collect data regardless of the weather and illumination conditions and over far and large areas of the Earth. Owing to the relatively complex nature of SAR observations, machine learning (ML) based algorithms play an important role in accurately detecting and monitoring oil spills and can significantly help experts in faster and more accurate detection. This paper uses SAR images from ESA's Copernicus Sentinel-1 satellite to detect and locate oil spills in open waters under different environmental conditions. To this end, a deep learning framework has been presented to identify oil spills automatically. The SAR images were segmented into two classes, the oil slick and the background, using convolutional neural networks (CNN) and vision transformers (ViT). Various scenarios for the proposed architecture were designed by placing ViT networks in different parts of the CNN backbone. An extensive dataset of oil spill events in various regions across the globe was used to train and assess the performance of the proposed framework. After the detection performance assessments, the F1-score values for the standard DeepLabV3+, FC-DenseNet, and U-Net networks were 75.08 %, 73.94 %, and 60.85, respectively. In the combined networks models (combination of CNN and ViT), the best F1-score results were obtained as 78.48 %. Our results showed that these hybrid models could improve detection accuracy and have a high ability to distinguish oil spill borders even in noisy images. Evaluation metrics are increased in all the combined networks compared to the original CNN networks.

TANet: Transformer‐based asymmetric network for RGB‐D salient object detection

AbstractExisting RGB‐D salient object detection methods mainly rely on a symmetric two‐stream Convolutional Neural Network (CNN)‐based network to extract RGB and depth channel features separately. However, there are two problems with the symmetric conventional network structure: first, the ability of CNN in learning global contexts is limited; second, the symmetric two‐stream structure ignores the inherent differences between modalities. In this study, a Transformer‐based asymmetric network is proposed to tackle the issues mentioned above. The authors employ the powerful feature extraction capability of Transformer to extract global semantic information from RGB data and design a lightweight CNN backbone to extract spatial structure information from depth data without pre‐training. The asymmetric hybrid encoder effectively reduces the number of parameters in the model while increasing speed without sacrificing performance. Then, a cross‐modal feature fusion module which enhances and fuses RGB and depth features with each other is designed. Finally, the authors add edge prediction as an auxiliary task and propose an edge enhancement module to generate sharper contours. Extensive experiments demonstrate that our method achieves superior performance over 14 state‐of‐the‐art RGB‐D methods on six public datasets. The code of the authors will be released at https://github.com/lc012463/TANet.

STrans-YOLOX: Fusing Swin Transformer and YOLOX for Automatic Pavement Crack Detection

Automatic pavement crack detection is crucial for reducing road maintenance costs and ensuring transportation safety. Although convolutional neural networks (CNNs) have been widely used in automatic pavement crack detection, they cannot adequately model the long-range dependencies between pixels and easily lose edge detail information in complex scenes. Moreover, irregular crack shapes also make the detection task challenging. To address these issues, an automatic pavement crack detection architecture named STrans-YOLOX is proposed. Specifically, the architecture first exploits the CNN backbone to extract feature information, preserving the local modeling ability of the CNN. Then, Swin Transformer is introduced to enhance the long-range dependencies through a self-attention mechanism by supplying each pixel with global features. A new global attention guidance module (GAGM) is used to ensure effective information propagation in the feature pyramid network (FPN) by using high-level semantic information to guide the low-level spatial information, thereby enhancing the multi-class and multi-scale features of cracks. During the post-processing stage, we utilize α-IoU-NMS to achieve the accurate suppression of the detection boxes in the case of occlusion and overlapping objects by introducing an adjustable power parameter. The experiments demonstrate that the proposed STrans-YOLOX achieves 63.37% mAP and surpasses the state-of-the-art models on the challenging pavement crack dataset.

A Multimodal Data Fusion and Deep Learning Framework for Large-Scale Wildfire Surface Fuel Mapping

Accurate estimation of fuels is essential for wildland fire simulations as well as decision-making related to land management. Numerous research efforts have leveraged remote sensing and machine learning for classifying land cover and mapping forest vegetation species. In most cases that focused on surface fuel mapping, the spatial scale of interest was smaller than a few hundred square kilometers; thus, many small-scale site-specific models had to be created to cover the landscape at the national scale. The present work aims to develop a large-scale surface fuel identification model using a custom deep learning framework that can ingest multimodal data. Specifically, we use deep learning to extract information from multispectral signatures, high-resolution imagery, and biophysical climate and terrain data in a way that facilitates their end-to-end training on labeled data. A multi-layer neural network is used with spectral and biophysical data, and a convolutional neural network backbone is used to extract the visual features from high-resolution imagery. A Monte Carlo dropout mechanism was also devised to create a stochastic ensemble of models that can capture classification uncertainties while boosting the prediction performance. To train the system as a proof-of-concept, fuel pseudo-labels were created by a random geospatial sampling of existing fuel maps across California. Application results on independent test sets showed promising fuel identification performance with an overall accuracy ranging from 55% to 75%, depending on the level of granularity of the included fuel types. As expected, including the rare—and possibly less consequential—fuel types reduced the accuracy. On the other hand, the addition of high-resolution imagery improved classification performance at all levels.

Remote Sensing Scene Classification Via Multigranularity Alternating Feature Mining

Models based on convolutional neural networks (CNNs) have achieved remarkable advances in high-resolution remote sensing (HRRS) images scene classification, but there are still challenges due to the high similarity among different categories and loss of local information. To address this issue, a multigranularity alternating feature mining (MGA-FM) framework is proposed in this article to learn and fuse both global and local information for HRRS scene classification. First, a region confusion mechanism is adopted to guide network's shallow layers to adaptively learn the salient features of distinguishing regions. Second, an alternating comprehensive training strategy is designed to capture and fuse shallow local feature information and deep semantic information to enhance feature representation capabilities. In particular, the MGA-FM framework can be flexibly embedded in various CNN backbone networks as a training mechanism. Extensive experimental results and visualization analysis on three remote sensing scene datasets indicated that the proposed method can achieve competitive classification performance.