Multispectral Remote Sensing Images Research Articles

Open-Pit Mining Area Extraction Using Multispectral Remote Sensing Images: A Deep Learning Extraction Method Based on Transformer

In the era of remote sensing big data, the intelligent interpretation of remote sensing images is a key technology for mining the value of remote sensing big data and promoting a number of major applications, mainly including land cover classification and extraction. Among these, the rapid extraction of open-pit mining areas plays a vital role in current practices for refined mineral resources development and management and ecological–environmental protection in China. However, existing methods are not accurate enough for classification, not fine enough for boundary extraction, and poor in terms of multi-scale adaptation. To address these issues, we propose a new semantic segmentation model based on Transformer, which is called Segmentation for Mine—SegMine—and consists of a Vision Transformer-based encoder and a lightweight attention mask decoder. The experimental results show that SegMine enhances the network’s ability to obtain local spatial detail information and improves the problem of disappearing small-scale object features and insufficient information expression. It also better preserves the boundary details of open-pit mining areas. Using the metrics of mIoU, precision, recall, and dice, experimental areas were selected for comparative analysis, and the results show that the new method is significantly better than six other existing major Transformer variants.

Research on Segmentation Method of Maize Seedling Plant Instances Based on UAV Multispectral Remote Sensing Images.

The accurate instance segmentation of individual crop plants is crucial for achieving a high-throughput phenotypic analysis of seedlings and smart field management in agriculture. Current crop monitoring techniques employing remote sensing predominantly focus on population analysis, thereby lacking precise estimations for individual plants. This study concentrates on maize, a critical staple crop, and leverages multispectral remote sensing data sourced from unmanned aerial vehicles (UAVs). A large-scale SAM image segmentation model is employed to efficiently annotate maize plant instances, thereby constructing a dataset for maize seedling instance segmentation. The study evaluates the experimental accuracy of six instance segmentation algorithms: Mask R-CNN, Cascade Mask R-CNN, PointRend, YOLOv5, Mask Scoring R-CNN, and YOLOv8, employing various combinations of multispectral bands for a comparative analysis. The experimental findings indicate that the YOLOv8 model exhibits exceptional segmentation accuracy, notably in the NRG band, with bbox_mAP50 and segm_mAP50 accuracies reaching 95.2% and 94%, respectively, surpassing other models. Furthermore, YOLOv8 demonstrates robust performance in generalization experiments, indicating its adaptability across diverse environments and conditions. Additionally, this study simulates and analyzes the impact of different resolutions on the model's segmentation accuracy. The findings reveal that the YOLOv8 model sustains high segmentation accuracy even at reduced resolutions (1.333 cm/px), meeting the phenotypic analysis and field management criteria.

SatelliteChangeNet: Deep Learning approach for Detection & Prediction

In geoscience, Detection is a useful method for analyzing land surface changes using data from Earth observation and for uncovering links between human activities and environmental phenomena. Detection in remote sensing is a rapidly evolving area of interest that is relevant for a number of fields. Recent years have seen a large number of publications and progress, even though the challenge is far from solved. This review focuses on deep learning applied to the task of Detection in multispectral remote-sensing images. In this work, SatelliteChangeNet addresses the growing need for an accurate and effective method to monitor and predict changes in satellite imagery, which is important for many purposes such as environmental monitoring, urban planning, and agriculture and disaster management. The changes always aim to show the struggle with the body and its different structures and lead to the search for a deep learning process. The program focuses on the use of satellite data for exploration of new areas, urban development analysis, environmental management damage, and change and prediction with important applications in agriculture. Water resources and farmland provide a lot of information about our planet. Analyzing these changes over time is important for understanding land use, environmental change, and natural hazards

Generating Fuzzy Membership Functions for Modeling Wetland Ecosystems From Multispectral Remote Sensing Images

Generating Fuzzy Membership Functions for Modeling Wetland Ecosystems From Multispectral Remote Sensing Images

MSWAGAN: Multispectral Remote Sensing Image Super-Resolution Based on Multiscale Window Attention Transformer

MSWAGAN: Multispectral Remote Sensing Image Super-Resolution Based on Multiscale Window Attention Transformer

MASCAR: Multidomain Adaptive Spatial–Spectral Variable Compression Artifact Removal Network for Multispectral Remote Sensing Images

MASCAR: Multidomain Adaptive Spatial–Spectral Variable Compression Artifact Removal Network for Multispectral Remote Sensing Images

Editorial: Foreword to the Special Issue on Artificial Intelligence for Hyper- and Multispectral Remote Sensing Image Processing

Editorial: Foreword to the Special Issue on Artificial Intelligence for Hyper- and Multispectral Remote Sensing Image Processing

Pan-Sharpening Network of Multi-Spectral Remote Sensing Images Using Two-Stream Attention Feature Extractor and Multi-Detail Injection (TAMINet)

Achieving a balance between spectral resolution and spatial resolution in multi-spectral remote sensing images is challenging due to physical constraints. Consequently, pan-sharpening technology was developed to address this challenge. While significant progress was recently achieved in deep-learning-based pan-sharpening techniques, most existing deep learning approaches face two primary limitations: (1) convolutional neural networks (CNNs) struggle with long-range dependency issues, and (2) significant detail loss during deep network training. Moreover, despite these methods’ pan-sharpening capabilities, their generalization to full-sized raw images remains problematic due to scaling disparities, rendering them less practical. To tackle these issues, we introduce in this study a multi-spectral remote sensing image fusion network, termed TAMINet, which leverages a two-stream coordinate attention mechanism and multi-detail injection. Initially, a two-stream feature extractor augmented with the coordinate attention (CA) block is employed to derive modal-specific features from low-resolution multi-spectral (LRMS) images and panchromatic (PAN) images. This is followed by feature-domain fusion and pan-sharpening image reconstruction. Crucially, a multi-detail injection approach is incorporated during fusion and reconstruction, ensuring the reintroduction of details lost earlier in the process, which minimizes high-frequency detail loss. Finally, a novel hybrid loss function is proposed that incorporates spatial loss, spectral loss, and an additional loss component to enhance performance. The proposed methodology’s effectiveness was validated through experiments on WorldView-2 satellite images, IKONOS, and QuickBird, benchmarked against current state-of-the-art techniques. Experimental findings reveal that TAMINet significantly elevates the pan-sharpening performance for large-scale images, underscoring its potential to enhance multi-spectral remote sensing image quality.

Modeling information flow from multispectral remote sensing images to land use and land cover maps for understanding classification mechanism

ABSTRACTInformation on Land Use and Land Cover Map (LULCM) is essential for environment and socioeconomic applications. Such maps are generally derived from Multispectral Remote Sensing Images (MRSI) via classification. The classification process can be described as information flow from images to maps through a trained classifier. Characterizing the information flow is essential for understanding the classification mechanism, providing solutions that address such theoretical issues as “what is the maximum number of classes that can be classified from a given MRSI?” and “how much information gain can be obtained?” Consequently, two interesting questions naturally arise, i.e. (i) How can we characterize the information flow? and (ii) What is the mathematical form of the information flow? To answer these two questions, this study first hypothesizes that thermodynamic entropy is the appropriate measure of information for both MRSI and LULCM. This hypothesis is then supported by kinetic-theory-based experiments. Thereafter, upon such an entropy, a generalized Jarzynski equation is formulated to mathematically model the information flow, which contains such parameters as thermodynamic entropy of MRSI, thermodynamic entropy of LULCM, weighted F1-score (classification accuracy), and total number of classes. This generalized Jarzynski equation has been successfully validated by hypothesis-driven experiments where 694 Sentinel-2 images are classified into 10 classes by four classical classifiers. This study provides a way for linking thermodynamic laws and concepts to the characterization and understanding of information flow in land cover classification, opening a new door for constructing domain knowledge.

Comparing Three Methods of Selecting Training Samples in Supervised Classification of Multispectral Remote Sensing Images.

Selecting training samples is crucial in remote sensing image classification. In this paper, we selected three images-Sentinel-2, GF-1, and Landsat 8-and employed three methods for selecting training samples: grouping selection, entropy-based selection, and direct selection. We then used the selected training samples to train three supervised classification models-random forest (RF), support-vector machine (SVM), and k-nearest neighbor (KNN)-and evaluated the classification results of the three images. According to the experimental results, the three classification models performed similarly. Compared with the entropy-based method, the grouping selection method achieved higher classification accuracy using fewer samples. In addition, the grouping selection method outperformed the direct selection method with the same number of samples. Therefore, the grouping selection method performed the best. When using the grouping selection method, the image classification accuracy increased with the increase in the number of samples within a certain sample size range.

Exploring Bangladesh's Soil Moisture Dynamics via Multispectral Remote Sensing Satellite Image

Accurate monitoring and mapping of soil moisture are essential for sustainable agricultural practices, water resource management, and climate studies. This study aims to explore the mapping of soil moisture in Bangladesh using multispectral remote-sensing satellite images. The purpose of this study is to prepare a map of soil moisture aiming to help government authorities in developing agricultural activities to accelerate the sustainable development of the rural economy in Bangladesh. A total of 14 Landsat scenes of paths 135-139 and rows 42-46 covers the entire Bangladesh. Thus, a set of Landsat imagery (a total of 14 scenes) for the year 2022 was used in this study to map the soil moisture of Bangladesh through the application of Geographical Information System (GIS) and Remote Sensing. Satellite Image preprocessing, correction, and analysis were done with ENVI software (version 5.1, developed by Research Systems, Inc., USA) and the ArcGIS software (version 10.6, developed by Environmental Systems Research Institute, USA). For the study of the long-term variation of soil moisture over Bangladesh and its seasonal characteristics, a soil moisture map can be used. In addition, to improve the climate model over Bangladesh, an up-to-date soil moisture map will be very helpful. The objective of this study is to provide accurate and detailed up-to-date spatial soil moisture information at reduced cost and time which is essential for environment modeling, risk assessment, decision-making for different government agencies and development partners, and help toward socio-economic development. In this study, the map shows soil moisture as very wet, wet, dry, and very dry soils of Bangladesh. The overall land cover classification accuracy was 92.56%, with a Kappa value 0.90 for Random Forest and the overall soil classification accuracy was 87.27%, with a Kappa value 0.858 for maximum likelihood classification indicating good consistency.

Deep Learning Based Spatial Distribution Estimation of Soil Pb Using Multi-Phase Multispectral Remote Sensing Images in a Mining Area

Extensive investigation and monitoring of lead (Pb) content of soil is significant for ensuring hazard-free agricultural production, protecting human health, and ecosystem security, especially in a mining area. One temporal period of a hyperspectral image is usually used to estimate the spatial distribution of Pb and other heavy metals, but hyperspectral images are usually difficult to obtain. Multispectral remote-sensing images are more accessible than hyperspectral images. In this study, a deep learning-based model using 3D convolution is proposed to estimate the Pb content from the constructed multi-phase, multispectral remote-sensing images. Multi-phase multispectral remote-sensing images were stacked to generate a data set with more spectral bands to reduce the atmospheric absorptive aerosol effect. At the same time, a neural network based on 3D convolution (3D-ConvNet) was proposed to estimate Pb content based on the constructed data set. Compared with partial least-squares regression (PLSR), random forest regression (RFR), support vector machine regression (SVMR), and gradient-boosting regression (GBR), experimental results showed the proposed 3D-ConvNet has obvious superiority and generates more accurate estimation results, with the prediction dataset coefficient of determination (R2) and the mean normalized bias (MNB) values being 0.90 and 2.63%, respectively. Therefore, it is possible to effectively estimate heavy metal content from multi-phase, multispectral remote-sensing images, and this study provides a new approach to heavy metal pollution monitoring.

MGDIN: Detail Injection Network for HSI and MSI Fusion Based on Multiscale and Global Contextual Features

ABSTRACT Hyperspectral remote sensing images (HSI) are characterized as rich spectral information with low spatial resolution, and a cost-effective way for the spatial information supplement is the fusion to multispectral remote sensing images (MSI). This study proposed a detail injection network for HSI and MSI fusion based on multiscale and global contextual features (MGDIN), which extracts features of different scales using residual multi-scale convolution, and captures the contextual information and long-range dependencies via global contextual block. MGDIN improves the spatial and spectral qualities of fused images by minimizing a new loss function that considers content, spectral and edge losses. Experiments on five publicly available datasets (including Botswana, Pavia Centre, Pavia University, Washington DC Mall and Houston) show that MGDIN outperforms the popular algorithms in terms of fusion quality and learning ability. The new loss function is also better than the popular loss functions in the experiments on the Botswana data set.

Hyperspectral and multispectral remote sensing image fusion using SwinGAN with joint adaptive spatial-spectral gradient loss function

ABSTRACT Hyperspectral remote sensing image (HSI) fusion with multispectral remote sensing images (MSI) improves data resolution. However, current fusion algorithms focus on local information and overlook long-range dependencies. The parameter of network tuning prioritizes global optimization, neglecting spatial and spectral constraints, and limiting spatial and spectral reconstruction capabilities. This study introduces SwinGAN, a fusion network combining Swin Transformer, CNN, and GAN architectures. SwinGAN's generator employs a detail injection framework to separately extract HSI and MSI features, fusing them to generate spatial residuals. These residuals are injected into the supersampled HSI to produce the final image, while a pure CNN architecture acts as the discriminator, enhancing the fusion quality. Additionally, we introduce a new adaptive loss function that improves image fusion accuracy. The loss function uses L1 loss as the content loss, and spatial and spectral gradient loss functions are introduced to improve the spatial representation and spectral fidelity of the fused images. Our experimental results on several datasets demonstrate that SwinGAN outperforms current popular algorithms in both spatial and spectral reconstruction capabilities. The ablation experiments also demonstrate the rationality of the various components of the proposed loss function.

UCTNet with Dual-Flow Architecture: Snow Coverage Mapping with Sentinel-2 Satellite Imagery

Satellite remote sensing (RS) has been drawing considerable research interest in land-cover classification due to its low price, short revisit time, and large coverage. However, clouds pose a significant challenge, occluding the objects on satellite RS images. In addition, snow coverage mapping plays a vital role in studying hydrology and climatology and investigating crop disease overwintering for smart agriculture. Distinguishing snow from clouds is challenging since they share similar color and reflection characteristics. Conventional approaches with manual thresholding and machine learning algorithms (e.g., SVM and Random Forest) could not fully extract useful information, while current deep-learning methods, e.g., CNNs or Transformer models, still have limitations in fully exploiting abundant spatial/spectral information of RS images. Therefore, this work aims to develop an efficient snow and cloud classification algorithm using satellite multispectral RS images. In particular, we propose an innovative algorithm entitled UCTNet by adopting a dual-flow structure to integrate information extracted via Transformer and CNN branches. Particularly, CNN and Transformer integration Module (CTIM) is designed to maximally integrate the information extracted via two branches. Meanwhile, Final Information Fusion Module and Auxiliary Information Fusion Head are designed for better performance. The four-band satellite multispectral RS dataset for snow coverage mapping is adopted for performance evaluation. Compared with previous methods (e.g., U-Net, Swin, and CSDNet), the experimental results show that the proposed UCTNet achieves the best performance in terms of accuracy (95.72%) and mean IoU score (91.21%) while with the smallest model size (3.93 M). The confirmed efficiency of UCTNet shows great potential for dual-flow architecture on snow and cloud classification.

A Review of Deep-Learning Methods for Change Detection in Multispectral Remote Sensing Images

Remote sensing is a tool of interest for a large variety of applications. It is becoming increasingly more useful with the growing amount of available remote sensing data. However, the large amount of data also leads to a need for improved automated analysis. Deep learning is a natural candidate for solving this need. Change detection in remote sensing is a rapidly evolving area of interest that is relevant for a number of fields. Recent years have seen a large number of publications and progress, even though the challenge is far from solved. This review focuses on deep learning applied to the task of change detection in multispectral remote-sensing images. It provides an overview of open datasets designed for change detection as well as a discussion of selected models developed for this task—including supervised, semi-supervised and unsupervised. Furthermore, the challenges and trends in the field are reviewed, and possible future developments are considered.

HyFormer: Hybrid Transformer and CNN for Pixel-Level Multispectral Image Land Cover Classification.

To effectively solve the problems that most convolutional neural networks cannot be applied to the pixelwise input in remote sensing (RS) classification and cannot adequately represent the spectral sequence information, we propose a new multispectral RS image classification framework called HyFormer based on Transformer. First, a network framework combining a fully connected layer (FC) and convolutional neural network (CNN) is designed, and the 1D pixelwise spectral sequences obtained from the fully connected layers are reshaped into a 3D spectral feature matrix for the input of CNN, which enhances the dimensionality of the features through FC as well as increasing the feature expressiveness, and can solve the problem that 2D CNN cannot achieve pixel-level classification. Secondly, the features of the three levels of CNN are extracted and combined with the linearly transformed spectral information to enhance the information expression capability, and also used as the input of the transformer encoder to improve the features of CNN using the powerful global modelling capability of the Transformer, and finally the skip connection of the adjacent encoders to enhance the fusion between different levels of information. The pixel classification results are obtained by MLP Head. In this paper, we mainly focus on the feature distribution in the eastern part of Changxing County and the central part of Nanxun District, Zhejiang Province, and conduct experiments based on Sentinel-2 multispectral RS images. The experimental results show that the overall accuracy of HyFormer for the study area classification in Changxing County is 95.37% and that of Transformer (ViT) is 94.15%. The experimental results show that the overall accuracy of HyFormer for the study area classification in Nanxun District is 95.4% and that of Transformer (ViT) is 94.69%, and the performance of HyFormer on the Sentinel-2 dataset is better than that of the Transformer.

Research on Bathymetric Inversion Capability of Different Multispectral Remote Sensing Images in Seaports.

In recent years, remote sensing has become an indispensable supplementary method for determining water depth in the seaports. At present, many scholars use multi-spectral satellite data to invert the water depth of the seaports, but how to select the appropriate satellite data in the seaports area is worth exploring. In this article, the differences in the retrieving ability between domestic and foreign multispectral images are compared, through building the random forest model and the band ratio model, which use different multispectral images to conduct retrieving water depth in Nanshan Port in conjunction with the WBMS multi-beam sounding system. The band ratio model and random forest model are chosen for water depth exploration, remote sensing images use GF-6, GF-2, Sentinel-2B, and Landsat 8 OLI data, which are all popular and easily accessible. The final experiment results from the constant adjustment of the model parameter show that the domestic series of GF-6 images performed the best in this experiment. The Root Mean Square Error (RMSE) and Mean Relative Error (MRE) of the random forest model are only 1.202 and 0.187, respectively. Simultaneously, it is discovered that the 'Red Edge' band of GF-6 is also very helpful in improving the accuracy of water depth inversion, which is rarely mentioned in previous studies. To some extent, the preceding studies demonstrate that it is possible to investigate water depth using common multispectral remote sensing images. In the case of some bathymetry inversion models or in some waters, the aforementioned study demonstrates that it is possible to examine the water depth using domestic remote sensing images that are superior to foreign multispectral images in terms of bathymetry inversion ability.

Multispectral Remote Sensing Image Deblurring Using Auxiliary Band Gradient Information

Multispectral remote sensing images (RSI), including hyperspectral and multispectral images, contain adequate information of ground objects and areas and play important roles in environmental monitoring, weather forecasting, urban planning, etc. However, due to many inevitable external effects on the remote sensing pathway, remote sensing images are often degraded by blur. The fields of multispectral remote sensing image deblurring have witnessed great improvements in recent years, including both optimization-based and deep-learning-based methods. However, issues are to be addressed in the remote sensing image deblurring field, such as the incompatibility of general regularizations, lack of spectral correlations for multispectral RSIs, demands of blind deblurring for real world applications, and high costs of computation. To address these problems, we incorporate a novel prior exploiting gradient information similarity between different spectral bands, and we name it auxiliary band gradient information (ABGI) prior. We show that the ABGI prior is applicable to all gradient sparsity regularizations by a simple subtract-then-add step. Specifically, we apply ABGI prior to the patch-wise minimal pixel (PMP) prior based deblurring method, and we also prove that the PMP prior exhibits sparsity for clear natural RSIs. We estimate our method on remote sensing image datasets of different spectral types and geographic resolutions. Compared to other state-of-the-art deblurring methods, our method shows superior performance on both simulated and real world blur.

Unsupervised Transformer Balanced Hashing for Multispectral Remote Sensing Image Retrieval

Unsupervised Transformer Balanced Hashing for Multispectral Remote Sensing Image Retrieval